Lead Data Engineer - Spark, Scala

Reference 250003AA

Responsibilities

Responsibilities

• Design, development and testing of components / modules involving Spark, Scala, Hive and related big-data technologies in a datalake architecture
• Implement design, development and deployment of new Data pipelines and maintain the existing ones.
• Lead migrations such as move to public cloud ( Azure ), version upgrades.
• Oversee team of Data Engineers located in both offshore and onshore.
• Building views that are plugged by Data Visualization tools such as Power BI Release & Deployment – Deploy using CD/CI practices and tools in various environments – development, UAT and production and follow production processes.
• Ensure Craftsmanship practices are followed.
• Follow Agile@Scale process in terms of participation in PI Planning and follow-up, Sprint planning, Back-log maintenance in Jira.
• Develop/propose tactical solutions for Project specific needs
  
  

Required

Profile required

• 7 + years of experience as a Data Engineer
• Architect, Design, Develop code on Spark, Scala, Hive, any big data ecosystem, Python, SQL, Design Patterns, Design Principles and Functional Patterns .
• Good understanding of ETL Processes and data warehousing concepts, API's
• Expertise in Spark, Scala, Unix Shell Scripting
• Good Hands on SQL, experience of Power BI will be added advantage.
• Working experience on public Cloud preferably on Azure will be an added advantage.
• Should have experience on Releasing, CI/CD, Git and JIRA
• Good analytical and troubleshooting skills to resolve the issues in timebound manner.
• Effective team player with ability work autonomously and in team with cross-cultural environment
• Effective verbal and written communication to work closely with all the stakeholders
  
  

Mandatory Skills:

Should be strong in Spark, Scala, Hive, SQL, Data Modeling

Good to Have Skills:

Azure, Databricks, Python, BI Reporting, AI

CI/CD, AGILE

Why join us

"We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status"

Business insight

At Société Générale, we are convinced that people are drivers of change, and that the world of

tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious.

Whether you’re joining us for a period of months, years or your entire career, together we can have

a positive impact on the future. Creating, daring, innovating and taking action are part of our DNA.

If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a

daily basis and develop or strengthen your expertise, you will feel right at home with us!

Still hesitating?

You should know that our employees can dedicate several days per year to solidarity actions during

their working hours, including sponsoring people struggling with their orientation or professional

integration, participating in the financial education of young apprentices and sharing their skills with

charities. There are many ways to get involved.

We are committed to support accelerating our Group’s ESG strategy by implementing ESG principles in all our activities and policies. They are translated in our business activity (ESG assessment, reporting, project management or IT activities), our work environment and in our responsible practices for environment protection.

Diversity and Inclusion

We are an equal opportunities employer and we are proud to make diversity a strength for our company. Societe Generale is committed to recognizing and promoting all talents, regardless of their beliefs, age, disability, parental status, ethnic origin, nationality, gender identity, sexual orientation, membership of a political, religious, trade union or minority organisation, or any other characteristic that could be subject to discrimination.