2397 - Lead Data Engineer

Role: Lead Data Engineer

Experience: 8-12 years

Must-Have:

• 8+ years of relevant experience in Data Engineering and delivery.
• 8+ years of relevant work experience in Big Data Concepts. Worked on cloud implementations.
• Have experience in Snowflake, SQL, AWS (glue, EMR, S3, Aurora, RDS, AWS architecture)
• Good experience with AWS cloud and microservices – AWS glue, S3, Python, and Pyspark.
• Good aptitude, strong problem-solving abilities, analytical skills, and ability to take ownership as appropriate.
• Should be able to do coding, debugging, performance tuning, and deploying the apps to the Production environment.
• Experience working in Agile Methodology
• Ability to learn and help the team learn new technologies quickly.
• Excellent communication and coordination skills

Good to have:

• Have experience in DevOps tools (Jenkins, GIT etc.) and practices, continuous integration, and delivery (CI/CD) pipelines.
• Spark, Python, SQL (Exposure to Snowflake), Big Data Concepts, AWS Glue.
• Worked on cloud implementations (migration, development, etc.

Role & Responsibilities:

• Be accountable for the delivery of the project within the defined timelines with good quality.
• Working with the clients and Offshore leads to understanding requirements, coming up with high-level designs, and completing development, and unit testing activities.
• Keep all the stakeholders updated about the task status/risks/issues if there are any.
• Keep all the stakeholders updated about the project status/risks/issues if there are any.
• Work closely with the management wherever and whenever required, to ensure smooth execution and delivery of the project.
• Guide the team technically and give the team directions on how to plan, design, implement, and deliver the projects.