Lead Data Engineer

Overview

We are seeking a highly skilled and experienced Lead Data Engineer to join our growing data team. The ideal candidate will lead the development and optimization of data pipelines, implement best practices for data management, and ensure our data infrastructure is scalable, reliable, and efficient. This is an exciting opportunity for an experienced data engineer to take ownership of major data engineering initiatives and work closely with cross-functional teams to drive business outcomes.

Key Responsibilities:

• Design, develop, and maintain scalable and high-performance data pipelines to ingest, process, and transform data from various sources.
• Lead the architecture and implementation of data storage solutions, including data lakes, data warehouses, and real-time processing systems.
• Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver data solutions that meet those needs.
• Ensure data quality, integrity, and security across all data systems.
• Mentor and guide junior data engineers, providing technical leadership and fostering a collaborative and innovative team culture.
• Continuously optimize existing data infrastructure for cost efficiency, performance, and scalability.
• Implement and enforce best practices for data engineering, including data governance, version control, and testing.
• Stay current with industry trends and emerging technologies in the data engineering space.

Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• 3+ years of experience in data engineering or related roles, with at least 2 years in a lead or senior position.
• Strong proficiency in programming languages such as Python, Java, or Scala.
• Extensive experience with data storage technologies, including relational databases (e.g., MySQL, PostgreSQL), NoSQL databases (e.g., MongoDB, Cassandra), and cloud data platforms (e.g., AWS, GCP, Azure).
• Experience with data pipeline orchestration tools (e.g., Apache Airflow, Dagster, Prefect) and ETL frameworks.
• Solid knowledge of data modelling, data warehousing concepts, and Big Data technologies (e.g., Apache Hadoop, Spark, Kafka).
• Familiarity with containerization technologies (e.g., Docker, Kubernetes) and cloud-based infrastructure.
• Worked on Snowflake.
• Excellent problem-solving skills and the ability to work under pressure and meet deadlines.
• Strong communication skills and the ability to collaborate with technical and non-technical stakeholders.

Job Type: Full-time

Pay: ₹400,000.00 - ₹1,000,000.00 per year

Benefits:

• Health insurance
• Provident Fund

Schedule:

• Day shift

Application Question(s):

• What is your current location?

Work Location: In person

Application Deadline: 05/04/2025
Expected Start Date: 15/04/2025