Overview
We are seeking an experienced and innovative Senior Data Engineer to lead the design, development, and implementation of robust data pipelines and solutions for our clients. The ideal candidate will possess strong technical expertise, excellent leadership skills, and the drive to continuously learn and innovate.
As a Senior Data Engineer, you will lead a team of 3 to 5 talented engineers, ensuring high-quality deliverables while fostering a culture of innovation, collaboration, and technical excellence. You will also coordinate with clients to gather requirements, design technical solutions, and drive seamless project execution.
Key Responsibilities
1. Data Pipeline Development
2. Team Leadership
3. Client Collaboration
4. Quality Assurance and Innovation
5. Internal Initiatives and Eminence Building
6. Learning and Adaptability
Technical Skills:
- Expertise in programming languages such as Python or Scala.
- Proficiency in designing and constructing data pipelines for ingesting raw data into Cloud Data Warehouses (e.g., Snowflake, Redshift), cleansing and transforming data to meet required specifications using various ETL/ELT tools such as Matillion, dbt, Striim, etc.
- Hands-on experience with relational and NoSQL databases and data modeling techniques.
- Hands-on experience of 2+ years in designing and developing data integration solutions using Matillion and/or dbt.
- Strong knowledge of data engineering and integration frameworks.
- Successfully implemented at least one end-to-end project with multiple transformation layers.
- Good grasp of coding standards, with the ability to define standards and testing strategies for projects.
- Proficiency in working with cloud platforms (AWS, Azure, GCP) and associated data services.
- Familiarity with containerization (Docker), and orchestration tools (such as Airflow, Control-M).
- Mandatory Skills-Python or Scala (Programming Languages), Data Warehousing, ETL Tools, Relational and Non-Relational Databases, Any Cloud
Job Types: Full-time, Permanent
Pay: ₹1,200,000.00 - ₹1,800,000.00 per year
Schedule:
- Day shift
- Morning shift
Work Location: In person