Senior Data Engineer

Overview

Job Description:Job Title: Data Engineer - Management Consulting -Mumbai

Designing, building, and maintaining data pipelines using cloud technologies to
ensure efficient data flow and quality for analysis by data scientists and business
users. Key responsibilities will include:

Job Responsibility

1. Data ingestion and extraction:
Utilize Airbyte to establish connections to various data sources, configure data extraction pipelines, and manage data replication schedules.

2. Data transformation with dbt:
Write dbt models to clean, transform, and aggregate data according to business requirements, leveraging dbt's declarative syntax for maintainable data pipelines.

3. Snowflake data modeling:
Design and implement data models in Snowflake, optimizing for performance and query efficiency, including dimensional modeling techniques.

4. Pipeline monitoring and maintenance:
Monitor data pipelines for errors, troubleshoot issues, and implement alerts to ensure data quality and reliability.

5. Data quality checks:
Implement data validation processes to identify and address data inconsistencies or errors before loading into Snowflake.

6. Collaboration with stakeholders:
Work closely with data analysts, data scientists, and business teams to understand data needs, define data requirements, and deliver actionable insights.Key Skills:Mandatory:

• Knowledge of ETL/ELT processes, data modelling, data quality best practices, and change data capture (CDC)
• SQL - Strong SQL skills to query, manipulate, and transform data
• Airbyte - Understanding of Airbyte connectors, configuration, and data synchronization capabilities
• dbt - Familiarity with dbt syntax, development workflow, and best practices for data transformation
• Snowflake - Understanding of Snowflake architecture, data warehousing concepts, and performance optimization techniques
• Cloud computing skills - Familiarity with cloud platforms like AWS, Azure.

Target Industry: Open

Gender: Open

Experience: 5 + years

Job Location: Goregaon, Mumbai ((Hybrid) but should be willing to come to the office regularly till confirmation ie for 6 months)

Working Days: 5 days

Qualification: Bachelor’s degree in computer science, Engineering, or a related
field

Notice Period: Immediate to 30 days

Job Type: Full-time

Pay: Up to ₹160,000.00 per month

Schedule:

• Day shift

Application Question(s):

• current salary ?
• expected salary ?
• notice period ? (less than 15 days needed )
• Do you have experience in ETL/ELT processes , SQL , dbt ,Snowflake ,Cloud computing ?

Work Location: In person