Senior Data Engineer

Overview

Key Responsibilities:

Schema Design & Data Modeling:

Design normalized, denormalized, star, and snowflake schemas based on business requirements.

Optimize database structures to enhance performance and scalability.

Implement partitioning, indexing, and clustering strategies for efficient data retrieval.

Data Engineering & ETL/ELT Pipelines:

Develop and maintain ETL/ELT processes using Azure Data Factory (ADF), Databricks, and Synapse Analytics.

Ensure efficient data ingestion, transformation, and storage in Azure Data Lake, SQL Database, and Synapse.

Work with structured and unstructured data, optimizing data flows for analytical processing.

Cloud Data Architecture & Optimization:

Design and implement scalable Azure-based data architectures.

Utilize Azure Data Lake, Cosmos DB, Synapse Analytics, and SQL Server for data storage and processing.

Implement data partitioning, indexing, and caching strategies to optimize query performance.

Collaboration & Stakeholder Communication:

Work closely with data scientists, analysts, and business teams to define data requirements.

Translate business needs into high-performance schema designs and data pipelines.

Ensure compliance with security, governance, and data quality best practices.

Required Skills & Experience:

8+ years of experience in data engineering, with a focus on schema design and data modeling.

Strong expertise in Azure Data Services (Azure Data Lake, Azure Synapse Analytics, Azure SQL Database, Cosmos DB, Databricks, Azure Data Factory).

Hands-on experience in schema design principles (OLTP vs. OLAP, star/snowflake schema, indexing, partitioning).

Proficiency in SQL, Python, or Scala for data processing and transformation.

Experience with Big Data processing using Apache Spark, Delta Lake, and Parquet formats.

Knowledge of data governance, security, and compliance best practices.

Familiarity with CI/CD pipelines for data workflows using Azure DevOps.

Experience in performance tuning, query optimization, and cost management on Azure.

Job Type: Full-time

Pay: ₹2,500,000.00 - ₹3,500,000.00 per year

Benefits:

• Health insurance
• Provident Fund

Schedule:

• Day shift
• UK shift
• US shift

Supplemental Pay:

• Performance bonus

Application Question(s):

• Do you have experience in Schema?

Experience:

• Data Engineer: 8 years (Preferred)

Work Location: Remote