Azure Data Engineer

Overview

Location: Bangalore

Experience: 4years+

Salary: 12 LPA to 15 LPA

Role Overview:

We are seeking a skilled Azure Data Engineer to design, develop, and maintain scalable data pipelines and analytics solutions using Azure technologies. The ideal candidate will have a strong technical background in Azure Data Factory, Azure Databricks, and Azure Synapse, with expertise in handling large-scale data transformations and ensuring data integrity and performance.

Key Responsibilities:

1. Data Engineering & Development:

 Design, build, and maintain data pipelines using Azure Data Factory, Azure Data Lake, Azure Synapse, and Azure Databricks.

 Implement data extraction and integration from diverse sources (Relational Databases, SAP, FTP, etc.) and manage loading to various targets.

 Develop and optimize complex data transformations using PySpark, Databricks SQL, and

Delta Lake.

2. Data Quality & Performance Optimization:

 Ensure data integrity and accuracy across all data pipelines and storage.

 Optimize data ingestion and transformation performance using best practices like

partitioning and cluster optimization.

 Troubleshoot and resolve issues related to large-scale data ingestion and processing.

3. Stakeholder Collaboration & Support:

 Collaborate with cross-functional teams to understand data requirements and deliver high- quality data solutions.

 Support production environments, ensuring adherence to SLAs and rapid issue resolution.

4. Agile & DevOps Integration:

 Implement CI/CD pipelines for automated deployments across Azure Data Factory, Azure

Databricks, and Azure Synapse.

 Apply Agile methodologies to manage projects, ensuring consistent and iterative delivery of data solutions.

Required Qualifications:

 Education: Bachelor's degree in Computer Science, Data Engineering, or a related field.

 Experience:

o 4-6 years of hands-on experience in data engineering, with 2-3 years specializing in

Azure cloud technologies.

o Proven expertise in Azure Data Factory, Azure Data Lake, Azure Synapse, and Azure

Databricks.

o Strong proficiency in SQL (including stored procedures, functions, and complex

queries).

 Technical Skills:

o Deep knowledge of PySpark, Databricks SQL, and Delta Lake concepts.

o Experience working with diverse data formats (Parquet, JSON, XML, CSV).

o Solid understanding of No-SQL databases and data modeling principles.

 Collaboration & Support:

o Experience in supporting production environments and resolving critical issues.

o Strong analytical skills and ability to translate business needs into technical

solutions.

Preferred Qualifications:

 Certification in DP-203 (Microsoft Certified: Azure Data Engineer Associate) or Databricks

Data Engineering.

 Experience with on-premises to Azure cloud migration projects.

 Familiarity with Agile methodologies and DevOps practices.

Job Types: Full-time, Permanent

Pay: ₹1,200,000.00 - ₹1,500,000.00 per year

Schedule:

• Day shift

Work Location: In person