Senior Big Data Engineer

Overview

Experience: 6+ years

Location: Pune (Client site-Bund Garden Road)

Job Responsibilities:

 Data Pipeline Development: Design, build, and maintain high-performance,

scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and ADLS.

 Data Platform Enhancement: Contribute to the development and optimization

of our Azure-based Data Platform, ensuring efficiency, reliability, and security.

 IoT & High-Volume Data Processing: Work with large-scale IoT and

operational datasets, optimizing data ingestion, transformation, and storage.

 Data Governance & Quality: Implement data governance best practices,

ensuring data integrity, consistency, and compliance.

Performance Optimization: Improve query performance and storage efficiency

for analytics and reporting use cases.

 Collaboration: Work closely with data scientists, architects, and business

teams to ensure data availability and usability.

 Innovation & Automation: Identify opportunities for automation and process

improvements, leveraging modern tools and technologies.

Job Requirements:

 6+ years of experience in data engineering with a focus on Azure cloud

technologies.

 Strong expertise in Azure Data Factory, Databricks, ADLS, and Power BI.

 Proficiency in SQL, Python, and Spark for data processing and

transformation.

 Experience with IoT data ingestion and processing, handling high-volume,

real-time data streams.

Strong understanding of data modeling, lakehouse architectures, and

medallion frameworks.

 Experience in building and optimizing scalable ETL/ELT processes.

 Knowledge of data governance, security, and compliance frameworks.

 Experience with monitoring, logging, and performance tuning of data

workflows.

 Strong problem-solving and analytical skills with a platform-first mindset.

Job Types: Full-time, Permanent

Benefits:

• Provident Fund

Schedule:

• Day shift
• Monday to Friday

Supplemental Pay:

• Performance bonus
• Yearly bonus

Work Location: In person