Bangalore, Karnataka, India
Information Technology
Full-Time
HTC Global Services
Overview
About The Role
We are looking for an Azure Data Engineer with 6 years of experience in designing, developing and maintaining ETL/ELT pipelines using Azure Data Factory to be ingesting, transforming and loading data from diverse sources.
Requirements
We are looking for an Azure Data Engineer with 6 years of experience in designing, developing and maintaining ETL/ELT pipelines using Azure Data Factory to be ingesting, transforming and loading data from diverse sources.
Requirements
- Applies and manages data storage solutions in Azure Data Lake, ensuring efficient data structuring, partitioning and access controls.
- Develops complex data transformations using PySpark and Python for data processing on distributed systems, ensuring high performance and scalability.
- Writes optimized and efficient SQL queries to retrieve, manipulate and aggregate large datasets from databases like Azure SQL, Synapse Analytics or other relational systems.
- Ensures data quality and consistency through proper error handling, logging and data validation checks within the ETL processes.
- Collaborates with data architects and business stakeholders to understand data requirements, build data models and design optimal solutions.
- Monitors, troubleshoots and optimizes data pipelines, ensuring data availability, performance and cost-effectiveness.
- Implements data security, governance, and compliance best practices for data storage and processing in the cloud environment.
- Participates in DevOps practices, including CI/CD pipelines for deploying data solutions using Azure DevOps or similar tools.
Similar Jobs
View All
11 Hours ago
Test
Information Technology
- 2,00,000 - 2,00,000 INR - Hourly
- 5 - 5 Yrs
- Bhopal
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do ei...
1 Day ago
Test Engineer - Automation Testing-Selenium - Pool Job
Information Technology
- Bangalore, Karnataka, India
We use cookies to offer you the best possible website experience. Your cookie preferences will be stored in your browser’s local storage. This includes cookies necessary for the website's operation. Additionally, you can freely decide and change any...
1 Day ago
Software Engineer II - Seq
Information Technology
- Bangalore, Karnataka, India
Focuses on further improving their craftsmanship and extending their skills beyond plain implementation, in particular: Develops quality software according to clean code principles and Blue Yonder standards and writes effective test cases. Autonomou...
1 Day ago
Java Springboot + AWS Developer
Information Technology
- Bangalore, Karnataka, India
A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction. You will understand requirements, create...
1 Day ago
Senior Software Engineer (IC3)
Information Technology
- Bangalore, Karnataka, India
Job DescriptionAt Oracle Cloud Infrastructure (OCI), we build the future of the cloud for Enterprises as a diverse team of fellow creators and inventors. We act with the speed and attitude of a start-up, with the scale and customer-focus of the lead...
2 Days ago
Web Developer
Information Technology
- Bangalore, Karnataka, India
At Involve, we’re on a mission to bring students to the center of their own learning journeys. We believe that when students are trusted, supported, and given space to lead, they don’t just learn betterthey thrive.We started back in 2018 when our fo...
2 Days ago
Test Engineer - Automation Testing-Selenium - Pool
Information Technology
- Bangalore, Karnataka, India
Date: Apr 20, 2025 Job Requisition Id: 61081 Location: Bangalore, KA, IN Bangalore, KA, IN YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foste...
2 Days ago
Senior Data Engineer
Information Technology
- Bangalore, Karnataka, India
About CogniteEmbark on a transformative journey with Cognite, a global SaaS forerunner in leveraging data to unravel complex business challenges through our cutting-edge Cognite Data Fusion (CDF) platform. We were awarded the 2022 Technology Innovat...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in