Free cookie consent management tool by TermsFeed Senior Azure Data Engineer | Antal Tech Jobs
Back to Jobs
3 Weeks ago

Senior Azure Data Engineer

decor
Information Technology
Full-Time
ZapCom Solutions

Overview

Job Information

    Date Opened

    03/20/2025

    Job Type

    Full time

    Industry

    IT Services

    City

    Bangalore

    State/Province

    Karnataka

    Country

    India

    Zip/Postal Code

    560066

About Us

Zapcom is a global Product Engineering and Technology Services company, specializing in bespoke, customer-centric solutions across industries like BFSI, e-commerce, retail, travel, transportation, and hospitality. Headquartered in the US, with a presence in India, Europe, Canada, and MENA, we excel in transforming ideas into tangible outcomes using AI, ML, Cloud solutions, and full-stack development.


At Zapcom, we value accountability, ownership, and equality, empowering you to excel. We listen to your aspirations and provide the support needed to achieve them. Our diverse, collaborative culture ensures every voice is heard, driving innovation and business value. With global opportunities and expansion plans, now is the perfect time to join our team. Work on impactful projects that shape the future. Apply today and be part of something extraordinary!


Job Description

Responsibilities:


  • Design and implement data ingestion, transformation, and movement using Azure Data Factory (ADF), Azure Synapse, and Data Lake
  • Collaborate with business stakeholders, data scientists, and engineers to build robust data solutions.
  • Develop and manage high-volume, real-time, and batch data ingestion pipelines using Azure Data Factory (ADF).
  • Implement event-driven architectures for real-time data movement and processing.
  • Develop large-scale data processing solutions using Azure Databricks and Apache Spark with PySpark, Scala, or Python.
  • Optimize data partitioning, caching, and indexing for efficient performance.
  • Manage complex transformations and aggregations for structured and unstructured datasets.
  • Design and implement high-performance data models in Azure Synapse Analytics using dedicated SQL Pools and Spark Pools.
  • Optimize query performance, workload management, and cost efficiency in Synapse Analytics.
  • Implement column store indexes, partitioning strategies, and data caching to enhance performance.
  • Design and manage secure, scalable data lakes using Azure Data Lake Storage Gen2 (ADLS Gen2).
  • Implement RBAC (Role-Based Access Control), encryption, and data masking to ensure security
  • Implement Azure Monitor, Log Analytics, and Application Insights for data pipeline monitoring and troubleshooting.
  • Optimize cost management, auto-scaling, and performance tuning across Azure services.


Requirement:


  • 8+ years of experience in data engineering, ETL development, and cloud-based data integration
  • Strong experience with Azure Data Factory (ADF): ETL/ELT pipeline orchestration and data movement.
  • Azure Databricks: Large-scale data transformation and big data processing with Apache Spark, PySpark, Scala, or Python.
  • Azure Synapse Analytics: Data warehousing, SQL Pools, Spark Pools, and performance tuning.
  • Azure Data Lake Storage Gen2 (ADLS Gen2): Secure, scalable data lake architecture.
  • SQL Server: Advanced T-SQL, stored procedures, indexing, and query optimization.

Share job
Similar Jobs
View All
10 Hours ago
MTS II - Software Engineer
Information Technology
  • 4 - 7 Yrs
  • Pune
MAJOR RESPONSIBILITIES • Design, implement, integrate, and verify software applications and tools using JavaScript, NodeJS, and C++. • Enhance, optimize, and improve the efficiency and robustness of current software, with a particular focus on OSS ...
decor
1 Day ago
Business Advisory Analyst
Information Technology
  • Bangalore, Karnataka, India
Skill required: Banking Services - Core BankingDesignation: Business Advisory AnalystQualifications:BBA/BCom/Master of Business AdministrationYears of Experience:3 to 5 yearsAbout AccentureAccenture is a global professional services company with lea...
decor
1 Day ago
Front End Developer
Information Technology
  • Bangalore, Karnataka, India
Position Title: Front End DeveloperCompany: Johnson Controls (JCI)Location: BangaloreJob Summary: We are seeking a talented Front End Developer with 4-7 years of experience to join our dynamic team. The ideal candidate will have a strong background ...
decor
1 Day ago
Database Engineer III (Big Data)
Information Technology
  • Bangalore, Karnataka, India
LivePerson (NASDAQ: LPSN) is the global leader in enterprise conversations. Hundreds of the world’s leading brands — including HSBC, Chipotle, and Virgin Media — use our award-winning Conversational Cloud platform to connect with millions of consume...
decor
1 Day ago
Data Scientist Manager
Information Technology
  • Bangalore, Karnataka, India
Job DescriptionLeads a team of people who design, develop and program methods, processes, and systems to consolidate and analyze unstructured, diverse “big data” sources to generate actionable insights and solutions for client services and product e...
decor
1 Day ago
Data Scientist Manager
Information Technology
  • Bangalore, Karnataka, India
Job DescriptionLeads a team of people who design, develop and program methods, processes, and systems to consolidate and analyze unstructured, diverse “big data” sources to generate actionable insights and solutions for client services and product e...
decor
1 Day ago
Sr. QA Engineer
Information Technology
  • Bangalore, Karnataka, India
Role Summary:Picarro is seeking an exceptional Sr. QA Engineer for functional testing of Picarro Analyzers. This role expects you to analyze requirements, create and execute test-plan, and record results in test-repo. This person is also expected to...
decor
1 Day ago
C++ Graphics and Windowing System Software Engineer - Mir
Information Technology
  • Bangalore, Karnataka, India
We build a high-performance, high-efficiency stack for window managers and display subsystems in C++, called Mir. We're growing the team and looking for new colleagues who share our passion for precision, performance and user experience.Our goal is ...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media