Free cookie consent management tool by TermsFeed Azure Data Engineer | Antal Tech Jobs
Back to Jobs
17 Weeks ago

Azure Data Engineer

decor
Mumbai, India
Information Technology
Full-Time
Thoucentric

Overview

About Us

Thoucentric is the Consulting arm of Xoriant, a prominent digital engineering services company with 5000+ employees. We are headquartered in Bangalore with presence across multiple locations in India, US, UK, Singapore & Australia Globally.


As the Consulting business of Xoriant, We help clients with Business Consulting, Program & Project Management, Digital Transformation, Product Management, Process & Technology Solutioning and Execution including Analytics & Emerging Tech areas cutting across functional areas such as Supply Chain, Finance & HR, Sales & Distribution across US, UK, Singapore and Australia. Our unique consulting framework allows us to focus on execution rather than pure advisory. We are working closely with marquee names in the global consumer & packaged goods (CPG) industry, new age tech and start-up ecosystem. Xoriant (Parent entity) started in 1990 and is a Sunnyvale, CA headquartered digital engineering firm with offices in the USA, Europe, and Asia. Xoriant is backed by ChrysCapital, a leading private equity firm. Our strengths are now combined with Xoriant’s capabilities in AI & Data, cloud, security and operations services proven for 30 years.


We have been certified as "Great Place to Work" by AIM and have been ranked as "50 Best Firms for Data Scientists to Work For".


We have an experienced consulting team of over 450+ world-class business and technology consultants based across six global locations, supporting clients through their expert insights, entrepreneurial approach and focus on delivery excellence. We have also built point solutions and products through Thoucentric labs using AI/ML in the supply chain space.


Job Description

Job Description:


We are looking for a highly skilled Azure Data Engineer to join our team. The ideal candidate will have strong expertise in implementing data solutions on Azure using technologies like Azure Data Lake Storage Gen2 (ADLS2), Azure Data Factory (ADF), Azure Databricks, and Azure SQL/other RDBMS. The role involves building robust and scalable data pipelines, transforming raw data into actionable insights, and supporting advanced analytics initiatives.


Key Responsibilities:


  • Design and Develop Data Solutions

    • Build and optimize data pipelines using Azure Data Factory and Azure Databricks.
    • Implement solutions for structured and unstructured data storage using ADLS Gen2.
    • Integrate data from various sources into Azure SQL or other relational databases.
  • Data Transformation and Processing
    • Design ETL/ELT workflows for data ingestion, cleansing, transformation, and aggregation.
    • Process and analyze large datasets using Databricks (PySpark/Scala/Spark SQL).
  • Performance Optimization
    • Optimize data storage and retrieval in ADLS2 and relational databases to ensure high performance.
    • Implement partitioning, indexing, and caching strategies for efficient data operations.
  • Collaboration and Support
    • Collaborate with data scientists, analysts, and business stakeholders to gather requirements and deliver solutions.
    • Ensure data security, governance, and compliance with organizational standards.
  • Monitoring and Maintenance
    • Monitor data pipelines for reliability and scalability.
    • Troubleshoot and resolve issues related to data processing and integration.


Requirements


Required Skills and Qualifications:


  • Technical Expertise:

    • Strong experience with Azure Data Lake Storage Gen2 (ADLS2) for data storage and management.
    • Proficiency in building data pipelines with Azure Data Factory (ADF).
    • Hands-on experience in Databricks (including PySpark, Scala, or Spark SQL).
    • Advanced knowledge of Azure SQL or any other RDBMS (e.g., SQL Server, PostgreSQL, MySQL).
  • Programming Skills:
    • Proficiency in Python, SQL, Pyspark for data engineering tasks.
  • Cloud Knowledge:
    • Solid understanding of Azure ecosystem, including services like Azure Synapse Analytics, Azure Blob Storage, and Azure Key Vault (optional but preferred).
  • Problem-Solving and Analytical Skills:
    • Ability to design and implement efficient solutions for large-scale data processing and analytics.
  • Soft Skills:
    • Strong communication and collaboration skills.
    • Ability to work in agile, fast-paced environments


Preferred Qualifications:


  • Azure certifications (e.g., Microsoft Certified: Azure Data Engineer Associate).
  • Familiarity with data governance frameworks and tools.
  • Knowledge of distributed systems and big data frameworks like Apache Kafka (optional).


Experience Level:


  • Minimum 3–5 years in data engineering or related roles.


Benefits

What a Consulting role at Thoucentric will offer you?


  • Opportunity to define your career path and not as enforced by a manager
  • A great consulting environment with a chance to work with Fortune 500 companies and startups alike.
  • A dynamic but relaxed and supportive working environment that encourages personal development.
  • Be part of One Extended Family. We bond beyond work - sports, get-togethers, common interests etc. Work in a very enriching environment with Open Culture, Flat Organization and Excellent Peer Group.
  • Be part of the exciting Growth Story of Thoucentric!


    Required Skills

      Azure Data Lake Storage G...
      Azure Data Lake Storage G...

      +5

    Practice Name

    Data Engineering

    Date Opened

    12/18/2024

    Work Mode

    Hybrid

    Job Type

    Full time

    Industry

    Consulting

    Corporate Office

    Thoucentric, Mumbai

    Zip/Postal Code

    400008

    City

    Mumbai

    Country

    India

    State/Province

    Maharashtra
Share job
Similar Jobs
View All
4 Hours ago
MTS II - Software Engineer
Information Technology
  • 4 - 7 Yrs
  • Pune
MAJOR RESPONSIBILITIES • Design, implement, integrate, and verify software applications and tools using JavaScript, NodeJS, and C++. • Enhance, optimize, and improve the efficiency and robustness of current software, with a particular focus on OSS ...
decor
1 Day ago
Business Advisory Analyst
Information Technology
  • Bangalore, Karnataka, India
Skill required: Banking Services - Core BankingDesignation: Business Advisory AnalystQualifications:BBA/BCom/Master of Business AdministrationYears of Experience:3 to 5 yearsAbout AccentureAccenture is a global professional services company with lea...
decor
1 Day ago
Front End Developer
Information Technology
  • Bangalore, Karnataka, India
Position Title: Front End DeveloperCompany: Johnson Controls (JCI)Location: BangaloreJob Summary: We are seeking a talented Front End Developer with 4-7 years of experience to join our dynamic team. The ideal candidate will have a strong background ...
decor
1 Day ago
Database Engineer III (Big Data)
Information Technology
  • Bangalore, Karnataka, India
LivePerson (NASDAQ: LPSN) is the global leader in enterprise conversations. Hundreds of the world’s leading brands — including HSBC, Chipotle, and Virgin Media — use our award-winning Conversational Cloud platform to connect with millions of consume...
decor
1 Day ago
Data Scientist Manager
Information Technology
  • Bangalore, Karnataka, India
Job DescriptionLeads a team of people who design, develop and program methods, processes, and systems to consolidate and analyze unstructured, diverse “big data” sources to generate actionable insights and solutions for client services and product e...
decor
1 Day ago
Data Scientist Manager
Information Technology
  • Bangalore, Karnataka, India
Job DescriptionLeads a team of people who design, develop and program methods, processes, and systems to consolidate and analyze unstructured, diverse “big data” sources to generate actionable insights and solutions for client services and product e...
decor
1 Day ago
Sr. QA Engineer
Information Technology
  • Bangalore, Karnataka, India
Role Summary:Picarro is seeking an exceptional Sr. QA Engineer for functional testing of Picarro Analyzers. This role expects you to analyze requirements, create and execute test-plan, and record results in test-repo. This person is also expected to...
decor
1 Day ago
C++ Graphics and Windowing System Software Engineer - Mir
Information Technology
  • Bangalore, Karnataka, India
We build a high-performance, high-efficiency stack for window managers and display subsystems in C++, called Mir. We're growing the team and looking for new colleagues who share our passion for precision, performance and user experience.Our goal is ...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media