Overview
About Us
Thoucentric is the Consulting arm of Xoriant, a prominent digital engineering services company with 5000+ employees. We are headquartered in Bangalore with presence across multiple locations in India, US, UK, Singapore & Australia Globally.
As the Consulting business of Xoriant, We help clients with Business Consulting, Program & Project Management, Digital Transformation, Product Management, Process & Technology Solutioning and Execution including Analytics & Emerging Tech areas cutting across functional areas such as Supply Chain, Finance & HR, Sales & Distribution across US, UK, Singapore and Australia. Our unique consulting framework allows us to focus on execution rather than pure advisory. We are working closely with marquee names in the global consumer & packaged goods (CPG) industry, new age tech and start-up ecosystem. Xoriant (Parent entity) started in 1990 and is a Sunnyvale, CA headquartered digital engineering firm with offices in the USA, Europe, and Asia. Xoriant is backed by ChrysCapital, a leading private equity firm. Our strengths are now combined with Xoriant’s capabilities in AI & Data, cloud, security and operations services proven for 30 years.
We have been certified as "Great Place to Work" by AIM and have been ranked as "50 Best Firms for Data Scientists to Work For".
We have an experienced consulting team of over 450+ world-class business and technology consultants based across six global locations, supporting clients through their expert insights, entrepreneurial approach and focus on delivery excellence. We have also built point solutions and products through Thoucentric labs using AI/ML in the supply chain space.
Job Description
Job Description:
We are looking for a highly skilled Azure Data Engineer to join our team. The ideal candidate will have strong expertise in implementing data solutions on Azure using technologies like Azure Data Lake Storage Gen2 (ADLS2), Azure Data Factory (ADF), Azure Databricks, and Azure SQL/other RDBMS. The role involves building robust and scalable data pipelines, transforming raw data into actionable insights, and supporting advanced analytics initiatives.
Key Responsibilities:
Design and Develop Data Solutions
- Build and optimize data pipelines using Azure Data Factory and Azure Databricks.
- Implement solutions for structured and unstructured data storage using ADLS Gen2.
- Integrate data from various sources into Azure SQL or other relational databases.
- Build and optimize data pipelines using Azure Data Factory and Azure Databricks.
- Data Transformation and Processing
- Design ETL/ELT workflows for data ingestion, cleansing, transformation, and aggregation.
- Process and analyze large datasets using Databricks (PySpark/Scala/Spark SQL).
- Design ETL/ELT workflows for data ingestion, cleansing, transformation, and aggregation.
- Performance Optimization
- Optimize data storage and retrieval in ADLS2 and relational databases to ensure high performance.
- Implement partitioning, indexing, and caching strategies for efficient data operations.
- Optimize data storage and retrieval in ADLS2 and relational databases to ensure high performance.
- Collaboration and Support
- Collaborate with data scientists, analysts, and business stakeholders to gather requirements and deliver solutions.
- Ensure data security, governance, and compliance with organizational standards.
- Collaborate with data scientists, analysts, and business stakeholders to gather requirements and deliver solutions.
- Monitoring and Maintenance
- Monitor data pipelines for reliability and scalability.
- Troubleshoot and resolve issues related to data processing and integration.
- Monitor data pipelines for reliability and scalability.
Requirements
Required Skills and Qualifications:
Technical Expertise:
- Strong experience with Azure Data Lake Storage Gen2 (ADLS2) for data storage and management.
- Proficiency in building data pipelines with Azure Data Factory (ADF).
- Hands-on experience in Databricks (including PySpark, Scala, or Spark SQL).
- Advanced knowledge of Azure SQL or any other RDBMS (e.g., SQL Server, PostgreSQL, MySQL).
- Strong experience with Azure Data Lake Storage Gen2 (ADLS2) for data storage and management.
- Programming Skills:
- Proficiency in Python, SQL, Pyspark for data engineering tasks.
- Proficiency in Python, SQL, Pyspark for data engineering tasks.
- Cloud Knowledge:
- Solid understanding of Azure ecosystem, including services like Azure Synapse Analytics, Azure Blob Storage, and Azure Key Vault (optional but preferred).
- Solid understanding of Azure ecosystem, including services like Azure Synapse Analytics, Azure Blob Storage, and Azure Key Vault (optional but preferred).
- Problem-Solving and Analytical Skills:
- Ability to design and implement efficient solutions for large-scale data processing and analytics.
- Ability to design and implement efficient solutions for large-scale data processing and analytics.
- Soft Skills:
- Strong communication and collaboration skills.
- Ability to work in agile, fast-paced environments
- Strong communication and collaboration skills.
Preferred Qualifications:
- Azure certifications (e.g., Microsoft Certified: Azure Data Engineer Associate).
- Familiarity with data governance frameworks and tools.
- Knowledge of distributed systems and big data frameworks like Apache Kafka (optional).
Experience Level:
- Minimum 3–5 years in data engineering or related roles.
Benefits
What a Consulting role at Thoucentric will offer you?
- Opportunity to define your career path and not as enforced by a manager
- A great consulting environment with a chance to work with Fortune 500 companies and startups alike.
- A dynamic but relaxed and supportive working environment that encourages personal development.
- Be part of One Extended Family. We bond beyond work - sports, get-togethers, common interests etc. Work in a very enriching environment with Open Culture, Flat Organization and Excellent Peer Group.
- Be part of the exciting Growth Story of Thoucentric!
Required Skills
+5
Practice Name
Date Opened
Work Mode
Job Type
Industry
Corporate Office
Zip/Postal Code
City
Country
State/Province