Data Engineer

Overview

Job Title: Data Engineer

Location: Nacharam

Experience: 5-7 years

Job Description:

We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in setting up data lakes and data factories, primarily on the Azure platform. This role involves designing, implementing, and maintaining scalable data solutions to support our business needs.

Key Responsibilities:

• Design, develop, and maintain data pipelines and architectures for data processing and integration.
• Set up and manage Azure Data Lake Storage (ADLS) and Azure Data Factory (ADF) to ensure efficient data flow and storage.
• Implement data ingestion, transformation, and loading processes using Azure services.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
• Ensure data quality, integrity, and security across all data platforms.
• Monitor and optimize data pipelines for performance and cost-efficiency.
• Troubleshoot and resolve data-related issues and provide technical support
• Knowledge of MLOps& Azure DevOps is must

Qualifications:

• Proven experience as a Data Engineer or in a similar role.
• 5-7 years of software development experience. Must have delivered minimum 5 end to end projects
• Strong expertise in Azure Data Lake Storage (ADLS) and Azure Data Factory (ADF).
• Proficiency in SQL, Python, and other relevant programming languages.
• Experience with ETL processes, data modeling, and data warehousing.
• Familiarity with big data technologies such as Hadoop, Spark, or Databricks is a plus.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.

Preferred Qualifications:

• Azure certifications such as Azure Data Engineer Associate or Azure Solutions Architect.
• Experience with other Azure services like Azure Synapse Analytics, Azure Databricks, and Azure Stream Analytics.
• Knowledge of Power BI will be added benefit
• Knowledge of data governance and compliance standards.

Job Type: Full-time

Schedule:

• Day shift
• Monday to Friday
• Morning shift

Experience:

• total work: 7 years (Preferred)

Work Location: In person