Azure Data Engineer

Overview

Job Title: Data Engineer
Fulltime/Perm

Location: India (Bengaluru)

Position Summary: We are seeking a skilled Azure Data Engineer to join our dynamic team. The ideal candidate will have expertise in Azure Data Factory and pipeline development, along with a strong foundation in Python for data manipulation using libraries such as NumPy, Pandas, and SciPy. This role primarily focuses on data engineering tasks rather than AI-specific applications.

Key Responsibilities:

• Azure Data Factory Development: Design, develop, and deploy data pipelines using Azure Data Factory to automate data ingestion, transformation, and loading processes.
• Python Data Library Integration: Utilize Python's data libraries including NumPy, Pandas, and SciPy to manipulate and preprocess data efficiently.
• Data Modeling: Demonstrate proficiency in designing and implementing both 3NF (Third Normal Form) and Star Schema data models to ensure optimal performance and scalability.
• Dashboard Support: Collaborate with stakeholders to understand reporting requirements and provide support in developing interactive dashboards using Power BI for data visualization.
• Data Quality Assurance: Implement data quality checks and validation processes to ensure accuracy, completeness, and consistency of data across different stages of the pipeline.
• Performance Optimization: Identify and implement performance tuning techniques to enhance the efficiency and speed of data processing workflows.
• Documentation and Best Practices: Maintain comprehensive documentation of data pipelines, workflows, and data models. Adhere to best practices in data engineering and ensure compliance with organizational standards.

Requirements:

• Bachelor's degree in Computer Science, Information Technology, or related field.
• Proven experience in Azure Data Factory and pipeline development.
• Proficiency in Python programming for data manipulation tasks, with a focus on libraries like NumPy, Pandas, and SciPy.
• Strong understanding of relational database concepts, including 3NF and Star Schema.
• Experience with Power BI or similar data visualization tools for creating interactive dashboards.
• Excellent problem-solving skills and attention to detail.
• Strong US English spoken and written communication and collaboration abilities, with the capability to work effectively in a team environment.
• Ability to prioritize tasks, manage workload efficiently, and meet project deadlines.

Job Type: Full-time

Pay: ?1,400,000.00 - ?1,500,000.00 per year

Benefits:

• Health insurance
• Life insurance
• Paid sick time
• Provident Fund

Schedule:

• Day shift

Experience:

• total work: 5 years (Required)
• Azure: 4 years (Required)

Work Location: In person