Azure Data Engineer

Overview

Job Description :
Key Responsibilities:
Exp : 6+years

Key Responsibilities:

· Design and develop scalable data pipelines using Azure DataBricks and Apache Spark.

· Develop and manage ETL workflows using Azure Data Factory (ADF).

· Optimize big data processing on Azure Data Lake and Synapse Analytics.

• Design and develop scalable data pipelines using Azure Data Factory, Pyspark, and Azure Databricks
• Optimize data workflows for efficiency and performance
• Implement data security and privacy measures
• Collaborate with cross-functional teams to understand data requirements
• Troubleshoot and resolve data-related issues
• Ensure data quality and integrity throughout the data lifecycle
• Document data processes and workflows
• Stay updated on industry trends and best practices in data engineering

Education

Bachelor's or Master's degree in Computer Science

Experience

6 years of experience in the relevant field

Technical Skills

• Proficiency in Pyspark and Azure Databricks
• Experience with Azure Data Factory and Azure Data Lake
• Strong SQL skills for data manipulation and querying
• Knowledge of data modeling and ETL processes
• Familiarity with cloud platforms such as Azure or AWS
• Experience with data warehousing concepts

9629667621

lavanya.p@findq.in

Job Type: Full-time

Benefits:

• Health insurance

Schedule:

• Day shift

Work Location: In person