Data Engineer

Overview

Job Title: Data Engineer

Location: [Hydrabad, Telangana]
Job Type: Full-Time (WFO)

Time: UK Time

Experience: 5 to 8 Years

Overview:
We are seeking a highly skilled and motivated Data Engineer or Business Intelligence Analyst with expertise in SQL Server, Power BI, Azure Data Factory (ADF), Databricks, and data migration from SQL to Power BI. The ideal candidate will have a strong background in data transformation, reporting, and creating impactful business intelligence solutions. You will be responsible for designing, developing, and maintaining data integration pipelines, creating data visualizations, and supporting the data migration process for business users.

Key Responsibilities:

• Data Migration & Integration:
• Migrate data from SQL Server to Power BI using efficient data integration techniques.
• Develop and manage data pipelines using Azure Data Factory (ADF) for seamless data transformation and loading into Power BI datasets.
• Support migration of large volumes of data from on-premises SQL Server to cloud environments.
• Power BI Reporting & Visualization:
• Design, develop, and maintain interactive dashboards and reports in Power BI to facilitate data-driven decision-making.
• Optimize Power BI reports for performance and scalability, ensuring users have quick access to accurate data.
• Create calculated measures, DAX queries, and implement advanced features like Power Query for data transformation.
• Databricks & Azure Integration:
• Utilize Databricks for advanced data processing, transformation, and machine learning tasks.
• Integrate Databricks with Power BI and Azure Data Factory for seamless data workflows.
• Implement Spark-based data transformations within Databricks for large datasets.
• Data Modeling & Optimization:
• Develop data models using SQL Server, Databricks, and Power BI to ensure that business users can access actionable insights.
• Implement best practices for data storage, schema design, and data optimization.
• Collaborate with cross-functional teams to understand data requirements and ensure models meet business needs.
• Documentation & Best Practices:
• Create and maintain technical documentation for the data pipeline, transformation process, and Power BI reports.
• Follow best practices for coding, version control, and deployment in a cloud environment.
• Collaboration & Troubleshooting:
• Collaborate with stakeholders to understand data needs and deliver accurate and insightful Power BI dashboards and reports.
• Troubleshoot issues related to data integration, visualization, and reporting in Power BI.

Required Skills & Qualifications:

• Experience with SQL Server: Strong proficiency in SQL Server, including query writing, stored procedures, and data integration.
• Power BI Expertise: Hands-on experience with Power BI for creating and maintaining interactive reports and dashboards. Advanced knowledge of Power Query and DAX.
• Azure Data Factory (ADF): Proficiency in building data pipelines and orchestrating data workflows using ADF.
• Databricks: Experience working with Databricks, including the creation of Spark-based data transformations and integrations with Azure services.
• Data Migration: Proven experience migrating data from SQL Server to Power BI or cloud-based environments.
• Data Modeling: Strong ability to design and optimize data models that support business reporting and analytics needs.
• Azure Ecosystem: Familiarity with the broader Azure ecosystem and cloud-based services related to data management (e.g., Azure SQL Database, Azure Synapse Analytics).

Preferred Skills:

• Certification: Power BI certification (Microsoft Certified: Data Analyst Associate) or equivalent.
• Programming Languages: Knowledge of Python or Scala for data transformation within Databricks.
• Version Control: Familiarity with version control tools like Git.

Soft Skills:

• Strong problem-solving and analytical skills.
• Ability to work effectively in a collaborative team environment.
• Excellent communication skills to interact with both technical and non-technical stakeholders.

Why Join Us?

• Competitive salary and benefits package.
• Work with cutting-edge data technologies in a dynamic, fast-paced environment.
• Opportunities for growth and professional development.
• Collaborative team culture and supportive management.

Job Types: Full-time, Permanent

Pay: ?1,512,554.54 - ?2,568,954.17 per year

Experience:

• total work: 6 years (Preferred)

Work Location: In person