Data Engineer

ROLE PURPOSE

The purpose of the Data Engineer is to build and unit test code for Projects and Programmes on Azure Cloud Data and Analytics Platform.

KEY ACCOUNTABILITIES

• Analyse business requirements and support\create design for requirements
• Build and deploy new/changes to data mappings, sessions, and workflows in Azure Cloud Platform key focus area would be Azure Data Factory.
• Develop performant code
• Perform ETL routines performance tuning, troubleshooting, support, and capacity estimation.
• Conduct thorough testing of ETL code changes to ensure quality deliverables
• Provide day-to-day support and mentoring to end users who are interacting with the data
• Profile and understand large amounts of source data available, including structured and semi-structured/web activity data
• Analyse defects and provide fixes
• Provide release notes for deployments
• Support Release activities
• Problem solving attitude
• Keep up to date with new skills - Develop technology skills in other areas of Platform

Skills and Experience:

• Experienced in ETL tools, data projects
• Recent Azure experience Strong knowledge of Azure Data Factory and Databricks
• Python knowledge would be highly desirable
• Strong knowledge of SQL
• Strong Analytical skills
• Azure DevOps knowledge
• Experience Logic Apps would be desirable
• Experience with Azure Functions would be a plus.
• Day to day decisions around coding and unit testing.