Data Engineer

Overview

Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further . This is a world of more possibilities , more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world.

Microsoft’s Azure Data engineering team is leading the transformation of analytics in the world of data with products like databases, data integration, big data analytics, messaging & real-time analytics, and business intelligence. The products our portfolio include Microsoft Fabric, Azure SQL DB, Azure Cosmos DB, Azure PostgreSQL, Azure Data Factory, Azure Synapse Analytics, Azure Service Bus, Azure Event Grid, and Power BI. Our mission is to build the data platform for the age of AI, powering a new class of data-first applications and driving a data culture.

Within Azure Data, the Microsoft Fabric platform team builds and maintains the operating system and provides customers a unified data stack to run an entire data estate. The platform provides a unified experience, unified governance, enables a unified business model and a unified architecture. 

The Fabric Data Analytics, Insights, and Curation team is leading the way at understanding the Microsoft Fabric composite services and empowering our strategic business leaders . We work with very large and fast arriving data and transform it into trustworthy insights . We build and manage pipelines, transformation, platforms, models, and so much more that empowers the Fabric product . As an Engineer on our team your core function will be Data Engineering with opportunities in Analytics, Science, Software Engineering, DEVOps , and Cloud Systems . You will be working alongside other Engineers, Scientists, Product, Architecture, and Visionaries bringing forth the next generation of data democratization products.

We are looking for Data Engineers who wants to build the Future of Big Data, Data Insights and become Full Stack Data Professionals.

We pride ourselves on a culture of customer centricity, innovation, agility, transparency, and flexibility. We are always eager to hear new ideas and promote out of the box thinking when addressing complex process , architecture, or technology challenges.

We do not just value differences or different perspectives. We seek them out and invite them in so we can tap into the collective power of everyone in the company. As a result, our customers are better served .

Responsibilities

• You will develop and maintain data pipelines, including solutions for data collection, management, transformation, and usage, ensuring accurate data ingestion and readiness for downstream analysis, visualization, and AI model training.
• You will design and implement end-to-end software life cycles, encompassing design, development, CI/CD, service reliability, recoverability, and participation in agile development practices, including on-call rotation.
• You will write code to implement performance monitoring protocols across data pipelines, building visualizations and aggregations to monitor pipeline health. You’ll also implement solutions and self-healing processes that minimize points of failure across multiple product features.
• You will anticipate data governance needs, designing data modeling and handling procedures to ensure compliance with all applicable laws and policies.
• You will implement and enforce security and access control measures to protect sensitive resources and data.
• You will Perform database administration tasks, including maintenance, and performance monitoring.
• You will collaborate with Product Managers, Data and Applied Scientists, Software and Quality Engineers, and other stakeholders to understand data requirements and deliver phased solutions that meet test and quality programs data needs, and support AI model training and inference.
  
  

Embody our culture and values

Qualifications

Required /Minimum Qualifications

• Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years' experience in business analytics, data science, software development, data modeling or data engineering work
• OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years' experience in business analytics, data science, software development, or data engineering work
• OR equivalent experience.
• 2+ years of experience in software or data engineering, with proven proficiency in C#, Java, or equivalent.
• 2+ years in one scripting language for data retrieval and manipulation (e.g., SQL or KQL).
• 2+ years of experience with ETL and data cloud computing technologies, including Azure Data Lake, Azure Data Factory, Azure Synapse, Azure Logic Apps, Azure Functions, Azure Data Explorer, and Power BI or equivalent platforms.
  
  

Other Requirements

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check:

• This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
  
  

Preferred/Additional Qualifications

• Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years' experience in business analytics, data science, software development, data modeling or data engineering work
• OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years of business analytics, data science, software development, data modeling or data engineering work experience
• OR equivalent experience.
• 1+ years of demonstrated experience implementing data governance practices, including data access, security and privacy controls and monitoring to comply with regulatory standards.
• 1+ years of experience in MLOps , covering the entire machine learning lifecycle: data ingestion, preprocessing, model training, validation, deployment, and monitoring.
  
  

Equal Opportunity Employer (EOP)

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form (Accessibility | Microsoft Careers).

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.

#azdat

#azuredata

#fabricdata #dataintegration #azure #synapse #databases #analytics #science