AWS-Data Engineer- Manager

At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data transformation solutions.

Years of Experience: Candidates with 8+ years of hands on experience

We are seeking a highly skilled and innovative Data Engineer to join our fast-growing dynamic Microsoft Alliance Data team. In this role, you will play a pivotal part in designing, developing, and maintaining data related projects, enabling our client to deploy analytics, advanced analytics and AI models. Your expertise will be crucial in transforming consumable vast datasets into actionable insights, empowering our clients to achieve their business goals.

Role And Responsibility

• Data Integration: Design and implement processes for data acquisition, storage, transformation, and retrieval from various sources, ensuring data quality and integrity but also seamless integration of large-scale datasets allowing our clients to fully leverage the value of their investment into their Data Lake and alike.
• Automation: Develop and implement automated processes for data extraction, transformation, and loading (ETL), reducing manual intervention and enhancing reliability via leading practice on data pipeline orchestration
• Leadership & Mentorship: Provide guidance and mentorship to junior data engineers and peers, fostering a culture of continuous learning and development within the team
• Security and Compliance: Ensure that data handling practices comply with industry standards and regulations, maintaining the highest levels of data security and privacy.
• Collaboration: Work closely with our clients business stakeholder, their data engineer and data scientists, AI researchers, and software engineers
• Innovation: Stay abreast of the latest advancements in data engineering, AI, and machine learning technologies, and apply this knowledge to improve our clients data infrastructure and capabilities.
  
  

Skills Required

• Experience in leading data engineering projects in an enterprise setting while working with a variety of data and analytic platforms, databases, analytic/BI tools (AWS, Synapse, Databricks)
• Experience in migrating data platform applications from on-prem to AWS Synapse and Databricks
• Data integration/data ingestion across structured and unstructured data sources, along with various enterprise applications
• Expertise with multiple integration/ETL patterns: batch, streaming, API/microservices
• Familiarity with modern data architecture and platforms: cloud, data mesh, data lakehouse, delta lake
• Advanced knowledge of SQL language, proficiency with Python, Spark/Scala or Java
• Problem-Solving: Strong analytical and problem-solving skills, with the ability to think critically and creatively.
• Communication: Excellent verbal and written communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
• Ability to work independently and in a team