Senior Data Engineer

Seeking a highly skilled and experienced Senior Data Engineer to work within their data engineering team and support the data science and business intelligence teams. The ideal candidate will have a proven track record of designing and implementing data pipelines, building scalable data infrastructure, and working with big data technologies in AWS cloud. The Senior Data Engineer will work closely with the Lead Data Engineer and Manager of Data Engineering to ensure the team's work aligns with the organization's strategic goals.

Key Responsibilities:

• Design and implement data pipelines that support the data science and business intelligence teams
• Build and maintain scalable data infrastructure that enables data-driven decision-making
• Collaborate with cross-functional teams to ensure project success
• Identify and implement best practices for data governance, data quality, and data security
• Mentor and provide technical guidance to other data engineers on the team
• Continuously evaluate new technologies and tools to improve data engineering processes

Qualifications:

• Bachelor's or Master's degree in Computer Science, Data Science, or a related field
• 5+ years of experience in data engineering with a proven track record of designing and implementing data pipelines
• Proficiency in programming languages such as Python, Pyspark
• Expert SQL skills and a good understanding of existing SQL warehouses
• Experience with big data technologies such as Hadoop, Spark, and Kafka
• Experience with AWS cloud (IAM, S3, Lambda, Glue, Redshift)
• Deep understanding of distributed systems (Spark, Dask)
• Experience with data modeling, ETL design, and data governance
• Experience with devops tools like Terraform
• Excellent communication and collaboration skills