Data Engineer I

Description

Data Engineer I

Chennai, India

The Opportunity:

Anthology delivers education and technology solutions so that students can reach their full potential and learning institutions thrive. Our mission is to empower educators and institutions with meaningful innovation that’s simple and intelligent, inspiring student success and institutional growth.

The Power of Together is built on having a diverse and inclusive workforce. We are committed to making diversity, inclusion, and belonging a foundational part of our hiring practices and who we are as a company.

For more information about Anthology and our career opportunities, please visit www.anthology.com.

Primary responsibilities will include:

• Design, implement, and maintain data pipelines for integrating and processing data using MySQL and AWS services.
• Develop and optimize ETL processes to ensure the timely and accurate transformation of data for analytical purposes.
• Create, manage, and enhance reports and dashboards using Power BI and AWS QuickSight to deliver actionable insights.
• Work with AWS cloud services including S3, Athena, SQS, Glue, Glue Crawlers, and Data Lakes to ensure seamless data storage, processing, and analytics.
• Write and maintain AWS Glue scripts for data transformation and pipeline orchestration.
• Collaborate with business analysts and data teams to ensure the availability and quality of data for reporting and analysis.
• Leverage Python and PySpark for data processing tasks where applicable.
• Work within Agile frameworks, participating in sprint planning, daily stand-ups, and reviews.
• Implement Continuous Integration and Continuous Delivery (CI/CD) pipelines using AWS CDK or similar tools to streamline development and deployment.
• Communicate effectively with both technical and non-technical stakeholders to ensure clarity of project goals and deliverables.
  
  

The Candidate:

Required skills/qualifications:

• 3-5 years of relevant experience
• Strong knowledge of MySQL databases, including schema design, queries, and performance tuning.
• Expertise in ETL concepts, data integration, and transformation techniques.
• Experience in developing and delivering reports and dashboards with Power BI and AWS QuickSight.
• In-depth knowledge of AWS cloud environments and services, including S3, Athena, SQS, Glue, Glue Crawlers, and Data Lakes
• Proficiency in AWS Glue scripting (Python, Scala).
• Familiarity with Python and PySpark for data processing tasks.
• Experience in agile methodologies, with an understanding of Agile practices and principles.
• Knowledge of CDK (Cloud Development Kit) and CI/CD practices for seamless deployment and automation.
• Excellent communication skills, with the ability to present technical information to both technical and non-technical audiences.
• Ability to work collaboratively in a fast-paced, team-oriented environment.
• Fluency in written and spoken English
  
  

Preferred skills/qualifications:

• Experience working in a cloud-native data architecture.
• Familiarity with advanced data processing tools and technologies such as Apache Spark.
• Understanding of data governance and security best practices in the cloud.
  
  

This job description is not designed to contain a comprehensive listing of activities, duties, or responsibilities that are required. Nothing in this job description restricts management's right to assign or reassign duties and responsibilities at any time.    

Anthology is an equal employment opportunity/affirmative action employer and considers qualified applicants for employment without regard to race, gender, age, color, religion, national origin, marital status, disability, sexual orientation, gender identity/expression, protected military/veteran status, or any other legally protected factor.