Senior Data Engineer

Company Overview

Milestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over 25 years, we have a demonstrated history of supporting category-defining enterprise clients that are growing ahead of the market. The company specializes in providing solutions across Application Services and Consulting, Digital Product Engineering, Digital Workplace Services, Private Cloud Services, AI/Automation, and ServiceNow. Milestone culture is built to provide a collaborative, inclusive environment that supports employees and empowers them to reach their full potential.

Our seasoned professionals deliver services based on Milestone’s best practices and service delivery framework. By leveraging our vast knowledge base to execute initiatives, we deliver both short-term and long-term value to our clients and apply continuous service improvement to deliver transformational benefits to IT. With Intelligent Automation, Milestone helps businesses further accelerate their IT transformation. The result is a sharper focus on business objectives and a dramatic improvement in employee productivity. Through our key technology partnerships and our people-first approach, Milestone continues to deliver industry-leading innovation to our clients. With more than 3,000 employees serving over 200 companies worldwide, we are following our mission of revolutionizing the way IT is deployed.

Job Overview

Job Summary:

We are looking for a highly skilled Senior Data Engineer with 8-10 years of experience to join our offshore team in India. The ideal candidate should have expertise in data engineering, strong hands-on experience with the SODA Data Quality Platform, and excellent communication skills to collaborate with global stakeholders.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines and ETL processes.
• Implement and manage data quality frameworks using the SODA Data Quality Platform to ensure data accuracy and reliability.
• Collaborate with data analysts, data scientists, and business teams to understand data requirements.
• Work with various data storage technologies such as AWS, Azure, GCP, SQL, and NoSQL databases.
• Optimize data workflows for performance, scalability, and security.
• Monitor, troubleshoot, and resolve data pipeline issues proactively.
• Ensure compliance with data governance, security, and best practices.
• Provide mentorship and technical guidance to junior data engineers.

Required Skills & Qualifications:

• 8+ years of experience in Data Engineering, Big Data, or related fields.
• Expertise in SODA Data Quality Platform for data validation, monitoring, and anomaly detection.
• Strong proficiency in SQL, Python, Spark, and other data processing frameworks.
• Hands-on experience with cloud platforms (AWS, Azure, or GCP) for data processing and storage.
• Proficiency in data pipeline orchestration tools like Airflow, dbt, or similar.
• Knowledge of data warehousing concepts (Snowflake, Redshift, BigQuery, etc.).
• Strong understanding of data governance, security, and compliance standards.
• Excellent problem-solving and analytical skills.
• Strong communication skills with the ability to work with global teams and stakeholders.

Nice to Have:

• Experience with Kafka, Kinesis, or similar streaming technologies.
• Knowledge of machine learning model deployment and MLOps.
• Exposure to DevOps and CI/CD for data engineering workflows.

Compensation

Estimated Pay Range:

Exact compensation and offers of employment are dependent on circumstances of each case and will be determined based on job-related knowledge, skills, experience, licenses or certifications, and location.

Our Commitment to Diversity & Inclusion