Bangalore, Karnataka, India
Information Technology
Full-Time
Amlgo Labs
Overview
Position : Data Engineer
Exp : 2-6 Years
Location : Gurugram
We are looking for a talented Data Engineer to join our team. This role requires a passion for building scalable data pipelines, working with cloud technologies, and ensuring high-quality data processing.
Key Responsibilities
Exp : 2-6 Years
Location : Gurugram
We are looking for a talented Data Engineer to join our team. This role requires a passion for building scalable data pipelines, working with cloud technologies, and ensuring high-quality data processing.
Key Responsibilities
- Design, build, and maintain efficient data pipelines using PySpark and AWS technologies.
- Develop and optimize ETL processes to support data transformation, integration, and loading into data warehouses or lakes.
- Write high-quality, reusable, and maintainable Python code for data processing tasks.
- Ensure the consistency, reliability, and scalability of the data infrastructure on AWS.
- Develop and execute complex SQL queries for data extraction, manipulation, and analysis.
- Monitor, troubleshoot, and optimize existing data workflows for performance improvements.
- Work with Big Data technologies such as Apache Spark, AWS Glue, and Redshift.
- Implement data quality and validation checks to ensure data integrity.
- 2+ years of experience designing, developing, and maintaining scalable data pipelines using PySpark.
- Expertise in Data Transformation using PySpark.
- Strong proficiency in Python and experience in using it for data engineering tasks.
- Hands-on experience with PySpark for distributed data processing.
- Develop, deploy, and maintain data solutions on AWS, ensuring scalability, security, and high availability.
- Strong knowledge of SQL and experience writing complex queries for data extraction and transformation.
- Experience building and maintaining ETL pipelines and data integration workflows.
- Experience with data warehousing concepts and working with cloud data platforms.
- Basic Knowledge of PowerBi.
- Excellent communication skills.
- Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field.
- Strong problem-solving skills and attention to detail.
- Excellent communication and teamwork skills.
Similar Jobs
View All
17 Hours ago
MTS II - Software Engineer
Information Technology
- 4 - 7 Yrs
- Pune
MAJOR RESPONSIBILITIES
• Design, implement, integrate, and verify software applications and tools using JavaScript, NodeJS, and C++.
• Enhance, optimize, and improve the efficiency and robustness of current software, with a particular focus on OSS ...
1 Day ago
Test Engineer - Functional Testing
Information Technology
- Hyderabad, Telangana, India
Job Description Proven experience of 2 years of hands-on experience of functional testing. Strong knowledge of quality best practices and methodologies for software testing Experience with automation tools such as selenium, Cypress.io Katalon Stu...
1 Day ago
UcodeSoft Solutions - iOS Developer - Xcode
Information Technology
- Hyderabad, Telangana, India
Responsibilities Collaborate with the development team to design and implement new features for our iOS applications using Swift. Write clean, maintainable, and efficient code under the guidance of senior developers. Assist in translating UI/UX d...
1 Day ago
Senior Technical Business Analyst
Information Technology
- Hyderabad, Telangana, India
About the role:As a Senior Business Analyst, you will: Leads the creation & presentation of estimates for overall cost, skill, effort & timeline for new & existing solutions and projects from a functional perspective. Demonstrates solutions to inter...
1 Day ago
Senior QA Engineer
Information Technology
- Hyderabad, Telangana, India
Our Mission SPAN is enabling electrification for all ⚡We are a mission-driven company designing, building, and deploying products that electrify the built environment, reduce carbon emissions, and slow the effects of climate change. Decarbonization ...
1 Day ago
Software Test Engineer
Information Technology
- Bangalore, Karnataka, India
Job DescriptionWe are looking for Software Testing Engineers with the ability to architect and implement modern test automation tools and frameworks to support automated functional testing of mobile and web applications they will also facilitate the...
1 Day ago
Full Stack Developer (JAVA & Angular)
Information Technology
- Bangalore, Karnataka, India
Fullstack Developer must be proficient in Java (Spring Boot) for backend development and Angular for frontend development. The ideal candidate will be responsible for designing, developing, and maintaining scalable web applications, ensuring seamles...
1 Day ago
QA Engineer
Information Technology
- Bangalore, Karnataka, India
We're looking for a...QA EngineerApply Now!Position OverviewYou will participate in the testing effort of a leading SaaS product for small and medium sized hotels. He/she will lead the Quality Engineering effort and help to test and critique softwar...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in