Hyderabad, Telangana, India
Information Technology
Full-Time
Refactor Academy
Overview
We are seeking an experienced Data Engineer to join our team on a contractual basis for 3 months (extendable). The ideal candidate will have 4+ years of hands-on experience in data engineering, with advanced proficiency in SQL, and 3+ years of experience with Python and PySpark. This role requires flexibility to work in the 1 PM to 10 PM (timezone) shift.
Responsibilities
Responsibilities
- Data Integration and ETL: Develop, maintain, and optimize data pipelines and ETL processes to ensure efficient data processing and integration from multiple sources.
- Advanced SQL: Design, query, and optimize complex SQL queries to extract, transform, and load (ETL) data efficiently. Proficient in writing optimized queries for large datasets and ensuring high performance.
- Python and PySpark: Utilize Python for data manipulation, cleaning, and processing. Work extensively with PySpark to handle large-scale data processing and distributed computing tasks.
- Data Modeling and Warehousing: Assist in designing, building, and maintaining data models and data warehouses, ensuring data integrity and performance.
- Collaboration: Work closely with data scientists, analysts, and other engineers to understand data needs and optimize data workflows.
- Troubleshooting and Optimization: Diagnose, troubleshoot, and resolve data-related issues and performance bottlenecks.
- Documentation: Create and maintain documentation for data pipelines, processes, and data structures.
- 4+ years of experience in data engineering or a related field.
- Advanced SQL knowledge with experience in writing optimized queries for large databases.
- 3+ years of experience in Python for data processing and automation.
- 3+ years of hands-on experience with PySpark for distributed data processing.
- Strong understanding of data modeling and database management.
- Familiarity with cloud platforms (AWS, GCP, or Azure) is a plus.
- Good understanding of data pipelines, ETL tools, and big data ecosystems.
- Ability to work in a collaborative, fast-paced environment.
- Strong problem-solving and debugging skills.
- Excellent communication skills and ability to work in a remote team.
Similar Jobs
View All
15 Hours ago
MTS II - Software Engineer
Information Technology
- 4 - 7 Yrs
- Pune
MAJOR RESPONSIBILITIES
• Design, implement, integrate, and verify software applications and tools using JavaScript, NodeJS, and C++.
• Enhance, optimize, and improve the efficiency and robustness of current software, with a particular focus on OSS ...
2 Days ago
Business Advisory Analyst
Information Technology
- Bangalore, Karnataka, India
Skill required: Banking Services - Core BankingDesignation: Business Advisory AnalystQualifications:BBA/BCom/Master of Business AdministrationYears of Experience:3 to 5 yearsAbout AccentureAccenture is a global professional services company with lea...
2 Days ago
Front End Developer
Information Technology
- Bangalore, Karnataka, India
Position Title: Front End DeveloperCompany: Johnson Controls (JCI)Location: BangaloreJob Summary: We are seeking a talented Front End Developer with 4-7 years of experience to join our dynamic team. The ideal candidate will have a strong background ...
2 Days ago
Database Engineer III (Big Data)
Information Technology
- Bangalore, Karnataka, India
LivePerson (NASDAQ: LPSN) is the global leader in enterprise conversations. Hundreds of the world’s leading brands — including HSBC, Chipotle, and Virgin Media — use our award-winning Conversational Cloud platform to connect with millions of consume...
2 Days ago
Data Scientist Manager
Information Technology
- Bangalore, Karnataka, India
Job DescriptionLeads a team of people who design, develop and program methods, processes, and systems to consolidate and analyze unstructured, diverse “big data” sources to generate actionable insights and solutions for client services and product e...
2 Days ago
Data Scientist Manager
Information Technology
- Bangalore, Karnataka, India
Job DescriptionLeads a team of people who design, develop and program methods, processes, and systems to consolidate and analyze unstructured, diverse “big data” sources to generate actionable insights and solutions for client services and product e...
2 Days ago
Sr. QA Engineer
Information Technology
- Bangalore, Karnataka, India
Role Summary:Picarro is seeking an exceptional Sr. QA Engineer for functional testing of Picarro Analyzers. This role expects you to analyze requirements, create and execute test-plan, and record results in test-repo. This person is also expected to...
2 Days ago
C++ Graphics and Windowing System Software Engineer - Mir
Information Technology
- Bangalore, Karnataka, India
We build a high-performance, high-efficiency stack for window managers and display subsystems in C++, called Mir. We're growing the team and looking for new colleagues who share our passion for precision, performance and user experience.Our goal is ...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in