Thiruvananthapuram, Kerala, India
Information Technology
Full-Time
Cloudesign
Overview
Role Overview
As the Data Engineer Lead, you will be at the forefront of designing, developing, and maintaining robust data pipelines that ensure data integrity, efficiency, and performance.
You will play a crucial role in optimizing our data infrastructure for cost and scalability on AWS and on-premises.
Key Responsibilities
As the Data Engineer Lead, you will be at the forefront of designing, developing, and maintaining robust data pipelines that ensure data integrity, efficiency, and performance.
You will play a crucial role in optimizing our data infrastructure for cost and scalability on AWS and on-premises.
Key Responsibilities
- Build, develop and maintain- efficient and performant data pipelines across both cloud and on-premises environments.
- Ensure accuracy, adequacy and legitimacy of data.
- Prepare ETL pipelines for getting data from various sources and store it one place.
- Analyze, interpret and present results through effective visualization and reports Identify critical metrics.
- Implement best practices for effective data management.
- Monitor the use of data systems and ensure correctness, completeness and availability of data services.
- Optimize data infrastructure and processes for cost efficiency on AWS cloud and on-premises.
- Utilize Apache Workflow and Nifi or equivalent tools to build and manage data workflows and integrations.
- Implement best practices for data governance, security, and compliance.
- Monitor and troubleshoot data pipeline issues to ensure timely resolution.
- Stay current with industry trends and emerging technologies in data engineering and cloud computing.
- Bachelor's degree in Computer Science, Information Technology, Data Science, or a related field.
- Proven experience as a Data Engineer Lead or in a similar role.
- Extensive hands-on experience with ETL and ELT processes.
Similar Jobs
View All
1 Day ago
Web Developer Internship in Mumbai
Information Technology
Selected Intern's Day-to-day Responsibilities Include Building our website from concept to completion from the bottom up. Fashioning everything from the home page to site layout and function. Creating website layout/user interface by using standa...
1 Day ago
Neolytix - Artificial Intelligence/Machine Learning Engineer
Information Technology
- Chennai, Tamil Nadu, India
Position : MLOps Engineer US Healthcare Claims Management.Location : Gurgaon, Sector 18, Delhi NCR, India,.UK Shift.Company : Neolytix.About The RoleWe are looking for an AI/ML Engineer to develop and implement intelligent claims analysis, prioritiz...
1 Day ago
AVP - Business Analyst, Analytics
Information Technology
- Chennai, Tamil Nadu, India
The Business Analytics Manager provides full leadership and supervisory responsibility. Provides operational/service leadership and direction to team(s). Applies in-depth disciplinary knowledge through provision of value-added perspectives or adviso...
1 Day ago
Software Engineer QA
Information Technology
- Chennai, Tamil Nadu, India
Who We AreAt Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to...
1 Day ago
.Net Developer - ASP/MVC
Information Technology
- Chennai, Tamil Nadu, India
Job Description Strong development background in Microsoft Technologies, primarily on ASP.NET, MVC, JavaScript and JQuery. Ability to work on existing product and make suitable changes for feature development and Hands-on experience with docker, S...
1 Day ago
Java Developer - Spring Boot Framework
Information Technology
- Chennai, Tamil Nadu, India
Roles And Responsibilities Design and develop Micro services using Java & Spring Participate in user story grooming, design discussions, and propose solutions Practice standard development process leveraging agile methodologies such as SCRUM and ...
1 Day ago
Business Analyst
Information Technology
Title: Business : Analyze and document business requirements using various techniques such as interviews, workshops, surveys, and document analysis. Translate business needs into clear and concise functional and non-functional requirements. Creat...
1 Day ago
Senior Java Developer - Spring Boot/J2EE Programming
Information Technology
- Chennai, Tamil Nadu, India
Experience : 4-10 YearsNumber of open positions : 05Job Title : JAVA DeveloperHiring lead time : ImmediateSkillsCyepro Private limited is looking to hire full stack developers to work closely with our agile software team. If you enjoy working in...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in