Free cookie consent management tool by TermsFeed Lead Data Engineer | Antal Tech Jobs
Back to Jobs
8 Weeks ago

Lead Data Engineer

decor
Gurugram, Haryana, India
Information Technology
Advance Auto Parts

Overview

Job Description

Lead Data Engineer

  • Seeking candidates with total experience of 9+ years and 6 years into data Engineering field.
  • Be an advocate with obsession for excellence delivering measurable success for Advance Auto Parts stakeholders with secure, scalable, highly available cloud architecture that leverages AWS Cloud services.
  • Provides technical leadership in AWS cloud tech stack, Snowflake and any ETL tool like Talend.
  • Extensive hands-on expertise in Pyspark, Airflow and RDS(Postgress).
  • Capable of conceptualizing, prototyping, and articulately presenting appropriate solutions to leadership for effective decision-making.
  • Ability to assess the current environment, requirements and propose Data Engineering Solutions.
  • Ability to build frameworks and pipelines using AWS and PySpark.
  • Skilled in crafting comprehensive solutions across AWS and Azure platforms, with demonstrated hands-on experience in design and implementation.
  • Proficiency in delivering high-quality data engineering services is a must have for this role.
  • Lead the entire lifecycle of project delivery, from development to production, and provide post-production warranty support.
  • Able to work with platform team in problem solving and troubleshooting activities.
  • Propose Standard and Best Practices by leveraging AWS Services.
  • Apply creative thinking/approach to arrive at technical solutions that enhance business goals and align with corporate technology strategies.
  • Help Application teams in onboarding the feeds into the built-in frameworks.
  • Make sure to follow the best design practices during the implementation of ETL Frameworks.
  • Demonstrate expertise in developing pipelines within Databricks and Airflow frameworks, ensuring meticulous attention to detail in establishing efficient monitoring, logging, and auditing capabilities.
  • Responsible for conducting regular code reviews and performance evaluations to ensure high standards of quality and efficiency.
  • Capable of cultivating effective collaboration with technical teams, delivery managers, as well as data engineers, scientists, and analysts.

Qualification:

  • Bachelor’s or master’s degree in computer science or equivalent experience
  • At least 9 years of experience in application design, development, and analysis
  • Experience in AWS Cloud Solutions. Retail Industry experience preferred.
  • Implement data transformations and data structures for data warehouse and lake/repository.
  • Experience in creating Various ETL Frameworks in processing or extracting the data from cloud databases by using AWS Services by leveraging Lambda, Glue, PySpark, Step Functions, SNS, SQS, Batch and Databricks .
  • Having certifications in AWS, Azure, Snowflake, and Databricks is an added advantage for this position.
  • Proficiency in Git, Azure DevOps, and DevOps pipelines is a valuable asset for this position.
  • Proficient in Terraform for infrastructure such as code, Python scripting for automation, shell scripting for system tasks, and containerization technologies. Additionally, experienced in orchestrating web services.
  • Proven ability to be a strategic thinker to drive the necessary ownership and data governance within the organization.
  • Ability to evaluate risks and provide business recommendations / solutions in a timely manner
  • Should have sound knowledge in various AWS Services.
  • Able to scan ETL Frameworks and propose optimizations and cost savings.
  • In addition to technical proficiency, the candidate should possess the ability to mentor junior team members, providing guidance and support to foster their professional growth and development within the team.
  • Understanding of and experience working in an Agile environment.
  • Able to work with other cross functional team members, both onshore and offshore for solutions and development tasks
  • Independent. Strong critical thinking, decision making, troubleshooting and problem-solving skills.
  • Go-Getter. Possesses strong, planning, execution and multitasking skills and demonstrated ability to reprioritize accordingly. Must be able to manage quickly changing priorities while meeting deadlines.

California Residents click below for Privacy Notice:

https://jobs.advanceautoparts.com/us/en/disclosures

Share job
Similar Jobs
View All
1 Day ago
Web Developer Internship in Mumbai
Information Technology
Selected Intern's Day-to-day Responsibilities Include Building our website from concept to completion from the bottom up. Fashioning everything from the home page to site layout and function. Creating website layout/user interface by using standa...
decor
1 Day ago
Neolytix - Artificial Intelligence/Machine Learning Engineer
Information Technology
  • Chennai, Tamil Nadu, India
Position : MLOps Engineer US Healthcare Claims Management.Location : Gurgaon, Sector 18, Delhi NCR, India,.UK Shift.Company : Neolytix.About The RoleWe are looking for an AI/ML Engineer to develop and implement intelligent claims analysis, prioritiz...
decor
1 Day ago
AVP - Business Analyst, Analytics
Information Technology
  • Chennai, Tamil Nadu, India
The Business Analytics Manager provides full leadership and supervisory responsibility. Provides operational/service leadership and direction to team(s). Applies in-depth disciplinary knowledge through provision of value-added perspectives or adviso...
decor
1 Day ago
Software Engineer QA
Information Technology
  • Chennai, Tamil Nadu, India
Who We AreAt Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to...
decor
1 Day ago
.Net Developer - ASP/MVC
Information Technology
  • Chennai, Tamil Nadu, India
Job Description Strong development background in Microsoft Technologies, primarily on ASP.NET, MVC, JavaScript and JQuery. Ability to work on existing product and make suitable changes for feature development and Hands-on experience with docker, S...
decor
1 Day ago
Java Developer - Spring Boot Framework
Information Technology
  • Chennai, Tamil Nadu, India
Roles And Responsibilities Design and develop Micro services using Java & Spring Participate in user story grooming, design discussions, and propose solutions Practice standard development process leveraging agile methodologies such as SCRUM and ...
decor
1 Day ago
Business Analyst
Information Technology
Title: Business : Analyze and document business requirements using various techniques such as interviews, workshops, surveys, and document analysis. Translate business needs into clear and concise functional and non-functional requirements. Creat...
decor
1 Day ago
Senior Java Developer - Spring Boot/J2EE Programming
Information Technology
  • Chennai, Tamil Nadu, India
Experience : 4-10 YearsNumber of open positions : 05Job Title : JAVA DeveloperHiring lead time : ImmediateSkillsCyepro Private limited is looking to hire full stack developers to work closely with our agile software team. If you enjoy working in...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media