Hyderabad, Telangana, India
Information Technology
Full-Time
Advance Auto Parts
Overview
Job Description
Lead Data Engineer
https://jobs.advanceautoparts.com/us/en/disclosures
We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age national origin, religion, sexual orientation, gender identity, status as a veteran and basis of disability or any other federal, state or local protected class.
Lead Data Engineer
- Seeking candidates with total experience of 9+ years and 6 years into data Engineering field.
- Be an advocate with obsession for excellence delivering measurable success for Advance Auto Parts stakeholders with secure, scalable, highly available cloud architecture that leverages AWS Cloud services.
- Provides technical leadership in AWS cloud tech stack, Snowflake and any ETL tool like Talend.
- Extensive hands-on expertise in Pyspark, Airflow and RDS(Postgress).
- Capable of conceptualizing, prototyping, and articulately presenting appropriate solutions to leadership for effective decision-making.
- Ability to assess the current environment, requirements and propose Data Engineering Solutions.
- Ability to build frameworks and pipelines using AWS and PySpark.
- Skilled in crafting comprehensive solutions across AWS and Azure platforms, with demonstrated hands-on experience in design and implementation.
- Proficiency in delivering high-quality data engineering services is a must have for this role.
- Lead the entire lifecycle of project delivery, from development to production, and provide post-production warranty support.
- Able to work with platform team in problem solving and troubleshooting activities.
- Propose Standard and Best Practices by leveraging AWS Services.
- Apply creative thinking/approach to arrive at technical solutions that enhance business goals and align with corporate technology strategies.
- Help Application teams in onboarding the feeds into the built-in frameworks.
- Make sure to follow the best design practices during the implementation of ETL Frameworks.
- Demonstrate expertise in developing pipelines within Databricks and Airflow frameworks, ensuring meticulous attention to detail in establishing efficient monitoring, logging, and auditing capabilities.
- Responsible for conducting regular code reviews and performance evaluations to ensure high standards of quality and efficiency.
- Capable of cultivating effective collaboration with technical teams, delivery managers, as well as data engineers, scientists, and analysts.
- Bachelor’s or master’s degree in computer science or equivalent experience
- At least 9 years of experience in application design, development, and analysis
- Experience in AWS Cloud Solutions. Retail Industry experience preferred.
- Implement data transformations and data structures for data warehouse and lake/repository.
- Experience in creating Various ETL Frameworks in processing or extracting the data from cloud databases by using AWS Services by leveraging Lambda, Glue, PySpark, Step Functions, SNS, SQS, Batch and Databricks .
- Having certifications in AWS, Azure, Snowflake, and Databricks is an added advantage for this position.
- Proficiency in Git, Azure DevOps, and DevOps pipelines is a valuable asset for this position.
- Proficient in Terraform for infrastructure such as code, Python scripting for automation, shell scripting for system tasks, and containerization technologies. Additionally, experienced in orchestrating web services.
- Proven ability to be a strategic thinker to drive the necessary ownership and data governance within the organization.
- Ability to evaluate risks and provide business recommendations / solutions in a timely manner
- Should have sound knowledge in various AWS Services.
- Able to scan ETL Frameworks and propose optimizations and cost savings.
- In addition to technical proficiency, the candidate should possess the ability to mentor junior team members, providing guidance and support to foster their professional growth and development within the team.
- Understanding of and experience working in an Agile environment.
- Able to work with other cross functional team members, both onshore and offshore for solutions and development tasks
- Independent. Strong critical thinking, decision making, troubleshooting and problem-solving skills.
- Go-Getter. Possesses strong, planning, execution and multitasking skills and demonstrated ability to reprioritize accordingly. Must be able to manage quickly changing priorities while meeting deadlines.
https://jobs.advanceautoparts.com/us/en/disclosures
We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age national origin, religion, sexual orientation, gender identity, status as a veteran and basis of disability or any other federal, state or local protected class.
Similar Jobs
View All
1 Day ago
MTS II - Software Engineer
Information Technology
- 4 - 7 Yrs
- Pune
MAJOR RESPONSIBILITIES
• Design, implement, integrate, and verify software applications and tools using JavaScript, NodeJS, and C++.
• Enhance, optimize, and improve the efficiency and robustness of current software, with a particular focus on OSS ...
1 Day ago
Test Engineer - Functional Testing
Information Technology
- Hyderabad, Telangana, India
Job Description Proven experience of 2 years of hands-on experience of functional testing. Strong knowledge of quality best practices and methodologies for software testing Experience with automation tools such as selenium, Cypress.io Katalon Stu...
1 Day ago
UcodeSoft Solutions - iOS Developer - Xcode
Information Technology
- Hyderabad, Telangana, India
Responsibilities Collaborate with the development team to design and implement new features for our iOS applications using Swift. Write clean, maintainable, and efficient code under the guidance of senior developers. Assist in translating UI/UX d...
1 Day ago
Senior Technical Business Analyst
Information Technology
- Hyderabad, Telangana, India
About the role:As a Senior Business Analyst, you will: Leads the creation & presentation of estimates for overall cost, skill, effort & timeline for new & existing solutions and projects from a functional perspective. Demonstrates solutions to inter...
1 Day ago
Senior QA Engineer
Information Technology
- Hyderabad, Telangana, India
Our Mission SPAN is enabling electrification for all ⚡We are a mission-driven company designing, building, and deploying products that electrify the built environment, reduce carbon emissions, and slow the effects of climate change. Decarbonization ...
1 Day ago
Software Test Engineer
Information Technology
- Bangalore, Karnataka, India
Job DescriptionWe are looking for Software Testing Engineers with the ability to architect and implement modern test automation tools and frameworks to support automated functional testing of mobile and web applications they will also facilitate the...
1 Day ago
Full Stack Developer (JAVA & Angular)
Information Technology
- Bangalore, Karnataka, India
Fullstack Developer must be proficient in Java (Spring Boot) for backend development and Angular for frontend development. The ideal candidate will be responsible for designing, developing, and maintaining scalable web applications, ensuring seamles...
1 Day ago
QA Engineer
Information Technology
- Bangalore, Karnataka, India
We're looking for a...QA EngineerApply Now!Position OverviewYou will participate in the testing effort of a leading SaaS product for small and medium sized hotels. He/she will lead the Quality Engineering effort and help to test and critique softwar...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in