Free cookie consent management tool by TermsFeed Data Engineer II | Antal Tech Jobs
Back to Jobs
6 Weeks ago

Data Engineer II

decor
Pune, Maharashtra, India
Telecommunications
Full-Time
Trimble

Overview

Job Description:
The Data Engineer will lead the design and architecture of AWS-based data solutions, develop end-to-end data pipelines, manage data lakes, and optimize data platforms for performance and scalability. Responsibilities include writing and testing Python, SQL or other code, conducting code reviews, implementing end to end ETL/ELT processes, enforcing data governance policies, and driving innovation in data engineering practices. This role also involves collaboration with cross-functional teams, aligning with stakeholders on technical requirements, providing technical leadership, and mentoring team members to enhance overall team efficiency.
Key Responsibilities:
  • Design and implement scalable data solutions on AWS, including data lakes, warehouses, and streaming systems.
  • Develop, optimize, and maintain data pipelines using AWS services.
  • Implement robust ETL/ELT processes and event-driven data ingestion.
  • Establish and enforce data governance policies, ensuring data quality, security, and compliance.
  • Optimize cloud resources for performance, availability, and cost-efficiency.
  • Partner with cross-functional teams to gather requirements and deliver comprehensive cloud-based solutions.
  • Identify opportunities to enhance systems, processes, and technologies while troubleshooting complex technical challenges.
Our current tech-stack:
  • AWS: Glue, Lambda, Step Function, Batch, ECS, Quicksight, Machine Learning, Sagemaker, etc.
  • DevOps: Cloudformation, Terraform, Git, CodeBuild
  • Database: Redshift, PostgreSQL, DynamoDB, Athena
  • Language: Bash, Python, SQL
Qualifications:
  • Bachelor's degree in Computer Science, Engineering, or related field. Master's degree preferred.
  • Expertise in AWS platforms, including data services. Basic knowledge of Azure is preferred.
  • Extensive experience in data and cloud engineering roles.
  • Expertise in AWS platforms, including data services.
  • Strong competence in ETL processes, data warehousing, and big data technologies.
  • Advanced skills in scripting, Python, SQL, and infrastructure automation tools.
  • Familiarity with containerization (e.g., Docker) and orchestration (e.g., Kubernetes).
  • Experience with data visualization tools (e.g., QuickSight) is a plus.
Share job
Similar Jobs
View All
15 Hours ago
MTS II - Software Engineer
Information Technology
  • 4 - 7 Yrs
  • Pune
MAJOR RESPONSIBILITIES • Design, implement, integrate, and verify software applications and tools using JavaScript, NodeJS, and C++. • Enhance, optimize, and improve the efficiency and robustness of current software, with a particular focus on OSS ...
decor
2 Days ago
Business Advisory Analyst
Information Technology
  • Bangalore, Karnataka, India
Skill required: Banking Services - Core BankingDesignation: Business Advisory AnalystQualifications:BBA/BCom/Master of Business AdministrationYears of Experience:3 to 5 yearsAbout AccentureAccenture is a global professional services company with lea...
decor
2 Days ago
Front End Developer
Information Technology
  • Bangalore, Karnataka, India
Position Title: Front End DeveloperCompany: Johnson Controls (JCI)Location: BangaloreJob Summary: We are seeking a talented Front End Developer with 4-7 years of experience to join our dynamic team. The ideal candidate will have a strong background ...
decor
2 Days ago
Database Engineer III (Big Data)
Information Technology
  • Bangalore, Karnataka, India
LivePerson (NASDAQ: LPSN) is the global leader in enterprise conversations. Hundreds of the world’s leading brands — including HSBC, Chipotle, and Virgin Media — use our award-winning Conversational Cloud platform to connect with millions of consume...
decor
2 Days ago
Data Scientist Manager
Information Technology
  • Bangalore, Karnataka, India
Job DescriptionLeads a team of people who design, develop and program methods, processes, and systems to consolidate and analyze unstructured, diverse “big data” sources to generate actionable insights and solutions for client services and product e...
decor
2 Days ago
Data Scientist Manager
Information Technology
  • Bangalore, Karnataka, India
Job DescriptionLeads a team of people who design, develop and program methods, processes, and systems to consolidate and analyze unstructured, diverse “big data” sources to generate actionable insights and solutions for client services and product e...
decor
2 Days ago
Sr. QA Engineer
Information Technology
  • Bangalore, Karnataka, India
Role Summary:Picarro is seeking an exceptional Sr. QA Engineer for functional testing of Picarro Analyzers. This role expects you to analyze requirements, create and execute test-plan, and record results in test-repo. This person is also expected to...
decor
2 Days ago
C++ Graphics and Windowing System Software Engineer - Mir
Information Technology
  • Bangalore, Karnataka, India
We build a high-performance, high-efficiency stack for window managers and display subsystems in C++, called Mir. We're growing the team and looking for new colleagues who share our passion for precision, performance and user experience.Our goal is ...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media