Calicut, Kerala, India
Information Technology
Full-Time
dentsu
Overview
The Lead GCP Data Engineer will design, implement, and maintain scalable, reliable, and efficient data solutions on Google Cloud Platform (GCP). The role focuses on enabling data-driven decision-making by developing ETL/ELT pipelines, managing large-scale datasets, and optimizing data workflows. The ideal candidate is a proactive problem-solver with strong technical expertise in GCP, a passion for data engineering, and a commitment to delivering high-quality solutions aligned with business needs
Job Description:
Key Responsibilities:
Data Engineering & Development:
Bengaluru
Brand:
Merkle
Time Type:
Full time
Contract Type:
Permanent
Job Description:
Key Responsibilities:
Data Engineering & Development:
- Design, build, and maintain scalable ETL/ELT pipelines for ingesting, processing, and transforming structured and unstructured data.
- Implement enterprise-level data solutions using GCP services such as BigQuery, Dataform, Cloud Storage, Dataflow, Cloud Functions, Cloud Pub/Sub, and Cloud Composer.
- Develop and optimize data architectures that support real-time and batch data processing.
- Manage and deploy GCP infrastructure components to enable seamless data workflows.
- Ensure data solutions are robust, scalable, and cost-effective, leveraging GCP best practices.
- Work closely with cross-functional teams, including data analysts, data scientists, DevOps, and business stakeholders, to deliver data projects aligned with business goals.
- Translate business requirements into scalable, technical solutions while collaborating with team members to ensure successful implementation.
- Implement best practices for data governance, security, and privacy, ensuring compliance with organizational policies and regulations.
- Conduct thorough quality assurance, including testing and validation, to ensure the accuracy and reliability of data pipelines.
- Monitor and optimize pipeline performance to meet SLAs and minimize operational costs.
- Education:
- Bachelor’s or master’s degree in computer science, Information Technology, Engineering, or a related field.
- Experience:
- Minimum of 5 years of experience in data engineering, with at least 3 years working on GCP cloud platforms.
- Proven experience designing and implementing data workflows using GCP services like BigQuery, Dataform, Cloud Dataflow, Cloud Pub/Sub, and Cloud Composer.
- Certifications:
- Google Cloud Professional Data Engineer certification preferred.
- Mandatory Skills:
- Advanced proficiency in Python for data pipelines and automation.
- Strong SQL skills for querying, transforming, and analyzing large datasets.
- Expertise in GCP services such as BigQuery, Dataform, Cloud Functions, Cloud Storage, Dataflow, and Kubernetes (GKE).
- Hands-on experience with CI/CD tools like Jenkins, Git, or Bitbucket for automation, deployment, and version control.
- Familiarity with workflow orchestration tools like Apache Airflow or Cloud Composer.
- Nice-to-Have Skills:
- Experience with other cloud platforms like AWS or Azure.
- Knowledge of data visualization tools (e.g., Looker, Tableau).
- Understanding of machine learning workflows and their integration with data pipelines.
- Strong problem-solving and critical-thinking abilities.
- Excellent communication skills to collaborate with technical and non-technical stakeholders.
- Proactive attitude towards innovation and learning.
- Ability to work independently and as part of a collaborative team.
Bengaluru
Brand:
Merkle
Time Type:
Full time
Contract Type:
Permanent
Similar Jobs
View All
1 Day ago
Web Developer Internship in Mumbai
Information Technology
Selected Intern's Day-to-day Responsibilities Include Building our website from concept to completion from the bottom up. Fashioning everything from the home page to site layout and function. Creating website layout/user interface by using standa...
1 Day ago
Neolytix - Artificial Intelligence/Machine Learning Engineer
Information Technology
- Chennai, Tamil Nadu, India
Position : MLOps Engineer US Healthcare Claims Management.Location : Gurgaon, Sector 18, Delhi NCR, India,.UK Shift.Company : Neolytix.About The RoleWe are looking for an AI/ML Engineer to develop and implement intelligent claims analysis, prioritiz...
1 Day ago
AVP - Business Analyst, Analytics
Information Technology
- Chennai, Tamil Nadu, India
The Business Analytics Manager provides full leadership and supervisory responsibility. Provides operational/service leadership and direction to team(s). Applies in-depth disciplinary knowledge through provision of value-added perspectives or adviso...
1 Day ago
Software Engineer QA
Information Technology
- Chennai, Tamil Nadu, India
Who We AreAt Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to...
1 Day ago
.Net Developer - ASP/MVC
Information Technology
- Chennai, Tamil Nadu, India
Job Description Strong development background in Microsoft Technologies, primarily on ASP.NET, MVC, JavaScript and JQuery. Ability to work on existing product and make suitable changes for feature development and Hands-on experience with docker, S...
1 Day ago
Java Developer - Spring Boot Framework
Information Technology
- Chennai, Tamil Nadu, India
Roles And Responsibilities Design and develop Micro services using Java & Spring Participate in user story grooming, design discussions, and propose solutions Practice standard development process leveraging agile methodologies such as SCRUM and ...
1 Day ago
Business Analyst
Information Technology
Title: Business : Analyze and document business requirements using various techniques such as interviews, workshops, surveys, and document analysis. Translate business needs into clear and concise functional and non-functional requirements. Creat...
1 Day ago
Senior Java Developer - Spring Boot/J2EE Programming
Information Technology
- Chennai, Tamil Nadu, India
Experience : 4-10 YearsNumber of open positions : 05Job Title : JAVA DeveloperHiring lead time : ImmediateSkillsCyepro Private limited is looking to hire full stack developers to work closely with our agile software team. If you enjoy working in...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in