GCP Data Engineer

Overview

Job Title: GCP Data Engineer (Mid-Level)
Location: Pune, Hyderabad, Chennai
Experience: 4+ years

Position Overview:

We are seeking a mid-level GCP Data Engineer with 4+ years of experience in ETL, Data Warehousing, and Data Engineering. The ideal candidate will have hands-on experience with GCP tools, solid data analysis skills, and a strong understanding of Data Warehousing principles.

Location: This position is open for Pune, Hyderabad, and Chennai locations.

Qualifications:

• 4+ years of experience in ETL & Data Warehousing.
• Excellent leadership and communication skills.
• Experience in developing Data Engineering solutions using Airflow, GCP BigQuery, Cloud Storage, Dataflow, Cloud Functions, Pub/Sub, Cloud Run, etc.
• Hands-on experience in building solution automations using ETL tools.
• Must have executed at least two GCP Cloud Data Warehousing projects.
• Experience in at least two projects using Agile/SAFe methodology.
• Mid-level experience in PySpark and Teradata.
• Hands-on experience with DevOps tools such as GitHub, Jenkins, Cloud Native, etc.
• Experience working with semi-structured data formats (JSON, Parquet, XML).
• Proficiency in writing complex SQL queries for data analysis and extraction.
• Strong understanding of Data Warehousing, Data Analysis, Data Profiling, Data Quality & Data Mapping.

Responsibilities:

• Analyze different source systems, profile data, document and fix Data Quality issues.
• Gather requirements and business process knowledge to transform data for end-user needs.
• Write complex SQL queries to extract and format source data for ETL/data pipelines.
• Create design documents, Source-to-Target Mapping documents, and other deployment/migration support documents.
• Design, develop, and test ETL/Data pipelines.
• Design & build metadata-based frameworks for data pipelines.
• Write Unit Test cases, execute Unit Testing, and document results.
• Deploy ETL/Data pipelines across different environments.
• Use DevOps tools for versioning, pushing/pulling code, and deployment.
• Support the team in troubleshooting, debugging defects, bug fixes, handling business requests, environment migrations, and other ad-hoc tasks.
• Provide production support, enhancements, and bug fixes.
• Collaborate with business and technology stakeholders to communicate EDW incidents/problems and manage expectations.
• Leverage ITIL concepts to manage incidents, problems, and documentation of knowledge.
• Perform data cleaning, transformation, and validation to ensure data accuracy and consistency.
• Stay updated with industry best practices and emerging technologies in data analysis and cloud computing.

Job Type: Full-time

Pay: ₹1,200,000.00 - ₹1,400,000.00 per year

Schedule:

• Day shift
• Morning shift

Application Question(s):

• How many GCP Cloud Data Warehousing projects have you executed?
• How many projects have you worked on using Agile or SAFe methodology?

Experience:

• ETL & Data Warehousing.: 4 years (Preferred)
• JD relevant: 4 years (Preferred)

Work Location: In person