Cloud Data Engineer - GCP

Overview

Position Overview : Cloud Data Engineer with expertise in Google Cloud Platform (GCP) Data Stack, including Event Hub, MS SQL DB, Azure Redis, and GCP Big Table Storage. The ideal candidate should have strong experience in Big Data architecture, data migration, and large-scale data processing using tools like Hadoop, Hive, HDFS, Impala, Spark, MapReduce, MS SQL, Kafka, and Redis. Familiarity with Cloudera, HBase, MongoDB, MariaDB, Python Scripts, and Unix Shell Scripting is a plus.

Key Responsibilities:

• Design, develop, and optimize Big Data solutions on GCP and cloud-based architectures.
• Lead and execute data migration projects from on-premise systems to GCP or hybrid cloud environments.
• Build and maintain ETL pipelines using Hadoop, Hive, Spark, Kafka, and SQL databases.
• Work with GCP Big Table Storage, Azure Redis, and Event Hub for data processing and storage.
• Implement real-time streaming solutions using Kafka and Event Hub.
• Optimize performance and security for Hadoop clusters, HDFS, and cloud storage solutions.
• Develop and automate Python and Unix Shell Scripts for data processing and workflow orchestration.
• Collaborate with data analysts, data scientists, and DevOps teams to improve data infrastructure.
• Required Skills & Experience:

Strong hands-on experience in GCP Data Stack (Big Table Storage, Event Hub, Azure Redis, MS SQL DB).

• Proficiency in Big Data technologies (Hadoop, Hive, HDFS, Impala, Spark, MapReduce). Experience with Kafka, Redis, and real-time data processing.
• Hands-on knowledge of SQL and NoSQL databases (MS SQL, HBase, MongoDB, MariaDB).
• Experience in data migration projects across cloud and on-premise environments.
• Strong scripting skills in Python and Unix Shell Scripting.
• Understanding Big Data security, performance tuning, and scalability best practices.

Location :

• Work from Office, Preferred Base location – Pune (India)

Shift Timings - USA Time zones

Job Type: Full-time

Pay: ₹154,666.98 - ₹1,043,294.16 per year

Benefits:

• Health insurance
• Provident Fund

Schedule:

• US shift

Application Question(s):

• The shift timing for the role is USA time zone are you comfortable with that ?

Work Location: In person