Overview
Job Summary:
We are seeking an experienced Senior Data Engineer with expertise in cloud platforms (Azure, AWS, GCP) to design, build, and optimize scalable data solutions. The ideal candidate will have a deep understanding of cloud-based data engineering, ETL/ELT processes, data warehousing, and real-time data processing.
Key Responsibilities:
Design and implement scalable, secure, and high-performance data pipelines across cloud platforms (Azure, AWS, GCP).
Develop ETL/ELT workflows using cloud-native tools such as AWS Glue, Azure Data Factory, and Google Dataflow.
Work with big data technologies like Spark, Databricks, Hadoop, and Kafka for real-time and batch data processing.
Design and optimize data lakes, data warehouses, and data marts (Snowflake, Redshift, BigQuery, Synapse).
Implement CI/CD pipelines for data solutions using Terraform, CloudFormation, or ARM templates.
Collaborate with data scientists, analysts, and software engineers to enable data-driven decision-making.
Ensure data governance, security, and compliance following industry best practices.
Monitor and improve data infrastructure for scalability, performance, and cost efficiency.
Required Skills & Qualifications:
8+ years of experience in Data Engineering with strong expertise in Azure, AWS, and GCP.
Hands-on experience with ETL/ELT frameworks, data pipelines, and cloud storage (S3, ADLS, GCS).
Proficiency in Python, SQL, Scala, or Java for data processing and automation.
Experience with big data tools: Spark, Databricks, Hadoop, Kafka, Snowflake, Redshift, BigQuery.
Strong knowledge of data modeling, data warehousing, and performance tuning.
Experience with orchestration tools such as Airflow, Step Functions, or Azure Data Factory.
Expertise in CI/CD, DevOps, and Infrastructure-as-Code (Terraform, CloudFormation, Bicep, ARM).
Familiarity with machine learning pipelines (preferred but not mandatory).
Preferred Qualifications:
Certifications in Azure Data Engineer (DP-203), AWS Certified Data Analytics, or Google Professional Data Engineer.
Experience with serverless data architectures (AWS Lambda, Azure Functions, Google Cloud Functions).
Strong understanding of data governance, security, and compliance (GDPR, HIPAA, SOC2).
Knowledge of streaming architectures using Apache Flink, Kinesis, or Pub/Sub.
Why Join Us?
Open Salary Package – We value your expertise.
Opportunity to work with cutting-edge cloud technologies.
Work on high-impact data engineering projects in a fast-paced environment.
Interested candidates? Apply now!
Job Type: Full-time
Benefits:
- Health insurance
- Life insurance
- Provident Fund
Schedule:
- Day shift
Work Location: In person
Application Deadline: 27/02/2025