Big Data Engineer

Overview

Education and Experience:

• Bachelor's degree in computer science, or similar technical field
• Minimum 5 years of experience in Big Data Engineering/Data Analysis

Preferred Skills and Qualifications:

• Proficiency in Python, SQL and Apache Spark
• AWS services such as EMR, Glue (serverless architecture), S3, Athena, IAM, Lambda and CloudWatch
• Core Spark, Spark Streaming, DataFrame API, Data Set API, RDD APIs & Spark SQL programming dealing with processing terabytes of data
• Advanced SQL using Hive/Impala framework including SQL performance tuning
• Expertise in Hadoop, and other distributed computing frameworks
• ElasticSearch (OpenSearch) and Kibana Dashboards
• Resource management frameworks such as Yarn or Mesos.
• Physical table design in Big Data environment
• External job schedulers such as autosys, AWS data pipeline, airflow etc.
• Experience working in Key/Value data store such as Hbase

*

Job Types: Full-time, Permanent

Pay: ₹2,000,000.00 - ₹4,000,000.00 per year

Schedule:

• Evening shift

Application Question(s):

• Are you staying in Noida or ready to relocate to Noida?

Experience:

• Data analytics: 5 years (Required)
• Big data: 5 years (Required)