Sr. Data Engineer

Overview

Role – Sr. Data Engineer
Location – Remote, India
Type – Permanent

Job Description:

• Good Python, PySpark programming & scripting skills.
• Azure Databricks with PySpark.
• Azure ADF, EventHub.
• Snowflake SQL/ alert configuration.
• Denodo VQL and CI CD knowledge.
• Azure Function app and Gen AI orchestrator( development -python FastAPI/ containerised deployment on Azure web app services).
• Ability to write complex SQL queries.
• Hands-on experience in building Data Pipelines (data ingestion, data transformation, data curation).
• Experience with Agile development practices.

Mandatory Skills:

· Hands-on experience with Databricks, PySpark, Azure ADF and EventHub.

· Hands-on PySpark, Python Coding.

· Hands-on Building Data pipeline in with Azure Infrastructure.

· Good experience in working with No SQL Databases, Snowflake alert Configuration, Azure Function App.

Job Type: Permanent

Pay: ₹1,700,000.00 - ₹2,000,000.00 per year

Experience:

• Total: 7 years (Required)
• Python: 4 years (Required)
• API Development: 4 years (Required)
• Containerization - CI/CD: 4 years (Required)
• Azure: 4 years (Required)
• Databricks: 4 years (Required)
• ADF: 3 years (Required)
• Pyspark: 3 years (Required)

Work Location: Remote