Overview
Senior Data Engineer
Location: Bengaluru, India
Summary
We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal
candidate will have extensive experience in data engineering, with a strong focus on Databricks, Python,
and SQL. As a Data Engineer you will play a crucial role in designing, developing, and maintaining our
data infrastructure to support various business needs.
Key Responsibilities.
Develop and implement efficient data pipelines and ETL processes to migrate and manage
client, investment, and accounting data in Databricks
Work closely with the investment management team to understand data structures and
business requirements, ensuring data accuracy and quality.
Monitor and troubleshoot data pipelines, ensuring high availability and reliability of data
systems.
Optimize database performance by designing scalable and cost-effective solutions.
What’s on offer
Competitive salary and benefits package.
Opportunities for professional growth and development.
A collaborative and inclusive work environment.
The chance to work on impactful projects with a talented team.
Experience:
6+ years of experience in data engineering or a similar role.
Proficiency in Apache Spark. Databricks Data Cloud, including schema design, data partitioning,
and query optimization
Exposure to Azure.
Exposure to Streaming technologies. (e.g Autoloader, DLT Streaming)
Advanced SQL, data modeling skills, and data warehousing concepts tailored to investment
management data (e.g., transaction, accounting, portfolio data, reference data etc).
Experience with ETL/ELT tools like snap logic and programming languages (Python/Scala/R
programming).
Familiarity with workload automation and job scheduling tools such as Control M.
Familiar with data governance frameworks and security protocols.
Excellent problem-solving skills and attention to detail.
Strong communication and collaboration skills.
Capital Market Domain or Investment or Finance industry experince is Mandatory
Job Type: Full-time
Pay: ₹558,890.56 - ₹1,939,362.08 per year
Work Location: In person