SE – Databricks Data Engineer

Job Title: SE – Databricks Data Engineer

Job ID: POS-9754

Primary Skill: Azure Data Factory

Location: Hyderabad

Experience

Secondary skills: Azure SQL, PySpark, Azure Synapse

Mode of work: Work from Office

Experience: 3-4 Years

About The Job

We are looking for an experienced Databricks Data Engineer to design, develop, and manage data pipelines using Azure services such as Databricks, Data Factory, and Datalake. The role involves building scalable ETL solutions, collaborating with cross-functional teams, and processing large volumes of data. You will work closely with business and technical teams to deliver robust data models and transformations in support of analytics and reporting needs.

Know Your Team

At ValueMomentum’s Engineering Center, we are a team of passionate engineers who thrive on tackling complex business challenges with innovative solutions while transforming the P&C insurance value chain. We achieve this through strong engineering foundation and continuously refining our processes, methodologies, tools, agile delivery teams, and core engineering archetypes. Our core expertise lies in six key areas: Cloud Engineering, Application Engineering, Data Engineering, Core Engineering, Quality Engineering, and Domain expertise.

Join a team that invests in your growth. Our Infinity Program empowers you to build your career with role-specific skill development leveraging immersive learning platforms. You'll have the opportunity to showcase your talents by contributing to impactful projects.

Responsibilities

• Design and develop ETL pipelines using ADF for data ingestion and transformation.
• Collaborate with Azure stack modules like Data Lakes and SQL DW to handle large volumes of data.
• Write SQL, Python, and PySpark code to meet data processing and transformation needs.
• Understand business requirements and create data flow processes that meet them.
• Develop mapping documents and transformation business rules.
• Ensure continuous communication with the team and stakeholders regarding project status.
  
  

Requirements

• 3 -4 years of experience in data ingestion, data processing, and analytical pipelines for big data and relational databases.
• Extensive hands-on experience with Azure services: Databricks, Data Factory, ADLS, Synapse, and Azure SQL.
• Experience in SQL, Python, and PySpark for data transformation and processing.
• Strong understanding of DevOps, CI/CD deployments, and Agile methodologies.
• Strong communication skills and attention to detail.
• Experience in the insurance or financial industry is preferred.
  
  

About The Company

Headquartered in New Jersey, US, ValueMomentum is the largest standalone provider of IT Services and Solutions to Insurers. Our industry focus, expertise in technology backed by R&D, and our customer-first approach uniquely position us to deliver the value we promise and drive momentum to our customers’ initiatives. ValueMomentum is amongst the top 10 insurance-focused IT services firms in North America by number of customers. Leading Insurance firms trust ValueMomentum with their Digital, Data, Core, and IT Transformation initiatives.

Benefits

We at ValueMomentum offer you a congenial environment to work and grow in the company of experienced professionals. Some benefits that are available to you are:

• Competitive compensation package.
• Career Advancement: Individual Career Development, coaching and mentoring programs for professional and leadership skill development.
• Comprehensive training and certification programs.
• Performance Management: Goal Setting, continuous feedback and year-end appraisal. Reward & recognition for the extraordinary performers.