Senior Data Engineer

Overview

RESPONSIBILITIES

• Designing and implementing data pipelines to collect, clean, and transform data from various sources
• Building and maintaining data storage and processing systems, such as databases, data warehouses, and data lakes
• Ensuring data is properly secured and protected
• Developing and implementing data governance policies and procedures
• Collaborating with business analysts, data analysts, data scientists, and other stakeholders to understand their data needs and ensure they have access to the data they need
• Sharing knowledge with the wider business, working with other BA’s and technology teams to make sure processes and ways of working is documented.
• Collaborate with Big Data Solution Architects to design, prototype, implement, and optimize data ingestion pipelines so that data is shared effectively across various business systems.
• Ensure the design, code and procedural aspects of solution are production ready, in terms of operational, security and compliance standards.
• Participate in day-to-day project and agile meetings and provide technical support for faster resolution of issues.
• Clearly and concisely communicating to the business, on status of items and blockers.
• Have an end-to-end knowledge of the data landscape within Lebara.

SKILLS & EXPERINCES

• 6+ years of design & development experience with big data technologies like Azure, AWS or GCP
• Preferred is Azure & Databricks, with experience in Azure DevOps
• Experience in data visualising technology in DL, like PowerBI
• Proficient in Python, PySpark and SQL
• Proficient in querying and manipulating data from various DB (relational and big data).
• Experience of writing effective and maintainable unit and integration tests for ingestion pipelines.
• Experience of using static analysis and code quality tools and building CI/CD pipelines.
• Excellent communication, problem-solving, and leadership skills, and be able to work well in a fast-paced, dynamic environment.

ROLE PURPOSE

We are undertaking a Data Transformation at Lebara and as data becomes fundamental to what we are doing, the ability to have the right data in the right place at the right time, that is accurate and consistent is essential.

The purpose of this job is to have a Senior Data Engineer resource that can participate in day-to-day QA activities like, testing sprint tickets, providing the updates on the assigned tickets, to improve your knowledge on the relevant domain. You need to be passionate enough to think & perform out of the box, to add innovation to improve your daily task and work FAST (Frequently discussed, Ambitious, Specific & Transparent). You will be the part of Lebara Data Lake Team. Need to have the clarity on the domain to understand the platform principles to achieve operational excellence for every change.

Job Types: Full-time, Permanent

Pay: Up to ₹250,000.00 per month

Benefits:

• Health insurance
• Provident Fund

Schedule:

• Day shift
• Fixed shift
• Monday to Friday

Supplemental Pay:

• Performance bonus
• Yearly bonus

Work Location: Remote

Expected Start Date: 01/04/2025