Who are we?

About LittleBig Connection

The world of work has been transforming at an incredible speed. Today, companies must not only adapt to keep pace with change – they have to get ahead of the game. They need to function as integrated organizations, positioning the best talent at the heart of each project to leverage the right skills at the right time.

LittleBig Connection is the solution that connects big companies with external experts looking for the best projects available.

We create a direct and transparent link between all companies and stakeholders, big and little, so they can team up more easily than ever before.

How do we do it?
Through our platform, which allows:

• Clients to publish on our marketplace all their requirements (RFPs) for external consulting services.

- Over 500,000 Consulting companies, IT Vendors, freelancers etc to identify their next projects and submit their consultants/candidates profile. - The whole ecosystem to collaborate from Sourcing to Payment digitally (legal support, performance monitoring tools, timesheets, invoicing etc.)

As the leading international player in its industry, LittleBig Connection supports 280 major clients such as AXA, Carrefour, Sephora, Decathlon, Air France or Kering in their Big innovation projects and flexibility needs. With the ambition to become the international leader of Total Workforce Management by 2025, LittleBig Connection is present in 25 countries around the world and has no intention of stopping there: Canada, India, Vietnam, Spain, Mauritius, Tunisia... the #FutureofWork is already here! Are you ready for the adventure?

Why join LittleBig Connection?

?? Thrive in the new digital business world

Lead high value-added strategic projects with a concrete business impact

Experience working in a young and international atmosphere, with colleagues on all 5 continents

Benefit from a flexible work environment with remote working options ‍ ‍

Access a variety of training courses and continuously improve your skills

Take part in the events organized by our LittleBig Crew: work socials team building events... moments you won't want to miss!

Job description

Your LittleBig responsibilities

At LittleBig Connection, we are committed to transforming data into actionable insights and enabling scalable AI solutions. We are currently building a centralized AI + Data platform within Azure to unify our data pipelines and AI model workflows, and we are seeking a highly skilled Senior Data Engineer to join our dynamic team. This role is pivotal in establishing a robust ETL framework and scalable infrastructure to support AI-driven decision-making and business analytics.

Key Responsibilities:

• ETL Development and Data Pipeline Management

• Design, build, and maintain scalable ETL workflows to automate data ingestion, transformation, and storage in Azure DataLake Storage.
• Implement robust data cleaning and transformation pipelines in PySpark and Python, adhering to defined quality and compliance criteria.
• Ensure data integrity through comprehensive quality checks, schema validation, and monitoring mechanisms.

• Data Architecture and Governance

• Define and implement best practices for data governance, including anonymization, schema standardization, and monitoring of data quality.
• Address country-specific data compliance requirements, ensuring adherence to local data residency laws and regulations.
• Develop mechanisms to manage and flag product-specific data for streamlined analysis.

• Collaboration and Integration

• Work closely with Data Scientists, Analysts, and Engineers to optimize data pipelines for AI model training and deployment.
• Collaborate with stakeholders to identify data requirements and ensure the pipelines align with business needs.
• Develop APIs and endpoints for data access and integration with AI microservices and business applications.

• Platform and Infrastructure Management

• Leverage Azure Databricks to build and maintain a unified data platform for end-to-end workflows.
• Integrate tools for data pipeline and model training monitoring, versioning, and tracking metrics.
• Monitor performance, troubleshoot issues, and implement improvements to enhance pipeline efficiency and scalability.

• Technical Leadership

• Mentor junior team members and foster a culture of technical excellence and innovation.
• Stay current with industry trends and emerging technologies and drive their adoption within the team.

Candidate Profile

• Education: Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.

• Experience: Minimum of 4-5 years of experience in data engineering, with at least 2 years working in Azure ecosystems.

• Technical Skills:

• Advanced proficiency in Python and PySpark for data processing.
• Extensive experience with Azure services, particularly Azure DataLake Storage, Databricks, and related analytics tools.
• Strong understanding of ETL frameworks and best practices.
• Hands-on experience with data governance tools and processes, including schema validation and anonymization techniques.
• Familiarity with database technologies such as MySQL and MongoDB.
• Experience with compliance implementation for data residency laws.

• Soft Skills:

• Excellent problem-solving and troubleshooting skills.
• Strong communication skills with the ability to convey technical concepts to non-technical stakeholders.
• Leadership skills to guide and mentor team members while collaborating across teams.