Free cookie consent management tool by TermsFeed Senior Data Engineer | Antal Tech Jobs
Back to Jobs
4 Weeks ago

Senior Data Engineer

decor
Kolkata, West Bengal, India
Information Technology
Full-Time
Ollion

Overview

OUR STORY

Let’s be honest: there are lots of people out there doing what we do. We’re just not convinced they’re doing it right. Businesses are hungry for innovation and opportunity, but not at the cost of their independence. At Ollion, we’ve connected companies and capabilities around the world to help ambitious organizations make the most of their transformation and leave the status quo in the dust.

WORKING AT OLLION

Innovation is risky. It demands bold steps and big questions, but that’s the price of making change. We’ve got our head in the cloud and two feet on the ground, channeling tech’s endless potential towards a single goal: making a world of difference. And we’re building a global team to do just that— a team capable of making game-changing breakthroughs without ever losing sight of the people it will impact. This is more than consulting. This is the change you can be.

THE OLLION DIFFERENCE

At Ollion, we’re all in on your independence. Our teams are seasoned. Our solutions are straightforward—sometimes even groundbreaking. And our engagements? Exactly as long as you want them to be. We deliver fresh thinking and hard-earned insight in a way that works for you and your customers, arming your organization with everything you need to make your transformation truly mean something.

WORKING WITH OLLION (our clients’ experiences)

Progress matters more than process. Our global team of cloud-native pros is all about creating new and better ways to work—not just by solving your tech challenges, but by using technology to solve your business challenges. We keep the formulas, frameworks, and ten-point plans to a minimum, tackling your most pressing problems with a proprietary mix of good-old-fashioned ingenuity and refreshing humanity.

DIVERSITY AT OLLION

One of our cultural keystones, ‘Find the angle’ recognizes that every individual has different aspirations, needs and brings a unique perspective.

We value diversity, inclusion, and equity (DE&I) as core to our success. We believe that a diverse workforce brings together unique perspectives, experiences, and ideas, leading to innovation, creativity, and better outcomes for our clients and our organization. We are on a journey and are committed to building a workplace that celebrates and respects individuals from all backgrounds, including but not limited to race, ethnicity, gender, sexual orientation, age, disability, and cultural heritage.

As our commitment to diversity and inclusion is reflected in our:

  • Awareness and sensitisation programs: to create awareness and sensitisation. We encourage open dialogue, active listening, and mutual respect, creating a safe and supportive environment for everyone to contribute their unique perspectives and ideas.
  • Dedicated efforts to building diverse teams: that leverage the strength of our differences to tackle complex challenges and drive innovation. By embracing diversity, we broaden our collective knowledge, enhance problem-solving capabilities, and unlock limitless potential for our employees.

Job Description

Job Overview

The Senior Data Engineering Consultant will be responsible for requirements gathering, solutioning, designing and building modern data platforms to support data-driven decision making. The Engineer will execute technical implementation of data engineering and visualization projects, and will be a hands-on role.

The Senior Data Engineering Consultant will help build a data and analytics consulting practice by taking part in recruiting efforts, creating technical collateral, and staying on top of technology trends with ongoing training and certifications. The entire consulting team will be responsible for building long-term strategic relationships with clients and participating in all aspects of project delivery

Key Responsibilities

  • Lead and drive discovery sessions with external clients and build state-of-the-art data architectures. Work with stakeholders to understand their problem statements, data requirements and implement solutions that meet their needs.
  • Design, implement, and develop data pipelines to collect and process large amounts of data from various sources.
  • Implement data storage solutions that are scalable, secure, and efficient, such as data warehouses and databases.
  • Develop and implement data validation and testing processes to ensure that data is processed accurately and efficiently.
  • Automate data collection, processing, and reporting processes to minimize manual work and improve efficiency.
  • Create high quality documents to capture problem statements, requirements, solutions and designs.
  • Support pre-sales activities, including whiteboard sessions, collaborating on solution architecture design, and assisting in proposal and statement of work creation.
  • Contribute to the development of reusable, repeatable collateral for use across the practice.
  • Obtain / maintain training and certification in cloud technologies.
  • Work with the marketing team to produce content to promote the practice across the region.

Qualifications

Key Requirements

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • 7-9 years of data engineering experience in data management, database architecture, data engineering, or data visualization.
  • Excellent problem-solving, organization, debugging, and analytical skills.
  • Ability to work independently and in a team environment.
  • Excellent communication skills for effectively expressing ideas to team members and clients.
  • Strong experience in Integrating with multiple data sources with both structured and unstructured data in both batch and streaming modes
  • Knowledge of cloud computing platforms, such as Amazon Web Services (AWS), Google Cloud Platform (GCP), or Microsoft Azure.
  • Experience building data pipelines with ETL tools/Equivalent Cloud services, such as Azure Data Factory, AWS Glue or equivalent.
  • Familiarity with data warehousing solutions, such as Snowflake, Google BigQuery, Databricks & Azure Synapse.
  • Experience with at least one programming language, such as Python, Java, or Scala.
  • Experience in at least one RDBMS (MSSQL/MySQL/Oracle/PostgreSQL)
  • Experience in at least one NoSQL databases (MongoDB/Cassandra/BigTable).
  • Strong Experience in Orchestration tools such as Apache Airflow/Nifi/ equivalent cloud native services
  • Strong skills in Apache Spark/Flink/Beam
  • Experience in designing, implementing, and managing event-driven data pipelines using Kafka or similar cloud-native streaming services like AWS Kinesis, Azure Event Hubs, or Google Cloud Pub/Sub.
  • Experience with visualization tools, such as Power BI, Looker, Tableau, and QuickSight.
  • Familiarity with Docker and Kubernetes
  • Debug and optimize existing data infrastructure and processes as needed.
  • Familiarity with version control systems, particularly Git, for managing code repositories, branching strategies, and collaborative development workflows.

Nice To Have

  • Experience building large-scale, high throughput, 24x7 data systems.
  • Any data engineering, visualization, or data science certifications on any of the clouds.
  • Exposure to machine learning algorithms, AI, and/or LLM, with implementation in practice.
  • Experience with legacy data systems (e.g. Hadoop, Informatica).
  • Experience with CI/CD concepts and tools for automating data pipeline deployments, testing, and version control, such as Jenkins, GitLab CI, Azure DevOps, or similar platforms
  • Experience with Data Quality frameworks and Data Governance tools such as Alation/Collibra/DataPlex

Additional Information

BENEFITS & PERKS FOR WORKING AT OLLION

Our employees multiply their potential because they have opportunities to: Create a lasting Impact, Learn and Grow professionally & personally, Experience great Culture, and Be your Whole Self!

Beyond an amazing, collaborative work environment, great people, and inspiring, innovative work, we have some great benefits and perks:

  • Benchmarked, competitive, in-market total rewards package including (but not limited to): base salary & short-term incentive for all employees
  • Fully remote-first, small but Global organization; ‘learn wherever, whenever’ frees our people from a rigid view of learning and growth
  • Retirement planning (i.e. CPF, EPF, company-matched 401(k))
  • Globally, we build benefit plans that offer choices for whatever stage in life our employees are in and allow for flexibility as life happens. Employees have access to a fully comprehensive benefits package to choose the medical, dental, and vision insurance plan that best fits their lives. In addition to great healthcare coverage, we also offer all employees mental health resources and additional wellness programs.
  • Generous time off and leave allowances
  • And more!

Ollion is an equal opportunity employer. We celebrate diversity and we are committed to creating an inclusive environment for all employees. Ollion does not discriminate in employment on the basis of race, color, religion, sex (including pregnancy and gender identity), national origin, political affiliation, sexual orientation, marital status, disability, genetic information, age, membership in an employee organization, parental status, military service, or other non-merit factor.

Share job
Similar Jobs
View All
4 Hours ago
MTS II - Software Engineer
Information Technology
  • 4 - 7 Yrs
  • Pune
MAJOR RESPONSIBILITIES • Design, implement, integrate, and verify software applications and tools using JavaScript, NodeJS, and C++. • Enhance, optimize, and improve the efficiency and robustness of current software, with a particular focus on OSS ...
decor
1 Day ago
Business Advisory Analyst
Information Technology
  • Bangalore, Karnataka, India
Skill required: Banking Services - Core BankingDesignation: Business Advisory AnalystQualifications:BBA/BCom/Master of Business AdministrationYears of Experience:3 to 5 yearsAbout AccentureAccenture is a global professional services company with lea...
decor
1 Day ago
Front End Developer
Information Technology
  • Bangalore, Karnataka, India
Position Title: Front End DeveloperCompany: Johnson Controls (JCI)Location: BangaloreJob Summary: We are seeking a talented Front End Developer with 4-7 years of experience to join our dynamic team. The ideal candidate will have a strong background ...
decor
1 Day ago
Database Engineer III (Big Data)
Information Technology
  • Bangalore, Karnataka, India
LivePerson (NASDAQ: LPSN) is the global leader in enterprise conversations. Hundreds of the world’s leading brands — including HSBC, Chipotle, and Virgin Media — use our award-winning Conversational Cloud platform to connect with millions of consume...
decor
1 Day ago
Data Scientist Manager
Information Technology
  • Bangalore, Karnataka, India
Job DescriptionLeads a team of people who design, develop and program methods, processes, and systems to consolidate and analyze unstructured, diverse “big data” sources to generate actionable insights and solutions for client services and product e...
decor
1 Day ago
Data Scientist Manager
Information Technology
  • Bangalore, Karnataka, India
Job DescriptionLeads a team of people who design, develop and program methods, processes, and systems to consolidate and analyze unstructured, diverse “big data” sources to generate actionable insights and solutions for client services and product e...
decor
1 Day ago
Sr. QA Engineer
Information Technology
  • Bangalore, Karnataka, India
Role Summary:Picarro is seeking an exceptional Sr. QA Engineer for functional testing of Picarro Analyzers. This role expects you to analyze requirements, create and execute test-plan, and record results in test-repo. This person is also expected to...
decor
1 Day ago
C++ Graphics and Windowing System Software Engineer - Mir
Information Technology
  • Bangalore, Karnataka, India
We build a high-performance, high-efficiency stack for window managers and display subsystems in C++, called Mir. We're growing the team and looking for new colleagues who share our passion for precision, performance and user experience.Our goal is ...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media