Free cookie consent management tool by TermsFeed Senior Data Engineer | Antal Tech Jobs
Back to Jobs
9 Weeks ago

Senior Data Engineer

decor
Banga, Punjab, India
Information Technology
Incture Technologies

Overview

Job Information

    Department

    Delivery

    Industry

    IT Services

    Date Opened

    02/14/2025

    Job Type

    Full time

    City

    Bangalore

    State/Province

    Karnataka

    Country

    India

    Zip/Postal Code

    560002

Job Description

Job Overview:

  • Develop data pipelines/data frameworks/applications/apis using industry best practices. Make adjustments to adapt to new methodologies that provide the business with increased flexibility and agility.
  • Drive Proof of Concept (POC) and Proof of Technology(POT) evaluations.
  • Build data system and data quality monitoring process and ensure health of the big data system.
  • Review KPIs, Monitoring and Alarms for successful production system.
  • Work with the stakeholders to understand the business & reporting needs – Propose, design and develop creative data solutions that provides required insight, improve/automate processes and adds value.
  • Influence and educate the team with your experience, idea and learning.
  • Stay current with the latest development tools, technology ideas, patterns and methodologies; share knowledge by clearly articulating results and ideas to key stakeholders.
  • Publish and update technical architecture and user/process documentation.

Job Requirements:

  • Bachelor’s degree in Computer Science or related technical field.
  • 4+ years of relevant experience on Scala/Python (PySpark), Distributed Databases, Kafka with solid hands-on multi-threading, functional programing etc.
  • A good understanding of CS Fundamentals, Data Structures, Algorithms and Problem Solving.
  • Professional hand-on experience in Sql and Query Optimization.
  • Experience in building frameworks for data ingestions and consumptions patterns.
  • Experience with Orchestration tools like Airflow ( perfered) , Automic , Autosys etc.
  • Hand-on experience in Data processing and Data manipulation.
  • Expertise with GCP cloud and GCP data processing tools, platforms and technologies like GCS, DataProc, DPaaS, BigQuery, Hive etc.
  • Experience with Streaming data via Kafka or structured streaming etc.
  • Exposure to lambda Architecture.
  • Exposure to visualization tools for data reporting such as Tableau, PowerBI, Looker etc.
  • Excellent communication skills for collaborating with teams.
  • Appreciate productivity and care deeply about helping others work more effectively and efficiently.

Mandatory Skills:

Scala/Python (Pyspark), Big Data Knowledge, Scripting (Shell/Python), GCP Data Tech Stack, Airflow, CICD, Kafka, Distributed Database, SQL/NoSQL

Share job
Similar Jobs
View All
1 Day ago
Test
Information Technology
  • 2,00,000 - 2,00,000 INR - Hourly
  • 5 - 5 Yrs
  • Bhopal
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco "Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do ei...
decor
1 Day ago
CSPL India - .Net Developer
Information Technology
  • Bangalore, Karnataka, India
Job SummaryWe are looking for a .NET Developer to join our team and drive the development of high-quality software solutions. The ideal candidate will have deep expertise in .NET Core and C#, along with strong experience in Microservices, Event-Driv...
decor
1 Day ago
Senior Full Stack Developer - Spring Boot/AngularJS
Information Technology
  • Bangalore, Karnataka, India
Position : Senior Full Stack DeveloperLocation : Chennai / LucknowExperience : 6+ years in IT (preferably in product-based companies)Education : Graduate degree from a recognized institutionJD SummaryWe're hiring a hands-on full stack developer with...
decor
1 Day ago
VAYUZ Technologies - Shopify Full Stack Developer
Information Technology
  • Bangalore, Karnataka, India
Job DescriptionKey Responsibilities : Develop, customize, and optimize Shopify stores, ensuring seamless UI/UX. Implement Shopify Liquid templates and themes to create responsive designs. Customize Shopify apps and integrations using RESTful APIs...
decor
1 Day ago
Interesting Job Opportunity: Technical Lead - MERN Stack
Information Technology
  • Bangalore, Karnataka, India
Job DescriptionRole : MERN full stack developer (Reactr.js + Node.js)Responsibilities Thorough understanding of React.js and its core principles Experience with popular React.js workflows (such as Flux or Redux) Strong proficiency in JavaScript, ...
decor
1 Day ago
Algoleap Technologies - Java Full Stack Developer
Information Technology
  • Bangalore, Karnataka, India
Job DescriptionWe are seeking a highly motivated and experienced Java Fullstack Developer to join our dynamic team. In this role, you will be instrumental in the full software development lifecycle, from conceptualization and design to implementatio...
decor
1 Day ago
Software Engineer in Bangalore
Information Technology
  • Bangalore, Karnataka, India
Key Responsibilities Work on building the enterprise product using ReactJS as a front-end. Handle the other front-end responsibilities. About Company: vBridge Hub is the 1st AI-enabled enterprise platform built for talent sourcing, screening, and...
decor
1 Day ago
Interesting Job Opportunity: Bharuwa Solutions - Java Developer - Spring Boot/Hibernate
Information Technology
  • Bangalore, Karnataka, India
Job DescriptionCandidates with 3+ years of experience in developing Java web applications, with good analytical skills and technical expertise in developing software products by using Java, Spring/Struts, Hibernate platforms, and the latest web tech...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media