Free cookie consent management tool by TermsFeed Data Engineer | Antal Tech Jobs
Back to Jobs
1 Week ago

Data Engineer

decor
Bangalore, Karnataka, India
Information Technology
Full-Time
Cognizant

Overview

Role: Data Engineer

Experience: 7 to 9 years

Skills: Databricks SQL, Databricks Delta Lake, Databricks Workflows, PySpark, Amazon S3, and Amazon Redshift

Responsibility

  • Design and implement data pipelines, ETL processes, and data storage solutions that support data-intensive applications(4+ Years)
  • Develop, test, and maintain architectures such as databases and large-scale data processing systems using tools such as Spark, Databricks and SQL (4+ Years)
  • Solid in Java/Python, Datastructure and Algorithms (4+)
  • Experience designing and delivering Transactional, Warehouse, Analytical and Reporting Data Platforms leveraging modern cloud data technologies (3+ years)
  • Experience in cloud development with the AWS platform (3+ years)
  • Experience in an Agile/Scrum team environment (2+ years)
  • Develop and maintain data pipelines using PySpark to ensure efficient data processing.
  • Implement and manage data storage solutions using Amazon S3 and Amazon Redshift.
  • Utilize Databricks SQL to perform complex data queries and generate actionable insights.
  • Oversee the integration of Databricks Delta Lake for optimized data storage and retrieval.
  • Design and automate workflows using Databricks Workflows to streamline data operations.
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions.
  • Ensure data quality and integrity through rigorous testing and validation processes.
  • Provide technical support and troubleshooting for data-related issues.
  • Lead the development of data models and schemas to support business analytics.
  • Conduct performance tuning and optimization of data processing tasks.
  • Stay updated with the latest industry trends and technologies to enhance data solutions.
  • Document all development processes and maintain comprehensive technical documentation.
  • Mentor junior developers and provide guidance on best practices.
Share job
Similar Jobs
View All
15 Hours ago
MTS II - Software Engineer
Information Technology
  • 4 - 7 Yrs
  • Pune
MAJOR RESPONSIBILITIES • Design, implement, integrate, and verify software applications and tools using JavaScript, NodeJS, and C++. • Enhance, optimize, and improve the efficiency and robustness of current software, with a particular focus on OSS ...
decor
2 Days ago
Business Advisory Analyst
Information Technology
  • Bangalore, Karnataka, India
Skill required: Banking Services - Core BankingDesignation: Business Advisory AnalystQualifications:BBA/BCom/Master of Business AdministrationYears of Experience:3 to 5 yearsAbout AccentureAccenture is a global professional services company with lea...
decor
2 Days ago
Front End Developer
Information Technology
  • Bangalore, Karnataka, India
Position Title: Front End DeveloperCompany: Johnson Controls (JCI)Location: BangaloreJob Summary: We are seeking a talented Front End Developer with 4-7 years of experience to join our dynamic team. The ideal candidate will have a strong background ...
decor
2 Days ago
Database Engineer III (Big Data)
Information Technology
  • Bangalore, Karnataka, India
LivePerson (NASDAQ: LPSN) is the global leader in enterprise conversations. Hundreds of the world’s leading brands — including HSBC, Chipotle, and Virgin Media — use our award-winning Conversational Cloud platform to connect with millions of consume...
decor
2 Days ago
Data Scientist Manager
Information Technology
  • Bangalore, Karnataka, India
Job DescriptionLeads a team of people who design, develop and program methods, processes, and systems to consolidate and analyze unstructured, diverse “big data” sources to generate actionable insights and solutions for client services and product e...
decor
2 Days ago
Data Scientist Manager
Information Technology
  • Bangalore, Karnataka, India
Job DescriptionLeads a team of people who design, develop and program methods, processes, and systems to consolidate and analyze unstructured, diverse “big data” sources to generate actionable insights and solutions for client services and product e...
decor
2 Days ago
Sr. QA Engineer
Information Technology
  • Bangalore, Karnataka, India
Role Summary:Picarro is seeking an exceptional Sr. QA Engineer for functional testing of Picarro Analyzers. This role expects you to analyze requirements, create and execute test-plan, and record results in test-repo. This person is also expected to...
decor
2 Days ago
C++ Graphics and Windowing System Software Engineer - Mir
Information Technology
  • Bangalore, Karnataka, India
We build a high-performance, high-efficiency stack for window managers and display subsystems in C++, called Mir. We're growing the team and looking for new colleagues who share our passion for precision, performance and user experience.Our goal is ...
decor

Talk to us

Feel free to call, email, or hit us up on our social media accounts.
Social media