Chennai, Tamil Nadu, India
Information Technology
Full-Time
Uber
Overview
About The Role
Uber's business relies on insights derived from real-time data by using Streaming Analytics. Our team built two streaming platforms, AthenaX and Flink as a Service (FaaS) on top of Apache Flink that powers many core trip flow applications with 4 9 availability and sub second latency, such as surge pricing for marketplace, push notifications to Apps, ETA calculations for maps.
Our team has grown a lot in the last few years (currently 2K+ yarn nodes, 2800+ pipelines). As part of the Athena team, you will design, implement, optimize, and manage large scale streaming computing infrastructure. You will work on problems like unification of stream and batch, common DSL for streaming analytics, streaming ingestion for data lake, and minimum downtime support that will impact multiple business use cases at Uber scale. At the same time, you will also have the opportunity to collaborate with the open source community for Flink, Presto, Pinot, and Kafka.
What the Candidate Will Do
Learn the internals of big data infrastructure at Uber scale.
Deep-Dive, the internal of Apache Flink, improves the platform usability and efficiency by building Presto SQL top of Flink, optimizing on the runtime, data delivery completeness, unifying streaming and batch processing top of Flink.
Design and implement distributed algorithms for streaming engine reliability to achieve zero downtime for critical use cases.
Work with multiple partner teams within and outside of Uber and build cross-functional solutions in a collaborative work environment.
Be actively involved in the Flink open source community by making code contributions, giving talks, and participating in community activities.
5+ years of total experience Solid understanding of Java for backend / systems software development.
2+ years of experience building large scale distributed software systems. Experience managing streaming processing systems with a strong availability SLA.
Experience working with Apache Flink, Apache Samza/Storm, Apache Calcite, Apache Spark or similar analytics technologies.
Experience working with SQL Compiler, SQL Plan / Runtime Optimization. Experience working with Large Scale distributed systems, HDFS / Yarn / Kubernetes
Uber's business relies on insights derived from real-time data by using Streaming Analytics. Our team built two streaming platforms, AthenaX and Flink as a Service (FaaS) on top of Apache Flink that powers many core trip flow applications with 4 9 availability and sub second latency, such as surge pricing for marketplace, push notifications to Apps, ETA calculations for maps.
Our team has grown a lot in the last few years (currently 2K+ yarn nodes, 2800+ pipelines). As part of the Athena team, you will design, implement, optimize, and manage large scale streaming computing infrastructure. You will work on problems like unification of stream and batch, common DSL for streaming analytics, streaming ingestion for data lake, and minimum downtime support that will impact multiple business use cases at Uber scale. At the same time, you will also have the opportunity to collaborate with the open source community for Flink, Presto, Pinot, and Kafka.
What the Candidate Will Do
Learn the internals of big data infrastructure at Uber scale.
Deep-Dive, the internal of Apache Flink, improves the platform usability and efficiency by building Presto SQL top of Flink, optimizing on the runtime, data delivery completeness, unifying streaming and batch processing top of Flink.
Design and implement distributed algorithms for streaming engine reliability to achieve zero downtime for critical use cases.
Work with multiple partner teams within and outside of Uber and build cross-functional solutions in a collaborative work environment.
Be actively involved in the Flink open source community by making code contributions, giving talks, and participating in community activities.
- Basic Qualifications
5+ years of total experience Solid understanding of Java for backend / systems software development.
- Preferred Qualifications
2+ years of experience building large scale distributed software systems. Experience managing streaming processing systems with a strong availability SLA.
Experience working with Apache Flink, Apache Samza/Storm, Apache Calcite, Apache Spark or similar analytics technologies.
Experience working with SQL Compiler, SQL Plan / Runtime Optimization. Experience working with Large Scale distributed systems, HDFS / Yarn / Kubernetes
Similar Jobs
View All
11 Hours ago
MTS II - Software Engineer
Information Technology
- 4 - 7 Yrs
- Pune
MAJOR RESPONSIBILITIES
• Design, implement, integrate, and verify software applications and tools using JavaScript, NodeJS, and C++.
• Enhance, optimize, and improve the efficiency and robustness of current software, with a particular focus on OSS ...
1 Day ago
Business Advisory Analyst
Information Technology
- Bangalore, Karnataka, India
Skill required: Banking Services - Core BankingDesignation: Business Advisory AnalystQualifications:BBA/BCom/Master of Business AdministrationYears of Experience:3 to 5 yearsAbout AccentureAccenture is a global professional services company with lea...
1 Day ago
Front End Developer
Information Technology
- Bangalore, Karnataka, India
Position Title: Front End DeveloperCompany: Johnson Controls (JCI)Location: BangaloreJob Summary: We are seeking a talented Front End Developer with 4-7 years of experience to join our dynamic team. The ideal candidate will have a strong background ...
1 Day ago
Database Engineer III (Big Data)
Information Technology
- Bangalore, Karnataka, India
LivePerson (NASDAQ: LPSN) is the global leader in enterprise conversations. Hundreds of the world’s leading brands — including HSBC, Chipotle, and Virgin Media — use our award-winning Conversational Cloud platform to connect with millions of consume...
1 Day ago
Data Scientist Manager
Information Technology
- Bangalore, Karnataka, India
Job DescriptionLeads a team of people who design, develop and program methods, processes, and systems to consolidate and analyze unstructured, diverse “big data” sources to generate actionable insights and solutions for client services and product e...
1 Day ago
Data Scientist Manager
Information Technology
- Bangalore, Karnataka, India
Job DescriptionLeads a team of people who design, develop and program methods, processes, and systems to consolidate and analyze unstructured, diverse “big data” sources to generate actionable insights and solutions for client services and product e...
1 Day ago
Sr. QA Engineer
Information Technology
- Bangalore, Karnataka, India
Role Summary:Picarro is seeking an exceptional Sr. QA Engineer for functional testing of Picarro Analyzers. This role expects you to analyze requirements, create and execute test-plan, and record results in test-repo. This person is also expected to...
1 Day ago
C++ Graphics and Windowing System Software Engineer - Mir
Information Technology
- Bangalore, Karnataka, India
We build a high-performance, high-efficiency stack for window managers and display subsystems in C++, called Mir. We're growing the team and looking for new colleagues who share our passion for precision, performance and user experience.Our goal is ...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in