Chennai, Tamil Nadu, India
Information Technology
Full-Time
TeizoSoft Private Limited
Overview
Key Responsibilities
- Document data pipelines, processes, and infrastructure. -
Mandatory Skill Set
- Design, develop, and maintain scalable and efficient data pipelines using Python, Spark, and Airflow.
- Implement ETL/ELT processes to ingest, transform, and load data from various sources into Snowflake.
- Optimize data pipelines for performance, reliability, and maintainability.
- Troubleshoot and resolve data pipeline issues and performance bottlenecks.
- Design and implement data warehousing solutions using Snowflake.
- Manage and optimize AWS cloud infrastructure for data engineering tasks.
- Ensure data security and compliance with industry best practices.
- Implement and manage data governance and data quality processes.
- Lead and mentor a team of data engineers, providing technical guidance and support.
- Foster a collaborative and high-performance team environment.
- Conduct code reviews and ensure adherence to coding standards.
- Participate in recruitment and onboarding processes.
- Utilize DBT (Data Build Tool) for data transformation and modeling.
- Develop and maintain data models for analytical and reporting purposes.
- Ensure data consistency and accuracy across the data warehouse.
- Write complex SQL queries for data extraction, transformation, and analysis.
- Optimize SQL queries for performance and efficiency.
- Design and implement database schemas and data structures.
- Implement automation for data pipeline deployment and monitoring.
- Utilize Airflow for workflow orchestration and scheduling.
- Implement CI/CD pipelines for data engineering tasks.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.
- Document data pipelines, processes, and infrastructure. -
Mandatory Skill Set
- Python : Advanced proficiency in Python for data engineering tasks.
- Spark : Extensive experience with Apache Spark for large-scale data processing.
- SQL : Strong SQL skills for data manipulation and analysis.
- Snowflake : Proven experience in designing and implementing data warehousing solutions using Snowflake.
- Airflow : Experience with Apache Airflow for workflow orchestration.
- AWS : Hands-on experience with AWS cloud services related to data engineering.
- DBT (Data Build Tool) : Experience with DBT for data transformation and modeling.
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- Knowledge of data governance and data quality best practices.
- Experience with containerization (Docker, Kubernetes).
- Experience with real time data streaming.
- Experience with CI/CD tools.
- Experience with data visualization tools.
- Strong problem-solving and analytical skills.
- Excellent communication and interpersonal skills.
- Ability to work independently and as part of a team.
- Strong leadership and mentorship abilities.
- Ability to manage multiple projects and priorities.
- Strong understanding of software development lifecycle.
Similar Jobs
View All
16 Hours ago
MTS II - Software Engineer
Information Technology
- 4 - 7 Yrs
- Pune
MAJOR RESPONSIBILITIES
• Design, implement, integrate, and verify software applications and tools using JavaScript, NodeJS, and C++.
• Enhance, optimize, and improve the efficiency and robustness of current software, with a particular focus on OSS ...
2 Days ago
Business Advisory Analyst
Information Technology
- Bangalore, Karnataka, India
Skill required: Banking Services - Core BankingDesignation: Business Advisory AnalystQualifications:BBA/BCom/Master of Business AdministrationYears of Experience:3 to 5 yearsAbout AccentureAccenture is a global professional services company with lea...
2 Days ago
Front End Developer
Information Technology
- Bangalore, Karnataka, India
Position Title: Front End DeveloperCompany: Johnson Controls (JCI)Location: BangaloreJob Summary: We are seeking a talented Front End Developer with 4-7 years of experience to join our dynamic team. The ideal candidate will have a strong background ...
2 Days ago
Database Engineer III (Big Data)
Information Technology
- Bangalore, Karnataka, India
LivePerson (NASDAQ: LPSN) is the global leader in enterprise conversations. Hundreds of the world’s leading brands — including HSBC, Chipotle, and Virgin Media — use our award-winning Conversational Cloud platform to connect with millions of consume...
2 Days ago
Data Scientist Manager
Information Technology
- Bangalore, Karnataka, India
Job DescriptionLeads a team of people who design, develop and program methods, processes, and systems to consolidate and analyze unstructured, diverse “big data” sources to generate actionable insights and solutions for client services and product e...
2 Days ago
Data Scientist Manager
Information Technology
- Bangalore, Karnataka, India
Job DescriptionLeads a team of people who design, develop and program methods, processes, and systems to consolidate and analyze unstructured, diverse “big data” sources to generate actionable insights and solutions for client services and product e...
2 Days ago
Sr. QA Engineer
Information Technology
- Bangalore, Karnataka, India
Role Summary:Picarro is seeking an exceptional Sr. QA Engineer for functional testing of Picarro Analyzers. This role expects you to analyze requirements, create and execute test-plan, and record results in test-repo. This person is also expected to...
2 Days ago
C++ Graphics and Windowing System Software Engineer - Mir
Information Technology
- Bangalore, Karnataka, India
We build a high-performance, high-efficiency stack for window managers and display subsystems in C++, called Mir. We're growing the team and looking for new colleagues who share our passion for precision, performance and user experience.Our goal is ...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in