Information Technology
Full-Time
Harbinger Group
Overview
Hinjewadi, Pune, Maharashtra, India
Department
Delivery Unit 4
Job posted on
Jan 17, 2025
Employment type
Third Party Contract
Position: Data Engineer
Experience - 5 to 7 Years
Work timing: Need to work from 1 pm to 10:30 pm to have overlap with the team in USA Eastern hours
Job Overview:
We are seeking a skilled Data Engineer to join team. In this role, you will design, implement, and maintain data pipelines and systems that ensure the efficient collection, storage, and processing of large datasets. You will collaborate with data scientists, analysts, and other stakeholders to ensure the smooth flow of data from various sources to ensure reliable insights.
Key Responsibilities:
- Data Pipeline Development: Design, implement, and optimize ETL (Extract, Transform, Load) processes to collect and process data from multiple sources.
- Data Architecture: Build and maintain scalable data architectures to support analytics and reporting needs.
- Database Management: Manage and optimize relational and NoSQL databases, ensuring high performance, scalability, and security.
- Data Integration: Integrate data from various sources, including APIs, databases, and external services, into centralized storage systems.
- Data Quality Assurance: Implement processes to ensure data accuracy, consistency, and completeness.
- Collaboration: Work closely with data scientists, analysts, and other teams to understand data requirements and deliver appropriate solutions.
- Optimization: Continuously improve the performance and scalability of data systems, ensuring low-latency and efficient data processing.
- Automation: Develop scripts and automation tools for data collection, processing, and reporting.
- Data Security & Compliance: Ensure that data systems comply with relevant privacy, security, and regulatory standards.
- Monitoring & Troubleshooting: Monitor data pipelines and systems for issues, troubleshoot failures, and ensure uptime.
Skills & Qualifications:
- Educational Background: Bachelor’s degree in computer science, Engineering, Information Technology, or a related field.
Experience:
oProven experience (3+ years) as a Data Engineer or in a similar role.
oExpertise in designing and managing ETL pipelines, data transformations data warehouses, report and dashboard development.
Technical Skills:
oProficiency in Python and SQL, writing stored procedures
oStrong understanding & experience of databases PostgreSQL, MongoDB and Snowflake star schema and data structures
oExperience with data modeling and data warehousing.
oExperience of using Streamlit
oKnowledge of version control systems (e.g., Git).
Tools:
oExperience with BI tools- Sisense and analytics platforms.
oFamiliar with containerization (Docker).
Soft Skills:
oStrong problem-solving skills and attention to detail.
oAbility to work in a team and collaborate across different departments.
oExcellent communication skills to convey technical concepts to non-technical stakeholders.
oA proactive approach to learning new tools, technologies, and methodologies.
Preferred Qualifications:
- Familiarity with cloud platforms (AWS) and their data-related services.
- Experience with machine learning data preparation and model deployment pipelines.
- Experience with DevOps or MLOps practices.
Similar Jobs
View All
15 Hours ago
MTS II - Software Engineer
Information Technology
- 4 - 7 Yrs
- Pune
MAJOR RESPONSIBILITIES
• Design, implement, integrate, and verify software applications and tools using JavaScript, NodeJS, and C++.
• Enhance, optimize, and improve the efficiency and robustness of current software, with a particular focus on OSS ...
2 Days ago
Business Advisory Analyst
Information Technology
- Bangalore, Karnataka, India
Skill required: Banking Services - Core BankingDesignation: Business Advisory AnalystQualifications:BBA/BCom/Master of Business AdministrationYears of Experience:3 to 5 yearsAbout AccentureAccenture is a global professional services company with lea...
2 Days ago
Front End Developer
Information Technology
- Bangalore, Karnataka, India
Position Title: Front End DeveloperCompany: Johnson Controls (JCI)Location: BangaloreJob Summary: We are seeking a talented Front End Developer with 4-7 years of experience to join our dynamic team. The ideal candidate will have a strong background ...
2 Days ago
Database Engineer III (Big Data)
Information Technology
- Bangalore, Karnataka, India
LivePerson (NASDAQ: LPSN) is the global leader in enterprise conversations. Hundreds of the world’s leading brands — including HSBC, Chipotle, and Virgin Media — use our award-winning Conversational Cloud platform to connect with millions of consume...
2 Days ago
Data Scientist Manager
Information Technology
- Bangalore, Karnataka, India
Job DescriptionLeads a team of people who design, develop and program methods, processes, and systems to consolidate and analyze unstructured, diverse “big data” sources to generate actionable insights and solutions for client services and product e...
2 Days ago
Data Scientist Manager
Information Technology
- Bangalore, Karnataka, India
Job DescriptionLeads a team of people who design, develop and program methods, processes, and systems to consolidate and analyze unstructured, diverse “big data” sources to generate actionable insights and solutions for client services and product e...
2 Days ago
Sr. QA Engineer
Information Technology
- Bangalore, Karnataka, India
Role Summary:Picarro is seeking an exceptional Sr. QA Engineer for functional testing of Picarro Analyzers. This role expects you to analyze requirements, create and execute test-plan, and record results in test-repo. This person is also expected to...
2 Days ago
C++ Graphics and Windowing System Software Engineer - Mir
Information Technology
- Bangalore, Karnataka, India
We build a high-performance, high-efficiency stack for window managers and display subsystems in C++, called Mir. We're growing the team and looking for new colleagues who share our passion for precision, performance and user experience.Our goal is ...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in