Hyderabad, Telangana, India
Information Technology
Paktolus
Overview
Responsibilities:
- Drive automation of infrastructure and deployment systems.
- Work within engineering teams to build data processing pipeline.
- Help team to automate data solutions.
- Build applications for next-gen data warehouse solutions.
- Collaborate with development teams to automate the configuration management, build, release, deployment, and monitoring processes.
- Build processes and methodologies to implement new solutions.
- Contribute and create a motivated work environment within the team.
- Mentor other team members and promote opportunities.
Requirements:
- Bachelor’s degree in fields of Computer Science, Statistics or an equivalent.
- Should have good understanding of Spark architecture and similar projects.
- Must have strong proficiency in Python with an emphasis in building data pipelines.
- Must have ability to write complex SQL to perform common types of analysis and aggregations.
- Must have experience in Airflow log management and log monitoring.
- Should have worked with integration Spark workloads on Airflow.
- Should have acumen to optimize and better manage Spark workloads by designing efficient DAGs.
- Should have worked on big data ecosystem and possess experience in storage, processing, and management of large data volumes.
- Should have worked with AWS data analytics tools like Glue, EMR, Athena, Kinesis.
- Should have working knowledge of delta lake, Apache Hudi and tools alike.
- Should have good understanding of deploying functions and building backend applications using AWS Lambda, API Gateways, or equivalent tools.
- Should have experience developing data driven applications with either of Scala or Python.
- Should have experience of SDLC
- Should have knowledge in version control tools like GitHub, TFS, Code Commit.
- Knowledge of Docker and Kubernetes is a plus.
- Should have experience working with large scale distributed systems and service-oriented architectures.
- Should have working experience with one of the tools like Snowflake, Redshift or Databricks SQL Analytics.
- AWS certification is a plus.
- Should possess good communication skills and ability to interact with stakeholders.
Similar Jobs
View All
1 Day ago
Lead Big Data Solution Engineer
Finance & Banking
- Delhi, Delhi, India
QualificationRequired Proven hands-on experience on designing, developing and supporting Database projects for analysis in a demanding environment. Proficient in database design techniques – relational and dimension designs Experience and a strong u...
1 Day ago
Performance Test Lead
Finance & Banking
- Delhi, Delhi, India
Job Title : Performance Test LeadCompany : QualiZealLocation : Hyderabad, IndiaJob Type : Contract to Hire (C2H) Work from OfficeExperience Required : 8+ YearsNotice Period : Immediate Joiners PreferredAbout QualiZealAt QualiZeal, we are committed t...
1 Day ago
Technical Support Engineer
Finance & Banking
- Delhi, Delhi, India
Join Us as a Technical Support Engineer!Are you passionate about helping others and solving technical challenges? At ORBCOMM, we’re looking for a Technical Support Engineer to join our global support team. In this role, you’ll be the first line of s...
1 Day ago
Senior Data Analyst
Finance & Banking
- Delhi, Delhi, India
hackajob is collaborating with OneAdvanced to connect them with exceptional tech professionals for this role.Role IntroductionWe are looking for a highly motivated individual with strong organizational and technical skills for the position of Senior...
1 Day ago
Senior Python Developer - Backend Technologies
Finance & Banking
- Delhi, Delhi, India
Job DescriptionWe are seeking a Senior Python Developer with a strong background in back-end web development and a proven track record in client-facing roles within IT service organizations. The ideal candidate will bring a blend of technical expert...
1 Day ago
Data Analyst - Intern-4
Finance & Banking
- Delhi, Delhi, India
If you are a passionate and self-motivated individual who wants to make a difference in the field ofinnovative, next generation healthcare products we are looking for you! Join our Data & Analyticsteam and help us to delivering the most critical ins...
1 Day ago
Junior .NET Developer in Indore, Ratlam, Narmadapuram, Ujjaini, Bhopal, Dewas
Finance & Banking
- Delhi, Delhi, India
Key Responsibilities Develop and maintain applications by writing clean, efficient, and maintainable code using C# (.NET Core) for the backend and AngularJS for the frontend. Implement new features and functionalities based on project requirements....
1 Day ago
Xenovex Technologies - Lead Full Stack Developer - .Net/AngularJS
Finance & Banking
- Delhi, Delhi, India
Job Title : .NET Developer (Junior and Senior)Location : ChennaiJob Type : Full-timeExperience : 1 to 10 years or aboveDepartment : Software Development / EngineeringJob SummaryWe are seeking a Senior Technical Lead Full Stack Developer with str...
Talk to us
Feel free to call, email, or hit us up on our social media accounts.
Email
info@antaltechjobs.in