Senior Kafka DevOps Engineer

Overview

Company: Shivaay
Location: On-Site
Working Hours: 10:00 PM – 7:00 AM (Sunday to Friday)
Off Days: Saturday off, 2nd and 4th Sunday off

About Us

Shivaay is a forward-thinking company specializing in delivering robust, data-driven solutions. We’re looking for a Senior Kafka DevOps Engineer with a passion for building and maintaining highly scalable, event-driven systems. Join us to work on cutting-edge projects and help shape the future of our technology stack.

Responsibilities

• Kafka Administration & Maintenance
• Install, configure, and maintain Apache Kafka clusters.
• Ensure high availability, scalability, and resilience of Kafka environments.
• Monitor performance, troubleshoot issues, and optimize Kafka components.
• DevOps & Automation
• Develop and maintain CI/CD pipelines to automate build, test, and deployment processes.
• Implement infrastructure-as-code best practices using tools such as Terraform or Ansible.
• Collaborate with cross-functional teams to standardize deployment workflows and automate repetitive tasks.
• System Monitoring & Alerting
• Utilize monitoring tools (e.g., Prometheus, Grafana, Elasticsearch) to track system metrics and KPIs.
• Configure alerts and proactively address production issues to minimize downtime.
• Security & Compliance
• Implement robust security measures and data encryption within Kafka environments.
• Collaborate with the security team to enforce compliance and protect sensitive data.
• Documentation
• Create and maintain clear technical documentation, including runbooks, standard operating procedures, and architecture diagrams.
• Contribute to best practice guidelines for Kafka and DevOps processes.
• Collaboration & Mentoring
• Work closely with software engineers, QA, and system administrators to meet overall project goals.
• Mentor junior team members, conduct code and infrastructure reviews, and share knowledge of Kafka and DevOps practices.

Qualifications

• Experience
• Minimum 3-5 years of hands-on experience in managing Apache Kafka in production.
• Proven track record of implementing DevOps methodologies in complex environments.
• Technical Skills
• Kafka: In-depth knowledge of Kafka architecture, brokers, topics, consumer groups, and partition strategies.
• DevOps: Proficiency with CI/CD tools (Jenkins, GitLab CI, etc.) and configuration management (Chef, Puppet, Ansible).
• Infrastructure: Experience with cloud platforms (AWS, Azure, or GCP) and container orchestration (Docker, Kubernetes).
• Scripting: Strong scripting skills (Bash, Python, or similar) for automation and system management.
• Soft Skills
• Strong analytical and problem-solving abilities.
• Excellent communication and collaboration skills.
• Ability to work effectively during night shifts and coordinate with distributed teams.

What We Offer

• Competitive salary and comprehensive benefits package.
• Opportunities for professional growth and learning in a dynamic work environment.
• A culture that promotes collaboration, innovation, and continuous improvement.
• On-site facilities and resources to support you during night shifts.

Work Schedule

• Days: Sunday to Friday (2nd and 4th Sunday off)
• Hours: 10:00 PM – 7:00 AM
• Off: Saturday off, plus 2nd and 4th Sunday off

Job Types: Full-time, Permanent

Pay: ₹50,000.00 - ₹120,000.00 per month

Schedule:

• Night shift

Application Question(s):

• Apply only if you are willing to work from the office during night shifts. Type "yes" if you accept.
• In how many days will you able to join if we select you

Experience:

• DevOps: 3 years (Preferred)
• Kafka: 1 year (Preferred)

Work Location: In person