Data Engineer

Job Title: Data Engineer

Experience: 7-8 Years
Hybrid (Bangalore)

1. Programming Languages

• 
  Proficiency in Python for automating processes and supporting services.
• 
  Shell scripting for task automation and system-level troubleshooting.

2. ETL Tools

• Experience with ETL tools like Informatica Cloud.
• 
  Ability to manage and optimize data extraction, transformation, and loading (ETL) processes.

3. SQL and Data Querying

• Strong SQL skills for querying data, creating custom checks, and monitoring services.

4. Data Pipeline Management

• Experience managing and monitoring data pipelines in various environments (upstream, batch, streaming).
• 
  Familiarity with pipeline orchestration tools like Luigi or Airflow.

5. Operational Support and Troubleshooting

• Experience providing operational support, including troubleshooting and resolving incidents.

6. Cloud Platforms and Data Environments

• Knowledge of cloud platforms like AWS, GCP, or Azure.
• 
  Experience with OpenShift and Kubernetes environments.

7. Monitoring and Automation Tools

• Proficiency in using Prometheus, Grafana, or similar tools for monitoring service health.
• 
  Ability to set up monitoring dashboards and perform anomaly detection.

8. Security and Access Management

• Knowledge of user access management, including account setup and permissions validation.

9. Data Flow and System Dependencies

• Ability to understand and document data flows and dependencies between different data services.

10. DevOps and Agile Practices

• Familiarity with DevOps principles and Agile environments.