Data Engineer

As a Data Engineer at Varaha ClimateAg Pvt. Ltd., you will play a crucial role in designing, implementing, and maintaining our data infrastructure and systems. You will be responsible for building scalable and efficient data pipelines, integrating data from various sources, and ensuring the availability and reliability of data for our climate tech and agritech applications. Your work will contribute to the development of data-driven solutions that drive innovation and decision-making within the company.

Responsibilities:

• Design, develop, and maintain data pipelines and ETL (Extract, Transform, Load) processes to collect, process, and integrate data from diverse sources such as weather data providers, satellite imagery, IoT sensors, and agricultural databases.

• Collaborate with cross-functional teams, including data scientists, software engineers, and domain experts, to understand data requirements and implement data models and schemas that support analytical and operational needs.

• Optimise data storage and retrieval systems for performance and scalability, ensuring efficient data processing and real-time or near-real-time data availability.

• Develop and implement data quality and validation processes to ensure the accuracy, completeness, and integrity of data.

• Monitor and troubleshoot data pipelines, identifying and resolving data-related issues or bottlenecks to maintain high data availability and reliability.

• Implement and maintain data security and privacy measures to protect sensitive information.

• Stay up to date with emerging technologies, tools, and best practices in data engineering and contribute to the continuous improvement of data infrastructure and processes.

• Design build analytical reports to support cross-functional teams with daily data requests.

Qualifications

• Bachelor's or Master's degree in computer science, data engineering, or a related field.

• Strong programming skills in languages such as Python.

• Proficiency in SQL and working knowledge of relational and NoSQL databases.

• Familiarity with cloud platforms like AWS, Azure, or GCP.

• Knowledge of data modelling concepts and experience in designing and optimising data schemas.

• Strong problem-solving and troubleshooting skills, with a keen attention to detail.

• Excellent communication and collaboration skills to work effectively in a cross-functional team.

• Experience in the agriculture domain or exposure to climate-related datasets is a plus.

Additional Information

Join a small, ambitious, and international team and enjoy the following benefits:

• Competitive salary and benefits package (ESOP)

• Key role in shaping a fast-growing climate tech startup
• Support for learning professional development
• A culture of undogmatic, unbureaucratic creativity and collaboration