Dhwani RIS - Senior Data Engineer - ETL Tools

Job Title : Senior Data Engineer

Company: Dhwani Rural Information Systems

Job Overview

We are looking for a talented and experienced Senior Data Engineer to join our team. The ideal candidate will be responsible for constructing, managing, and enhancing data pipelines and infrastructure, ensuring efficient and reliable data flow throughout the organization.

In this role, you will play a crucial part in promoting data-driven decision-making across the company.

You will lead a team of analysts to derive meaningful insights from complex data sets, develop strong analytics frameworks, and provide actionable recommendations to drive business growth.

In addition to your specific deliverables, you will be expected to support others in the larger organization where required and to have a natural inclination towards start-ups, software, and the latest IT solutions.

Key Responsibilities

• Develop and maintain the overall data architecture, including data lakes, data warehouses, and data marts.
• Lead and mentor a team of data analysts, fostering a data-centric culture.
• Develop and implement a comprehensive data strategy aligned with business objectives.
• Understanding clients requirements and giving software demos.
• Coordinating with clients vendors and partners, ensuring on-time reporting, query resolution.
• Requirement gathering for designing reporting formats and dashboard designs.
• Writing the SQL query to find the analysis and connect it to the dashboards.
• Preparing a Dashboard through which clients can visualize the campaign and can make quick decisions.
• Collaborate with cross-functional teams to identify data needs and deliver data-driven solutions.
• Identify and address bottlenecks and performance issues in data processing.
• Monitor and optimize the performance of data pipelines and databases.
• Preparation of M&E framework/Log framework and digitization of the M&E framework on the platform.
• Delivering monthly, quarterly, and yearly Power BI reports to the client.
• Data cleaning and manipulating a large amount of data which helps to analyze the project smoothly.
• Training manual and training of clients and their partners.
• Independently leading a project as needed.
• Quick research to support with projects design and strategy in the areas of CSR, rural development,
  
  

tech4good, survey platforms, dashboarding tools, etc.

• Provide regular updates and reports on data pipeline performance, issues, and resolutions.
  
  

Essential Technical Requirements

• Strong research skills (qualitative and quantitative, impact assessments, report writing, log frame design).
• Experience in working with data in Excel for data storage, data cleaning, and data analysis.
• Stay up-to-date with the latest analytics trends and technologies.
• Experience of using BI tools like Google Studio, Power BI, Tableau etc.
• Experience with programming languages such as Python/SQL/Java.
• Experience with database systems like MySQL and MongoDB.
• Experience in data integration, including API integration and data modeling.
• Document ETL processes, data models, and data flow diagrams.
• Experience with ETL tools such as Apache Nifi, Apache Airflow, Talend, Informatica, SSIS (SQL Server
  
  

Integration Services), and AWS Glue.

• Exposure to different off-the-shelf survey solutions (Google Forms, Survey Monkey, Surveyor, etc.).
• Experience in working on multiple projects in a fast-paced work environment.
• Proven track record of delivering projects on time and within budget.
• Experience with project management tools and techniques, including project planning, resource allocation, risk management, and stakeholder communication.
• Ability to work with cross-functional teams and manage external vendors and partners.
• Strong communication and interpersonal skills, with the ability to build and maintain relationships with clients and team members.
• Essential Non-Technical Requirements
• Strong analytical and problem-solving skills.
• Ability to think strategically and identify opportunities for process improvements.
• Excellent organizational and leadership abilities.
• High level of motivation and dedication to delivering high-quality work.
• Commitment to continuous learning and professional development.
  
  

Education Qualifications

• Bachelor's or master's degree in computer science, Engineering, or a related field.
  
  

Experience Required

• Minimum of 5 years of experience as a Lead Analytics or in a similar role.
• Experience working with IT platforms and software solutions is essential.
• Experience with data visualization and business dashboards for global data representation is a plus.
• Advanced knowledge and extensive experience with dashboarding tools such as PowerBI, Tableau, and similar platforms.
• This includes creating and optimizing complex business dashboards, developing interactive data visualizations, and ensuring accurate global data representation to support data-driven Skills and Experience
• Statistical Analysis, Machine Learning, Python Programming, Data Visualization, Predictive Modeling, Big Data, SQL, Data Mining
  
  

(ref:hirist.tech)