Freight Tiger - Data Engineer - SQL/ETL/Big Data

About The Role

We are seeking a highly motivated and experienced Data Engineer to join our dynamic team in Bangalore. This role is crucial in building and maintaining our data infrastructure, enabling us to derive valuable insights and drive data-driven decisions. The ideal candidate will have 4-5 years of hands-on experience in data engineering, a strong understanding of data warehousing principles, and a passion for building scalable and reliable data pipelines. We are looking for an immediate joiner who can contribute to our projects from day one.

Responsibilities

Design, Develop, and Maintain Data Pipelines :

• Build and optimize robust data pipelines to extract, transform, and load (ETL) data from various sources into our data warehouse.
• Implement data validation and quality checks to ensure data accuracy and consistency.
• Monitor and troubleshoot data pipeline performance and resolve any issues that arise.
  
  

Data Warehousing And Database Management

• Design and implement efficient data warehouse schemas and data models.
• Manage and optimize database performance, including query optimization and indexing.
• Ensure data security and compliance with relevant regulations.
  
  

Big Data Technologies

• Utilize big data technologies such as Hadoop, Spark, or similar frameworks to process and analyze large datasets.
• Develop and maintain data processing workflows on cloud platforms like AWS, Azure, or GCP.
  
  

Collaboration And Communication

- Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. -

• Document data engineering processes and best practices.
• Communicate effectively with team members and stakeholders regarding project status and technical issues.
  
  

Automation And Optimization

• Automate data engineering tasks and processes to improve efficiency.
• Identify and implement opportunities for performance optimization and cost reduction.
• Implement CI/CD for data pipelines.
  
  

Staying Current

• Keep abreast of the latest data engineering technologies and trends.
• Evaluate and recommend new tools and technologies to improve our data infrastructure.
  
  

Required Skills And Experience

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• 4-5 years of proven experience as a Data Engineer.
• Strong proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL, SQL Server).
• Experience with ETL tools and data integration platforms (e.g., Apache Airflow, Talend, Informatica).
• Experience with big data technologies (e.g., Hadoop, Spark, Kafka).
• Experience with cloud platforms (AWS, Azure, GCP) and cloud-based data warehousing solutions (e.g., Redshift, BigQuery, Snowflake).
• Programming skills in Python, Java, or Scala.
• Understanding of data warehousing concepts and data modeling techniques.
• Experience with version control systems (e.g., Git).
• Strong problem-solving and analytical skills.
• Excellent communication and collaboration skills.
• Experience with CI/CD pipelines.
  
  

Preferred Skills

• Experience with data visualization tools (e.g., Tableau, Power BI).
• Knowledge of machine learning concepts and experience working with data science teams.
• Experience with data governance and data quality tools.
• Experience with real time data processing.
  
  

Location : Bangalore, India

Joining : Immediate Joiner preferred.

(ref:hirist.tech)