Data Engineer - Vertoz

• Must have at least 1-2 years of hands-on working knowledge on Big Data technologies such as Impala, Hive, Hadoop, Spark, Spark streaming, Kafka, etc.
• Excellent programming skills in Python.
• Experience with stream-processing systems: Storm, Spark-Streaming, etc.
• Experience with relational SQL and NoSQL databases, including Vertica.
• Experience with cloud services.
• Cloudera Hadoop Distribution, Shell Scripting, Superset, Hands-on with cluster management.
• Development: Create and maintain scalable big data applications using Python,Spark, Hive, and Impala.
• Data Pipelines: Develop and optimize data processing pipelines to handle large datasets.
• Integration: Implement data ingestion, transformation, and loading processes.
• Collaboration: Work with data scientists and analysts to meet data requirements.
• Quality Control: Ensure data quality, integrity, and security.
• Performance: Monitor and troubleshoot performance issues to improve efficiency.
• Documentation: Contribute to code reviews, testing, and comprehensive documentation.

Requirements

• Education: Bachelor’s or Master’s degree in Computer Science, IT, or a related field.
• Experience: 1-2 years in a Big Data Developer role.
• Proficiency in Python.
• Strong experience with Apache Spark.
• Hands-on experience with Hive and Impala.
• Familiarity with Hadoop, HDFS, Kafka, and other big data tools.
• Knowledge of data modeling, ETL processes, and data warehousing concepts.
• Soft Skills: Excellent problem-solving, communication, and teamwork skills.

Benefits

• No dress codes
• Flexible working hours
• 5 days working
• 24 Annual Leaves
• International Presence
• Celebrations
• Team outings