Senior Data Engineer

Combine interface design concepts with digital design and establish milestones to encourage cooperation and teamwork.

Develop overall concepts for improving the user experience within a business webpage or product, ensuring all interactions are intuitive and convenient for customers.

Collaborate with back-end web developers and programmers to improve usability.

Conduct thorough testing of user interfaces in multiple platforms to ensure all designs render correctly and systems function properly.

Converting the jobs from Talend ETL to Python and convert Lead SQLS to Snowflake. Developers with Python and SQL Skills.

Developers should be proficient in Python especially Pandas, Pyspark, or Dask for ETL scripting, with strong SQL skills to translate complex queries. They need expertise in Snowflake SQL for migrating and optimizing queries, as well as experience with data pipeline orchestration (e.g., Airflow) and cloud integration for automation and data loading. Familiarity with data transformation, error handling, and logging is also essential.

Converting the jobs from Talend ETL to Python and convert Lead SQLS to Snowflake. Developers with Python and SQL SkillsDevelopers should be proficient in Python especially Pandas, Pyspark or Dask for ETL scripting, with strong SQL skills to translate complex queries. They need expertise in Snowflake SQL for migrating and optimizing queries, as well as experience with data pipeline orchestration (e.g., Airflow) and cloud integration for automation and data loading. Familiarity with data transformation, error handling, and logging is also essential. Python Programming, Data Processing Libraries Pandas, NumPy, Pyspark and Dask Familiarity with Python scheduling and orchestration tools like Airflow or Luigi and API Integration Integrating Python with external systems via APIs if needed for your ETL jobs.SQL Skills SQL Querying Proficiency in writing complex SQL queries, joins, aggregationsand data transformations. This is important for both Talend SQL Queries that need to be rewritten in Python or other system Migrating SQL code to Snowflake SQL syntax.

and Database Design and Optimization Stored Procedures and Functions and knowledge of Snowflake stored procedures and user-defined functions UDF is essential. Snowflake Skills Snowflake SQL, Snowflake Data Types: Knowledge of how Snowflake handles various data types and how to map data types from the original ETL flow. ETL Concepts & Data Transformation

ETL Concepts: Understanding of ETL best practices like batch vs. stream processing, handling slowly changing dimensions, data cleaning, and transformation.

Data Flow Design: Design of data pipelines in Python (using libraries like Pandas, Pyspark, etc.) to replicate the ETL jobs previously done in Talend.

Scheduling and Orchestration: Setting up and managing job scheduling/orchestration tools like Apache Airflow, Luigi, or Prefect to automate Python scripts and Snowflake tasks (if Talend orchestration functionality is also being replaced).Formal training or certification on software engineering concepts and 5+ years applied experience and Hands-on practical experience in system design, application development, testing, and operational stability