
Overview
About the job Data Analytics-Python Developer
Mandatory skills
1.Python, Dagster, Docker containerization-3 5 years
2.Data Modeling-3 years
Required Qualifications:
- Proven experience as a Python Developer with a focus on data engineering.
- Hands-on experience with Dagster for building and maintaining data pipelines.
- Proficiency in Python libraries (Pandas, Polars, DuckDB) and ETL processes.
- Solid understanding of Docker containerization.
- Experience with Power BI, particularly connecting to Parquet data sources.
- Experience wih Dimentional modeling, start schema, snow-flake schema.
- Strong analytical, problem-solving, and communication skills.
Preferred Qualifications:
- Familiarity with Agile methodologies and a collaborative, team-oriented environment.
Responsibilities:
- Pipeline Development:
o Develop and maintain Dagster pipelines to connect with various data sources and
convert raw data into Parquet format.
o Optimize ETL processes for robust, scalable data workflows.
- Data Analysis & Transformation:
o Analyze different source systems to design efficient integration strategies.
o Modify and manage Parquet datasets to ensure data quality and performance.
- Technical Implementation:
o Utilize Python libraries such as Pandas, Polars, and DuckDB for data processing
and analysis.
o Deploy applications using Docker for seamless containerization and deployment.
- Data Modeling:
o Design innovative data models from source tables to staging, capturing time-series
data for advanced analytics.
- Collaboration:
o Work closely with