Data Engineer

Job Details

Essential Job functions (Tasks, duties, and responsibilities most important to get the job done)

As a Data Engineer, you will be part of a Data and Analytics (D & A) team responsible for building data pipelines that enables us to make informed decisions across the entire organization. This is a great opportunity to make a real impact on the course of the company, which makes data-based decisions as a part of its Data + Analytics Strategy.

The Data Engineer is responsible for design, development, testing, and implementation of automated data pipelines and for the Enterprise Data Warehouse, hosted in the Cloud. The Data Engineer works closely with Business Intelligence / Analytics teams and business users to understand requirements, translate them into technical design, develop data pipelines and implement solutions in the Enterprise Data Warehouse (Redshift).

Primary Responsibilities Include:

Architecture & Design (10%)

• Participate in the definition of solution approaches during annual, quarterly, and sprint level planning.
• Participate in efforts to raise systems stability, performance, and reduce technical debt.
• Know the tools, frameworks, and code / configuration standards for development.

Development (70%)

• Analyze existing & create new stored procedures which involve complex data models and business rules.
• Build data pipelines utilizing various ETL transformation tools such as informatica or AWS Glue
• Actively participate through all phases of the project cycle from ideation to post-implementation stabilization.
• Work with business and technical peers to define how best to meet requirements, balancing speed & robustness.
• Build high-quality, maintainable SQL OLAP/Analytic functions following established patterns and coding practices.
• Analyze technical data to establish solutions that achieve complex data transformations.
• Participate / perform testing to ensure data quality and integrity via unit, integration, regression, and UAT testing.
• Create and maintain process design, data model, and operations documentation.
• Assist in the maintenance of the codebase, unit tests, and related technical design docs and configurations.
• Engage and collaborate with stakeholders via the Agile process, identifying and mitigating risks & issues as needed.
• Maintain software velocity & quality for deliverables, holding oneself accountable to commitments.

Operational Support (20%)

• Comply with established policies and standards for Change management, incident management, and security.
• Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
• Participate in the tuning of the production platform, optimizing process & SQL for performance and stability.
• Contribute to code and configuration management, troubleshooting bugs within a complex, global code base.
• Assist in Tier 3 support efforts to triage & resolve issues and prevent issues at code & configuration level.
• Available to periodically work nights, weekends or holidays as support issues and business needs demand, e.g., production deployments, unscheduled emergency support.

JOB requirements (minimum competencies required for job performance)

• Experience in PL/SQL scripting and query optimization, required.
• Experience with AWS (Amazon Web Services) Redshift, Oracle, or PostgreSQL, preferred.
• Experience with Informatica Power Center and/or Informatica Cloud / IDMC, preferred.
• Experience in data model design, dimensional data modeling, and complex stored procedure development, required.
• Strong analytical skills, synthesizing information with attention to detail & accuracy to establish patterns and solutions.
• Experience with AWS, e.g., S3, PySpark, Glue, Redshift, Lambda, preferred.
• Experience with Data Lake House platforms, e.g., Databricks, Snowflake, preferred.
• Experience in scripting languages, e.g., Python, Scala, Java, Unix Shell, Bash, preferred.
• Experience operating in Agile and Waterfall development methodologies, preferred.
• Experience building data visualization solutions using BI platforms, e.g., Tableau, Power BI, Qlik, preferred.
• Capable of balancing technology ideals and business objectives, evaluating options and implications.
• Must possess strong written and verbal communication skills.
• Manages and prioritizes work effectively with minimal supervision, seeking and offering help as needed to achieve goals.
• Adaptable to change and able to work independently and as part of a team.
• Applies curiosity and creativity to solve problems, seeking opportunities and overcoming challenges with resourcefulness.
• High bias for action in meeting commitments & deadlines; effectively sees, communicates, and mitigates risks and issues.
• Active participant in the development community; seeks and offers guidance, coaching, and professional development.

Prior work experience and educational requirements

• Bachelor’s degree in a technology or business-related area, preferred.
• 4+ years' experience in SQL ETL development for Large Enterprise Data Warehousing environment, required.
• 2+ years' experience end-to-end development expertise from concept, design & development to stabilization, preferred.
• 2+ years’ experience in software development using Agile (Scrum or Kanban), preferred.
• 1+ years' experience with retail, apparel, and/or supply chain, preferred.