Senior Python Developer role

Career Area:

Job Description:

Your Work Shapes the World at Caterpillar Inc.

When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

Role Definition
Performs implementation, regular problem solving, maintenance and support for a agile software development.

Top Candidates will have :

Responsibilities:

• Data Pipeline Development: Design, develop, and maintain scalable and efficient ETL/ELT pipelines using Python and AWS services (e.g., Lambda, Glue, S3, EC2, Step Functions).
• Data Warehousing: Architect, implement, and optimize data models and queries within Snowflake, ensuring optimal performance and scalability.
• Cloud Infrastructure: Manage and maintain data infrastructure on AWS, including provisioning, monitoring, and troubleshooting.
• Data Quality and Governance: Implement data quality checks and monitoring processes to ensure data integrity and reliability.
• Performance Optimization: Identify and resolve performance bottlenecks in data pipelines and queries.
• Collaboration: Work closely with data scientists, analysts, and other engineers to understand data requirements and deliver effective solutions.
• Automation: Automate data engineering tasks and processes to improve efficiency and reduce manual effort.
• Documentation: Create and maintain comprehensive documentation for data pipelines, infrastructure, and processes.
• Mentorship: Mentor junior data engineers and contribute to the team's knowledge sharing and best practices.
• Security: Implement and maintain data security best practices.

Required Skills and Experience:

• Expertise in Python programming for data processing and automation.
• Strong proficiency in SQL for data manipulation and analysis.
• Extensive experience with AWS cloud services, particularly those related to data engineering (e.g., S3, Glue, Lambda, EC2, IAM, Step Functions, CloudWatch).
• Proven experience with Snowflake data warehousing.
• Experience designing and implementing ETL/ELT pipelines.
• Strong understanding of data modeling concepts and best practices.
• Experience with version control systems (e.g., Git).
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• Experience with data orchestration tools like Airflow or similar.

Preferred Skills:

• Experience with data streaming technologies (e.g., Kafka, Kinesis).
• Experience with infrastructure as code (IaC) tools (e.g., Terraform, CloudFormation).
• Experience with building data lakes.
• Experience with CI/CD pipelines in AZDO.

This Job Description is intended as a general guide to the job duties for this position and is intended for the purpose of establishing the specific salary grade. It is not designed to contain or be interpreted as an exhaustive summary of all responsibilities, duties and effort required of employees assigned to this job. At the discretion of management, this description may be changed at any time to address the evolving needs of the organization. It is expressly not intended to be a comprehensive list of “essential job functions” as that term is defined by the Americans with Disabilities Act.

Posting Dates:

Caterpillar is an Equal Opportunity Employer (EEO).

Not ready to apply? Join our Talent Community .