Overview
Hyderabad, IN, India
BigData Development
BCM Industry
20/12/2024
Req. VR-110541
Project description
Information and Document Systems is a global technology change and delivery organization comprising nearly 200 individuals located mostly in Switzerland, Poland, and Singapore. Providing global capturing and document processing, archiving, and retrieval solutions to all business divisions focusing on supporting Legal, Regulatory, and Operational functions.
Responsibilities
Design, implement, and manage data solutions on Azure
Develop and maintain data pipelines using Databricks
Ensure efficient data storage and retrieval using Azure Storage and Data Lake
Automate infrastructure and application deployments with Ansible
Write clean, maintainable code in Python
Collaborate with team members using Git and GitLab for version control and CI/CD
Gather and document business requirements through stakeholder interviews and workshops
Analyze and translate business needs into technical specifications
Apply data analytics to interpret data and support business decisions
Communicate effectively with stakeholders to manage expectations and provide project updates
Continuously seek opportunities to improve processes and drive efficiency
Share and contribute: Support and guide less senior team members, contribute to team spirit and dynamic growth, actively participate in wider engineering group
and product-wide activities
Skills
Must have
10+ years of data engineering/analysis experience
Degree in Computer Science, Information Technology, or related field
Proficient in deploying and managing services on Microsoft Azure
Hands-on experience with Databricks for data processing and analytics
Understanding of Azure Storage concepts and best practices
Understanding of Microsoft Fabric concepts and best practices
Experience in designing, implementing, and managing data lakes on Azure
Experience in using Ansible for automation and configuration management, with proficiency in YAML
Strong programming skills in Python for data manipulation and automation
Proficient in version control using Git and experience with GitLab for CI/CD pipelines
Excellent verbal and written communication skills to interact with stakeholders and team members
Strong analytical abilities to interpret data and provide actionable insights to support data-driven decision-making
Nice to have
Experience in Agile Framework
Banking / Investment Banking domain experience
Other
Languages
English: C2 Proficient
Seniority
Senior