Data Engineer

Overview

Key Responsibilities

• Lead technical discussions with customers during pre-sales, delivering technical proposals, architecture plans, and estimations.
• Drive architectural review discussions with customers and auditors to ensure alignment with best practices.
• Develop detailed case studies on existing projects and reusable assets.
• Oversee the entire product lifecycle, ensuring seamless communication with delivery teams to improve architecture.
• Provide performance optimization guidance for large-scale data warehouse (DW) projects, particularly on Petabyte-scale systems.
• Manage migration of source systems, including CSV, SQL, Oracle, MongoDB, SAP BW, and SAP Hana.
• Lead efforts to optimize performance and cost for client projects.
• Implement robust data security protocols, ensuring encryption and decryption of Personally Identifiable Information (PII) data.
• Utilize Apache Airflow and scripting languages (Java/Python) for workflow management and process optimization.

Preferred Skills

• Strong problem-solving and communication skills.
• Knowledge of Machine Learning practices and data manipulation techniques.
• Experience with at least one reporting tool and access control mechanisms.

Job Type: Full-time

Pay: ₹70,000.00 - ₹80,000.00 per month

Benefits:

• Provident Fund
• Work from home

Schedule:

• Monday to Friday
• Morning shift

Supplemental Pay:

• Performance bonus

Education:

• Bachelor's (Required)

Experience:

• Google Cloud Platform (GCP): 10 years (Required)
• Big Data ETL Processes using Java/Python: 10 years (Required)
• Database Management(CSV,SQL,Oracle,MongoDB,SAP BW,SAP Hana): 10 years (Required)
• Workflow Tools (Apache Airflow): 10 years (Required)
• Data Security(PII (Personally Identifiable Information): 10 years (Required)
• SQL and Query Optimization: 10 years (Required)
• Reporting Tools: 10 years (Required)
• BAs, Data/ML Engineers, and other stakeholders: 10 years (Required)
• Team Collaboration: 10 years (Required)
• Machine Learning Knowledge: 10 years (Required)
• Access Control Mechanisms: 10 years (Required)

Location:

• Remote (Required)

Work Location: Remote