Data Engineer

Overview

Job Title: Data Engineer

Location: Hyderabad

Total Experience: 4 - 6 Years

Job Type: 1-Year Contract (extendable based on performance)

Work Mode: Hybrid

Notice Period: Immediate to 15 Days

Work Timings: Monday to Friday, 10 am to 7 pm (IST)

Interview Process

· Level 1: Internal Round

· Level 2: Client Round

(Note: The interview levels may vary)

Company Overview

Compileinfy Technology Solutions Pvt. Ltd. is a leading provider of cutting-edge technology and IT services, delivering custom solutions to businesses globally. We are committed to excellence, innovation, and collaboration to create lasting value for our clients. Our focus on high-quality services helps businesses of all sizes grow and succeed. At Compileinfy, we offer a dynamic work environment where innovation thrives, and professional growth is supported.

Job Summary

We are seeking experienced ETL Developers and Data Engineers to ingest and analyze data from multiple enterprise sources into Adobe Experience Platform (AEP).

Job Responsibility

· Analyze and understand customers' use cases and data sources to extract, transform, and load data from multiple enterprise sources into Adobe Experience Platform

(AEP).

· Design and build data ingestion pipelines in the platform using PySpark.

· Ensure data ingestion is optimized for performance, throughput, and latency.

· Develop and test complex SQL queries for data extraction, analysis, and reporting within AEP.

· Ensure SQL queries follow best practices for performance optimization.

· Migrate platform configurations, including data ingestion pipelines and SQL, across multiple sandboxes.

· Debug and resolve issues related to data ingestion, SQL, or other platform functionalities.

· Support Data Architects in implementing data models within the platform.

· Contribute to innovation initiatives and develop intellectual property for the organization.

· Present advanced features and complex use case implementations in multiple forums.

· Participate in scrum events and provide updates on deliverables.

· Work independently across multiple engagements with minimal supervision.

Requirements

Experience:4–6 years of professional experience in data engineering and ETL development, with expertise in the following:

· 4+ years of experience developing data ingestion pipelines using PySpark (batch and streaming).

· 4+ years of experience with AWS data engineering services, including Glue, Athena, DynamoDB, Kinesis, Kafka, Lambda, and Redshift.

· 1+ years of hands-on experience with Redshift, specifically:

o Loading data from various sources, such as S3 buckets and on-premises databases, into Redshift.

o Optimizing data ingestion processes for efficiency and performance.

o Designing, developing, and optimizing queries using SQL and PySparkSQL.

o Structuring Redshift tables (e.g., distribution keys, compression, vacuuming).

· Experience developing applications that consume REST APIs.

· Strong ability to write, analyze, and optimize complex SQL queries for performance and scalability.

Good to Have

· 2+ years of experience in developing and supporting ETL pipelines using enterprise- grade ETL tools like Pentaho, Informatica, or Talend.

· Strong understanding of data modeling, including design patterns and best practices.

· Experience with reporting tools such as Tableau or Power BI.

Why Join Us?

At Compileinfy, we value innovation, collaboration, and professional growth. You'll have the opportunity to work on exciting, high-impact projects and be part of a team that embraces cutting-edge technologies. We provide continuous learning and career advancement opportunities in a dynamic, inclusive environment.

Perks and Benefits

· Competitive salary and benefits package

· Flexible work environment

· Opportunities for professional development and training

· A supportive and collaborative team culture

Application Process

To apply, please submit your updated resume along with a brief cover letter highlighting your interest and suitability for the role.

Job Type: Contractual / Temporary
Contract length: 12 months

Pay: ₹1,000,000.00 - ₹1,200,000.00 per year

Benefits:

• Provident Fund

Schedule:

• Day shift
• Monday to Friday

Work Location: In person