Specialist - Data Engineer

Country:

India

Location:

Capital Cyberscape, 2nd Floor, Ullahwas, Sector 59, Gurugram, Haryana 122102

Role: Specialist - Data Engineer

Location: Gurgaon

Full/ Part-time: Full Time

Build a career with confidence

About the role:

We are seeking a skilled Data Engineer with strong experience in AWS and SQL to join our team. The ideal candidate will design, develop, and maintain scalable data infrastructure and pipelines, leveraging AWS services such as Glue, S3, Dynamo DB and Redshift. This role requires a hands-on approach to managing data workflows, optimizing performance, and collaborating with cross-functional teams to support analytics and business needs.

Key Responsibilities:

As a Specialist, you ll be responsible for:

Data Pipeline Development:

• Design, develop, and manage robust ETL/ELT pipelines to process structured and unstructured data efficiently.

• Ensure seamless data ingestion, transformation, and delivery across various systems.

AWS Glue Expertise:

• Develop, schedule, and monitor Glue jobs for data extraction, transformation, and loading (ETL).

• Write and optimize PySpark scripts within Glue for large-scale data processing.

• Configure Glue crawlers for metadata cataloging and schema discovery.

• Troubleshoot and optimize Glue workflows for efficiency and cost-effectiveness.

Amazon Redshift Expertise:

• Design and implement data models and schemas optimized for Redshift.

• Manage Redshift clusters, ensuring scalability, security, and performance tuning.

• Implement techniques such as distribution keys, sort keys, and compression for optimized querying.

• Integrate Redshift with other AWS services and third-party tools for seamless data analysis.

Cloud Data Infrastructure:

• Build and maintain cloud-based data infrastructure using AWS services such as S3, Lambda, and Step Functions.

• Automate data pipeline workflows using orchestration tools like Step Functions and AWS Glue workflows.

Database Management and SQL Expertise:

• Write, optimize, and maintain complex SQL queries for data extraction, reporting, and analytics.

• Administer relational and non-relational databases, ensuring data integrity and availability.

Collaboration and Communication:

• Work closely with data analysts, data scientists, and business stakeholders to understand and address data needs.

• Translate business requirements into technical specifications and implement solutions.

Data Governance and Security:

• Establish data quality, governance, and compliance best practices.

• Ensure adherence to security policies for data storage, access, and processing.

Requirements

As a minimum you must have:

• Experience in Data pipeline development and data engineering.

• Proficiency in AWS Glue and Amazon Redshift

• Good experience in SQL and database management

Benefits

We are committed to offering competitive benefits programs for all of our employees, and enhancing our programs when necessary.

• Enjoy your best years with our retirement savings plan

• Have peace of mind and body with our health insurance

• Make yourself a priority with flexible schedules, parental leave and our holiday purchase scheme

• Drive forward your career through professional development opportunities

• Achieve your personal goals with our Employee Assistance Programme

Our commitment to you

Join us and make a difference.

Apply Now!

Carrier is An Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or veteran status, age or any other federally protected class.

Job Applicant's Privacy Notice:

Click on this link to read the Job Applicant's Privacy Notice