CGI - AWS Data Engineer - PySpark (2-10 yrs)

Role : AWS Data Engineer / AWS Service Developer

Location : Bangalore, Chennai

Years of experience : 2 to 10 years

Role : Software Engineer / Senior Software Engineer / Lead Analyst

Key skills : AWS Developer, AWS Data Engineer, AWS API Gateway, AWS RDS, AWS network, AWS Glue, AWS Lambda.

We are seeking a highly skilled AWS Developer with 2 -10 years of hands-on experience across a range of AWS services, including API creation, network architecture, and security. The ideal candidate will be proficient in AWS Lambda, Glue, API Gateway, Lattice, RDS, and Databricks, with a proven ability to design and deploy scalable serverless applications.

This role requires expertise in data processing, data warehousing, and API development, with a strong focus on security, optimization, and teamwork.

Responsibilities :

- Design, develop, and deploy scalable, secure applications using AWS cloud-native technologies.

- Use AWS services like Lambda, Kinesis, Redshift, and API Gateway to build high-performance solutions.

- Architect serverless applications using AWS Lambda for event-driven computing.

- Build and maintain real-time or batched data pipelines

- Design and optimize data warehouses with Amazon Redshift for large-scale data storage and analysis.

- Implement event-driven architectures for efficient communication between various AWS services.

- Write and optimize PySpark code for the data processes to transform and load data.

- Ensure security and compliance with AWS best practices, including VPC, IAM, and encryption.

- Identify performance, scalability, and cost-saving opportunities within AWS environments.

- Create and maintain technical documentation for AWS architecture and processes.

- Good understanding and working knowledge of GIT CI/CD pipelines for automated testing and deployment.

- Troubleshoot and resolve issues with AWS services to minimize production downtime.

Must-Have Skills :

- Proficiency in a wide range of AWS services, with a focus on Lambda, Kinesis, and Redshift.

- Strong skills in designing, implementing, and optimizing data warehousing solutions using Amazon Redshift.