AWS Data Engineer - ETL/SQL/Python (7-10 yrs)

Job Title : AWS Data/API Gateway Pipeline Engineer

Location : Bangalore, Noida, Hyderabad, Pune

Experience : 7+ Years

Job Type : Contract (6 months plus extendable )

Joining : Immediate (Within 1 Week)

Job Overview :

We are looking for an experienced AWS Data/API Gateway Pipeline Engineer with a strong background in AWS data warehousing, API development, and data engineering. The ideal candidate will have hands-on experience in building scalable ETL pipelines, working with AWS services, and integrating APIs. The role requires excellent problem-solving abilities, independence in execution, and a strong analytical mindset.

Key Responsibilities :

- Design, develop, and maintain ETL pipelines for large-scale data processing using AWS services like Lambda, EventBridge, Step Functions, SNS, SQS, and S3.

- Develop, manage, and optimize AWS API Gateway for seamless API integration and performance.

- Work with Python (Spark/PySpark) and Java to build scalable data solutions.

- Write optimized SQL queries for relational databases like PostgreSQL and manage Redis Cache & DynamoDB.

- Implement event-driven architectures using AWS services.

- Manage and enhance CI/CD pipelines using GitHub Actions and follow Agile methodologies.

- Ensure security best practices by configuring IAM roles and policies in AWS.

Required Skills & Experience :

- AWS Services : Hands-on experience with Lambda, API Gateway, EventBridge, Step Functions, SNS, SQS, S3.

- ETL & Data Processing : Experience in designing and managing ETL pipelines with large datasets.

- Programming Languages : Strong proficiency in Python (PySpark/Spark) and Java.

- API Development : Experience in developing and managing AWS APIs.

- Database Management : Experience with PostgreSQL, Redis Cache, and DynamoDB.

- CI/CD & DevOps : Experience working with GitHub Actions for CI/CD pipelines.

- Security & IAM : Practical knowledge of AWS IAM roles and policies.

- Bonus : Familiarity with Kinesis or Kafka for real-time data streaming.