1 Exl India Job
ExlService Holdings - AWS Data Engineer - ETL/Python (5-10 yrs)
Exl India
posted 14hr ago
Flexible timing
Key skills for the job
Responsibilities :
- Design, develop, and maintain large-scale data pipelines using AWS services such as Glue, Lambda, S3, and Redshift.
- Architect and implement data solutions in AWS Redshift for optimized data storage and retrieval.
- Build, automate, and monitor data workflows using AWS Step Functions and CloudFormation using templates.
- Set up and manage AWS Lake Formation and Glue Data Catalog for data lake environments.
- Develop and optimize ETL processes using Python and PySpark to process and transform large datasets.
- Implement data governance and security frameworks using AWS IAM and ensure compliance with organizational policies.
- Collaborate with data scientists, analysts, and stakeholders to understand data requirements and translate them into scalable solutions.
- Troubleshoot, optimize, and enhance existing data pipelines and architecture for performance and scalability.
- Implement best practices for data governance, security, and quality across the AWS infrastructure (PaaS).
Required Skills :
- 5+ years of experience in data engineering with a focus on AWS.
- Strong expertise in Python, PySpark, and SQL for building and optimizing ETL pipelines.
- In-depth knowledge of AWS Glue, Lambda, S3, Redshift, and AWS Step Functions.
- Hands-on experience with AWS CloudFormation using templates for infrastructure automation.
- Proficiency in AWS Lake Formation and Glue Data Catalog for data lake management.
- Strong understanding of IAM (Identity and Access Management) for securing AWS environments.
- Experience with performance tuning, data modeling, and query optimization in AWS environments.
- Advanced skills in implementing data security, governance, and compliance in cloud infrastructures.
Good to Have Skills :
- Experience with setting up CI/CD pipelines for data workflows.
- Knowledge of AWS cost optimization practices.
- Familiarity with additional AWS services such as Athena, DynamoDB, or RDS.
Note :
This role emphasizes advanced skills in Python, PySpark, SQL, PaaS, IAM, CloudFormation , Lake Formation, and Redshift. If your expertise aligns with these technologies, we look forward to receiving your application!
Functional Areas: Other
Read full job descriptionPrepare for AWS Data Engineer roles with real interview advice