Sr AWS Data Engineer

Position - AWS Data EngineerLocation - Pune/ Gurgaon/ Hyderabad/ HybridExperience - 6+ years Responsibilities: Design, develop and maintain large-scale data pipelines using AWS services such as Glue, Lambda and S3. Architect and implement data solutions in AWS Redshift for optimized data storage and retrieval. Build, automate and monitor data workflows using AWS Step Functions and CloudFormation. Ensure the effective setup and management of AWS Lake Formation and Glue Data Catalog for data lake environments. Develop and optimize ETL processes using Python and PySpark to process and transform large datasets. Collaborate with data scientists, analysts and stakeholders to understand data requirements and translate them into scalable solutions. Implement best practices for data governance, security and quality across AWS infrastructure. Troubleshoot, optimize and enhance existing data pipelines and architecture for performance and scalability.Required Skills: 6+ years of experience in data engineering with a focus on AWS. Strong expertise in AWS Glue, Lambda, S3, Redshift and Step Functions. Hands-on experience with AWS CloudFormation and AWS Lake Formation is a must. Proficiency in Glue Data Catalog and data lake architectures. Advanced programming skills in Python and PySpark for building and optimizing ETL pipelines. Experience with performance tuning, data modeling and query optimization in AWS environments. Strong understanding of data security, governance and compliance in cloud environments.Good to have skills: Experience with CI/CD pipeline setup for data workflows. Knowledge of AWS cost optimization practices. Familiarity with other AWS services such as Athena, DynamoDB or RDS.