Senior Associate_ AWS Data Engineer_D&A_Advisory

Responsibilities

Bachelors/Masters/Computer Science/Equivalent engineering
Previous Work Experience 3-7 years (Bachelor Degree holders)
In-depth experience with various AWS data services, including Amazon S3, Amazon Redshift,
AWS Glue, AWS Lambda, and Amazon EMR, SQS, SNS, Step Functions, Event Bridge.
Ability to design, implement, and maintain scalable data pipelines using AWS services.
Strong proficiency in big data technologies such as Apache Spark and Apache Hadoop for processing and analyzing large datasets.
Hands-on experience with database management systems such as Amazon RDS, DynamoDB, and others.
Good knowledge in AWS OpenSearch.
Experience in data ingestion services like AWS AppFlow, DMS, AWS Glue etc.
Hands on experience on developing REST API s using AWS API Gateway.
Experience in real time and batch data processing in AWS environment utilizing services like
Kinesis firehose, AWS Glue, AWS Lambda etc.
Proficiency in programming languages such as Python, PySpark for building data applications and ETL processes.
Strong scripting skills for automation and orchestration of data workflows.
Solid understanding of data warehousing concepts and best practices.
Experience in designing and managing data warehouses on AWS Redshift or similar platforms.
Proven experience in designing and implementing Extract, Transform, Load (ETL) processes.
Knowledge of AWS security best practices and the ability to implement secure data solutions.
Knowledge of monitoring logs, create alerts, dashboards in AWS CloudWatch.
Understanding of version control systems, such as Git.

Nice to have skills
Experience with Agile and DevOps concepts.
Understanding of networking principles, including VPC design, subnets, and security groups.
Experience with containerization tools such as Docker and orchestration tools like Kubernetes.
Ability to deploy and manage data applications using containerized solutions.
Familiarity with integrating machine learning models into data pipelines.
Knowledge of AWS SageMaker or other machine learning platforms.
Experience in AWS Bedrock for GEN AI integration
Knowledge of monitoring tools for tracking the performance and health of data systems.
Ability to optimize and fine-tune data pipelines for efficiency.
Experience in AWS services like Code Pipeline, Code Commit, Code Deploy, Code Build, Cloud Formation.

Mandatory skill sets

AWS Data engineer

Preferred skill sets

AWS Data engineer

Years of experience required

4-10

Education qualification

Btech/MBA/MCA