Data Engineer

Role & responsibilities:

Primary Responsibilities:

• Total Experience 9 plus is mandatory
• Enhancements, new development, defect resolution and production support of ETL development using AWS native services.
• This is a senior role hence Total Experience 9 plus is mandatory
• Experience with Data Modelling (worked with different data sets and its integrations).
• Integrate data sets using AWS services such as Glue, Lambda functions.
• Use AWS SNS to send emails and Alerts.
• Author ETL processes using Python, Pyspark.
• ETL process monitoring using CloudWatch events.
• Connecting with different data sources like S3 and validating data using Athena.
• Competencies / Experience:
• Deep technical skills in AWS Glue (Crawler, Data Catalog): 5 years.
• Hands on experience on Python: 3 years.
• PL/SQL experience: 3 years.
• CloudFormation and Terraform: 2 years
• CI/CD Github actions : 2 years
• Good understanding of AWS services like S3, SNS, Secret Manager, Athena and Lambda: 1 years.