Tech Lead - AWS Data Engineer Job

7-10 Years

• Expertise in Complex Jobs Design and Development
• Designing and building AWS Glue workflows to replace existing ETL processes.

• Standardizing code across all workflows to maintain consistency and scalability.
• Conducting unit tests on all converted jobs to ensure accuracy and reliability.
• Loading initial data into the required workflows and validating data integrity.
• Implementing a layered architecture in AWS and Snowflake for efficient data consumption.
• Creating comprehensive mapping documents for all existing processes and assets.
• Analyzing and enhancing all Excel, Qlik, and MS Access assets to support ongoing reporting needs.
• Developing additional views and logic to supplement reporting requirements.
• Deploying solutions to QA/UAT environments and providing support for Production migration.
• Documenting procedures to enable end-user execution and ongoing support.
• Knowledge of CICD pipelines and Jenkins.
• Strong expertise in architecture principles, design patterns, and best practices.
• Hands-on experience with cloud platforms (e. g. , AWS) and related services(AWS Glue, AWS Athena, AWS Lambda, AWS Devops, AWS CloudWatch, AWS S3, Event Bridge).
• Proficiency in PySpark, Python and Snowflake.
• handle a team of 5 members and interact with multiple stakeholders