Zimetrics Technologies - AWS Data Engineer - PySpark/Python (7-16 yrs)

Responsibilities :

1. Design, implement, and continuously expand data pipelines by performing extraction, transformation, and loading activities

2. Understand requirements and business process knowledge in order to transform the data in a way that's geared towards the needs of end users

3. Ensure that the data architecture is scalable and maintainable

4. Work with the business in designing and delivering correct, high quality data solution

5. Investigate data to identify potential issues within ETL pipelines, notify end-users and propose adequate solutions

6. Prepare documentation for further reference

7. Help team in data migration work

8. Help team in code reviews

Skills :

1. Experience of at least ETL tool (AWS Glue,Step Functions, Lambda) a. Experience of Python and Fast API

2. Knowledge of API development

3. SQL knowledge (query performance tuning, index maintenance, etc.) as well as an understanding of database structure

4. Knowledge of data modeling principles

5. Organizational skills : time management and planning

6. High attention to detail

7. Passionate about complex data structures and problem solving

8. Expertise in scripting languages (Python, Bash, Perl, etc.)

9. Handling DMS activity for data migration work.

9. Involved in code review process

10. Having experience in handling team and client communications