Data Engineer - Python/SQL (3-5 yrs)

Role : Data Engineer

Technical skills required :

1. Strong proficiency in Python, with an emphasis on clean, modular, and well-documented code.

2. Expertise in SQL, JIRA, Git, and GitHub.

3. Hands-on experience with designing and implementing scalable and secure data processing pipelines using Azure Data Factory.

Responsibilities :

1. Design and maintain scalable, efficient data models and architectures to support data analytics and reporting.

2. Implement rigorous data cleaning, transformation, and integration processes to ensure data quality and consistency.

3. Work closely with data analysts, business analysts, and other stakeholders to understand data requirements and implement effective data solutions.

4. Maintain comprehensive documentation of data procedures, systems, and architectures.

5. Provide guidance and support for data governance practices, including metadata management, data lineage, and data cataloging.

6. Assembles large, complex data sets that meet functional / non-functional business requirements.

7. Identifies, designs, and implements internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

8. Implement security measures to protect sensitive data, essential for maintaining trust and compliance with data privacy regulations.

9. Develop, maintain, and optimize scalable data pipelines that can handle large volumes and various types of data.

Note : It is a contractual job (6 months - 1 year).