Senior Data Engineer - Python/ETL Tools (3-10 yrs)

Senior Data Engineer

Company: Infometry Inc

Location: Remote

Role : Senior data Engineer

Shift : 2PM-11PM

EXP: 4-7 years

NP: Immediate

Job Description :

We are seeking a skilled Data Engineer to join our dynamic team. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to support our data warehousing and analytics initiatives. You will work closely with cross-functional teams to understand business requirements, design efficient data solutions, and ensure data integrity and quality. The ideal candidate should have expertise in using Matillion and Snowflake for ETL processes, proficiency in Python programming for scripting and automation, and a solid understanding of data warehousing concepts and API integration.

Responsibilities:

- Collaborate with stakeholders to gather and understand business requirements for data integration, transformation, and reporting.

- Design, develop, and maintain scalable and efficient data pipelines using Matillion and Snowflake.

- Implement data integration solutions for various data sources like SAP and other systems, ensuring data accuracy, consistency, and completeness.

- Write Python scripts for data processing, transformation, and automation tasks is a plus.

- Optimize and tune data pipelines for performance and reliability.

- Ensure data quality and integrity throughout the data lifecycle by implementing validation checks and error handling mechanisms.

- Work closely with data analysts and data scientists to support their analytical and reporting needs.

- Experience in working in Agile working in sprints

Requirements:

- Bachelor's degree in computer science, Engineering, or related field.

- Proven experience working as a Data Engineer or similar role.

- Hands-on experience with Matillion and Snowflake for ETL processes and data warehousing.

- Proficiency in Python programming for data manipulation, scripting, and automation is a plus

- Strong understanding of data warehousing concepts, data modeling, and relational databases.

- Experience with API integration and web services.

- Strong communication and collaboration abilities