Data Engineer - ETL/Python (7-13 yrs)

Company Overview :

Join a leading tech company focused on delivering innovative data solutions to clients across various industries. Our team is dedicated to leveraging cutting-edge technology and techniques to help businesses make informed decisions through data-driven insights. We foster a collaborative environment that encourages growth, creativity, and professional development.

Key Responsibilities :

- Design, develop, and maintain scalable data pipelines and ETL processes using Pyspark, Python, and SQL.

- Implement and manage data processing workflows using Amazon EMR and Apache Airflow.

- Collaborate with cross-functional teams to gather requirements and ensure data integration with existing systems.

- Monitor and troubleshoot data pipeline performance, ensuring reliability and consistency of data delivery.

- Stay updated on industry trends and technologies to continuously enhance our data engineering practices.

Required Skills and Qualifications :

- Proven experience (7 to 13 years) in data engineering roles, with a minimum of 5 years of relevant experience.

- Strong proficiency in Pyspark, Python, SQL, and experience with data processing frameworks like EMR.

-Hands-on experience with workflow orchestration tools such as Apache Airflow.

- Solid understanding of database management, data modeling, and best practices in data governance.

- Excellent problem-solving skills and ability to work independently or in a team-oriented environment.