Data Engineer - SQL/Python (6-13 yrs)

Key Responsibilities :

- Develop, maintain, and optimize data pipelines to integrate data from various sources.

- Write efficient SQL queries to extract, clean, and transform data for analysis and reporting purposes.

- Work with Python and PySpark to build scalable data processing solutions.

- Collaborate with cross-functional teams to understand data requirements and deliver high-quality solutions.

- Monitor and troubleshoot data workflows, ensuring data accuracy, consistency, and performance optimization.

- Support the development and implementation of data models and architectures for analytics and reporting.

- Document technical processes and workflows for future reference.

Required Skills and Qualifications :

- Strong proficiency in SQL for querying and managing relational databases.

- Hands-on experience with Python and PySpark for data processing.

- Familiarity with NoSQL databases.

- High level understanding of commodity trading (domain knowledge/experience)

- Understanding of Multiprocessor architecture (spark clustering)

- Strong analytical and problem-solving skills.

- Ability to work independently as well as in a team environment.

- Excellent communication and interpersonal skills.

Preferred Qualifications :

- Knowledge of data visualization tools (i.e., Power BI, Tableau) is a plus