Recro - Data Engineer - ETL/Python (3-6 yrs)

We are looking for a passionate and innovative individual to join our Data Science team. This role offers you the chance to work in a dynamic, industry-neutral environment with cutting-edge technologies. You will play a pivotal role in enriching and maintaining our central repository of datasets, enabling advanced data analytics and machine learning techniques to drive actionable insights. If you are someone who loves a challenge and enjoys collaborating with cross-functional teams, this is the role for you!

The core responsibilities for the job include the following :

ETL Development :

- Design, develop, and maintain efficient ETL processes for multi-scale data sets.

- Optimize data transformation and validation processes to ensure data accuracy and consistency.

- Collaborate with cross-functional teams to understand data requirements and implement business logic.

Data Pipeline Architecture :

- Architect and build scalable, high-performance data pipelines.

- Continuously evaluate and implement new technologies for pipeline efficiency and reliability.

- Develop scraping pipelines for acquiring sector-specific datasets.

Data Modeling :

- Design and implement data models to support analytics and reporting needs.

- Optimize database structures for performance and scalability.

Data Quality and Governance :

- Implement robust data quality checks and governance processes to maintain data integrity.

- Collaborate with stakeholders to define and enforce data quality standards.

Documentation and Communication :

- Maintain detailed documentation of ETL processes, data models, and system architectures.

- Effectively communicate complex technical concepts to non-technical stakeholders.

Cross-functional Collaboration :

- Work closely with the Quant team and developers to refine and optimize data pipelines.

- Liaise with external stakeholders to gather requirements for cloud database enrichment.

Requirements :

- Bachelor's degree in Computer Science, Information Technology, or a related field.

- Proven experience (3+ years) as a Data Engineer with expertise in ETL techniques is a MUST.

- Strong programming skills in Python, Java, or Scala.

- Proficiency in web scraping and transforming publicly available data.

- Hands-on experience with cloud platforms such as AWS, Azure, or GCP.

- Strong knowledge of SQL, relational, and non-relational databases.

- Understanding of data warehousing concepts and architectures.

- Familiarity with big data tools like Hadoop, Spark, and Kafka.

- Expertise in data modeling tools and techniques.

- Excellent problem-solving, analytical, and communication skills.

Preferred Qualifications :

- Master's degree or equivalent in Computer Science/Data Science.

- Knowledge of data streaming and real-time processing.

- Familiarity with data governance and security best practices.