Data Engineering Lead - ETL/Python (2-6 yrs)

Responsibilities :

- Design, develop, and maintain data pipelines using orchestration tools like Airflow or similar.

- Build and manage ETL/ELT processes to extract, transform, and load data from various sources.

- Develop and maintain data models and schemas in relational databases such as MySQL and PostgreSQL.

- Implement data transformations using tools like dbt or similar alternatives.

- Write clean, efficient, and well-documented code in Python and SQL.

- Collaborate with data analysts and data scientists to understand data requirements and provide support.

- Monitor and troubleshoot data pipeline performance and data quality issues.

- Implement and maintain data quality checks and validation processes.

- Deploy and manage data engineering tools and infrastructure.

- Optimize data storage and retrieval processes for performance and scalability.

- Stay up-to-date with the latest advancements in data engineering technologies and best practices.

Requirements :

- 2+ years of experience in software and data engineering.

- Experience with relational databases (MySQL, PostgreSQL, Redshift, BigQuery, Clickhouse, etc.).

- Solid software engineering fundamentals and proficiency in Python and optionally Typescript.

- Experience building data engineering pipelines using orchestration tools (Airflow, Airbyte, Temporal, etc.).

- Experience with data transformations using dbt or similar alternatives.

- Ability to ship high-quality data products.