Lead Data Engineer - Python/SQL (5-8 yrs)

Lead Data Engineer.

Experience : 5 - 8 years in Startup (Product Company).

MUST EXPERIENCE :

- Python with Panda.

- SQL.

- Azure / AWS.

- Has to be from Product Development and not Service Industry.

- Start up culture.

- Must have worked on Data Pipelines and not maintenance of SW Products.

- 80% Development so has to be hands on development experience.

Job Overview :

We are seeking an experienced Lead Data Engineer to design, develop, and optimize scalable data engineering pipelines.

You will lead the data function, define strategy, and ensure our data systems are secure, efficient, and aligned with business needs.

Key Responsibilities :

- Architect, develop, and deploy scalable and configurable ETL pipelines for batch and streaming data.

- Lead the data strategy, roadmap, and stakeholder relationships.

- Optimize pipeline performance and implement real-time monitoring.

- Design and develop robust data APIs and services.

- Review and enhance the codebase, ensuring security and scalability.

- Mentor team members and contribute to organizational growth.

Mandatory Skills :

- Expertise in Python and SQL.

- Experience with Spark in a production environment.

- Strong knowledge of data modeling, design, and ETL frameworks.

- Hands-on experience with orchestration tools (e.g, Airflow, Kubeflow).

- Proficiency in cloud platforms like AWS or Azure.

- Familiarity with developer tools (e.g, Linux, GitHub, Docker, VSCode).

Preferred Skills :

- Familiarity with Pandas API and distributed systems.

- Strong understanding of data structures, algorithms, and data warehousing technologies.

Why Join Us ?

- Opportunity to lead cutting-edge data engineering projects.

- Work in a fast-paced, collaborative environment.

- Contribute to building a high-impact data function.