Lead Data Engineer

Role : Data Engineer Lead

Years Of Experience : 6+ years 

Work Location : Bengaluru, Hyderabad ,chennai, pune.

Key Responsibilities:

• Lead the design and implementation of scalable and high-performance data pipelines.
• Develop and implement data models that optimize data storage, processing, and retrieval, ensuring data consistency and accuracy.
• Design and manage data warehouses and data lakes with efficient data structures for easy querying and analysis.
• Lead a team of data engineers, providing technical guidance, mentoring, and career development.
• Build and manage automated data pipelines for the collection, transformation, and loading (ETL/ELT) of data from multiple sources into data storage systems (e.g., SQL databases, data lakes).
• Use Python and SQL to develop scripts that handle complex data processing tasks, including data cleansing, aggregation, transformation, and enrichment.
• Implement and manage orchestration tools (e.g., Apache Airflow, Prefect, Dagster) to automate the scheduling and monitoring of data workflows.
• Establish and manage CI/CD pipelines for automated testing, deployment, and monitoring of data engineering workflows.
• Optimize data storage, retrieval, and processing workflows for performance and cost efficiency.
• Implement data security measures and ensure compliance with data governance policies, including data privacy, access control, and auditability.
• Communicate data requirements, updates, and progress with stakeholders (e.g., product managers, data scientists, business analysts).

Preferred Qualifications:

• BS degree in Computer Science or Engineering or equivalent experience