Lead Data Engineer - SQL/Python (7-10 yrs)

Job Description : Lead Data Engineer.

Job Location : Hyderabad.

Experience : 7-10 years.

Position Overview : We are seeking an experienced and innovative Lead Data Engineer to join our team.

This role will be instrumental in designing, building, and optimizing our data infrastructure, enabling seamless data flow and ensuring the scalability, reliability, and performance of our systems.

The Lead Data Engineer will collaborate with cross-functional teams to deliver robust data solutions that drive actionable insights and business growth.

Key Responsibilities :

Data Architecture and Strategy :

- Design and implement scalable, high-performance data architectures to support analytical and operational needs.

- Develop a roadmap for data infrastructure and engineering projects aligned with business goals.

Pipeline Development :

- Build, optimize, and maintain robust ETL/ELT pipelines to process large volumes of structured and unstructured data.

- Ensure data quality, consistency, and reliability across all pipelines and systems.

Team Leadership :

- Lead and mentor a team of data engineers, fostering a culture of collaboration, innovation, and continuous learning.

- Provide technical guidance and code reviews to maintain high-quality engineering standards.

Collaboration :

- Partner with data scientists, analysts, and product teams to understand data requirements and deliver tailored solutions.

- Work closely with DevOps and infrastructure teams to ensure seamless integration and deployment of data systems.

Technology and Innovation :

- Stay current with industry trends, emerging technologies, and best practices in data engineering and big data.

- Evaluate and implement new tools, platforms, and technologies to improve data processing and analysis capabilities.

Governance and Compliance :

- Establish and enforce data governance policies and standards to ensure compliance with relevant regulations.

- Implement security measures to safeguard sensitive data and maintain system integrity.

Qualifications :

- 7-10 years of hands-on experience as a Data Engineer or a similar role.

- Strong proficiency in Python and SQL.

- Experience with cloud platforms (AWS, Azure, GCP) and cloud-native data services (e.g., AWS Redshift, Azure Synapse Analytics, Google BigQuery).

- Experience with data warehousing, data lake architectures, and ETL/ELT processes.

- Experience with big data technologies such as Hadoop, Spark, and Kafka.

- Experience with data modeling, data integration, and data quality best practices.

- Experience with Agile methodologies and DevOps practices.

- Strong analytical and problem-solving skills.

- Excellent communication, collaboration, and interpersonal skills.

- A passion for data and a strong desire to learn and grow.

Bonus Points :

- Experience with containerization technologies (Docker, Kubernetes)

- Experience with data visualization and business intelligence tools (Tableau, Power BI)

- Experience with machine learning and AI/ML platforms

- Experience with data streaming and real-time analytics

- Relevant certifications (e.g., AWS Certified Data Analytics - Specialty, Azure Data Engineer Associate)