SQL Technical Lead - Big Data/Hadoop (6-8 yrs)

Role : SQL Technical Lead.

Location : Pune (Onsite).

Worked in Big data/ Hadoop ecosystem.

Exp range 6 to 8 yearsTech lead with some management exp - 8-10 experience

Strong relevant experience of 8 years in pySpark, Bigdata with ADLS Gen 2.

Key Responsibilities :

- Lead and mentor a team of SQL developers.

- Provide technical guidance and solutions to complex SQL problems.

- Oversee the design, development, and implementation of SQL solutions.

- Ensure adherence to best practices, coding standards, and performance optimization techniques.

- Strong proficiency in PySpark for data processing and analysis.

- In-depth knowledge of the Hadoop ecosystem (HDFS, YARN, MapReduce, Spark).

- Experience with Azure Data Lake Storage Gen2 (ADLS Gen2) for data storage and retrieval.

- Write efficient and optimized SQL queries for data extraction, transformation, and loading (ETL).

- Develop complex SQL procedures, functions, and triggers to automate data processes.

- Perform data quality checks and validation to ensure data accuracy and integrity.

- Identify and resolve performance bottlenecks in SQL queries and data pipelines.

- Implement indexing strategies and query optimization techniques to improve query performance.

- Collaborate with business analysts, data engineers, and other stakeholders to understand requirements and deliver solutions.

- Work closely with the team to ensure smooth project execution and timely delivery.

Required Skills and Experience :

- Strong proficiency in SQL, including advanced SQL concepts and functions.

- In-depth knowledge of PySpark for data processing and analysis.

- Experience with the Hadoop ecosystem (HDFS, YARN, MapReduce, Spark).

- Hands-on experience with Azure Data Lake Storage Gen2 (ADLS Gen2).

- Strong understanding of data warehousing and data modeling concepts.

- Experience with ETL processes and data pipelines.

- Excellent problem-solving and analytical skills.

- Strong communication and interpersonal skills.

- Ability to work independently and as part of a team.

Preferred Skills :

- Experience with cloud platforms like Azure or AWS.

- Knowledge of data visualization tools (Power BI, Tableau, etc.).

- Experience with machine learning and AI techniques.

- Certifications in relevant technologies (e.g., Azure Data Engineer, Hadoop Developer).