Lead Data Engineer - Data Visualization Tools (8-10 yrs)

Role Description :

This is a full-time on-site role as a Lead Data Engineer located in Bengaluru.

As a Lead Data Engineer, you will be responsible for overseeing the data engineering team, designing and implementing scalable data solutions, and ensuring data quality and integrity.

Your day-to-day tasks will include developing ETL processes, optimizing data pipelines, and collaborating with cross-functional teams to support data-driven decision-making.

Responsibilities :

- Lead, mentor, and guide a team of data engineers.

- Assign tasks, provide technical guidance, and conduct performance reviews.

- Foster a collaborative and high-performing team environment.

- Design, develop, and implement data pipelines and architectures for data ingestion, transformation, storage, and consumption.

- Develop and implement ETL/ELT processes using various tools and technologies.

- Optimize data pipelines for performance, scalability, and cost-effectiveness.

- Ensure data quality and integrity throughout the data lifecycle.

- Implement data governance and security best practices.

- Design and develop data models for data warehouses, data lakes, and other data stores.

- Define and implement data standards and best practices.

- Experience with cloud platforms (AWS, Azure, GCP) and cloud-based data services.

- Design and implement cloud-based data solutions.

- Stay abreast of the latest advancements in data engineering technologies and best practices.

- Research and evaluate new technologies and tools to improve data operations.

Qualifications :

- 8+ years of experience in data engineering, data warehousing, and data integration.

- 5+ years of experience leading and mentoring data engineering teams.

- Strong proficiency in SQL and scripting languages (Python, Scala).

- Experience with big data technologies (Hadoop, Spark).

- Experience with cloud platforms (AWS, Azure, GCP) and cloud-based data services.

- Experience with data modeling techniques (dimensional modeling, star schema).

- Experience with ETL/ELT tools and technologies.

- Strong analytical and problem-solving skills.

- Excellent communication and interpersonal skills.

- Strong leadership and mentoring skills.

Desired Skills :

- Experience with data streaming platforms (Kafka, Kinesis).

- Experience with data visualization tools (Tableau, Power BI).

- Experience with containerization technologies (Docker, Kubernetes).

- Experience with Agile development methodologies