Senior Data Engineer - ETL (5-10 yrs)

Position : Senior Data Engineer

Location : Bangalore

Employment Type : Full-Time

Experience Level : Senior (5+ years)

Job Overview :

We are looking for a Senior Data Engineer with over 5 years of experience to design, build, and maintain robust data infrastructure, including data warehouses and pipelines.

You will be responsible for implementing ETL processes, working with data warehouses like Redshift and ClickHouse, and managing data pipelines for efficient data flow.

Experience with Data Lakes, Knowledge Graph Databases (Neo4J), and Vector Databases is an added advantage.

If you're passionate about data, ETL processes, and driving insights from massive datasets, this role is for you.

Key Responsibilities :

- Design, develop, and optimize scalable data pipelines and ETL processes.

- Manage and maintain data warehouses such as Redshift or ClickHouse, ensuring data accuracy, consistency, and performance.

- Build and manage data lakes to support large-scale data storage and retrieval.

- Collaborate with data scientists, analysts, and other stakeholders to ensure smooth data accessibility and delivery.

- Monitor and troubleshoot data pipelines to maintain reliability and performance.

- Work with ETL tools and Python to automate and streamline data integration processes.

- Contribute to data architecture decisions, ensuring the system scales effectively and meets business requirements.

Required Qualifications :

- Data Warehousing : 5+ years of experience working with data warehouses like Amazon Redshift, ClickHouse, or similar systems.

- ETL Processes : Strong experience in designing, building, and maintaining ETL pipelines using industry-standard tools.

- Python Expertise : Proficiency in Python for data engineering tasks such as scripting, automation, and working with data frameworks.

- Data Pipeline : Hands-on experience building and optimizing data pipelines for structured and unstructured data.

Preferred Qualifications :

- Data Lakes : Experience with data lake architectures and managing large-scale data storage is a plus.

- Knowledge Graph DB : Exposure to graph databases like Neo4J is a plus.

- Vector Databases : Familiarity with vector databases for handling large-scale unstructured data is a plus.

Soft Skills :

- Strong problem-solving skills and the ability to work independently or in a team.

- Ability to communicate complex technical concepts clearly to both technical and non-technical stakeholders.

- Strong analytical mindset and attention to detail.

Educational Requirements :

- Bachelor's Degree: In Computer Science, Data Engineering, Information Technology, or a related field(or equivalent experience)