Sr. Data Engineering Lead

Roles & Responsibilities:

Data Engineering Leadership & Strategy:

Lead and mentor a team of data engineers, fostering a culture of technical excellence and collaboration.

Define and implement data engineering best practices, standards, and processes.

Data Pipeline Architecture & Development:

Design, build, and maintain scalable, robust, and efficient data pipelines for ingestion, transformation, and loading of data from various sources.

Optimize data pipelines for performance, reliability, and cost-effectiveness.

Implement data quality checks and monitoring systems to ensure data integrity.

Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.

Cloud-Based Data Infrastructure:

Design, implement, and manage cloud-based data infrastructure using platforms like AWS, Azure, or GCP.

Leverage cloud services (e.g., data lakes, data warehouses, serverless computing) to build scalable and cost-effective data solutions.

Leverage opensource airbyte , mage ai and similar

Ensure data security, governance, and compliance within the cloud environment.

Data Modeling & Warehousing:

Design and implement data models to support business intelligence, reporting, and analytics.

Optimize data warehouse performance for efficient querying and reporting.

Collaboration & Communication:

Collaborate effectively with cross-functional teams including product managers, software engineers, and business stakeholders.

Requirements:

Bachelor's or master's degree in computer science, Engineering, or a related field.

8+ years of proven experience in data engineering, with at least 3+ years in a lead role.

Expertise in building and maintaining data pipelines using tools such as Apache Spark, Apache Kafka, Apache Beam, or similar.

Proficiency in SQL and one or more programming languages like Python, Java, or Scala.

Hands-on experience with cloud-based data platforms (AWS, Azure, GCP) and services.

Locations : Mumbai, Delhi / NCR, Bengaluru , Kolkata, Chennai, Hyderabad, Ahmedabad, Pune, Remote

Work Timings: 2.30 pm - 11.30 pm IST