Home
Communities
Companies
- Companies
  
  Discover best places to work
- Compare Companies
  
  Compare & find best workplace
- Add Office Photos
  
  Bring your workplace to life
- Add Company Benefits
  
  Highlight your company's perks
Reviews
- Company reviews
  
  Read reviews for 6L+ companies
- Write a review
  
  Rate your former or current company
Salaries
- Browse salaries
  
  Discover salaries for 6L+ companies
- Salary calculator
  
  Calculate your take home salary
- Are you paid fairly?
  
  Check your market value
- Share your salary
  
  Help other jobseekers
- Gratuity calculator
  
  Check your gratuity amount
- HRA calculator
  
  Check how much of your HRA is tax-free
- Salary hike calculator
  
  Check your salary hike
Interviews
- Company interviews
  
  Read interviews for 40K+ companies
- Campus placements
  
  Interviews questions for 2K+ colleges
- Share interview questions
  
  Contribute your interview questions
Jobs
Awards

WINNERS AWAITED!
- ABECA 2025
  
  WINNERS AWAITED!
  
  AmbitionBox Employee Choice Awards - 4th Edition
- ABECA 2024
  
  AmbitionBox Employee Choice Awards - 3rd Edition
- AmbitionBox Best Places to Work 2022
  
  2nd Edition
- AmbitionBox Best Places to Work 2021
  
  1st Edition

For Employers

Add office photos

Engaged Employer

Ernst & Young

Compare

3.4

based on 10.7k Reviews

Video summary

2206 Ernst & Young Jobs

Data Engineering Lead

Ernst Young

3.4

based on 10.7k Reviews

8-10 years

Kochi

1 vacancy

Data Engineering Lead

Ernst & Young

posted 5d ago

Job Role Insights

Flexible timing

Key skills for the job

DevOps Python Quality Assurance Consulting SQL SAP Business Intelligence

+ 2 more

Job Description

Data Engineering Lead is responsible for collaborating with the Data Architect to design and implement scalable data lake architecture and data pipelines

Position Summary

Design and implement scalable data lake architectures using Azure Data Lake services.
Develop and maintain data pipelines to ingest data from various sources.
Optimize data storage and retrieval processes for efficiency and performance.
Ensure data security and compliance with industry standards.
Collaborate with data scientists and analysts to facilitate data accessibility.
Monitor and troubleshoot data pipeline issues to ensure reliability.
Document data lake designs, processes, and best practices.
Experience with SQL and NoSQL databases, as well as familiarity with big data file formats like Parquet and Avro.

Roles and Responsibilities

Essential

Must Have Skills

Azure Data Lake
Azure Synapse Analytics
Azure Data Factory
Azure DataBricks
Python (PySpark, Numpy etc)
SQL
ETL
Data warehousing
Azure Devops
Experience in developing streaming pipeline using Azure Event Hub, Azure Stream analytics, Spark streaming
Experience in integration with business intelligence tools such as Power BI

Good to have skills

Big Data technologies (e.g., Hadoop, Spark)
Data security

General Skills

Experience with Agile and DevOps methodologies and the software development lifecycle.
Proactive and responsible for deliverables
Escalates dependencies and risks
Works with most DevOps tools, with limited supervision
Completion of assigned tasks on time and regular status reporting
Should be able to train new team members
Desired to have knowledge on any of the cloud solutions such as Azure or AWS with DevOps/Cloud certifications.
Should be able to work with a multi culture global teams and team virtually
Should be able to build strong relationship with project stakeholders