Upload Button Icon Add office photos
filter salaries All Filters

65 Recruit Elite Jobs

Lead Data Engineer - Python (5-9 yrs)

5-9 years

Lead Data Engineer - Python (5-9 yrs)

Recruit Elite

posted 1mon ago

Job Description

Role & Responsibilities :

Lifesight is growing rapidly and seeking a strong Data Engineer to be a key member of the Data and Business Intelligence organization with a focus on deep data engineering projects. You will be joining as one of the few initial data engineers as part of the data platform team in our Bengaluru office. You will have an opportunity to help define our technical strategy and data engineering team culture in India.

You will design and build data platforms and services while managing our data infrastructure in cloud environments that fuel strategic business decisions across Lifesight products.

A successful candidate will be a self-starter, who drives excellence, is ready to jump into a variety of big data technologies & frameworks, and is able to coordinate and collaborate with other engineers, as well as mentor other engineers in the team.

What You'll Be Doing :

- Build highly scalable, available, fault-tolerant distributed data processing systems (batch and streaming systems) processing over 100s of terabytes of data ingested every day and petabyte-sized data warehouse and elasticsearch cluster.

- Build quality data solutions and refine existing diverse datasets to simplified models encouraging self-service.

- Build data pipelines that optimize on data quality and are resilient to poor-quality data sources.

- Own the data mapping, business logic, transformations, and data quality.

- Low-level systems debugging, performance measurement & optimization on large production clusters.

- Participate in architecture discussions, influence product roadmap, and take ownership and responsibility over new projects.

- Maintain and support existing platforms and evolve to newer technology stacks and architectures.

Ideal Candidate :

- Proficiency in Python and PySpark.

- Deep understanding of Apache Spark, Spark tuning, creating RDDs, and building data frames.

- Experience in big data technologies like HDFS, YARN, Map-Reduce, Hive, Kafka, Spark, Airflow, Presto, etc.

- Experience in building distributed environments using any of Kafka, Spark, Hive, Hadoop, etc.

- Good understanding of the architecture and functioning of distributed database systems.

- Experience working with various file formats like Parquet, Avro, etc., for large volumes of data.

- Experience with one or more NoSQL databases.

- Experience with AWS, GCP.

- 5+ years of professional experience as a data or software engineer.


Functional Areas: Software/Testing/Networking

Read full job description

What people at Recruit Elite are saying

Recruit Elite Benefits

Free Transport
Child care
Gymnasium
Cafeteria
Work From Home
Free Food +6 more
View more benefits

Compare Recruit Elite with

Accenture

3.8
Compare

Infosys

3.6
Compare

Wipro

3.7
Compare

Amazon

4.1
Compare

Capgemini

3.7
Compare

IBM

4.0
Compare

Genpact

3.8
Compare

Tech Mahindra

3.5
Compare

Teleperformance

3.9
Compare

Cognizant

3.7
Compare

WNS

3.4
Compare

TCS

3.7
Compare

HCLTech

3.5
Compare

iEnergizer

4.6
Compare

Bharti Airtel

4.0
Compare

HDFC Bank

3.9
Compare

Axis Bank

3.8
Compare

LTIMindtree

3.8
Compare

HDB Financial Services

3.9
Compare

Jio

3.9
Compare

Similar Jobs for you

Lead Data Engineer at TalentXO

5-9 Yrs

₹ 34-45 LPA

Lead Data Engineer at Hiringeye

7-10 Yrs

₹ 22-28 LPA

Lead Data Engineer at TALENT XO

5-9 Yrs

₹ 30-45 LPA

Lead Data Engineer at Recruit Elite

5-9 Yrs

₹ 40-45 LPA

Lead Data Engineer at Tech Recruitz Solutions

5-9 Yrs

₹ 30-45 LPA

Lead Data Engineer at Cynosure Corporate Solutions

8-12 Yrs

₹ 35-40 LPA

Lead Data Engineer at Innovatily Pvt. Ltd

8-12 Yrs

₹ 24-30 LPA

Lead Data Engineer at Recro

8-12 Yrs

₹ 25-32 LPA

Lead Data Engineer at Sound of the Sun

5-9 Yrs

₹ 15-42 LPA

Lead Data Engineer at SMARTWORK IT SERVICES

8-10 Yrs

₹ 10-24 LPA

Lead Data Engineer - Python (5-9 yrs)

5-9 Yrs

1mon ago·via hirist.com

Associate - Sales - IT (1-6 yrs)

1-6 Yrs

26d ago·via updazz.com

Direct Response Copywriter (3-6 yrs)

3-6 Yrs

27d ago·via updazz.com

Principal Engineer - Java Technologies (7-12 yrs)

7-12 Yrs

1mon ago·via hirist.com

Senior UX Designer - Figma/Sketch (3-5 yrs)

3-5 Yrs

1mon ago·via hirist.com

Principal UX Designer - Figma/InVision (6-8 yrs)

6-8 Yrs

1mon ago·via hirist.com

Engineering Manager - PHP/Node.js (10-15 yrs)

10-15 Yrs

1mon ago·via hirist.com

Senior Software Engineer - Python (6-10 yrs)

6-10 Yrs

1mon ago·via hirist.com

Recently Viewed

REVIEWS

DMICDC Logistics Data Services

No Reviews

REVIEWS

NEC

No Reviews

JOBS

Inferenz Tech

No Jobs

SALARIES

NEC

JOBS

NEC

No Jobs

JOBS

NEC

No Jobs

SALARIES

KISCO India

No Salaries

LIST OF COMPANIES

NEC

Locations

SALARIES

Brillio

No Salaries

SALARIES

NEC

write
Share an Interview
How was your last interview experience?
Rate your experience using AmbitionBox
Terrible
Terrible
Poor
Poor
Average
Average
Good
Good
Excellent
Excellent