Upload Button Icon Add office photos
Engaged Employer

i

This company page is being actively managed by Tech Recruitz Solutions Team. If you also belong to the team, you can get access from here

Tech Recruitz Solutions Verified Tick

Compare button icon Compare button icon Compare
filter salaries All Filters

6 Tech Recruitz Solutions Jobs

Lead Data Engineer - Python (5-9 yrs)

5-9 years

Lead Data Engineer - Python (5-9 yrs)

Tech Recruitz Solutions

posted 1d ago

Job Description

Role & Responsibilities :

- Build highly scalable, available, fault-tolerant distributed data processing systems (batch and streaming systems) processing over 100s of terabytes of data ingested every day and petabyte-sized data warehouse and elasticsearch cluster.


- Build quality data solutions and refine existing diverse datasets to simplified models encouraging self-service.


- Build data pipelines that optimize on data quality and are resilient to poor-quality data sources.


- Own the data mapping, business logic, transformations, and data quality.


- Low-level systems debugging, performance measurement & optimization on large production clusters.


- Participate in architecture discussions, influence product roadmap, and take ownership and responsibility over new projects.


- Maintain and support existing platforms and evolve to newer technology stacks and architectures.


Ideal Candidate :


- Proficiency in Python and PySpark.


- Deep understanding of Apache Spark, Spark tuning, creating RDDs, and building data frames.


- Experience in big data technologies like HDFS, YARN, Map-Reduce, Hive, Kafka, Spark, Airflow, Presto, etc.


- Experience in building distributed environments using any of Kafka, Spark, Hive, Hadoop, etc.


- Good understanding of the architecture and functioning of distributed database systems.


- Experience working with various file formats like Parquet, Avro, etc., for large volumes of data.


- Experience with one or more NoSQL databases.


- Experience with AWS, GCP.


- 5+ years of professional experience as a data or software engineer.


Functional Areas: Software/Testing/Networking

Read full job description

Compare Tech Recruitz Solutions with

TCS

3.7
Compare

Accenture

3.8
Compare

Wipro

3.7
Compare

Cognizant

3.7
Compare

Capgemini

3.7
Compare

HDFC Bank

3.9
Compare

Infosys

3.6
Compare

ICICI Bank

4.0
Compare

HCLTech

3.5
Compare

Tech Mahindra

3.5
Compare

Genpact

3.8
Compare

Teleperformance

3.9
Compare

Concentrix Corporation

3.8
Compare

Axis Bank

3.8
Compare

Amazon

4.1
Compare

Jio

3.9
Compare

Reliance Retail

3.9
Compare

iEnergizer

4.6
Compare

IBM

4.0
Compare

LTIMindtree

3.8
Compare

Similar Jobs for you

Lead Data Engineer at Recruit Elite

5-9 Yrs

₹ 30-40 LPA

Lead Data Engineer at TALENT XO

5-9 Yrs

₹ 30-40 LPA

Lead Data Engineer at TALENT XO

5-9 Yrs

₹ 30-45 LPA

Lead Data Engineer at TalentXO

5-9 Yrs

₹ 34-45 LPA

Lead Data Engineer at Hiringeye

7-10 Yrs

₹ 22-28 LPA

Lead Data Engineer at Innovatily Pvt. Ltd

8-12 Yrs

₹ 24-30 LPA

Lead Data Engineer at Cloud Destinations

5-7 Yrs

₹ 15-25 LPA

Lead Data Engineer at Eucloid Data Solutions Pvt Ltd

5-10 Yrs

₹ 12-28 LPA

Lead Data Engineer at SMARTWORK IT SERVICES

8-10 Yrs

₹ 10-24 LPA

Lead Data Engineer at Kadel Labs Private Limited

3-8 Yrs

₹ 10-29 LPA

Lead Data Engineer - Python (5-9 yrs)

5-9 Yrs

1d ago·via hirist.com

Senior Data Scientist - Python (4-6 yrs)

4-6 Yrs

17d ago·via hirist.com
write
Share an Interview