Upload Button Icon Add office photos
Engaged Employer

i

This company page is being actively managed by Careernet Team. If you also belong to the team, you can get access from here

Careernet Verified Tick

Compare button icon Compare button icon Compare
filter salaries All Filters

22 Careernet Jobs

Principal Engineer - Python/Spark (10-15 yrs)

10-15 years

Principal Engineer - Python/Spark (10-15 yrs)

Careernet

posted 2d ago

Job Role Insights

Fixed timing

Job Description

Job Description :


Requirements :


- Strong experience (12+ years) in Scala programming language and extensive experience with Apache Spark for Big Data processing for design, developing and maintaining scalable on-prem and cloud environments, especially on AWS EMR.


- Proficiency in performance tuning of Spark jobs, optimizing resource usage, shuffling, partitioning, and caching for maximum efficiency in Big Data environments.


- In-depth understanding of the Hadoop ecosystem, including HDFS, YARN, and MapReduce.


- Expertise in designing and implementing scalable, fault-tolerant data pipelines with end-to-end monitoring and alerting.


- Using Python to develop infrastructure modules. Hence, hands-on experience with Python.


- Solid grasp of database systems and SQLs for writing efficient SQLs (RDBMS/Warehouse) to handle TBS of data.


- Familiarity with design patterns and best practices for efficient data modeling, partitioning

strategies, and sharding for distributed systems and experience in building, scheduling, and maintaining DAG workflows.


- End-to-end ownership with definition, development, and documentation of software's objectives, business requirements, deliverables, and specifications in collaboration with stakeholders.


- Experience in working on GIT (or equivalent source control) and solid understanding of Unit and integration test frameworks.


- Must have the ability to collaborate with stakeholders/teams to understand requirements and develop a working solution and the ability to work within tight deadlines and effectively

prioritize and execute tasks in a high-pressure environment.


- Must be able to mentor junior staff.


Functional Areas: Other

Read full job description

Prepare for Principal Engineer roles with real interview advice

What people at Careernet are saying

What Careernet employees are saying about work life

based on 638 employees
54%
46%
78%
99%
Strict timing
Monday to Friday
No travel
Day Shift
View more insights

Careernet Benefits

Cafeteria
Work From Home
Job Training
Team Outings
Health Insurance
Soft Skill Training +6 more
View more benefits

Compare Careernet with

ABC Consultants

3.9
Compare

Team Lease

3.9
Compare

Mafoi Randstad

4.5
Compare

Kelly Services

4.2
Compare

Quess

3.9
Compare

Adecco Group

3.7
Compare

ManpowerGroup

3.8
Compare

Gi Group

3.9
Compare

Randstad

3.8
Compare

Iksula

3.5
Compare

Innovsource Services

4.0
Compare

IMPACT Infotech

3.4
Compare

Teamware Solutions

4.2
Compare

CIEL HR

4.0
Compare

First Advantage

3.8
Compare

LanceSoft

3.1
Compare

Kutumbh Care

3.9
Compare

Progressive Infovision

4.2
Compare

Experis IT

3.0
Compare

PeopleStrong

3.4
Compare

Similar Jobs for you

Software Python Engineer at Yo HR Consultancy

5-10 Yrs

₹ 15-35 LPA

Scala Developer at Radioactive Technologies

10-12 Yrs

₹ 27-32 LPA

Big Data Engineer Lead at TalentXo

5-10 Yrs

₹ 28-40 LPA

Software Python Engineer at Ara Resources Pvt Ltd

5-10 Yrs

₹ 20-35 LPA

Principal Data Engineer at Recruise India Consulting

15-24 Yrs

₹ 40-60 LPA

Engineer at AU SMALL FINANCE BANK Limited

5-8 Yrs

₹ 15-30 LPA

Senior Big Data Engineer at Yogy HR Solutions

6-10 Yrs

₹ 20-24 LPA

Principal Data Engineer at Cloudsufi India Private Limited

15-20 Yrs

₹ 35-56 LPA

Principal Data Engineer at Cloudsufi India Private Limited

15-20 Yrs

₹ 35-56 LPA

Architect at Zenfinet

10-17 Yrs

₹ 10-40 LPA

Principal Engineer - Python/Spark (10-15 yrs)

10-15 Yrs

2d ago·via hirist.com

Engineering Manager (10-14 yrs)

10-14 Yrs

2d ago·via hirist.com

Cloud Development Engineer - CI/CD (4-9 yrs)

4-9 Yrs

2d ago·via hirist.com

AI Solution Engineer - Generative AI (1-3 yrs)

1-3 Yrs

2d ago·via hirist.com

Full Stack Developer - C#/Javascript (5-8 yrs)

5-8 Yrs

3d ago·via hirist.com

Vendor Manager - eCommerce - Apparels (2-8 yrs)

2-8 Yrs

8d ago·via iimjobs.com
write
Share an Interview