Upload Button Icon Add office photos
Engaged Employer

i

This company page is being actively managed by Photon Interactive Team. If you also belong to the team, you can get access from here

Photon Interactive Verified Tick

Compare button icon Compare button icon Compare
filter salaries All Filters

283 Photon Interactive Jobs

SPARK Data Onboarding Engineer

5-10 years

Kolkata, Mumbai, New Delhi + 4 more

1 vacancy

SPARK Data Onboarding Engineer

Photon Interactive

posted 1mon ago

Job Description

Job Title: PySpark Data Engineer
Summary:
We are seeking a skilled PySpark Data Engineer to join our team and drive the development of robust data processing and transformation solutions within our data platform. You will be responsible for designing, implementing, and maintaining PySpark-based applications to handle complex data processing tasks, ensure data quality, and integrate with diverse data sources. The ideal candidate possesses strong PySpark development skills, experience with big data technologies, and the ability to work in a fast-paced, data-driven environment.
Key Responsibilities: Data Engineering Development:
  • Design, develop, and test PySpark-based applications to process, transform, and analyze large-scale datasets from various sources, including relational databases, NoSQL databases, batch files, and real-time data streams.
  • Implement efficient data transformation and aggregation using PySpark and relevant big data frameworks.
  • Develop robust error handling and exception management mechanisms to ensure data integrity and system resilience within Spark jobs.
  • Optimize PySpark jobs for performance, including partitioning, caching, and tuning of Spark configurations.
Data Analysis and Transformation:
  • Collaborate with data analysts, data scientists, and data architects to understand data processing requirements and deliver high-quality data solutions.
  • Analyze and interpret data structures, formats, and relationships to implement effective data transformations using PySpark.
  • Work with distributed datasets in Spark, ensuring optimal performance for large-scale data processing and analytics.
Data Integration and ETL:
  • Design and implement ETL (Extract, Transform, Load) processes to ingest and integrate data from various sources, ensuring consistency, accuracy, and performance.
  • Integrate PySpark applications with data sources such as SQL databases, NoSQL databases, data lakes, and streaming platforms
Qualifications and Skills:
  • Bachelors degree in Computer Science, Information Technology, or a related field.
  • 5+ years of hands-on experience in big data development, preferably with exposure to data-intensive applications.
  • Strong understanding of data processing principles , techniques, and best practices in a big data environment.
  • Proficiency in PySpark, Apache Spark, and related big data technologies for data processing, analysis, and integration.
  • Experience with ETL development and data pipeline orchestration tools (e.g., Apache Airflow, Luigi).
  • Strong analytical and problem-solving skills, with the ability to translate business requirements into technical solutions.
  • Excellent communication and collaboration skills to work effectively with data analysts, data architects, and other team members.

Employment Type: Full Time, Permanent

Read full job description

Photon Interactive Interview Questions & Tips

Prepare for Photon Interactive roles with real interview advice

Top Photon Interactive Onboarding Engineer Interview Questions

Q1. What are design patterns, and have you implemented any of the design pattern in your previous project, can you explain?
Q2. What tools do you use and why do you required them?
Q3. What is responsive design ? How will you develop responsive websites ?
View all 67 questions

What people at Photon Interactive are saying

What Photon Interactive employees are saying about work life

based on 1.8k employees
67%
91%
70%
84%
Flexible timing
Monday to Friday
No travel
Day Shift
View more insights

Photon Interactive Benefits

Work From Home
Cafeteria
Team Outings
Health Insurance
Job Training
Soft Skill Training +6 more
View more benefits

Compare Photon Interactive with

TCS

3.7
Compare

Infosys

3.6
Compare

Wipro

3.7
Compare

HCLTech

3.5
Compare

Tech Mahindra

3.5
Compare

LTIMindtree

3.8
Compare

Mphasis

3.4
Compare

Hexaware Technologies

3.5
Compare

Persistent Systems

3.5
Compare

Xoriant

4.1
Compare

CitiusTech

3.4
Compare

Iris Software

4.0
Compare

HTC Global Services

3.6
Compare

HERE Technologies

3.9
Compare

iOPEX Technologies

3.5
Compare

Tietoevry

4.3
Compare

Collabera Technologies

3.5
Compare

Evalueserve

3.3
Compare

Unisys

3.7
Compare

Infogain

3.6
Compare

Similar Jobs for you

Cloud Data Engineer at Brighttier

Kolkata, Mumbai + 5

7-15 Yrs

₹ 10-14 LPA

Senior Data Engineer at Picarro

Kolkata, Mumbai + 5

3-7 Yrs

₹ 5-9 LPA

Data Engineer at Metafolks

Remote

3-8 Yrs

₹ 6-10 LPA

Big Data Engineer at RARR Technologies

Hyderabad / Secunderabad

6-12 Yrs

₹ 8-14 LPA

Spark Developer at Smurk IT India

Chennai

2-6 Yrs

₹ 4-8 LPA

Spark Developer at Infotel UK Consulting

Chennai

2-7 Yrs

₹ 4-9 LPA

Spark Developer at Natobotics

Pune

4-9 Yrs

₹ 5-9 LPA

Spark Developer at N Consulting Global

Pune

4-9 Yrs

₹ 7-25 LPA

Data Engineer at Angel Broking Limited

Kolkata, Mumbai + 5

4-8 Yrs

₹ 6-10 LPA

Software Developer at Ericsson India Global Services Pvt. Ltd.

Gurgaon / Gurugram

2-7 Yrs

₹ 7-11 LPA

Photon Interactive Chennai Office Locations

View all
Chennai Office
5th Block, 2nd Floor, DLF IT Park, 1/124, Mount Poonamallee Road, Sivaji Gardens, Manapakkam, Chennai
Tamil Nadu 600089
Chennai Office
5th Block, 2nd Floor, DLF IT Park, 1/124, Mount Poonamallee Road, Sivaji Gardens, Manapakkam, Chennai
Chennai – 600089

SPARK Data Onboarding Engineer

5-10 Yrs

Kolkata, Mumbai, New Delhi +4 more

1mon ago·via naukri.com

Scrum Master

8-13 Yrs

Kolkata, Mumbai, New Delhi +4 more

10hr ago·via naukri.com

Sr. Scrum Master

9-14 Yrs

Pune

11hr ago·via naukri.com

Java Developer with AWS

5-10 Yrs

Chennai

13hr ago·via naukri.com

React JS Developer

4-7 Yrs

₹ 15 - 25L/yr

Chennai

1d ago·via naukri.com

Project Manager

3-7 Yrs

Remote

1d ago·via naukri.com

QA Lead_Offshore

6-10 Yrs

Remote

1d ago·via naukri.com

Hiring For React.js Senior Developer / Technical Lead

6-11 Yrs

₹ 25 - 40L/yr

Chennai, Bangalore / Bengaluru

2d ago·via naukri.com

Full Stack

3-7 Yrs

Kolkata, Mumbai, New Delhi +4 more

2d ago·via naukri.com

Lead Software Engineer WMOS - Pune/HYD

8-13 Yrs

Kolkata, Mumbai, New Delhi +4 more

2d ago·via naukri.com
write
Share an Interview