Add office photos
i
Photon Interactive
Compare
All Filters
255 Photon Interactive Jobs
SPARK Data Onboarding Engineer
5-10 years
Kolkata, Mumbai, New Delhi + 4 more
1 vacancy
SPARK Data Onboarding Engineer
Photon Interactive
posted 15d ago
Job Role Insights
Flexible timing
Key skills for the job
Job Description
- Design, develop, and test PySpark-based applications to process, transform, and analyze large-scale datasets from various sources, including relational databases, NoSQL databases, batch files, and real-time data streams.
- Implement efficient data transformation and aggregation using PySpark and relevant big data frameworks.
- Develop robust error handling and exception management mechanisms to ensure data integrity and system resilience within Spark jobs.
- Optimize PySpark jobs for performance, including partitioning, caching, and tuning of Spark configurations.
- Collaborate with data analysts, data scientists, and data architects to understand data processing requirements and deliver high-quality data solutions.
- Analyze and interpret data structures, formats, and relationships to implement effective data transformations using PySpark.
- Work with distributed datasets in Spark, ensuring optimal performance for large-scale data processing and analytics.
- Design and implement ETL (Extract, Transform, Load) processes to ingest and integrate data from various sources, ensuring consistency, accuracy, and performance.
- Integrate PySpark applications with data sources such as SQL databases, NoSQL databases, data lakes, and streaming platforms
- Bachelors degree in Computer Science, Information Technology, or a related field.
- 5+ years of hands-on experience in big data development, preferably with exposure to data-intensive applications.
- Strong understanding of data processing principles , techniques, and best practices in a big data environment.
- Proficiency in PySpark, Apache Spark, and related big data technologies for data processing, analysis, and integration.
- Experience with ETL development and data pipeline orchestration tools (e.g., Apache Airflow, Luigi).
- Strong analytical and problem-solving skills, with the ability to translate business requirements into technical solutions.
- Excellent communication and collaboration skills to work effectively with data analysts, data architects, and other team members.
Employment Type: Full Time, Permanent
Read full job descriptionPhoton Interactive Interview Questions & Tips
Prepare for Photon Interactive roles with real interview advice
What people at Photon Interactive are saying
What Photon Interactive employees are saying about work life
Photon Interactive Benefits
View more benefits
Compare Photon Interactive with
TCS
Infosys
Wipro
HCLTech
Tech Mahindra
LTIMindtree
Mphasis
Hexaware Technologies
Persistent Systems
Xoriant
CitiusTech
Iris Software
HERE Technologies
BT Business
HTC Global Services
iOPEX Technologies
Tietoevry
Evalueserve
Unisys
Infogain
Similar Jobs for you
Photon Interactive Chennai Office Locations
Tamil Nadu 600089
Chennai – 600089
Hiring For AEM Administrator
8-13 Yrs
Hyderabad / Secunderabad, Chennai, Bangalore / Bengaluru
Automation Test Engineer
7-12 Yrs
₹ 12 - 20L/yr
Chennai, Bangalore / Bengaluru
Google Cloud Platform (GCP) Architect
10-17 Yrs
₹ 15 - 27.5L/yr
Chennai, Bangalore / Bengaluru
