AmbitionBox
Jobs
- Reviews
- Salaries
- Interview Questions
- About Company
- Benefits
- Jobs
- Office Photos
- Community
Add office photos
i
Photon Interactive
Compare
All Filters
271 Photon Interactive Jobs
SPARK Data Onboarding Engineer
5-10 years
Kolkata, Mumbai, New Delhi + 4 more
1 vacancy
SPARK Data Onboarding Engineer
Photon Interactive
posted 1mon ago
Job Role Insights
Flexible timing
Key skills for the job
Job Description
- Design, develop, and test PySpark-based applications to process, transform, and analyze large-scale datasets from various sources, including relational databases, NoSQL databases, batch files, and real-time data streams.
- Implement efficient data transformation and aggregation using PySpark and relevant big data frameworks.
- Develop robust error handling and exception management mechanisms to ensure data integrity and system resilience within Spark jobs.
- Optimize PySpark jobs for performance, including partitioning, caching, and tuning of Spark configurations.
- Collaborate with data analysts, data scientists, and data architects to understand data processing requirements and deliver high-quality data solutions.
- Analyze and interpret data structures, formats, and relationships to implement effective data transformations using PySpark.
- Work with distributed datasets in Spark, ensuring optimal performance for large-scale data processing and analytics.
- Design and implement ETL (Extract, Transform, Load) processes to ingest and integrate data from various sources, ensuring consistency, accuracy, and performance.
- Integrate PySpark applications with data sources such as SQL databases, NoSQL databases, data lakes, and streaming platforms
- Bachelors degree in Computer Science, Information Technology, or a related field.
- 5+ years of hands-on experience in big data development, preferably with exposure to data-intensive applications.
- Strong understanding of data processing principles , techniques, and best practices in a big data environment.
- Proficiency in PySpark, Apache Spark, and related big data technologies for data processing, analysis, and integration.
- Experience with ETL development and data pipeline orchestration tools (e.g., Apache Airflow, Luigi).
- Strong analytical and problem-solving skills, with the ability to translate business requirements into technical solutions.
- Excellent communication and collaboration skills to work effectively with data analysts, data architects, and other team members.
Employment Type: Full Time, Permanent
Read full job descriptionPhoton Interactive Interview Questions & Tips
Prepare for Photon Interactive roles with real interview advice
Top Photon Interactive Onboarding Engineer Interview Questions
What people at Photon Interactive are saying
What Photon Interactive employees are saying about work life
Photon Interactive Benefits
View more benefits
Compare Photon Interactive with
TCS
Infosys
Wipro
HCLTech
Tech Mahindra
LTIMindtree
Mphasis
Hexaware Technologies
Persistent Systems
Xoriant
CitiusTech
Iris Software
HTC Global Services
HERE Technologies
iOPEX Technologies
Tietoevry
Collabera Technologies
Evalueserve
Unisys
Infogain
Similar Jobs for you
Photon Interactive Chennai Office Locations
Tamil Nadu 600089
Chennai – 600089
Sr Developer - Java API with Elastic
8-9 Yrs
Kolkata, Mumbai, New Delhi +4 more
Sr Software Engineer - Java,AWS - CHN
6-9 Yrs
Kolkata, Mumbai, New Delhi +4 more
Recently Viewed
SALARIES
TCS
SALARIES
Koch Business Solutions
JOBS
Applied Materials
No Jobs
JOBS
Travtech Software
No Jobs
PHOTOS
Vendasta Technology (India) Private Limited
No Photos
JOBS
Vendasta Technology (India) Private Limited
No Jobs
SALARIES
Persistent Systems
COMPANY BENEFITS
TCS
No Benefits
JOBS
Nuvento Systems
No Jobs
COMPANY BENEFITS
TCS
No Benefits
