Add office photos
All Filters
45 Response Informatics Jobs
Streaming Data engineer
2-6 years
Kolkata, Mumbai, New Delhi + 4 more
1 vacancy
Streaming Data engineer
Response Informatics
posted 7hr ago
Job Role Insights
Fixed timing
Key skills for the job
Job Description
- Should be able to write code for the given scenario.
- Should have knowledge on Spark related queries
- MUST Have Flink coding/troubleshoot pipeline level knowledge
- Core Python (example : apply validation rules to csv file, String comparison, collections and Basic constructs)
- Spark Optimization and Spark Submit command.
- SQL MUST ( Example : join and Aggregate window Functions)
- Excellent Communication Skills
- Basics of Streaming pipeline
- basics of Spark Session, Streaming processing, and transformation of streaming data.
- Spark Streaming, kafka , hive etc. Spark or any Streaming technology
- Basics of Spark, hive etc.
- Overall Spark concepts about Sessions , context etc.
- Spark Streaming or Flink Streaming with Kafka project (hands on)
- Azure Cloud and services
Some of the set of queries might be asked for Evaluation:
- Difference between Spark Streaming session Vs Batch Sessions
- Spark Structured Streaming
- spark.readStream() method used to read data in Spark Streaming Application
- Use of writeStream method and what are different arguments supported by it ? to write data frame to provided sink, it has arguments like format, location, writeMode etc.
- Action need to call for reading data from kafka queue ? start()
- print output of streaming operation on Terminal Using format( console )
Candidates MUST have worked on below (should have Hands-on experience / worked on multiple projects)
Python
SQL
Apache Flink
Spark
Apache Kafka
Batch processing
Hive or snowflake
Employment Type: Full Time, Permanent
Read full job descriptionPrepare for Data Engineer roles with real interview advice
People are getting interviews at Response Informatics through
People are getting interviews through
(based on 2 Response Informatics interviews)
Referral
100%
Low
Confidence
?
Low Confidence means the data is based on a small number of responses received from the candidates.
What people at Response Informatics are saying
What Response Informatics employees are saying about work life
based on 24 employees
Strict timing
Monday to Friday
No travel
Day Shift
Response Informatics Benefits
Job Training 
Soft Skill Training 
Work From Home 
Health Insurance 
Team Outings 
Compare Response Informatics with
TCS
Compare
Infosys
Compare
Wipro
Compare
HCLTech
Compare
Tech Mahindra
Compare
LTIMindtree
Compare
Mphasis
Compare
Hexaware Technologies
Compare
Persistent Systems
Compare
HCL Infosystems
Compare
AYN InfoTech
Compare
Izmo
Compare
Acer India
Compare
Sagarsoft
Compare
Agility E Services
Compare
Expedien eSolutions
Compare
RS Software
Compare
DCM Infotech
Compare
Nxtra Data
Compare
Monotype
Compare
Similar Jobs for you
Business Development Executive (BDE)
2-5 Yrs
Kolkata, Mumbai, New Delhi +4 more
Share an Interview