Add office photos
All Filters
115 Metafolks Jobs
Data Engineer (Apache Spark and Scala)
Metafolks
posted 2mon ago
Job Role Insights
Flexible timing
Key skills for the job
Job Description
We are currently offering the following positions for a duration of 1 year, with the possibility of extension. Remote work options are available, but candidates should be based in Bangalore, Chennai, or Hyderabad, Pune,Noida
These roles will be under third-party.
Develop and maintain data pipelines using Apache Spark and Scala to process large volumes of data efficiently
Ability to write and optimize code in Scala for Spark applications.
Designing, creating, and maintaining Scala-based applications.
Create real-time data pipelines using Apache Spark
Build and maintain SQL databases using Spark SQL
Build and maintain a codebase for Apache Spark data processes
Develop distributed code using the Scala programming language
Flow Control in Scala, Functions in Scala, Data Structures in Scala
Build, deploy, and run Spark scripts
Transform structured data using SparkSQL, DataSets, and DataFrames
Optimize Spark jobs through partitioning, caching, and other techniques
Process continual streams of data with Spark Streaming
Should have understanding on Spark SQL, DataSets, Running Spark on Clusters, Scala Libraries
Experience with streaming data architectures and technologies for real-time and low-latency data processing
Employment Type: Full Time, Permanent
Read full job description What people at Metafolks are saying
What Metafolks employees are saying about work life
based on 1 employee
Flexible timing
Monday to Friday
No travel
Metafolks Benefits
View more benefits
Compare Metafolks with
TCS
Compare
Accenture
Compare
Cognizant
Compare
Wipro
Compare
Capgemini
Compare
HDFC Bank
Compare
ICICI Bank
Compare
Infosys
Compare
HCLTech
Compare
Tech Mahindra
Compare
Genpact
Compare
Teleperformance
Compare
Concentrix Corporation
Compare
Axis Bank
Compare
Amazon
Compare
Jio
Compare
Reliance Retail
Compare
IBM
Compare
iEnergizer
Compare
HDB Financial Services
Compare
Similar Jobs for you
Share an Interview