Home
Communities
Companies
- Companies
  
  Discover best places to work
- Compare Companies
  
  Compare & find best workplace
- Add Office Photos
  
  Bring your workplace to life
- Add Company Benefits
  
  Highlight your company's perks
Reviews
- Company reviews
  
  Read reviews for 6L+ companies
- Write a review
  
  Rate your former or current company
Salaries
- Browse salaries
  
  Discover salaries for 6L+ companies
- Salary calculator
  
  Calculate your take home salary
- Are you paid fairly?
  
  Check your market value
- Share your salary
  
  Help other jobseekers
- Gratuity calculator
  
  Check your gratuity amount
- HRA calculator
  
  Check how much of your HRA is tax-free
- Salary hike calculator
  
  Check your salary hike
Interviews
- Company interviews
  
  Read interviews for 40K+ companies
- Campus placements
  
  Interviews questions for 2K+ colleges
- Share interview questions
  
  Contribute your interview questions
Jobs
Awards

WINNERS AWAITED!
- ABECA 2025
  
  WINNERS AWAITED!
  
  AmbitionBox Employee Choice Awards - 4th Edition
- ABECA 2024
  
  AmbitionBox Employee Choice Awards - 3rd Edition
- AmbitionBox Best Places to Work 2022
  
  2nd Edition
- AmbitionBox Best Places to Work 2021
  
  1st Edition

Add office photos

Employer? Claim Account for FREE

Metafolks

Compare

5.0

based on 1 Review

164 Metafolks Jobs

Data Engineer (Apache Spark and Scala)

Metafolks

5.0

based on 1 Review

3-8 years

Remote

1 vacancy

Data Engineer (Apache Spark and Scala)

Metafolks

posted 4mon ago

Job Role Insights

Key skills for the job

SQL Clinical SAS Programming Spark Data Processing Data Structures and Algorithms SCALA

+ 1 more

Job Description

We are currently offering the following positions for a duration of 1 year, with the possibility of extension. Remote work options are available, but candidates should be based in Bangalore, Chennai, or Hyderabad, Pune,Noida

These roles will be under third-party.

Develop and maintain data pipelines using Apache Spark and Scala to process large volumes of data efficiently
Ability to write and optimize code in Scala for Spark applications.
Designing, creating, and maintaining Scala-based applications.
Create real-time data pipelines using Apache Spark
Build and maintain SQL databases using Spark SQL
Build and maintain a codebase for Apache Spark data processes
Develop distributed code using the Scala programming language
Flow Control in Scala, Functions in Scala, Data Structures in Scala
Build, deploy, and run Spark scripts
Transform structured data using SparkSQL, DataSets, and DataFrames
Optimize Spark jobs through partitioning, caching, and other techniques
Process continual streams of data with Spark Streaming
Should have understanding on Spark SQL, DataSets, Running Spark on Clusters, Scala Libraries
Experience with streaming data architectures and technologies for real-time and low-latency data processing