Add office photos
All Filters
69 Unitforce Technologies Consulting Jobs
EMR _ Spark SME
5-10 years
Bangalore / Bengaluru
1 vacancy
EMR _ Spark SME
Unitforce Technologies Consulting
posted 7hr ago
Job Role Insights
Flexible timing
Key skills for the job
Job Description
Job Description
Role: EMR_Spark SME
Location: Bangalore
Who are we looking for?
We are seeking an experienced EMR/Spark SME to lead the design, development, and optimization of big data solutions using AWS EMR and Apache Spark. The ideal candidate will have deep technical expertise in distributed computing, data processing pipelines, and performance tuning for large-scale data sets. This role requires a hands-on professional who can support engineering teams, advise on best practices, and troubleshoot complex issues in EMR and Spark environments.
Technical Skills:
5+ years of experience in big data technologies with hands-on expertise in AWS EMR and Apache Spark.
Proficiency in Spark Core, Spark SQL, and Spark Streaming for large-scale data processing.
Strong experience with data formats (Parquet, Avro, JSON) and data storage solutions (Amazon S3, HDFS).
Solid understanding of distributed systems architecture and cluster resource management (YARN).
Familiarity with AWS services (S3, IAM, Lambda, Glue, Redshift, Athena).
Experience in scripting and programming languages such as Python, Scala, and Java.
Knowledge of containerization and orchestration (Docker, Kubernetes) is a plus.
Architect and develop scalable data processing solutions using AWS EMR and Apache Spark.
Optimize and tune Spark jobs for performance and cost efficiency on EMR clusters.
Monitor, troubleshoot, and resolve issues related to EMR and Spark workloads.
Implement best practices for cluster management, data partitioning, and job execution.
Collaborate with data engineering and analytics teams to integrate Spark solutions with broader data ecosystems (S3, RDS, Redshift, Glue, etc.).
Automate deployments and cluster management using infrastructure-as-code tools like CloudFormation, Terraform, and CI/CD pipelines.
Ensure data security and governance in EMR and Spark environments in compliance with company policies.
Provide technical leadership and mentorship to junior engineers and data analysts.
Stay current with new AWS EMR features and Spark versions to recommend improvements and upgrades.
Requirements and Skills
Performance tuning and optimization of Spark jobs.
Problem-solving skills with the ability to diagnose and resolve complex technical issues.
Strong experience with version control systems (Git) and CI/CD pipelines.
Excellent communication skills to explain technical concepts to both technical and non-technical audiences.
Qualification:
Education qualification: B.Tech, BE, BCA, MCA, M. Tech or equivalent technical degree from a reputed college.
Certifications:
AWS Certified Solutions Architect Associate/Professional
AWS Certified Data Analytics Specialty
Recruiter Name Madhuri
Recruiter Email Id madhuri.k@uftech.com
Employment Type: Full Time, Permanent
Read full job descriptionUnitforce Technologies Consulting Interview Questions & Tips
Prepare for Unitforce Technologies Consulting roles with real interview advice
People are getting interviews at Unitforce Technologies Consulting through
People are getting interviews through
(based on 1 Unitforce Technologies Consulting interview)
Referral
100%
Low
Confidence
?
Low Confidence means the data is based on a small number of responses received from the candidates.
What people at Unitforce Technologies Consulting are saying
What Unitforce Technologies Consulting employees are saying about work life
based on 24 employees
Flexible timing
Monday to Friday
No travel
Day Shift
Unitforce Technologies Consulting Benefits
View more benefits
Compare Unitforce Technologies Consulting with
HCL Infosystems
Compare
Accel Frontline
Compare
Northcorp Software
Compare
Diverse Lynx
Compare
Elentec Power India (EPI) Pvt. Ltd.
Compare
HyScaler
Compare
Appsierra
Compare
Emblix Solutions
Compare
Solartis Technology Services
Compare
Trawex Technologies
Compare
Yashi Consulting Services
Compare
VHS Consulting
Compare
IVTL Infoview Technologies
Compare
Apex CoVantage
Compare
Knoldus Inc
Compare
DynPro
Compare
Apmosys Technologies
Compare
Avontix
Compare
AvenData GmbH
Compare
Dahua Technology India Pvt.Ltd.
Compare
Similar Jobs for you
Share an Interview