Premium Employer
i
This company page is being actively managed by
Sopra Steria Team. If you also belong to the team, you
can get access from
here
Sopra Steria
Compare
All Filters
167 Sopra Steria Jobs
Data Engineer PySpark
Sopra Steria
posted 4d ago
Job Role Insights
Flexible timing
Key skills for the job
Job Description
We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. As a Data Engineer, you will collaborate closely with our Data Scientists to develop and deploy machine learning models. Proficiency in below listed skills will be crucial in building and maintaining pipelines for training and inference datasets.
Responsibilities:
Work in tandem with Data Scientists to design, develop, and implement machine learning pipelines.
Utilize PySpark for data processing, transformation, and preparation for model training.
Leverage AWS EMR and S3 for scalable and efficient data storage and processing.
Implement and manage ETL workflows using Stream sets for data ingestion and transformation.
Design and construct pipelines to deliver high-quality training and inference datasets.
Collaborate with cross-functional teams to ensure smooth deployment and real-time/near real-time inferencing capabilities.
Optimize and fine-tune pipelines for performance, scalability, and reliability.
Ensure IAM policies and permissions are appropriately configured for secure data access and management.
Implement Spark architecture and optimize Spark jobs for scalable data processing.
Requirements:
Mandatory
Proficiency in Advanced SQL (Window functions), Spark Architecture, Pyspark or Scala with Spark, Hadoop.
Proven expertise in designing and deploying data pipelines.
Strong problem-solving skills and ability to work effectively in a collaborative team environment.
Excellent communication skills and ability to translate technical concepts to non-technical stakeholder
Desirable
Hands-on experience with Airflow, S3, and Stream sets or similar ETL tools. [ can be trained locally ]
Understanding of real-time or near real-time inferencing architectures.
- Basic Knowledge on Kafka ,AWS IAM, AWS EMR and Snowflake.
Total Experience Expected: 06-08 years
BE
Employment Type: Full Time, Permanent
Read full job descriptionPrepare for Data Engineer roles with real interview advice
People are getting interviews at Sopra Steria through
People are getting interviews through
(based on 82 Sopra Steria interviews)
Job Portal
Campus Placement
Referral
Company Website
Recruitment Consultant
Walkin
47%
20%
13%
2%
2%
1%
15% candidates got the interview through other sources.
High
Confidence
?
High Confidence means the data is based on a large number of responses received from the candidates.
What people at Sopra Steria are saying
Data Engineer salary at Sopra Steria
reported by
10
employees
with 1-4
years exp.
₹6
L/yr - ₹7.5
L/yr
31%
less
than the average Data Engineer Salary in India
View more details
What Sopra Steria employees are saying about work life
based on 1.7k employees
Flexible timing
Monday to Friday
No travel
Day Shift
Sopra Steria Benefits
Submitted by Company
Crèche & Day Care Executive Health Screening Bonhomie Policy Employee assistance program (EAP)
Submitted by Employees
View more benefits 
Compare Sopra Steria with
Capgemini
Compare
Accenture
Compare
TCS
Compare
Wipro
Compare
Infosys
Compare
HCLTech
Compare
Tech Mahindra
Compare
Cognizant
Compare
IBM
Compare
Genpact
Compare
DXC Technology
Compare
CGI Group
Compare
Hewlett Packard Enterprise
Compare
Atos
Compare
Synechron
Compare
Zensar Technologies
Compare
Capita
Compare
Societe Generale Global Solution Centre
Compare
Fujitsu
Compare
Movate
Compare
Similar Jobs for you
Sopra Steria Chennai Office Location
Chennai Office
2/G-2 SIPCOT IT Park,
Siruseri,
Kanchipuram
Chennai
603103
603103
ServiceNow Developer Technical Lead - Immediate joiner
6-10 Yrs
Noida, Pune, Bangalore Rural
Share an Interview