All Filters
(1)329 Pyspark Jobs in Hyderabad / Secunderabad
Data Engineer-Data Platforms
2-5 years
₹ 4.2 - 23L/yr (AmbitionBox estimate)
Hyderabad / Secunderabad
Data Engineer-Data Platforms
IBM
posted 1d ago
Job Role Insights
Key skills for the job
Job Description
As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution.
- Your primary responsibilities include:
- Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements.
- Strive for continuous improvements by testing the build solution and working under an agile framework.
- Discover and implement the latest technologies trends to maximize and build creative solutions
- Experience with Apache Spark (PySpark): In-depth knowledge of Sparks architecture, core APIs, and PySpark for distributed data processing.
- Big Data Technologies: Familiarity with Hadoop, HDFS, Kafka, and other big data tools. Data Engineering Skills: Strong understanding of ETL pipelines, data modeling, and data warehousing concepts.
- Strong proficiency in Python: Expertise in Python programming with a focus on data processing and manipulation. Data Processing Frameworks: Knowledge of data processing libraries such as Pandas, NumPy.
- SQL Proficiency: Experience writing optimized SQL queries for large-scale data analysis and transformation.
- Cloud Platforms: Experience working with cloud platforms like AWS, Azure, or GCP, including using cloud storage systems
- Define, drive, and implement an architecture strategy and standards for end-to-end monitoring.
- Partner with the rest of the technology teams including application development, enterprise architecture, testing services, network engineering,
- Good to have detection and prevention tools for Company products and Platform and customer-facing
Employment Type: Full Time, Permanent
Read full job descriptionIBM Interview Questions & Tips
Prepare for IBM Data Engineer roles with real interview advice
What people at IBM are saying
Rating based on 208 Data Engineer
reviews
Anonymous · Engineering - Software & QA
1. Work-Pertional life balance. 2. Your work recognition. 3. Appreciation of your work. 4. Job security. 5. Opportunity to learn and grow yourself in multiple technology and tools.
- Salary - Good
1. All the mentioned benefits are depending on project basis, its not a universal.
Data Engineer salary at IBM
Unlock 
Compare IBM with
Oracle
TCS
Cognizant
Accenture
Infosys
Capgemini
Wipro
Deloitte
Amazon
Amdocs
SAP
Microsoft Corporation
Tech Mahindra
PwC
Ernst & Young
Nagarro
NetApp
Salesforce
SAS
Similar Jobs for you
Data Engineer-Data Platforms
IBM India Pvt. Limited
2-5 Yrs
Hyderabad / Secunderabad
Data Engineer-Data Platforms
IBM India Pvt. Limited
6-8 Yrs
Hyderabad / Secunderabad
Data Engineer-Data Platforms
IBM India Pvt. Limited
5-10 Yrs
Hyderabad / Secunderabad
Data Platform Engineer
Accenture Solutions Pvt Ltd
7-9 Yrs
Hyderabad / Secunderabad
Application Developer
Accenture Solutions Pvt Ltd
7-11 Yrs
Hyderabad / Secunderabad
Software Development Engineer
Accenture Solutions Pvt Ltd
7-9 Yrs
Hyderabad / Secunderabad
Application Developer
Accenture Solutions Pvt Ltd
3-5 Yrs
Hyderabad / Secunderabad
Application Developer
Accenture Solutions Pvt Ltd
3-7 Yrs
Hyderabad / Secunderabad
Application Developer
Accenture Solutions Pvt Ltd
5-9 Yrs
Hyderabad / Secunderabad
Application Developer
Accenture Solutions Pvt Ltd
5-7 Yrs
Hyderabad / Secunderabad
Recently Viewed
JOBS
Browse jobs
Discover jobs you love
JOBS
IBM
No Jobs
JOBS
IBM
No Jobs
REVIEWS
Comscore Technologies
No Reviews
REVIEWS
Maersk
No Reviews
REVIEWS
Visionyle Solutions
No Reviews
SALARIES
IBM
REVIEWS
Digitize Solutions
No Reviews
SKILL
Interview Questions
18 interview questions
