All Filters
1,903 Pyspark Jobs
Data Engineer - Data Platforms
3-5 years
₹ 4.25 - 25L/yr (AmbitionBox estimate)
Pune
Data Engineer - Data Platforms
IBM
posted 20hr ago
Job Role Insights
Flexible timing
Key skills for the job
Job Description
As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution.
Your primary responsibilities include:
- Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements.
- Strive for continuous improvements by testing the build solution and working under an agile framework.
- Discover and implement the latest technologies trends to maximize and build creative solutions
- Experience with Apache Spark (PySpark): In-depth knowledge of Sparks architecture, core APIs, and PySpark for distributed data processing.
- Big Data Technologies: Familiarity with Hadoop, HDFS, Kafka, and other big data tools. Data Engineering Skills: Strong understanding of ETL pipelines, data modeling, and data warehousing concepts.
- Strong proficiency in Python: Expertise in Python programming with a focus on data processing and manipulation. Data Processing Frameworks: Knowledge of data processing libraries such as Pandas, NumPy.
- SQL Proficiency: Experience writing optimized SQL queries for large-scale data analysis and transformation.
- Cloud Platforms: Experience working with cloud platforms like AWS, Azure, or GCP, including using cloud storage systems
- Define, drive, and implement an architecture strategy and standards for end-to-end monitoring.
- Partner with the rest of the technology teams including application development, enterprise architecture, testing services, network engineering,
- Good to have detection and prevention tools for Company products and Platform and customer-facing
Employment Type: Full Time, Permanent
Read full job descriptionIBM Interview Questions & Tips
Prepare for IBM Data Engineer roles with real interview advice
What people at IBM are saying
Rating based on 207 Data Engineer
reviews
Anonymous · Engineering - Software & QA
1. Work-Pertional life balance. 2. Your work recognition. 3. Appreciation of your work. 4. Job security. 5. Opportunity to learn and grow yourself in multiple technology and tools.
- Salary - Good
1. All the mentioned benefits are depending on project basis, its not a universal.
Data Engineer salary at IBM
Unlock 
What IBM employees are saying about work life
IBM Benefits
View more benefits
Compare IBM with
Oracle
TCS
Cognizant
Accenture
Infosys
Capgemini
Wipro
Deloitte
Amazon
Amdocs
SAP
Microsoft Corporation
Tech Mahindra
PwC
Ernst & Young
Nagarro
NetApp
Salesforce
SAS
Similar Jobs for you
IBM Bangalore / Bengaluru Office Locations
Karnataka 560029
Karnataka 560029
Risk Modelling Associate - CCAR / CECL models, JP Morgan, Mumbai
JPMorgan Chase Bank
3-6 Yrs
₹ 25 - 35L/yr
Mumbai
Quant Modeling Machine Learning Associate - JP Morgan, Bengaluru
JPMorgan Chase Bank
4-9 Yrs
₹ 25 - 40L/yr
Mumbai
Quant Modeling Machine Learning Associate - JP Morgan, Mumbai
JPMorgan Chase Bank
3-7 Yrs
₹ 25 - 35L/yr
Mumbai
