Home
Communities
Companies
- Companies
  
  Discover best places to work
- Compare Companies
  
  Compare & find best workplace
- Add Office Photos
  
  Bring your workplace to life
- Add Company Benefits
  
  Highlight your company's perks
Reviews
- Company reviews
  
  Read reviews for 7L+ companies
- Write a review
  
  Rate your former or current company
Salaries
- Browse salaries
  
  Discover salaries for 8L+ companies
- Salary calculator
  
  Calculate your take home salary
- Are you paid fairly?
  
  Check your market value
- Share your salary
  
  Help other jobseekers
- Gratuity calculator
  
  Check your gratuity amount
- HRA calculator
  
  Check how much of your HRA is tax-free
- Salary hike calculator
  
  Check your salary hike
Interviews
- Company interviews
  
  Read interviews for 1L+ companies
- Campus placements
  
  Interviews questions for 2K+ colleges
- Share interview questions
  
  Contribute your interview questions
Jobs
Awards

WINNERS AWAITED!
- ABECA 2025
  
  WINNERS AWAITED!
  
  AmbitionBox Employee Choice Awards - 4th Edition
- ABECA 2024
  
  AmbitionBox Employee Choice Awards - 3rd Edition
- AmbitionBox Best Places to Work 2022
  
  2nd Edition
- AmbitionBox Best Places to Work 2021
  
  1st Edition

120 Hdfs Jobs

Data Engineer - Data Platforms

IBM India Pvt. Limited

4.0

based on 22.1k Reviews

3-5 years

₹ 4.25 - 25L/yr (AmbitionBox estimate)

Pune

Data Engineer - Data Platforms

IBM

posted 5d ago

Job Role Insights

Key skills for the job

Data Engineering AWS SQL ETL Testing Azure DevOps Big Data

+ 7 more

Job Description

As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution.

Your primary responsibilities include:

Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements.
Strive for continuous improvements by testing the build solution and working under an agile framework.
Discover and implement the latest technologies trends to maximize and build creative solutions

Required education

Bachelor's Degree

Preferred education

Master's Degree

Required technical and professional expertise

Experience with Apache Spark (PySpark): In-depth knowledge of Sparks architecture, core APIs, and PySpark for distributed data processing.
Big Data Technologies: Familiarity with Hadoop, HDFS, Kafka, and other big data tools. Data Engineering Skills: Strong understanding of ETL pipelines, data modeling, and data warehousing concepts.
Strong proficiency in Python: Expertise in Python programming with a focus on data processing and manipulation. Data Processing Frameworks: Knowledge of data processing libraries such as Pandas, NumPy.
SQL Proficiency: Experience writing optimized SQL queries for large-scale data analysis and transformation.
Cloud Platforms: Experience working with cloud platforms like AWS, Azure, or GCP, including using cloud storage systems

Preferred technical and professional experience

Define, drive, and implement an architecture strategy and standards for end-to-end monitoring.
Partner with the rest of the technology teams including application development, enterprise architecture, testing services, network engineering,
Good to have detection and prevention tools for Company products and Platform and customer-facing

Employment Type: Full Time, Permanent

Read full job description

IBM Interview Questions & Tips

Prepare for IBM Data Engineer roles with real interview advice

What people at IBM are saying

4.2

Rating based on 208 Data Engineer reviews

Anonymous · Engineering - Software & QA

Likes

1. Work-Pertional life balance. 2. Your work recognition. 3. Appreciation of your work. 4. Job security. 5. Opportunity to learn and grow yourself in multiple technology and tools.