All Filters
(1)331 Spark Jobs in Pune
Data Engineer - Data Platforms
2-5 years
₹ 3.65 - 25L/yr (AmbitionBox estimate)
Pune
Data Engineer - Data Platforms
IBM
posted 2d ago
Job Role Insights
Key skills for the job
Job Description
As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution.
- Your primary responsibilities include:
- Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements.
- Strive for continuous improvements by testing the build solution and working under an agile framework.
- Discover and implement the latest technologies trends to maximize and build creative solutions
- Experience with Apache Spark (PySpark): In-depth knowledge of Sparks architecture, core APIs, and PySpark for distributed data processing.
- Big Data Technologies: Familiarity with Hadoop, HDFS, Kafka, and other big data tools. Data Engineering Skills: Strong understanding of ETL pipelines, data modeling, and data warehousing concepts.
- Strong proficiency in Python: Expertise in Python programming with a focus on data processing and manipulation. Data Processing Frameworks: Knowledge of data processing libraries such as Pandas, NumPy.
- SQL Proficiency: Experience writing optimized SQL queries for large-scale data analysis and transformation.
- Cloud Platforms: Experience working with cloud platforms like AWS, Azure, or GCP, including using cloud storage systems
- Define, drive, and implement an architecture strategy and standards for end-to-end monitoring.
- Partner with the rest of the technology teams including application development, enterprise architecture, testing services, network engineering,
- Good to have detection and prevention tools for Company products and Platform and customer-facing
Employment Type: Full Time, Permanent
Read full job descriptionIBM Interview Questions & Tips
Prepare for IBM Data Engineer roles with real interview advice
What people at IBM are saying
Rating based on 208 Data Engineer
reviews
Anonymous · Engineering - Software & QA
1. Work-Pertional life balance. 2. Your work recognition. 3. Appreciation of your work. 4. Job security. 5. Opportunity to learn and grow yourself in multiple technology and tools.
- Salary - Good
1. All the mentioned benefits are depending on project basis, its not a universal.
Data Engineer salary at IBM
Unlock 
Compare IBM with
Oracle
TCS
Cognizant
Accenture
Infosys
Capgemini
Wipro
Deloitte
Amazon
Amdocs
SAP
Microsoft Corporation
Tech Mahindra
PwC
Ernst & Young
Nagarro
NetApp
Salesforce
SAS
Similar Jobs for you
Recently Viewed
JOBS
Wipro
No Jobs
REVIEWS
Hubbell
No Reviews
REVIEWS
Adidas
No Reviews
LIST OF COMPANIES
Expedia Group
Overview
