All Filters
45 API Jobs
Data Engineer
5-7 years
₹ 6 - 25L/yr (AmbitionBox estimate)
Bangalore / Bengaluru
Data Engineer
IBM
posted 6mon ago
Job Role Insights
Key skills for the job
Job Description
Your Role and Responsibilities
Data Engineer in IBM's CIO organization, supporting a data warehouse that consolidates IBM's global real estate data into IBM's Cognitive Enterprise Data Platform (CEDP), including integrations with enterprise systems (TRIRIGA, Maximo, Envizi, and others). Data includes comprehensive information about IBM's global internal real estate portfolio, including properties, space, leases, energy consumption, construction/renovation projects, and environmental compliance.
Responsibilities:
- Manage integrations for data ingestion from multiple source systems via APIs, queries, and Apache Spark and Airflow workflows. Launch Spark jobs in Airflow as needed.
- Support data transformations and aggregations in a Cloud Object Storage (COS) integration zone, and subsequent data feeds to a DB2 warehouse.
- Maintain a Cirrus platform hosting Cloud Object Storage, along with inbound & outbound data flows. Initiate activities such as opening firewall flows, defining entitlements, and managing roles & user access as needed. Identify and perform other activities required to ensure reliable operation of the cluster,
- Identify and promptly address issues with data and integrations. Implement and optimize monitoring, and troubleshoot errors through in-depth reviews of logs, code, data, and integration components.
- Document and share data architectures and flows (including schemas, tables, queries, and scheduled activities) with data analysts and Cognos developers.
- Develop new capabilities for data ingestion and transformation as needed. Create algorithms, develop new transfers using Spark/Airflow, APIs, SQL, etc. Perform comprehensive testing of individual components as well as end-to-end solution.
Required Technical and Professional Expertise
- 5+ years of experience with managing data warehouses and integration solutions
- API integration experience
- Apache Spark and Airflow experience
- SQL development, relational database table structure, and database design
- Expertise in working with structured and unstructured data
- Excellent communication skills (written and verbal). Able to clearly communicate with leadership and colleagues about technical capabilities, limitations, issues, and recommendations.
- Highly organized, detail oriented, independent, and resourceful.
- Able to manage complex technical projects with diverse global stakeholders and detailed, interdependent requirements
- Experience with Agile practices and associated tools, including Jira
Preferred Technical and Professional Expertise
- Cognos Analytics experience, including creating/maintaining data modules and developing reports & dashboards
- Javascript development experience
- BS or BA in a related discipline
Employment Type: Full Time, Permanent
Functional Areas: Software/Testing/Networking
Read full job descriptionIBM Interview Questions & Tips
Prepare for IBM Data Engineer roles with real interview advice
What people at IBM are saying
Rating based on 208 Data Engineer
reviews
Anonymous · Engineering - Software & QA
1. Work-Pertional life balance. 2. Your work recognition. 3. Appreciation of your work. 4. Job security. 5. Opportunity to learn and grow yourself in multiple technology and tools.
- Salary - Good
1. All the mentioned benefits are depending on project basis, its not a universal.
Data Engineer salary at IBM
Unlock 
Compare IBM with
Oracle
TCS
Cognizant
Accenture
Infosys
Capgemini
Wipro
Deloitte
Amazon
Amdocs
SAP
Microsoft Corporation
Tech Mahindra
PwC
Ernst & Young
Nagarro
NetApp
Salesforce
SAS
Similar Jobs for you
3-8 Yrs
₹ 3 - 7L/yr
Chennai, Bangalore / Bengaluru, Hyderabad / Secunderabad
Senior Java Developer
Digital Aptech
4-9 Yrs
₹ 11 - 21L/yr
Bhubaneshwar, Kolkata
4-9 Yrs
Greater Noida
Senior Python Developer
MSys Technologies
4-9 Yrs
Chennai, Pune, Bangalore / Bengaluru
Digital Cloud Architect
SONATA SOFTWARE LIMITED
10-15 Yrs
Bangalore / Bengaluru
Node Js Developer
Xebia It Architects
5-7 Yrs
Pune, Bangalore / Bengaluru, Gurgaon / Gurugram
Digital Senior Engineer
SONATA SOFTWARE LIMITED
4-7 Yrs
Bangalore / Bengaluru
