filter salaries All Filters

263 Data Ingestion Jobs

Data Engineer-Data Platforms

5-10 years

₹ 5 - 29L/yr (AmbitionBox estimate)

tooltip
This is an estimate of the average salary range for this position. It has not been reviewed by the company, and the actual salary may differ.

Bangalore / Bengaluru

Data Engineer-Data Platforms

IBM

posted 6d ago

Job Description



As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.

Your primary responsibilities include:
  • Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.
  • Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization.
  • Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too.


  • Required education
    Bachelor's Degree

    Preferred education
    Master's Degree

    Required technical and professional expertise
  • Must have 5+ years exp in Big Data -Hadoop Spark -Scala ,Python
  • Hbase, Hive Good to have Aws -S3,
  • athena ,Dynomo DB, Lambda, Jenkins GIT
  • Developed Python and pyspark programs for data analysis.
  • Good working experience with python to develop Custom Framework for generating of rules (just like rules engine).
  • Developed Python code to gather the data from HBase and designs the solution to implement using Pyspark. Apache Spark DataFrames/RDD's were used to apply business transformations and utilized Hive Context objects to perform read/write operations..


  • Preferred technical and professional experience
  • Understanding of Devops.
  • Experience in building scalable end-to-end data ingestion and processing solutions
  • Experience with object-oriented and/or functional programming languages, such as Python, Java and Scala"

  • Employment Type: Full Time, Permanent

    Read full job description

    IBM Interview Questions & Tips

    Prepare for IBM Data Engineer roles with real interview advice

    What people at IBM are saying

    4.2
     Rating based on 208 Data Engineer reviews

    Likes

    1. Work-Pertional life balance. 2. Your work recognition. 3. Appreciation of your work. 4. Job security. 5. Opportunity to learn and grow yourself in multiple technology and tools.

    • Salary - Good
    • +6 more
    Dislikes

    1. All the mentioned benefits are depending on project basis, its not a universal.

    Read 208 Data Engineer reviews

    Data Engineer salary at IBM

    reported by 2.8k employees
    Lock Unlock
    ₹5.9 L/yr - ₹25.4 L/yr
    33% more than the average Data Engineer Salary in India
    View more details

    Compare IBM with

    Oracle

    3.7
    Compare

    TCS

    3.7
    Compare

    Cognizant

    3.7
    Compare

    Accenture

    3.8
    Compare

    Infosys

    3.6
    Compare

    Capgemini

    3.7
    Compare

    Wipro

    3.7
    Compare

    Deloitte

    3.8
    Compare

    Google

    4.4
    Compare

    Amazon

    4.1
    Compare

    Amdocs

    3.7
    Compare

    SAP

    4.2
    Compare

    Microsoft Corporation

    4.0
    Compare

    Tech Mahindra

    3.5
    Compare

    PwC

    3.4
    Compare

    Ernst & Young

    3.4
    Compare

    Nagarro

    4.0
    Compare

    NetApp

    3.9
    Compare

    Salesforce

    4.0
    Compare

    SAS

    4.4
    Compare

    Similar Jobs for you

    Data Engineer at IBM India Pvt. Limited

    Bangalore / Bengaluru

    5-10 Yrs

    ₹ 7-12 LPA

    Data Engineer at IBM India Pvt. Limited

    Bangalore / Bengaluru

    5-10 Yrs

    ₹ 7-12 LPA

    Data Engineer at IBM India Pvt. Limited

    Bangalore / Bengaluru

    3-5 Yrs

    ₹ 4-7 LPA

    Data Engineer at IBM India Pvt. Limited

    Bangalore / Bengaluru

    3-5 Yrs

    ₹ 5-7 LPA

    Data Engineer at IBM India Pvt. Limited

    Hyderabad / Secunderabad

    5-10 Yrs

    ₹ 7-12 LPA

    Data Engineer at IBM India Pvt. Limited

    Hyderabad / Secunderabad

    5-10 Yrs

    ₹ 7-12 LPA

    Data Engineer at IBM India Pvt. Limited

    Hyderabad / Secunderabad

    5-10 Yrs

    ₹ 7-12 LPA

    Data Engineer at IBM India Pvt. Limited

    Kochi

    5-10 Yrs

    ₹ 7-12 LPA

    Data Engineer at IBM India Pvt. Limited

    Hyderabad / Secunderabad

    6-8 Yrs

    ₹ 8-10 LPA

    Data Engineer at IBM India Pvt. Limited

    Mysuru / Mysore

    6-8 Yrs

    ₹ 8-15 LPA

    5-10 Yrs

    Bangalore / Bengaluru

    6d ago·via naukri.com

    5-10 Yrs

    Hyderabad / Secunderabad

    7d ago·via naukri.com

    Senior Data Engineer

    Wells Fargo International Solutions Private Ltd

    4-8 Yrs

    Bangalore / Bengaluru

    6d ago·via naukri.com

    Application Lead

    Accenture Solutions Pvt Ltd

    12-17 Yrs

    Gurgaon / Gurugram

    7d ago·via naukri.com

    5-10 Yrs

    Hyderabad / Secunderabad

    7d ago·via naukri.com

    Technology Architect

    Accenture Solutions Pvt Ltd

    5-10 Yrs

    Chennai

    8d ago·via naukri.com

    Data Engineer

    Accenture Solutions Pvt Ltd

    5-10 Yrs

    Bangalore / Bengaluru

    8d ago·via naukri.com

    2-4 Yrs

    Kochi

    14d ago·via naukri.com

    5-10 Yrs

    Hyderabad / Secunderabad

    14d ago·via naukri.com

    5-10 Yrs

    Bangalore / Bengaluru

    14d ago·via naukri.com
    How was your last interview experience?
    How was your last interview experience?
    Rate your experience using AmbitionBox
    Terrible
    Terrible
    Poor
    Poor
    Average
    Average
    Good
    Good
    Excellent
    Excellent