Home
Communities
Companies
- Companies
  
  Discover best places to work
- Compare Companies
  
  Compare & find best workplace
- Add Office Photos
  
  Bring your workplace to life
- Add Company Benefits
  
  Highlight your company's perks
Reviews
- Company reviews
  
  Read reviews for 6L+ companies
- Write a review
  
  Rate your former or current company
Salaries
- Browse salaries
  
  Discover salaries for 6L+ companies
- Salary calculator
  
  Calculate your take home salary
- Are you paid fairly?
  
  Check your market value
- Share your salary
  
  Help other jobseekers
- Gratuity calculator
  
  Check your gratuity amount
- HRA calculator
  
  Check how much of your HRA is tax-free
- Salary hike calculator
  
  Check your salary hike
Interviews
- Company interviews
  
  Read interviews for 40K+ companies
- Campus placements
  
  Interviews questions for 2K+ colleges
- Share interview questions
  
  Contribute your interview questions
Jobs
Awards

WINNERS AWAITED!
- ABECA 2025
  
  WINNERS AWAITED!
  
  AmbitionBox Employee Choice Awards - 4th Edition
- ABECA 2024
  
  AmbitionBox Employee Choice Awards - 3rd Edition
- AmbitionBox Best Places to Work 2022
  
  2nd Edition
- AmbitionBox Best Places to Work 2021
  
  1st Edition

Add office photos

Employer? Claim Account for FREE

Hitachi

Compare

4.0

based on 631 Reviews

1 Hitachi Senior Data Engineer Job

Senior Data Engineer PySpark, Informatica, Python, SQL, Azure

Hitachi Ltd.

4.0

based on 631 Reviews

6-8 years

Noida

1 vacancy

Senior Data Engineer PySpark, Informatica, Python, SQL, Azure

Hitachi

posted 4d ago

Job Role Insights

Flexible timing

Key skills for the job

Hive Oozie Sqoop Flume

Job Description

Description:

Join GlobalLogic, to be a valid part of the team working on a huge software project for the world-class company providing M2M / IoT 4G/5G modules e g to the automotive, healthcare and logistics industries

Through our engagement, we contribute to our customer in developing the end-user modulesfirmware, implementing new features, maintaining compatibility with the newest telecommunication and industry standards, as well as performing analysis and estimations of the customer requirements

Requirements:

Our Big Data capability team needs hands-on developers who can produce beautiful functional code to solve complex analytics problems

If you are an exceptional developer with an aptitude to learn and implement using new technologies, and who loves to push the boundaries to solve complex business problems innovatively, then we would like to talk with you

You would be responsible for evaluating, developing, maintaining and testing big data solutions for advanced analytics projects

The role would involve big data pre-processing reporting workflows including collecting, parsing, managing, analyzing and visualizing large sets of data to turn information into business insights

The role would also involve testing various machine learning models on Big Data, and deploying learned models for ongoing scoring and prediction

An appreciation of the mechanics of complex machine learning algorithms would be a strong advantage

Qualification Experience 8-10 years of demonstrable experience designing technological solutions to complex data problems, developing testing modular, reusable, efficient and scalable code to implement those solutions

Ideally, this would include work on the following technologies

Expert-level proficiency in Scala PySpark knowledge is a strong advantage

Exp in at least one of Java, Scala or Python Preferred

Strong understanding and experience in distributed computing frameworks, particularly Apache Hadoop YARN, MR, HDFS and associated technologies one or more of Hive, Sqoop, Avro, Flume, Oozie, Zookeeper, Impala, etc Hands-on experience with Apache Spark and its components (Streaming, SQL, MLLib) is a strong advantage

Operating knowledge of cloud computing platforms (AWS orAzure or GCP)

Experience working within a Linux computing environment, and use of command line tools including knowledge of Shell/Python scripting for automating common tasks

Ability to work in a team in an agile setting, familiarity with JIRA and clear understanding of how Git works or any version control tools

In addition, the ideal candidate would have great problem-solving skills, and the ability confidence to hack their way out of tight corners

Experience:

Must Have (handson) Experience Scala or Python or PySpark expertise

Distributed computing framewor ks (Hadoop Ecosystem AND Spark components)

Cloud computing platforms AWS

Linux environment, SQL and Shell scripting

Nice to have : DevOps knowledge

Job Responsibilities:

Our Big Data capability team needs hands-on developers who can produce beautiful functional code to solve complex analytics problems

You would be responsible for evaluating, developing, maintaining and testing big data solutions for advanced analytics projects

The role would involve big data pre-processing reporting workflows including collecting, parsing, managing, analyzing and visualizing large sets of data to turn information into business insights

The role would also involve testing various machine learning models on Big Data, and deploying learned models for ongoing scoring and prediction

An appreciation of the mechanics of complex machine learning algorithms would be a strong advantage

Ideally, this would include work on the following technologies

Expert-level proficiency in Scala PySpark knowledge is a strong advantage

Exp in at least one of Java, Scala or Python Preferred

Operating knowledge of cloud computing platforms (AWS orAzure or GCP)

Experience working within a Linux computing environment, and use of command line tools including knowledge of Shell/Python scripting for automating common tasks

Ability to work in a team in an agile setting, familiarity with JIRA and clear understanding of how Git works or any version control tools

In addition, the ideal candidate would have great problem-solving skills, and the ability confidence to hack their way out of tight corners

Experience:

Must Have (handson) Experience Scala or Python or PySpark expertise

Distributed computing framewor ks (Hadoop Ecosystem AND Spark components)

Cloud computing platforms AWS

Linux environment, SQL and Shell scripting

Nice to have : DevOps knowledge

What We Offer

Exciting Projects: We focus on industries like High-Tech, communication, media, healthcare, retail and telecom

Our customer list is full of fantastic global brands and leaders who love what we build for them

Collaborative Environment: You Can expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment or even abroad in one of our global centers or client facilities!

Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible work schedules, opportunities to work from home, and paid time off and holidays

Professional Development: Our dedicated Learning Development team regularly organizes Communication skills training(GL Vantage, Toast Master),Stress Management program, professional certifications, and technical and soft skill trainings

Excellent Benefits: We provide our employees with competitive salaries, family medical insurance, Group Term Life Insurance, Group Personal Accident Insurance , NPS(National Pension Scheme ), Periodic health awareness program, extended maternity leave, annual performance bonuses, and referral bonuses

Employment Type: Full Time, Permanent

Read full job description

Prepare for Senior Data Engineer roles with real interview advice