Big Data Lead

Responsibilities

About the Team/Project

This role is within the HR Data team under the Human & Other Resources (H2R) unit of the CFT. The HR Big Data services center is involved in the transformation by creating an agile data-centric IT architecture for businesses such as HR, Sourcing, and Real Estate.

Roles & Responsibilities

• In-depth understanding of Big Data Ecosystem and their data flow.
• Expected to have good articulation and presentation skills in both verbal and written.
• The candidate must have coding and configuration expertise on the below processes:
1. Ingestion: Setting up new pipeline for the ingestion process using NIFI and Kafka.
2. Backend Data Processes: Implementation of Backend Processes using SPARK/SCALA (at least 4 major backend process implementations desired).
3. Extraction Functionality: Develop and manage the extraction function, good knowledge in Hive Query Language to troubleshoot process issues resulting from improper queries.
4. Data Handling: Knowledge on handling the data storage and data manipulation process (Data Processing using SPARK framework).
5. Quarterly Upgradation: Impact analysis, fixes, testing of new features in Big Data Platform.
6. Coding Standards: Hands-on individual responsible for producing excellent quality of code, adhering to expected coding standards and industry best practices.

Good to Have Skills

• Expertise in ELK and Kibana.
• Expertise in Java APIs.
• Expertise in Ansible and AWX (YML scripting).

Profile Required

About the Team/Project

This role is within the HR Data team under the Human & Other Resources (H2R) unit of the CFT. The HR Big Data services center is involved in the transformation by creating an agile data-centric IT architecture for businesses such as HR, Sourcing, and Real Estate.

Roles & Responsibilities

• In-depth understanding of Big Data Ecosystem and their data flow.
• Expected to have good articulation and presentation skills in both verbal and written.
• The candidate must have coding and configuration expertise on the below processes:
1. Ingestion: Setting up new pipeline for the ingestion process using NIFI and Kafka.
2. Backend Data Processes: Implementation of Backend Processes using SPARK/SCALA (at least 4 major backend process implementations desired).
3. Extraction Functionality: Develop and manage the extraction function, good knowledge in Hive Query Language to troubleshoot process issues resulting from improper queries.
4. Data Handling: Knowledge on handling the data storage and data manipulation process (Data Processing using SPARK framework).
5. Quarterly Upgradation: Impact analysis, fixes, testing of new features in DHR application.
6. Coding Standards: Hands-on individual responsible for producing excellent quality of code, adhering to expected coding standards and industry best practices.

Good to Have Skills

• Expertise in ELK and Kibana.
• Expertise in Java APIs.
• Expertise in Ansible and AWX (YML scripting)