Informatica Big Data Engineer - Hive/HDFS (4-5 yrs)

JOB OPPORTUNITY WITH OUR CLIENT!!.

Role : Informatica Big Data Engineer.

Experience : 4+ yrs.

Job location : Dubai and Offshore (Bangalore or Chennai location).

Notice Period : Maximum 60 days.

Education :

- Degree, Post graduate in Computer Science or related field (or equivalent industry experience).

Experience :

- Minimum 4+ years of development and design experience in Informatica Big Data Management

- Extensive knowledge on Oozie scheduling, HQL, Hive, HDFS (including usage of storage controllers) and data partitioning.

Technical Skills :

- Extensive experience working with SQL and NoSQL databases Linux OS configuration and use, including shell scripting.

- Good hands on experience with design patterns and their implementation.

- Well versed with Agile, DevOps and CI/CD principles (GitHub, Jenkins etc.), and actively involved in solving, troubleshooting issues in distributed services ecosystem.

- Familiar with Distributed services resiliency and monitoring in a production environment.

- Experience in designing, building, testing and implementing security systems - including identifying security design gaps in existing and proposed architectures and recommend changes or enhancements.

- Responsible for adhering to established policies, following best practices, developing and possessing an in-depth understanding of exploits and vulnerabilities, resolving issues by taking the appropriate corrective action.

- Knowledge on security controls designing Source and Data Transfers including CRON, ETLs, and JDBC-ODBC scripts.

- Understand basics of Networking including DNS, Proxy, ACL, Policy and troubleshooting.

- High level knowledge of compliance and regulatory requirements of data including but not limited to encryption, anonymization, data integrity, policy control features in large scale infrastructures.

- Understand data sensitivity in terms of logging, events and in memory data storage- such as no card numbers or personally identifiable data in logs.

- Implements wrapper solutions for new/existing components with no/minimal security controls to ensure compliance to bank standards.

Functional Skills :

- Experience in Agile methodology.

- Ensure quality of technical and application architecture and design of systems across the organization.

- Effectively research and benchmark technology against other best in class technologies.

- Experience in Banking, Financial and Fintech experience in an enterprise environment preferred

- Able to influence multiple teams on technical considerations, increasing their productivity and effectiveness, by sharing deep knowledge and experience.

- Self-motivator and self-starter, Ability to own and drive things without supervision and works collaboratively with the teams across the organization.

Soft Skills :

- Have excellent soft and interpersonal skills to interact and present the ideas to team.

- The engineer should've good listening skills and speaks clearly in front of team, stakeholders and management.

- The engineer should always carry positive attitude towards work and establishes effective team relations and builds a climate of trust within the team.

Key Responsibilities :

- Design, develop, and implement data integration solutions using Informatica PowerCenter, PowerExchange, and Data Quality tools.

- Extensive experience with Oozie scheduling, HQL, Hive, HDFS (including usage of storage controllers) and data partitioning.

- Develop and maintain complex ETL jobs, data transformations, and data quality rules.

- Troubleshoot and resolve data quality issues and performance bottlenecks.

- Participate in all phases of the software development lifecycle, including requirements gathering, design, development, testing, and deployment.

- Work closely with data architects, data analysts, and business stakeholders to understand business requirements and translate them into technical solutions.

- Ensure data security and compliance with relevant regulations (e.g., GDPR, CCPA).

- Implement and maintain data governance policies and procedures.

- Contribute to the continuous improvement of data integration processes and technologies.

- Stay abreast of the latest advancements in big data technologies and best practices.

- Mentor junior team members and provide technical guidance.

- Collaborate with cross-functional teams to ensure smooth project delivery.