Designing Development of Data Pipelines in Informatica BDM and Azure Cloud
KEY ACCOUNTABILITIES:
-Requirement Gathering and planning for New Business requirements and designing data pipelines in Informatica DEI.
-Creating efficient data workflows to extract data from various sources, transform it into a usable format, and load it into target systems in Big Data Hadoop Ecosystem and its platforms.
-Creating and managing ETL processes using Informatica DEI or similar tools to extract, transform, and load data from various sources.
-Development of mappings, workflows and application for project requirements in Informatica DEI in lower env and deploying them in Production post business sign-offs.
-Responsible to debug production issues post production deployment.
-Very well verse in Hadoop and Bigdata ecosystem and scripting to design efficient data pipelines to complex Business requirements.
-Documentation: Documenting the entire data flow processes, including workflows, configurations, and any customizations created for New projects for hand-over to Production Support team.
-Implementing data quality checks, audits and governance policies to ensure data accuracy, consistency, and security.
-Must have Unix scripting Knowledge.
-Collaboration: Work closely with other ETL developers, Production Support Team, Data Architects, and Business Analysts to ensure alignment and Required support.
Requirements
QUALIFICATIONS EXPERIENCE:
-Graduation(BE/Btech) with 5-7 Years
-Must have Minimum 5 + years of exp in Informatica Data Engineering tool in Hadoop environment and Big Data Ecosystem.
-Must have Minimum 5+ years of experience in designing Data Pipeline in Azure Cloud Data Lake and Informatica Data Engineering.
-Must have a understanding of Azure Stack (Azure Data Bricks, Azure streaming Analytics Azure Synapse)
-Must Have Unix knowledge for writing shell scripts and troubleshoot of existing shell scripts.
-Experience in any programming language like Python/Scala.
-Must have SQL knowledge of writing tuning complex query/script in RDBMS/Hive.
-Understanding of informatica components/services/Repository.
-Good understanding of informatica different type of connectors
-Experience in Financial Banking domain will added advantage.