Azure Technical Consultant - Databricks/Data Factory (5-12 yrs)

Role : Azure Technical Consultant

Experience : 8+ years

Location : Pan India

Work Mode : Remote

Timings : 5:30 pm - 2:30 am

Required Skills :

Skills - Must Have :

Offshore dev(s) : Data Bricks, Spark, Azure Data Factory, azure synapse ,DevOps.

To meet our requirements, the candidates must have hands-on experience in Azure and Databricks.

We require strong candidates with specific expertise in Databricks and Azure for this role.

- Provide mutually agreed upon Architecture for Data Lake, and Data Migration.

- Azure Landing Zone Review/Hardening.

- Provide Automated Deployment of Services (ADF, Synapse, Databricks, Log Analytics, Storage - Data lake, in accordance with the Architecture Diagram to be finalized.

- Create full refresh and incremental resilient Data Pipelines as agreed to in Architecture.

- ADF, Azure Databricks, Event Hub, Kafka, Synapse as required by Architecture.

- Create full refresh and incremental resilient ADF/Synapse/Data Bricks/Spark pipelines as needed.

- Support and provide Data Governance for Data using Purview/ERWin Intelligence, ADF/Synapse Pipelines, and PowerBI dashboard.

- Create a Data Lake Environment with initial schema and load the data to include data domains: - Clinical Data (MVP) - Claims - Provider - Members - Eligibility - Regular ingestion of the data identified above

- Develop 3 patterns and necessary infrastructure support for the business on how to consume data from the curated zone.

These 3 patterns will include the below: - PowerBI - Data Science access from that exploratory Subscription - APIM access for interoperability

- Schedule, and set up alerts and Metrics using Log Analytics Workspace.

- Provide data quality, and code quality pipelines for observed data set.

- Design and implement Security Paradigm for the entire estate, role-based access control (RBAC), Encryption, Network setup for private and or Service End Points to GEHA standards

- Provide full design documentation of the new platform and future roadmaps to be shared with clients/auditors if needed for validation or awareness.

This will be in the form of as-built documentation.

- Provide templates for further development and deployment.

- Conduct session to review Control Environment and summarize additional recommended controls (if required)

- Conduct knowledge transfer to the GEHA team