Cloud Data Platform Admin

Job Objective

We are seeking highly skilled and experienced cloud data platform admin with 5+ years of experience in Cloud platforms (Azure\ GCP) and Databricks. The ideal candidate will have expertise in provisioning services in cloud platforms, ensuring cyber security compliance, access & role management, monitoring data usage and cloud billing, setting up DevOps and cloud PaaS services to deploy AI/ML/ GenAI workloads.

Skill and Experience

• 3+ years of admin experience in cloud platforms of Azure (nice to have GCP experience) & Databricks
• Expertise in provisioning Azure services like ADLS, ADF, Functions, Event Grid, Stream Analytics
• Expertise in provisioning and managing cloud DWHs (Synapse), managed DBs (Azure DBs), PostgreSQL
• Experience in setting up streaming services (Kafka, Pub/Sub, Service Bus Messaging, Event Hub)
• Good knowledge of scheduling and orchestration tools like Airflow, Composer
• Expertise in setting up DevOps, CI/CD tools
• Experience in setting up API Gateway and deploying proxy endpoints
• Experience in deploying workloads on managed Kubernetes clusters using Terraform, YAML
• Hands on experience in Databricks (DLT, CDC, Lakeflow Connect), Unity catalogue
• Good knowledge about containerization and Dockers
• Ability to code in python, SQL
• Knowledge of open table formats (Delta, Iceberg) and tools (Trino, Flink, Presto)
• Ability to work independently & collaboratively and to manage multiple projects & priorities simultaneously
• Strong communication skills
• High level of collaboration & stakeholder management

Roles & Responsibilities

• Provision managed & serverless native cloud components to implement enterprise Lakehouse & federated Data Lakes with data retention & archiving strategies along with access management
• Manage environments required to implement Analytics. AI/ML use cases in real time and batch
• Establish DevOps and API gateway
• Mange cloud consumption cost through optimization of services