Databricks Admin

Technical Skillset

• Strong understanding of key infrastructure components of Databricks & Cloud platform (Compute, Networking, Storage, Encryption , Security, Identity and Access Management).
• Hands-on Databricks platform build and administration experience, understanding Databricks Data & AI platform and Delta Lake architecture.
• Automate Databricks deployments using Infrastructure as Code - Terraform, CloudFormation, ARM templates
• Experience in designing the databricks architecture on AWS/Azure/GCP
• Good understanding of Unity Metastore objects like catalogs, schemas,volumes
• Optimize cloud resources to support AI/ML workloads, ensuring performance efficiency and cost-effectiveness.
• Develop and maintain automation scripts to streamline deployment, management, and scaling of AI/ML tasks
• Design Databricks HA and DR strategies.
• Set up data storage, archival policies, and encryption.
• Optimize cloud resources to support AI/ML workloads, ensuring performance efficiency and cost-effectiveness.
• Establish and document operational and security standards.
• Troubleshoot Databricks performance, connectivity, and security issues.
• Experience with compliance audits, reporting metrics, and managing security incidents.
• Extensive knowledge of Jenkins/CircleCI/GitHub Actions or any CI/CD tool.
• Follow the Agile development methodology.
• LLM Model deployments and LLMOPS are a plus
• AWS/Azure/GCP Solutions Architect Certifications
• Knowledge on any Cloud infrastructure, and security implementation/management