Databricks Administartor

Job Title: Databricks Administrator
Experience: 6+ Years
Location: Hyderabad/Hybrid
Job Type: Full-time

Job Description:

We are seeking an experienced Databricks Administrator with 6+ years of expertise in managing and optimizing Databricks environments. The ideal candidate should have hands-on experience with Azure/AWS Databricks, cluster management, security configurations, and performance optimization. This role requires close collaboration with data engineering and analytics teams to ensure smooth operations and scalability.

Key Responsibilities:

• Deploy, configure, and manage Databricks workspaces, clusters, and jobs.
• Monitor and optimize Databricks performance, auto-scaling, and cost management.
• Implement security best practices, including role-based access control (RBAC) and encryption.
• Manage databricks integration with cloud storage (Azure Data Lake, S3, etc.) and other data services.
• Automate infrastructure provisioning and management using Terraform, ARM templates, or CloudFormation.
• Troubleshoot Databricks runtime issues, job failures, and performance bottlenecks.
• Support CI/CD pipelines for Databricks workloads and notebooks.
• Collaborate with data engineering teams to enhance ETL pipelines and data processing workflows.
• Ensure compliance with data governance policies and regulatory requirements.
• Maintain and upgrade Databricks versions and libraries as needed.

Required Skills & Qualifications:

• 6+ years of experience as a Databricks Administrator or in a similar role.
• Strong knowledge of Azure/AWS Databricks and cloud computing platforms.
• Hands-on experience with Databricks clusters, notebooks, libraries, and job scheduling.
• Expertise in Spark optimization, data caching, and performance tuning.
• Proficiency in Python, Scala, or SQL for data processing.
• Experience with Terraform, ARM templates, or CloudFormation for infrastructure automation.
• Familiarity with Git, DevOps, and CI/CD pipelines.
• Strong problem-solving skills and ability to troubleshoot Databricks-related issues.
• Excellent communication and stakeholder management skills.

Preferred Qualifications:

• Databricks certifications (e.g., Databricks Certified Associate/Professional).
• Experience in Delta Lake, Unity Catalog, and MLflow.
• Knowledge of Kubernetes, Docker, and containerized workloads.
• Experience with big data ecosystems (Hadoop, Apache Airflow, Kafka, etc.).

Why Join Us?

• Opportunity to work on cutting-edge Databricks solutions.
• Competitive salary and benefits package.
• Career growth and upskilling opportunities.

📢 Apply Now!
[Provide application instructions email, career portal, etc.]