Databricks DevOps Architect

Job Role: Azure DevOps Architect/Administrator

Job Responsibilities:

• CI/CD Pipeline Management: Design, implement, and manage Continuous Integration/Continuous Deployment (CI/CD) pipelines using Azure DevOps and GitHub. Ensure the pipelines are efficient, reliable, and scalable.
• Infrastructure as Code (IaC): Automate the provisioning and management of infrastructure, with a focus on Azure Databricks and Azure Data Factory in a private network environment, using tools like Terraform and ARM templates.
• Environment Management: Create and manage development, testing, and production environments, ensuring consistency, security, and alignment with organizational requirements.
• Security: Implement security best practices throughout the CI/CD pipeline, including secrets management, secure code scanning, and compliance with security standards.
• Monitoring & Logging: Set up and maintain monitoring and logging for applications and infrastructure using Azure Monitor, Log Analytics, and related tools to ensure system reliability and performance.
• Automation: Identify opportunities for automation to streamline processes, reduce manual errors, and improve operational efficiency.
• Policy Enforcement: Establish and enforce policies such as branch policies, pull request reviews, and pipeline approvals to maintain code quality and compliance with organizational standards.

Minimum Qualifications:

• Education: Bachelor’s degree in computer science, Information Systems, Engineering, or a related field.
• Experience: 7+ years of professional experience in DevOps, with a strong focus on Azure. Knowledge of Data Platforms like Databricks, Data Factory (Preferred)
• Communication Skills: Excellent verbal and written communication skills with the ability to clearly document processes, procedures, and configurations.
• Customer Focus: Strong commitment to providing high-quality support to internal and external users and stakeholders, with the ability to understand and address their needs.
• Collaboration: Proven ability to work collaboratively as part of a cross-functional team, fostering a positive and productive work environment.
• Adaptability: Flexibility to adapt to changing requirements and priorities, with a proactive approach to problem-solving.
• Continuous Learning: Eagerness to learn new technologies and continuously improve skills to stay current in a rapidly evolving field.