DevOps Engineer - Azure/Kafka (6-8 yrs)

Key Responsibilities :

- Design, build, and maintain robust and efficient CI/CD pipelines using Azure DevOps. Automate build, test, and deployment processes for Kafka applications.

- Implement and maintain continuous integration and continuous delivery practices.

- Develop and manage infrastructure as code (IaC) using Terraform to provision and manage Kafka clusters.

- Automate infrastructure deployments and configurations for scalability and reliability.

- Ensure infrastructure consistency and compliance with best practices.

- Implement and adhere to software development best practices, including version control, code reviews, and testing.

- Ensure the quality, scalability, and security of all Kafka-related solutions.

- Participate in code reviews and provide constructive feedback to team members.

- Collaborate effectively with software engineers, data engineers, and other stakeholders to understand requirements and deliver solutions that meet business needs.

- Communicate technical concepts effectively to both technical and non-technical audiences.

- Participate in agile development methodologies and contribute to team discussions.

- Monitor Kafka cluster performance and identify and resolve any issues.

- Troubleshoot Kafka-related problems and provide timely solutions.

- Stay up-to-date with the latest Kafka technologies and best practices.

Required Competencies :

- 6+ years of proven experience as a DevOps Engineer with a strong focus on Azure DevOps and Terraform.

- Strong understanding of CI/CD principles and best practices.

- In-depth knowledge of Azure DevOps, including pipelines, build agents, and release management.

- Expertise in Terraform for infrastructure provisioning and management.

- Solid understanding of Linux/Unix systems administration.

- Experience with containerization technologies (Docker, Kubernetes).

- Basic knowledge of Confluent Kafka, including its architecture, features, and best practices.

- Basic knowledge of cloud platforms, preferably AWS.

- Strong attention to detail and commitment to quality.

- A strong desire to learn and adapt to new technologies and best practices.

Bonus Points :

- Experience with Kafka Streams, Kafka Connect, and other Kafka ecosystem components.

- Experience with monitoring and logging tools (e.g., Prometheus, Grafana, ELK stack).

- Experience with scripting languages (Python, Bash).

- Experience with Agile methodologies (Scrum, Kanban).

- Relevant certifications (e.g., AWS Certified DevOps Engineer, Azure DevOps Engineer Expert)