Site Reliability Engineer - Docker/Kubernetes (5-10 yrs)

Job Description :

A Kubernetes & Airflow Specialist is responsible for deploying, managing, and optimizing containerized applications on Kubernetes and orchestrating workflows with Apache Airflow. This role ensures efficient resource utilization, high availability, and automation of data pipelines and processes, making it critical for organizations aiming for scalable and robust cloud-based solutions.

Key Responsibilities :

- Kubernetes Management : Design, deploy, and manage Kubernetes clusters for containerized applications.

- Airflow Orchestration : Build and manage workflows and data pipelines using Apache Airflow.

- Automation & Optimization : Automate processes for container management and pipeline execution to enhance efficiency and scalability.

- Resource Allocation : Configure and optimize Kubernetes clusters for efficient resource usage and cost control.

- Monitoring & Troubleshooting : Monitor cluster health, resolve deployment issues, and ensure system reliability.

- Integration : Integrate Kubernetes and Airflow with cloud platforms (AWS, Azure, GCP) and third-party tools.

- Security & Compliance : Ensure secure communication, access control, and adherence to best practices for both platforms.

Key Skills :

- Strong understanding of Kubernetes architecture (pods, nodes, namespaces, and services).

- Proficiency in Apache Airflow for workflow orchestration.

- Experience with containerization tools like Docker.

- Hands-on expertise in YAML configuration for Kubernetes deployments.

- Cloud platform knowledge (AWS, Azure, or GCP).

Preferred :

- Experience with Helm for Kubernetes package management.

- Knowledge of CI/CD pipelines using tools like Jenkins, GitLab CI, or GitHub Actions.

- Familiarity with monitoring tools like Prometheus and Grafana.

- Scripting experience with Python or Bash.