LLM Ops Engineer

Minimum Experience: 5+ Years

Job Details
Infrastructure as Code (laC) - Experience with laC tools such as Terraform or Ansible for automating infrastructure provisioning. Containerization and Orchestration - Proficiency in containerization technologies (e.g., Docker) and orchestration tools (e.g., Kubernetes) for managing LLM deployments.

Cloud Platforms
Familiarity with cloud platforms such as AWS (Bedrock), Azure, or GCP, and experience in deploying and managing applications in a cloud environment.
Monitoring and Logging Tools
Knowledge of monitoring tools (e.g., Prometheus, Grafana) and logging systems (e.g., ELK stack) for real-time performance monitoring and analysis.
Security Measures
Understanding of security guardrails using tools like LLM Guard and familiarity with how to mask/redact/obfuscate sensitive data, protect the input and output of toxic and harmful content to/from LLMS, and understand the performance implications of the same.
Scripting and Automation
Proficient in scripting languages such as Python, Shell, or similar, and experience in automating deployment and maintenance processes.