Senior MLOps Engineer

Project Description:

Grid Dynamics wants to build a centralized, observable and secure platform for their ML, Computer Vision, LLM and SLM models. Grid Dynamics wants to onboard a vast number of AI agents, able to cover multiple required skills, ensuring a certain level of control and security in regards to their usage and availability. The observable platform must be vendor-agnostic, easy to extend to multiple type of AI applications and flexible in terms of technologies, frameworks and data types.

This project is focused on establishing a centralized LLMOps capability where every ML, CV, AI-enabled application is monitored, observed, secured and provides logs of every activity.

The solution consists of key building blocks such monitor every step in a RAG, Multimodal RAG or Agentic Platform, track performances and provide curated datasets for potential fine-tuning.

Alignment with business scenarios, PepVigil provides also certain guardrails that allow or block interactions user-to-agent, agent-to-agent or agent-to-user. Also, Guardrails will enable predefined workflows, aimed to give more control over the series of LLM chains.

Details on Tech Stack

Job Qualifications and Skill Sets

• Advanced degree in Data Science, Computer Science, Statistics, or a related field
• Setting up Agent Mesh (LangSmith)
• Setting up Agent communication protocols (JSON/XML etc)
• Setting up message queues, CI/CD pipelines (Azure Queue Storage, Azure DevOps)
• Setting up integrations Langgrah, LangFuse
• Knowledge on Observability tool Arize-Phoenix tools
• Managing Agent Registry, Integrating with AgentAuth framework like Composio
• Setting up AgentCompute (Sandpack, E2BDev, Assistant APIs)
• Integration with IAM (Azure IAM, OKTA)
• Performing/Configuring Dynamic Orchestration and agent permissions

Tech Stack Required:

• ML
• MLOPs
• Agent (Agent / Agent Mesh)
• LangFuse, LanChain, LangGraph
• Deployments (Docker, Jenkins, Kubernetes)
• Cloud Platforms: Azure/AWS/GCP

We offer:

• Opportunity to work on bleeding-edge projects
• Work with a highly motivated and dedicated team
• Competitive salary
• Flexible schedule
• Benefits package - medical insurance, sports
• Corporate social events
• Professional development opportunities
• Well-equipped office