Skip to the content
Agent Tools

MLflow Skills

Partner, reviewed

Skills for tracing, evaluating, and improving AI agents with MLflow. Supports the full agent improvement loop: instrument → trace → evaluate → iterate → validate.

Plugin · by mlflow · runs in Claude Code, Cowork, claude.ai · 13 skills, 1 hook · listed 2026-07-21

Claude Code

claude plugin install mlflow-skills

Skills (13)

  • Skill agent-evaluation

    Use this when you need to EVALUATE OR IMPROVE or OPTIMIZE an existing LLM agent's output quality - including improving tool selection accuracy, answer quality, reducing costs, or fixing issues where…

    Any agent

    npx skills add mlflow/skills --skill agent-evaluation
  • Skill analyzing-mlflow-session

    Analyzes an MLflow session — a sequence of traces from a multi-turn chat conversation or interaction. Use when the user asks to debug a chat conversation, review session or chat history, find where…

    Any agent

    npx skills add mlflow/skills --skill analyzing-mlflow-session
  • Skill analyzing-mlflow-trace

    Analyzes a single MLflow trace to answer a user query about it. Use when the user provides a trace ID and asks to debug, investigate, find issues, root-cause errors, understand behavior, or analyze…

    Any agent

    npx skills add mlflow/skills --skill analyzing-mlflow-trace
  • Skill build-a-scorer

    Help the user go from zero to a shipped MLflow evaluation prototype by understanding their app, generalizing a small set of atomic quality criteria, and implementing each criterion with the cheapest…

    Any agent

    npx skills add mlflow/skills --skill build-a-scorer
  • Skill debug-agent

    Root-causes AI agent failures from MLflow traces without requiring a code change, regression suite, scorer, or evaluation run.

    Any agent

    npx skills add mlflow/skills --skill debug-agent
  • Skill fix-agent-issue

    Drives a disciplined explore → plan → implement → verify loop for changing an AI agent's behavior with confidence — whether fixing a reported failure or introducing a new requirement, business rule…

    Any agent

    npx skills add mlflow/skills --skill fix-agent-issue
  • Skill instrumenting-with-mlflow-tracing

    Instruments Python and TypeScript code with MLflow Tracing for observability. Must be loaded when setting up tracing as part of any workflow including agent evaluation.

    Any agent

    npx skills add mlflow/skills --skill instrumenting-with-mlflow-tracing
  • Skill mlflow-agent

    Master dispatcher for all MLflow workflows. Use this skill when the user wants to do anything with MLflow — tracing, evaluating, debugging, or improving an agent.

    Any agent

    npx skills add mlflow/skills --skill mlflow-agent
  • Skill mlflow-onboarding

    Onboards users to MLflow by determining their use case (GenAI agents/apps or traditional ML/deep learning) and guiding them through relevant quickstart tutorials and initial integration.

    Any agent

    npx skills add mlflow/skills --skill mlflow-onboarding
  • Skill querying-mlflow-metrics

    Fetches aggregated trace metrics (token usage, latency, trace counts, quality evaluations) from MLflow tracking servers. Triggers on requests to show metrics, analyze token usage, view LLM costs…

    Any agent

    npx skills add mlflow/skills --skill querying-mlflow-metrics
  • Skill retrieving-mlflow-traces

    Retrieves MLflow traces using CLI or Python API. Use when the user asks to get a trace by ID, find traces, filter traces by status/tags/metadata/execution time, query traces, or debug failed traces.

    Any agent

    npx skills add mlflow/skills --skill retrieving-mlflow-traces
  • Skill sagemaker-mlflow

    Connect to SageMaker Managed MLflow (mlflow-app or mlflow-tracking-server ARN) as an MLflow backend, then hand off to the other MLflow skills. Triggers on a SageMaker MLflow ARN (arn:aws:sagemaker:...

    Any agent

    npx skills add mlflow/skills --skill sagemaker-mlflow
  • Skill searching-mlflow-docs

    Searches and retrieves MLflow documentation from the official docs site. Use when the user asks about MLflow features, APIs, integrations (LangGraph, LangChain, OpenAI, etc.), tracing, tracking, or…

    Any agent

    npx skills add mlflow/skills --skill searching-mlflow-docs

From Anthropic's public plugin directory, read on 2026-10-16. Find a skill by task.