MLflow Skills
Partner, reviewedSkills for tracing, evaluating, and improving AI agents with MLflow. Supports the full agent improvement loop: instrument → trace → evaluate → iterate → validate.
Claude Code
claude plugin install mlflow-skills
Skills (13)
-
Skill agent-evaluation
Use this when you need to EVALUATE OR IMPROVE or OPTIMIZE an existing LLM agent's output quality - including improving tool selection accuracy, answer quality, reducing costs, or fixing issues where…
Any agent
npx skills add mlflow/skills --skill agent-evaluation
-
Skill analyzing-mlflow-session
Analyzes an MLflow session — a sequence of traces from a multi-turn chat conversation or interaction. Use when the user asks to debug a chat conversation, review session or chat history, find where…
Any agent
npx skills add mlflow/skills --skill analyzing-mlflow-session
-
Skill analyzing-mlflow-trace
Analyzes a single MLflow trace to answer a user query about it. Use when the user provides a trace ID and asks to debug, investigate, find issues, root-cause errors, understand behavior, or analyze…
Any agent
npx skills add mlflow/skills --skill analyzing-mlflow-trace
-
Skill build-a-scorer
Help the user go from zero to a shipped MLflow evaluation prototype by understanding their app, generalizing a small set of atomic quality criteria, and implementing each criterion with the cheapest…
Any agent
npx skills add mlflow/skills --skill build-a-scorer
-
Skill debug-agent
Root-causes AI agent failures from MLflow traces without requiring a code change, regression suite, scorer, or evaluation run.
Any agent
npx skills add mlflow/skills --skill debug-agent
-
Skill fix-agent-issue
Drives a disciplined explore → plan → implement → verify loop for changing an AI agent's behavior with confidence — whether fixing a reported failure or introducing a new requirement, business rule…
Any agent
npx skills add mlflow/skills --skill fix-agent-issue
-
Skill instrumenting-with-mlflow-tracing
Instruments Python and TypeScript code with MLflow Tracing for observability. Must be loaded when setting up tracing as part of any workflow including agent evaluation.
Any agent
npx skills add mlflow/skills --skill instrumenting-with-mlflow-tracing
-
Skill mlflow-agent
Master dispatcher for all MLflow workflows. Use this skill when the user wants to do anything with MLflow — tracing, evaluating, debugging, or improving an agent.
Any agent
npx skills add mlflow/skills --skill mlflow-agent
-
Skill mlflow-onboarding
Onboards users to MLflow by determining their use case (GenAI agents/apps or traditional ML/deep learning) and guiding them through relevant quickstart tutorials and initial integration.
Any agent
npx skills add mlflow/skills --skill mlflow-onboarding
-
Skill querying-mlflow-metrics
Fetches aggregated trace metrics (token usage, latency, trace counts, quality evaluations) from MLflow tracking servers. Triggers on requests to show metrics, analyze token usage, view LLM costs…
Any agent
npx skills add mlflow/skills --skill querying-mlflow-metrics
-
Skill retrieving-mlflow-traces
Retrieves MLflow traces using CLI or Python API. Use when the user asks to get a trace by ID, find traces, filter traces by status/tags/metadata/execution time, query traces, or debug failed traces.
Any agent
npx skills add mlflow/skills --skill retrieving-mlflow-traces
-
Skill sagemaker-mlflow
Connect to SageMaker Managed MLflow (mlflow-app or mlflow-tracking-server ARN) as an MLflow backend, then hand off to the other MLflow skills. Triggers on a SageMaker MLflow ARN (arn:aws:sagemaker:...
Any agent
npx skills add mlflow/skills --skill sagemaker-mlflow
-
Skill searching-mlflow-docs
Searches and retrieves MLflow documentation from the official docs site. Use when the user asks about MLflow features, APIs, integrations (LangGraph, LangChain, OpenAI, etc.), tracing, tracking, or…
Any agent
npx skills add mlflow/skills --skill searching-mlflow-docs
From Anthropic's public plugin directory, read on 2026-10-16. Find a skill by task.