使用 MLflow 追踪和评估代理运行

Instrument LLM and agent applications with MLflow tracing, evaluation, prompt tracking, and monitoring so operators can debug behavior before and after deployment.

Prerequisites

Python, uv or pip, MLflow tracking server, LLM or agent application

Installation

Requirements and caveats from upstream:
-
- python
- MLflow provides everything you need to build, debug, evaluate, and deploy production-quality LLM applications and AI agents. Supports Python, TypeScript/JavaScript, Java and any other programming language. MLflow also...

Basic usage or getting-started notes:
- 3. Run Your Code
- <a href="https://mlflow.org/docs/latest/genai/tracing/quickstart/">Getting Started →</a>
- <div>Run systematic evaluations, track quality metrics over time, and catch regressions before they reach production. Choose from 50+ built-in metrics and LLM judges, or define your own.</div><br>

• Source: https://github.com/1991513ccie-png/skills
• Extracted from upstream docs: https://raw.githubusercontent.com/mlflow/mlflow/HEAD/README.md

Documentation

• https://mlflow.org/docs/latest/genai/