使用Strands Evals进行可重复的代理评估套件运行,支持轨迹和模拟器覆盖率
Build repeatable evaluation experiments for agents and LLM apps with output checks, trajectory scoring, simulators, and trace-based review.
Prerequisites
Python 3.10+, pip, optional judge-model access
Installation
Use the upstream install or setup path that matches your environment:
- pip install strands-agents-evals
- pip install -e .
- pip install -e ".[test]"
- pip install -e ".[test,dev]"
Requirements and caveats from upstream:
- <a href="https://python.org"><img alt="Python versions" src="https://img.shields.io/pypi/pyversions/strands-agents-evals"/></a>
- ◆ <a href="https://github.com/1991513ccie-png/skills">Python SDK</a>
- python
Basic usage or getting-started notes:
- Multiple Evaluation Types: Output evaluation, trajectory analysis, tool usage assessment, and interaction evaluation
- bash
- from strands import Agent
- Source: https://github.com/1991513ccie-png/skills
- Extracted from upstream docs: https://raw.githubusercontent.com/strands-agents/evals/HEAD/README.md
Documentation
- https://github.com/1991513ccie-png/skills