使用 Prompt Flow 进行 LLM 工作流测试和评估
Build a Prompt Flow graph, run interactive and batch tests, inspect traces and evaluation metrics, and promote only reviewed LLM workflow versions.
Prerequisites
Prompt Flow CLI, Python 3.9 through 3.11, promptflow and promptflow-tools packages, configured OpenAI or Azure OpenAI connection, optional VS Code extension.
Installation
Use the upstream install or setup path that matches your environment:
- pip install promptflow promptflow-tools
Requirements and caveats from upstream:
-
-
- Create executable flows that link LLMs, prompts, Python code and other tools...
Basic usage or getting-started notes:
- To get started quickly, you can use a pre-built development environment. Click the button below to open the repo in GitHub Codespaces, and then continue the readme!
-
- If you want to get started in your local environment, first install the packages:
- Source: https://github.com/1991513ccie-png/skills
- Extracted from upstream docs: https://raw.githubusercontent.com/microsoft/promptflow/HEAD/README.md
Documentation
- https://microsoft.github.io/promptflow/index.html
