net8.0.NETStandard2.0
A library containing a set of evaluators for evaluating the quality (coherence, relevance, truth, completeness, groundedness, fluency, equivalence etc.) of responses received from an LLM.
Published
Dec 10, 2024
1y ago
Total Downloads
1.3M
1,276,533
Install
dotnet add package Microsoft.Extensions.AI.Evaluation.Quality --version 0.9.37-preview
| Product | Versions |
|---|---|
| .NET | |
| .NET Standard |
README
Microsoft.Extensions.AI.Evaluation
These packages have been designed to work together to support building processes for evaluating the quality of AI software.
- Microsoft.Extensions.AI.Evaluation - Defines core abstractions and types for supporting evaluation.
- Microsoft.Extensions.AI.Evaluation.Quality - Contains evaluators that can be used to evaluate the quality of AI responses in your projects including Relevance, Truth, Completeness, Fluency, Coherence, Equivalence and Groundedness.
- Microsoft.Extensions.AI.Evaluation.Reporting - Contains support for caching LLM responses, storing the results of evaluations and generating reports from that data.
- Microsoft.Extensions.AI.Evaluation.Console - A command line dotnet tool for generating reports and managing evaluation data.
Install the packages
From the command-line:
dotnet add package Microsoft.Extensions.AI.Evaluation
dotnet add package Microsoft.Extensions.AI.Evaluation.Quality
dotnet add package Microsoft.Extensions.AI.Evaluation.Reporting
Or directly in the C# project file:
<ItemGroup>
<PackageReference Include="Microsoft.Extensions.AI.Evaluation" Version="[CURRENTVERSION]" />
<PackageReference Include="Microsoft.Extensions.AI.Evaluation.Quality" Version="[CURRENTVERSION]" />
<PackageReference Include="Microsoft.Extensions.AI.Evaluation.Reporting" Version="[CURRENTVERSION]" />
</ItemGroup>
Install the command line tool
dotnet tool install Microsoft.Extensions.AI.Evaluation.Console --create-manifest-if-needed
Changes from Previous Version
No structural changes between v0.9.6-preview and v0.9.37-preview.
Adoption Assessment
A verified publisher signal is available. Assess fit from the package's supported frameworks, license and dependency graph rather than popularity alone.
This version is marked prerelease. Validate its API and upgrade path before production use.Compatibility metadata lists 2 target frameworks; confirm the exact target used by your application.
Related Guides & Workflows
Learn how to evaluate, integrate, or audit this package in your .NET project.