Microsoft.Extensions.AI.Evaluation
Author Trust
7 packages
Microsoft.Extensions.AI.Evaluation
Microsoft
A library that defines core abstractions and types for supporting evaluation.
Microsoft.Extensions.AI.Evaluation.Quality
Microsoft
A library containing evaluators that can be used to evaluate the quality of AI responses in your projects including Relevance, Truth, Completeness, Fluency, Coherence, Retrieval, Equivalence and Groundedness.
Microsoft.Extensions.AI.Evaluation.Reporting
Microsoft
A library that contains support for caching LLM responses, storing the results of evaluations and generating reports from that data.
Microsoft.Extensions.AI.Evaluation.NLP
Microsoft
A library that contains a set of evaluators that implement commonly used algorithmic evaluators.
Microsoft.Extensions.AI.Evaluation.Safety
Microsoft
A library that contains a set of evaluators that are built atop the Azure AI Foundry Evaluation service that can be used to evaluate the content safety of AI responses in your projects including Protected Material, Groundedness Pro, Ungrounded Attributes, Hate and Unfairness, Self Harm, Violence, Sexual, Code Vulnerability and Indirect Attack.
Microsoft.Extensions.AI.Evaluation.Console
Microsoft
A command line dotnet tool for generating reports and managing evaluation data.
Microsoft.Extensions.AI.Evaluation.Reporting.Azure
Microsoft
A library that supports the Microsoft.Extensions.AI.Evaluation.Reporting library with an implementation for caching LLM responses and storing the evaluation results in an Azure Storage container.