LMSupply.Generator

v0.20.2

A .NET library for local LLM text generation using ONNX Runtime GenAI. Supports streaming, chat templates, and automatic hardware detection with CUDA/DirectML GPU acceleration.

iyulab-rnd

llm ai ml onnx text-generation chatbot phi llama gpu cuda directml streaming

NuGet Stats Changelog

Total Downloads

28.1K

28,087

Published

Mar 7, 2026

Latest stable version

Install

.NET CLI

dotnet add package LMSupply.Generator --version 0.20.2

Package Manager Console

Install-Package LMSupply.Generator -Version 0.20.2

PackageReference

<PackageReference Include="LMSupply.Generator" Version="0.20.2" />

Frameworks

net10.0

Dependencies

LMSupply.Core

net10.0

[0.20.2, )

LMSupply.Llama

net10.0

[0.20.2, )

Microsoft.ML.OnnxRuntimeGenAI

net10.0

[0.12.1, )

Adoption guide

Assess this package against its supported frameworks, license, maintenance signals and dependency graph before making it a project standard.

Compatibility metadata lists 1 target framework; confirm the exact target used by your application.

How to read this guidance

Sources: published NuGet v3 registry metadata and explicit NuBrowse editorial guides. Refresh: package metadata is refreshed from NuGet when the page loads. Limit: this is not a security, legal or compatibility guarantee; validate the selected version in your project.

Useful next steps

Move from package metadata to a concrete selection or review workflow.

Audit NuGet dependencies in a .NET project Review NuGet licenses before shipping