Install
| Product | Versions |
|---|---|
| .NET |
README
**This is an auto-generated C#/.NET binding for llama.cpp. It provides higher-level APIs to inference the LLaMA Models and deploy it on local device with C#/.NET, and includes all pre-built binaries for Windows, Linux and Mac **
It is based on the original work by the LLamaSharp project, but using CLangSharp/ClangSharpPInvokeGenerator to auto-generate the native bindings from the llama.cpp repository.
It's not meant to be a replacement of LLamaSharp, just to provide the minimum code required to use the latest version of llama.cpp via the low level APIs.
License
This project is licensed under the terms of the MIT license.
Changes from Previous Version
Adoption Assessment
Assess this package against its supported frameworks, license, maintenance signals and dependency graph before making it a project standard.
Related Guides & Workflows
Learn how to evaluate, integrate, or audit this package in your .NET project.