Skip to main content
LLamaSharp package icon

LLamaSharp

LLamaSharp is a cross-platform library to run 🦙LLaMA/LLaVA model (and others) in your local device. Based on [llama.cpp](https://github.com/ggerganov/llama.cpp), inference with LLamaSharp is efficient on both CPU and GPU. With the higher-level APIs and RAG support, it's convenient to deploy LLM (Large Language Model) in your application with LLamaSharp.

Total Downloads
1.2M
1,204,249
Published
Nov 8, 2024
Latest stable version

Install

.NET CLI
dotnet add package LLamaSharp --version 0.19.0
Package Manager Console
Install-Package LLamaSharp -Version 0.19.0
PackageReference
<PackageReference Include="LLamaSharp" Version="0.19.0" />

Frameworks

net6.0 net8.0 .NETStandard2.0

Dependencies

[9.0.0-preview.9.24525.1, )
[8.0.0, )
[9.0.0-preview.9.24525.1, )
[8.0.0, )
[8.0.0, )
[9.0.0-preview.9.24525.1, )
System.Linq.Async
.NETStandard2.0
[6.0.1, )
[8.0.0, )
System.Text.Json
.NETStandard2.0
[8.0.5, )

Adoption guide

Assess this package against its supported frameworks, license, maintenance signals and dependency graph before making it a project standard.

Compatibility metadata lists 3 target frameworks; confirm the exact target used by your application.

The published metadata declares 14 direct dependency entries across framework groups. Inspect the resolved dependency graph for your target framework.

How to read this guidance

Sources: published NuGet v3 registry metadata and explicit NuBrowse editorial guides. Refresh: package metadata is refreshed from NuGet when the page loads. Limit: this is not a security, legal or compatibility guarantee; validate the selected version in your project.

Useful next steps

Move from package metadata to a concrete selection or review workflow.