LLMSharp.OpenAi.Tokenizer

v2.0.3

Open AI Chat Completion Models (GPT 3.5/GPT 4) BPE Tokenizer unofficial implementation

veerash-ayyagari

openai gpt 3.5 4 tokenizer dotnet tiktoken

NuGet Stats Changelog

Total Downloads

28.5K

28,532

Published

Oct 4, 2023

Latest stable version

Install

.NET CLI

dotnet add package LLMSharp.OpenAi.Tokenizer --version 2.0.3

Package Manager Console

Install-Package LLMSharp.OpenAi.Tokenizer -Version 2.0.3

PackageReference

<PackageReference Include="LLMSharp.OpenAi.Tokenizer" Version="2.0.3" />

Frameworks

.NETStandard2.0

Dependencies

Google.Protobuf

.NETStandard2.0

[3.24.1, )

Adoption guide

Assess this package against its supported frameworks, license, maintenance signals and dependency graph before making it a project standard.

Compatibility metadata lists 1 target framework; confirm the exact target used by your application.

How to read this guidance

Sources: published NuGet v3 registry metadata and explicit NuBrowse editorial guides. Refresh: package metadata is refreshed from NuGet when the page loads. Limit: this is not a security, legal or compatibility guarantee; validate the selected version in your project.