Tiktoken.Encodings.Abstractions
The fastest tokenizer for GPT-3.5 and GPT-4 inspired by Tiktoken.
Install
dotnet add package Tiktoken.Encodings.Abstractions --version 3.1.2-alpha.0.1
Install-Package Tiktoken.Encodings.Abstractions -Version 3.1.2-alpha.0.1
<PackageReference Include="Tiktoken.Encodings.Abstractions" Version="3.1.2-alpha.0.1" />
Frameworks
Dependencies
No declared dependencies.
Adoption guide
Assess this package against its supported frameworks, license, maintenance signals and dependency graph before making it a project standard.
This version is marked prerelease. Validate its API and upgrade path before production use.
Compatibility metadata lists 6 target frameworks; confirm the exact target used by your application.
How to read this guidance
Sources: published NuGet v3 registry metadata and explicit NuBrowse editorial guides. Refresh: package metadata is refreshed from NuGet when the page loads. Limit: this is not a security, legal or compatibility guarantee; validate the selected version in your project.
Useful next steps
Move from package metadata to a concrete selection or review workflow.