net10.0.NETFramework4.6.2net8.0net9.0.NETStandard2.0.NETStandard2.1
Load tokenizer.json (HuggingFace format) as a Tiktoken encoding.
Published
Sep 25, 2026
23d ago
Total Downloads
157.2K
157,215
Install
dotnet add package Tiktoken.Encodings.Tokenizer --version 3.1.6-alpha.0.27
| Product | Versions |
|---|---|
| .NET | |
| .NET Standard | |
| Other |
README
Changes from Previous Version
No structural changes between v3.1.6-alpha.0.26 and v3.1.6-alpha.0.27.
Adoption Assessment
Assess this package against its supported frameworks, license, maintenance signals and dependency graph before making it a project standard.
This version is marked prerelease. Validate its API and upgrade path before production use.Compatibility metadata lists 6 target frameworks; confirm the exact target used by your application.
Related Guides & Workflows
Learn how to evaluate, integrate, or audit this package in your .NET project.