Microsoft.ML.Tokenizers.Data.O200kBase

v0.22.0

The Microsoft.ML.Tokenizers.Data.O200kBase includes the Tiktoken tokenizer data file o200k_base.tiktoken, which is utilized by models such as gpt-4o.

dotnetframework Microsoft MLNET

ML.NET ML Machine Learning

NuGet Stats Changelog

Total Downloads

3.9M

3,852,644

Published

Nov 13, 2024

Latest stable version

Install

.NET CLI

dotnet add package Microsoft.ML.Tokenizers.Data.O200kBase --version 0.22.0

Package Manager Console

Install-Package Microsoft.ML.Tokenizers.Data.O200kBase -Version 0.22.0

PackageReference

<PackageReference Include="Microsoft.ML.Tokenizers.Data.O200kBase" Version="0.22.0" />

Frameworks

.NETStandard2.0

Dependencies

Microsoft.ML.Tokenizers

.NETStandard2.0

[0.22.0, )

Adoption guide

A verified publisher signal is available. Assess fit from the package's supported frameworks, license and dependency graph rather than popularity alone.

Compatibility metadata lists 1 target framework; confirm the exact target used by your application.

How to read this guidance

Sources: published NuGet v3 registry metadata and explicit NuBrowse editorial guides. Refresh: package metadata is refreshed from NuGet when the page loads. Limit: this is not a security, legal or compatibility guarantee; validate the selected version in your project.