Microsoft.ML.Tokenizers.Data.O200kBase

v2.0.0-preview.1.25125.4

The Microsoft.ML.Tokenizers.Data.O200kBase includes the Tiktoken tokenizer data file o200k_base.tiktoken, which is utilized by models such as gpt-4o.

dotnetframework Microsoft MLNET

ML.NET ML Machine Learning

NuGet Stats Changelog

Total Downloads

3.1M

3,076,692

Published

Feb 25, 2025

Latest stable version

Install

.NET CLI

dotnet add package Microsoft.ML.Tokenizers.Data.O200kBase --version 2.0.0-preview.1.25125.4

Package Manager Console

Install-Package Microsoft.ML.Tokenizers.Data.O200kBase -Version 2.0.0-preview.1.25125.4

PackageReference

<PackageReference Include="Microsoft.ML.Tokenizers.Data.O200kBase" Version="2.0.0-preview.1.25125.4" />

Frameworks

.NETStandard2.0

Dependencies

Microsoft.ML.Tokenizers

.NETStandard2.0

[2.0.0-preview.1.25125.4, )

Adoption guide

A verified publisher signal is available. Assess fit from the package's supported frameworks, license and dependency graph rather than popularity alone.

This version is marked prerelease. Validate its API and upgrade path before production use.

Compatibility metadata lists 1 target framework; confirm the exact target used by your application.

How to read this guidance

Sources: published NuGet v3 registry metadata and explicit NuBrowse editorial guides. Refresh: package metadata is refreshed from NuGet when the page loads. Limit: this is not a security, legal or compatibility guarantee; validate the selected version in your project.

Useful next steps

Move from package metadata to a concrete selection or review workflow.

Audit NuGet dependencies in a .NET project Review NuGet licenses before shipping