Microsoft.ML.Tokenizers.Data.R50kBase

v0.22.0

The Microsoft.ML.Tokenizers.Data.R50kBase includes the Tiktoken tokenizer data file r50k_base.tiktoken, which is utilized by models such as text-davinci-001

dotnetframework Microsoft MLNET

ML.NET ML Machine Learning

NuGet Stats Changelog

Total Downloads

29.4K

29,402

Published

Nov 13, 2024

Latest stable version

Install

.NET CLI

dotnet add package Microsoft.ML.Tokenizers.Data.R50kBase --version 0.22.0

Package Manager Console

Install-Package Microsoft.ML.Tokenizers.Data.R50kBase -Version 0.22.0

PackageReference

<PackageReference Include="Microsoft.ML.Tokenizers.Data.R50kBase" Version="0.22.0" />

Frameworks

.NETStandard2.0

Dependencies

Microsoft.ML.Tokenizers

.NETStandard2.0

[0.22.0, )

Adoption guide

A verified publisher signal is available. Assess fit from the package's supported frameworks, license and dependency graph rather than popularity alone.

Compatibility metadata lists 1 target framework; confirm the exact target used by your application.

How to read this guidance

Sources: published NuGet v3 registry metadata and explicit NuBrowse editorial guides. Refresh: package metadata is refreshed from NuGet when the page loads. Limit: this is not a security, legal or compatibility guarantee; validate the selected version in your project.