.NETStandard2.0
Microsoft.ML.Tokenizers contains the implmentation of the tokenization used in the NLP transforms.
Published
Nov 1, 2022
4y ago
Total Downloads
14.3M
14,290,585
Install
dotnet add package Microsoft.ML.Tokenizers --version 0.20.0-preview.22551.1
| Product | Versions |
|---|---|
| .NET Standard |
Adoption Assessment
A verified publisher signal is available. Assess fit from the package's supported frameworks, license and dependency graph rather than popularity alone.
This version is marked prerelease. Validate its API and upgrade path before production use.No SPDX license expression is published. Review the license text and your organisation's policy before redistribution.Compatibility metadata lists 1 target framework; confirm the exact target used by your application.
Related Guides & Workflows
Learn how to evaluate, integrate, or audit this package in your .NET project.