Any Framework
Tokenization of raw text is a standard pre-processing step for many NLP tasks. For English, tokenization usually involves punctuation splitting and separation of some affixes like possessives. Other languages require more extensive token pre-processing, which is usually called segmentation.
Published
May 2, 2014
12y ago
Total Downloads
30.8K
30,827
Install
dotnet add package Stanford.NLP.Segmenter --version 3.3.1.1
No framework information available.
README
Changes from Previous Version
No structural changes between v3.3.0 and v3.3.1.1.
Adoption Assessment
Assess this package against its supported frameworks, license, maintenance signals and dependency graph before making it a project standard.
No SPDX license expression is published. Review the license text and your organisation's policy before redistribution.No target framework metadata is available. Confirm compatibility in a representative project before standardising on this package.
Related Guides & Workflows
Learn how to evaluate, integrate, or audit this package in your .NET project.