ToonTokenizer

v1.0.0.28

Complete .NET library for parsing and tokenizing TOON (Token-Oriented Object Notation) - a compact, human-readable format optimized for LLM prompts. Includes full lexer, resilient parser, AST generation, position tracking, and extension methods for IDE integration.

madskristensen

toon parser lexer tokenizer llm ast json serialization prompt-engineering

NuGet Stats Changelog

Total Downloads

1.9K

1,916

Published

Nov 26, 2025

Latest stable version

Install

.NET CLI

dotnet add package ToonTokenizer --version 1.0.0.28

Package Manager Console

Install-Package ToonTokenizer -Version 1.0.0.28

PackageReference

<PackageReference Include="ToonTokenizer" Version="1.0.0.28" />

Frameworks

.NETFramework4.6.2 net8.0 net10.0 .NETStandard2.0

Dependencies

System.Text.Json

.NETFramework4.6.2

[4.7.2, )

System.Text.Json

.NETStandard2.0

[4.7.2, )

Adoption guide

Assess this package against its supported frameworks, license, maintenance signals and dependency graph before making it a project standard.

Compatibility metadata lists 4 target frameworks; confirm the exact target used by your application.

How to read this guidance

Sources: published NuGet v3 registry metadata and explicit NuBrowse editorial guides. Refresh: package metadata is refreshed from NuGet when the page loads. Limit: this is not a security, legal or compatibility guarantee; validate the selected version in your project.