1.1.0

What's Changed (WITH BREAKING CHANGES)

• Added .NET 9.0 support
• Added windows arm64 support by @Binozo in #12 and @sappho192 in #13
• Bump RelaxVersioner from 3.4.0 to 3.9.0 in /dotnet/Tokenizers.DotNet by @dependabot in #11

From 1.1.0, Windows runtime package will be separated into win-x64 and win-arm64.
If you were using previous version, please change the package ID to Tokenizers.DotNet.runtime.win-x64.

New Contributors

• @Binozo made their first contribution in #12

Full Changelog: 1.0.5...1.1.0RC1

1.0.5

• Upgrade csbindgen to 1.9.3

1.0.4

What's Changed

• Updated tokenizers library from 0.19.1 to 0.20.0

Full Changelog: 1.0.1...1.0.4

1.0.1

This is the first official stable release!

What's Changed

• Fixes #3 ; Implement encode() function by @sappho192 in #6
• Unified the library and runtime version using NATIVE_LIB_VERSION.txt

The previous library 0.9.2 will only be compatible with the runtime 0.6.1.

Full Changelog: 0.9.2...1.0.1

0.9.2 (library) 0.6.1 (runtime)

What's Changed

• Fixes #4 ; Manage multiple tokenizer context (not thread-safe) by @sappho192 in #5

Notes

Previous libraries until 0.9.1 will only be compatible with the runtime 0.5.0 or below.

Full Changelog: 0.9.0...0.9.2

0.9.0 (library) 0.5.0 (runtime)

Initial official beta-release