Skip to content

Releases: nlpodyssey/gotokenizers

v0.2.0

12 Dec 23:29
@marco-nicola marco-nicola
v0.2.0
e5c78e8
Compare
Choose a tag to compare
v0.2.0 Latest
Latest

Added

  • Initial Encoding implementation, including its creation from PreTokenizedString
Assets 2
Loading

First tagged release

11 Dec 10:37
@marco-nicola marco-nicola
v0.1.0
d41a37f
Compare
Choose a tag to compare
First tagged release 
v0.1.0

Fix some golint problems
Assets 2
Loading