What's Changed
- Fix query filtering and vocabulary dict by @mossbee in #92 (1/2)
- Fix query filtering and vocabulary dict by @xhluca in #96 (2/2)
- Update corpus.py by @Restodecoca in #102
- Add pypi and pepy badges by @xhluca in #103
Notes
The behavior of tokenizers have changed wrt null token. Now, the null token will be added first to the vocab rather than at the end, as the previous approach is inconsistent with the general standard (the "" string should map to 0 in general). However, it is a backward compatible change because the tokenizers should work the same way as before, but expect the tokenizers before 0.2.7 to differ from the tokenizers in 0.2.7 and beyond in the behavior, even though both will work with the retriever object.
New Contributors
- @Restodecoca made their first contribution in #102
Full Changelog: 0.2.6...0.2.7
Contributors
xhluca, mossbee, and Restodecoca