Skip to content

0.3

Compare
Choose a tag to compare
@tomviner tomviner released this 27 Jul 22:08
· 13 commits to main since this release

Add the ability to set the max_tokens_to_sample param. This is described as The maximum number of tokens to generate before stopping. If not set, this defaults to a generous 10_000 tokens. #4