- Connection pools to swap between clients
- Chunksize param for async runs
- Determine cache and response by request type, not client name
- Async support in arun_batch
- Batched runs now caches individual items
- Score prompt does not truncate outside token
- Deprecated chatGPT in favor of openaichat which uses OpenAI completions
- Deprecated Sessions
- Batched inference support in manifest.run. No more separate manifest.run_batch method.
- Standard request base model for all language inputs.
- ChatGPT client. Requires CHATGPT_SESSION_KEY to be passed in.
- Diffusion model support
- Together model support
- Prompt class
- OPT client - OPT is now available in HuggingFace
First major pip release of Manifest. Install via pip install manifest-ml.