Narrative LLM Tools

A set of tools to use when calling Narrative I/O LLMs. This package provides utilities for managing LLM conversations, handling REST API interactions, and enforcing JSON schema formats.

Features

• 🤗 HuggingFace Inference Endpoints Handler
• 🌐 RestAPI Client
• 💬 Conversation State Management
• ✅ JSON Schema Validation and Enforcement
• 🛠️ Tool Management System
• 💾 Caching System for Format Enforcers

LLMs

Checkout our our HuggingFace Space for more information.

Installation

You can install the package using pip:

pip install narrative-llm-tools

Usage

HuggingFace Inference Endpoints Handler

To use the HuggingFace Inference Endpoints Handler, via HuggingFace Inference Endpoints you will need to reference this library from a requirements.txt file in your repository:

narrative-llm-tools @ git+https://github.com/narrative-io/[email protected]

Additionally, you will need to add the following handler.py file to your repository:

from narrative_llm_tools.handlers.huggingface import EndpointHandler

License

MIT License