introduction: simple lightweight inference server container
1: Llama server, simple inference server for docker based on llama cpp python
2: stable diffusion inlcuding a basic server based on diffusers lib
3: vLLM package
-
Notifications
You must be signed in to change notification settings - Fork 0
michelgirault/ai-server
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
docker and container tools to run llm and image generator
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published