Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

llama.cpp service #23

Open
wants to merge 8 commits into
base: main
Choose a base branch
from
Open

Conversation

parfeniukink
Copy link
Contributor

SUMMARY:
llama.cpp OpenAI-compatible web-server Github Action.
The purpose of the service is to be used along with integration tests, etc...

* a `neuralmagic/nm-actions/actions/publisher` could be used by other
  GitHub actions in order to perform builds and publishes to
  distribution indexes
* The README.md is added along with usage example
A new parameter determines if the date prefix will added to the distribution name
* timestamp determines whether the DATE suffix has to be attached to the package name
* prefix determines whether any prefix has to be attached to the package name
* built_type is added as a input property
    * available options: dev,release,nightly,custom
* built types detemine the suffix for the package name
* 'publisher' is renamed to 'pyblish_pypi'
@parfeniukink parfeniukink requested a review from markurtz August 19, 2024 06:45
@parfeniukink parfeniukink self-assigned this Aug 19, 2024
@parfeniukink parfeniukink changed the title Parfeniukink/llamacpp service llama.cpp service Aug 19, 2024
@parfeniukink parfeniukink force-pushed the parfeniukink/llamacpp-service branch from 1778aad to 02bd3a6 Compare August 21, 2024 14:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant