Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

10x Faster New Worker #18

Merged
merged 53 commits into from
Dec 14, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
53 commits
Select commit Hold shift + click to select a range
e7c8de4
Changes to worker
alpayariyak Nov 16, 2023
8f17764
Update Dockerfile
alpayariyak Nov 16, 2023
c34d79e
Entrypoint for testing
alpayariyak Nov 20, 2023
5ca8e56
fix: clean up extra
justinmerrell Nov 22, 2023
c1b9ff1
worker changes
Nov 22, 2023
9661241
worker changes
alpayariyak Nov 22, 2023
12a151d
Merge branch 'revamp2' of https://github.com/runpod-workers/worker-vl…
Nov 22, 2023
cbde2cb
Update download_model.py
justinmerrell Nov 22, 2023
ff3ed55
Update requirements.txt
justinmerrell Nov 22, 2023
d06fb9e
Update Dockerfile
justinmerrell Nov 22, 2023
98af834
fix: added hf_transfer requirement
justinmerrell Nov 22, 2023
7f73f41
Merge remote-tracking branch 'origin/new-concurrency' into revamp2
alpayariyak Nov 26, 2023
97480ff
handler changes
alpayariyak Nov 28, 2023
7cadff2
edge case
alpayariyak Nov 28, 2023
fdddeac
Update handler.py
alpayariyak Nov 28, 2023
820a21f
Download logic + other changes
alpayariyak Nov 29, 2023
9b9c1cf
cleanup
justinmerrell Nov 30, 2023
c455508
Update handler.py
justinmerrell Nov 30, 2023
4131b7a
Update Dockerfile
justinmerrell Nov 30, 2023
bd3ede6
Update Dockerfile
justinmerrell Nov 30, 2023
f958014
Update handler.py
justinmerrell Nov 30, 2023
86916bf
Update handler.py
alpayariyak Nov 30, 2023
8dbf197
Update handler.py
justinmerrell Nov 30, 2023
daf2f4d
Make handler stream aggregate_text
alpayariyak Dec 1, 2023
b242b0c
Refactor handler + add non-streaming, add utils.py
alpayariyak Dec 1, 2023
8d27261
Logging change
alpayariyak Dec 1, 2023
3a9393b
Batched Tokens, cleanup
alpayariyak Dec 5, 2023
b4c61e6
Packing model into worker for internal use
alpayariyak Dec 6, 2023
66c23d4
Model Downloading, no GPU
alpayariyak Dec 6, 2023
48c520b
Version Bump + small changes
alpayariyak Dec 6, 2023
b705544
model packing, cuda version selection on build
alpayariyak Dec 6, 2023
8dbd8f1
Token counting, cuda-related changes
alpayariyak Dec 6, 2023
5acbbf5
Cleanup
alpayariyak Dec 6, 2023
09a85ca
feat: add docker build action
justinmerrell Dec 8, 2023
8156b1d
Final changes
alpayariyak Dec 8, 2023
4052a17
Merge branch 'merge-ready' of https://github.com/runpod-workers/worke…
alpayariyak Dec 8, 2023
35a7447
Update Dockerfile
justinmerrell Dec 9, 2023
11e6495
Update Dockerfile
justinmerrell Dec 9, 2023
deb6f67
Update Dockerfile
justinmerrell Dec 9, 2023
bcf37e7
Update Dockerfile
justinmerrell Dec 9, 2023
5e38a1a
Multi-GPU Fix
alpayariyak Dec 9, 2023
f1afbcb
CPU Limit
alpayariyak Dec 9, 2023
8578581
Small changes
alpayariyak Dec 9, 2023
b518273
bug fix
alpayariyak Dec 9, 2023
e81007d
bug fix
alpayariyak Dec 9, 2023
7ca8ee7
Update README.md
alpayariyak Dec 12, 2023
50f06a5
Update README.md
alpayariyak Dec 12, 2023
2dbab5c
Update README.md
alpayariyak Dec 12, 2023
91c4779
Merge branch 'merge-ready' of https://github.com/runpod-workers/worke…
alpayariyak Dec 12, 2023
ef89868
Small changes
alpayariyak Dec 12, 2023
22de0b3
Complete refactor, improved overall functionality
alpayariyak Dec 13, 2023
bfa3703
Concurrency modifier
alpayariyak Dec 13, 2023
d39844a
Small fixes
alpayariyak Dec 13, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
35 changes: 0 additions & 35 deletions .github/workflows/CD-docker_dev.yml

This file was deleted.

34 changes: 0 additions & 34 deletions .github/workflows/CD-docker_release.yml

This file was deleted.

70 changes: 0 additions & 70 deletions .github/workflows/CI-test_worker.yml

This file was deleted.

40 changes: 40 additions & 0 deletions .github/workflows/docker-build-release.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,40 @@
name: CD | Docker-Build-Release

on:
push:
branches:
- "main"
release:
types: [published]
workflow_dispatch:
inputs:
image_tag:
description: "Docker Image Tag"
required: false
default: "dev"

jobs:
docker-build:
runs-on: DO
# DO is a custom runner deployed on DigitalOcean, only available for workflows under the runpod-workers organization.
# If you would like to use this workflow, you can replace DO with ubuntu-latest or any other runner.

steps:
- name: Set up QEMU
uses: docker/setup-qemu-action@v2

- name: Set up Docker Buildx
uses: docker/setup-buildx-action@v2

- name: Login to Docker Hub
uses: docker/login-action@v2
with:
username: ${{ secrets.DOCKERHUB_USERNAME }}
password: ${{ secrets.DOCKERHUB_TOKEN }}

# Build and push step
- name: Build and push
uses: docker/build-push-action@v4
with:
push: true
tags: ${{ vars.DOCKERHUB_REPO }}/${{ vars.DOCKERHUB_IMG }}:${{ (github.event_name == 'release' && github.event.release.tag_name) || (github.event_name == 'workflow_dispatch' && github.event.inputs.image_tag) || 'dev' }}
160 changes: 0 additions & 160 deletions .gitignore

This file was deleted.

3 changes: 0 additions & 3 deletions .vscode/settings.json

This file was deleted.

Loading