Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Support DeepSeek Janus Models #3195

Open
2 tasks done
juliancoy opened this issue Jan 28, 2025 · 1 comment
Open
2 tasks done

[Feature] Support DeepSeek Janus Models #3195

juliancoy opened this issue Jan 28, 2025 · 1 comment
Assignees
Labels
help wanted Extra attention is needed visIon-LM

Comments

@juliancoy
Copy link

juliancoy commented Jan 28, 2025

Checklist

Motivation

Docker is a valuable tool for the management of dependencies. Indeed, it can simplify the running of Janus Models to a single command:

docker run -it --rm \
  -p 8000:8000 \
  -d \
  -v huggingface:/root/.cache/huggingface \
  -w /app \
  --gpus all \
  --name janus \
  -e MODEL_NAME=deepseek-ai/Janus-Pro-7B \
  julianfl0w/janus:latest

Make sure it's working by navigating in your browser to
http://localhost:8000/webui

and by running

docker logs janus

This keeps all the Torch dependencies contained within the image, meaning the user doesn't have to adjust their base installations to run models like these.

Note: You will have to install NVIDIA Container Runtime (or equivalent)

The implementation of this Dockerfile can be found at DeepSeek Janus PR#38

Related resources

No response

@zhaochenyang20 zhaochenyang20 changed the title [Feature] Docker Image for DeepSeek Janus Models [Feature] Support DeepSeek Janus Models Jan 28, 2025
@zhaochenyang20 zhaochenyang20 self-assigned this Jan 28, 2025
@zhaochenyang20 zhaochenyang20 added help wanted Extra attention is needed visIon-LM labels Jan 28, 2025
@zhaochenyang20
Copy link
Collaborator

@mickqian Thanks for your interests

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed visIon-LM
Projects
None yet
Development

No branches or pull requests

2 participants