Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Docs] Add docs for running SGLang on AMD #3245

Open
2 tasks done
zhaochenyang20 opened this issue Feb 1, 2025 · 3 comments
Open
2 tasks done

[Docs] Add docs for running SGLang on AMD #3245

zhaochenyang20 opened this issue Feb 1, 2025 · 3 comments
Assignees
Labels
amd documentation Improvements or additions to documentation good first issue Good for newcomers help wanted Extra attention is needed

Comments

@zhaochenyang20
Copy link
Collaborator

zhaochenyang20 commented Feb 1, 2025

Checklist

Motivation

That has long been waiting, we should add a docs on how to run SGLang on AMD devices.

#3219
#3243
#3200
#3208
#3198

Here is something related. To me, I think we should add a docs on how to:

  1. configure environment in AMD GPU;
  2. how to install sglang;
  3. how to run a llama model;
  4. how to run deepseek V3 models.

Related resources

No response

@zhaochenyang20 zhaochenyang20 added amd documentation Improvements or additions to documentation good first issue Good for newcomers help wanted Extra attention is needed labels Feb 1, 2025
@zhaochenyang20 zhaochenyang20 self-assigned this Feb 1, 2025
@Beichen-Ma
Copy link

could you please review this pr? I was able to run DeepSeek V3 on AMD gpus and produced this doc.

@yushengsu-thu
Copy link

@zhaochenyang20 Let me try to fix this.

@zhaochenyang20
Copy link
Collaborator Author

@zhaochenyang20 Let me try to fix this.

thanks so much for your help!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
amd documentation Improvements or additions to documentation good first issue Good for newcomers help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

3 participants