Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Ascend NPU support for veRL #338

Open
Yikun opened this issue Feb 21, 2025 · 1 comment
Open

Add Ascend NPU support for veRL #338

Yikun opened this issue Feb 21, 2025 · 1 comment

Comments

@Yikun
Copy link

Yikun commented Feb 21, 2025

This RFC proposed to provide initial support for veRL on Ascend NPU.

PR1:Support FSDP worker and vLLM Ascend #332

A basic PR based on FSDP and Ascend NPU to make GRPO workflow work on Ascend NPU
(based on #198 which is proposed by @Chendong98 )

Include Single controller, FSDP worker Ascend NPU support, vLLM Ascend support (>=0.7.1)

Co-author:

PR2:Support Megatron 0.6 in veRL #85

Owner: @Chendong98

PR3: Support MindSpeed worker in veRL TBD

Based on PR2
Owner: @Chendong98

@Yikun
Copy link
Author

Yikun commented Feb 21, 2025

We had a internal meeting about Ascend NPU support for veRL, above is the initial info to make things clear for several PRs recent submitted (#332 #198 #85), hopes no more misunderstanding.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant