Skip to content

[WIP] support sglang engine #3810

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 5 commits into
base: main
Choose a base branch
from

Conversation

Jintao-Huang
Copy link
Collaborator

No description provided.

@Jintao-Huang Jintao-Huang changed the title support aglang engine [WIP] support aglang engine Apr 9, 2025
@Jintao-Huang Jintao-Huang changed the title [WIP] support aglang engine [WIP] support sglang engine Apr 9, 2025
@Jintao-Huang Jintao-Huang linked an issue Apr 9, 2025 that may be closed by this pull request
@xihuai18
Copy link
Contributor

For your information:

大家好!经过两个月旷日持久的大战(20 余人中美 12h 内两班倒),我们终于 end2end 拉通了 veRL-SGLang,和友商框架提供了完整类似的功能,这是已经完全验证过的相关文档:

https://verl.readthedocs.io/en/latest/workers/sglang_worker.html

欢迎大家上手尝试!我们接下来的开发计划如下:

zhaochenyang20/Awesome-ML-SYS-Tutorial#74

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

When to support SGLang
2 participants