Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add EngineFragment #3120

Open
wants to merge 131 commits into
base: main
Choose a base branch
from
Open

Add EngineFragment #3120

wants to merge 131 commits into from

Conversation

fzyzcjy
Copy link
Collaborator

@fzyzcjy fzyzcjy commented Jan 25, 2025

Motivation

Modifications

Checklist

fzyzcjy added 30 commits January 25, 2025 09:22
@fzyzcjy
empty file
a2f2f48
@fzyzcjy
empty class
815dbc3
@fzyzcjy
mv MetricManager
3c0e52f
@fzyzcjy
fix
65b3a37
@fzyzcjy
mv _ReqState
6ce5236
@fzyzcjy
mv GenerationConverter.init
7ca0a47
@fzyzcjy
mv tokenize_request
b88e450
@fzyzcjy
simp branch
3b8ed7b
@fzyzcjy
tokenize_requests
2f47f92
@fzyzcjy
mv postprocess_response
e21a05e
@fzyzcjy
simp code
ab5d79a
@fzyzcjy
extract _compute_meta_info
053c8f4
@fzyzcjy
mv convert_logprob_style etc
02c451c
@fzyzcjy
make private
ccd5e8a
@fzyzcjy
mv GenerationManager.init
ecf5e21
@fzyzcjy
mv GenerationManager body
818f8cd
@fzyzcjy
fix import
022eb4f
@fzyzcjy
mv modelconfig
dc53f8f
@fzyzcjy
call generation_converter
c4f1668
@fzyzcjy
fix metrics
1670ce1
@fzyzcjy
fix err
905d247
@fzyzcjy
handle tokenizer_manager.generate_request
41bee7d
@fzyzcjy
handle abort_request
2b3ca96
@fzyzcjy
add field
e293f1f
@fzyzcjy
rm empty func
2424cf2
@fzyzcjy
extract _RequestDumper
422ea33
@fzyzcjy
call setup
3e6e363
@fzyzcjy
call handle_batch_output
56dcbd1
@fzyzcjy
more tokenizer_manager call generation_manager
0c08f30
@fzyzcjy
use property
deec6af
@fzyzcjy fzyzcjy marked this pull request as ready for review January 26, 2025 07:18
fzyzcjy and others added 18 commits January 26, 2025 17:39
@fzyzcjy
Merge branch 'main' into feat/generation_manager
03b5799
@fzyzcjy
Merge branch 'main' into feat/generation_manager
2588e23
@fzyzcjy
Merge branch 'main' into feat/generation_manager
7daa570 
# Conflicts:
#	python/sglang/srt/managers/tokenizer_manager.py
@fzyzcjy
Merge branch 'feat/generation_manager' into feat/rename_tokenizer_man…
3c21082 
…ager

# Conflicts:
#	python/sglang/srt/openai_api/adapter.py
@fzyzcjy
Merge branch 'feat/rename_tokenizer_manager' into feat/separate_comm
8239d52 
# Conflicts:
#	python/sglang/srt/entrypoints/engine.py
#	python/sglang/srt/entrypoints/http_server.py
#	python/sglang/srt/managers/detokenizer_manager.py
#	python/sglang/srt/managers/scheduler.py
@fzyzcjy
Merge branch 'feat/separate_comm' into feat/engine_fragment_0125
bc23bb4
@fzyzcjy
fix import
f62574e
@fzyzcjy
Merge branch 'feat/separate_comm' into feat/engine_fragment_0125
039df0a
@fzyzcjy
fix rename
6f057aa
@fzyzcjy
Merge branch 'feat/rename_tokenizer_manager' into feat/separate_comm
1aa2ef0
@fzyzcjy
Merge branch 'feat/separate_comm' into feat/engine_fragment_0125
c38c8c5
@fzyzcjy
fix rename
ce8fbef
@fzyzcjy
Merge branch 'feat/rename_tokenizer_manager' into feat/separate_comm
488b6cd
@fzyzcjy
Merge branch 'feat/separate_comm' into feat/engine_fragment_0125
0fca144
@fzyzcjy
bump ci
5ed169c
@fzyzcjy
Revert "bump ci"
3d46e2f 
This reverts commit 5ed169c.
@fzyzcjy
Revert "Revert "bump ci""
570d657 
This reverts commit 3d46e2f.
@fzyzcjy
Revert "Revert "Revert "bump ci"""
89e433e 
This reverts commit 570d657.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@merrymercy merrymercy Awaiting requested review from merrymercy merrymercy is a code owner

@Ying1123 Ying1123 Awaiting requested review from Ying1123 Ying1123 is a code owner

@zhyncs zhyncs Awaiting requested review from zhyncs zhyncs is a code owner

@hnyls2002 hnyls2002 Awaiting requested review from hnyls2002 hnyls2002 is a code owner

@ispobock ispobock Awaiting requested review from ispobock ispobock is a code owner

@ByronHsu ByronHsu Awaiting requested review from ByronHsu ByronHsu is a code owner

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@fzyzcjy