Skip to content

Commit

Permalink
Fix error with deploy test
Browse files Browse the repository at this point in the history
Signed-off-by: Thomas Parnell <[email protected]>
  • Loading branch information
tdoublep committed Jan 17, 2025
1 parent 43b5c48 commit d19ff3d
Showing 1 changed file with 3 additions and 2 deletions.
5 changes: 3 additions & 2 deletions vllm/core/scheduler.py
Original file line number Diff line number Diff line change
Expand Up @@ -919,8 +919,9 @@ def _schedule_prefills(
ignored_seq_groups: List[SequenceGroup] = []
seq_groups: List[ScheduledSequenceGroup] = []

applicable_spyre_warmup_shapes = list(
self.scheduler_config.spyre_warmup_shapes)
if self.scheduler_config.spyre_scheduling_enabled:
applicable_spyre_warmup_shapes = list(
self.scheduler_config.spyre_warmup_shapes)

waiting_queue = self.waiting

Expand Down

0 comments on commit d19ff3d

Please sign in to comment.