Code

Fy/sllm checkpoint#2

Code

Open

future-xy wants to merge 11 commits intomainServerlessLLM/vllm:mainfrom fy/sllm_checkpointServerlessLLM/vllm:fy/sllm_checkpointCopy head branch name to clipboard

+348-1

Commits

Commits on Sep 10, 2024

• add serverless-llm loader

  

  xly

  authored and

  future-xy

  committed
  7216657

  Copy full SHA for 7216657

• custom load api

  

  xly

  authored and

  future-xy

  committed
  f9d1fc7

  Copy full SHA for f9d1fc7

• save load sllm

  

  Leyang Xue

  authored and

  future-xy

  committed
  9252771

  Copy full SHA for 9252771

• early load cpu & single gpu save

  

  Leyang Xue

  authored and

  future-xy

  committed
  cbd772c

  Copy full SHA for cbd772c

• update loader

  

  Leyang Xue

  authored and

  future-xy

  committed
  c54898c

  Copy full SHA for c54898c

• vllm loader new API

  

  Leyang Xue

  authored and

  future-xy

  committed
  2b9fe5b

  Copy full SHA for 2b9fe5b

• set empty tensor

  

  Leyang Xue

  authored and

  future-xy

  committed
  3fd5452

  Copy full SHA for 3fd5452

• clean up loader

  

  Leyang Xue

  authored and

  future-xy

  committed
  623a35e

  Copy full SHA for 623a35e

Commits on Sep 11, 2024

• feat: use save and load model api

  

  future-xy

  committed
  4e788b0

  Copy full SHA for 4e788b0

Commits on Sep 15, 2024

• fix: create path

  

  future-xy

  committed
  c5e6af3

  Copy full SHA for c5e6af3

• fix: rank path

  

  future-xy

  committed
  242ab3f

  Copy full SHA for 242ab3f