add support for flash decoding on xpu#1118

Open

kaixuanliu wants to merge 4 commits intohuggingface:mainfrom kaixuanliu:flash_xpu

+105-37

Commits on Jan 17, 2025

add support for flash decoding on xpu
kaixuanliu
committed

Commits on Jan 21, 2025

Merge branch 'main' into flash_xpu
kaixuanliu
authored
change block_size to 16 for xpu, as single_query_cached_kv_attention API does not support 64
kaixuanliu
committed

Commits on Jan 23, 2025

optimize the performance
kaixuanliu
committed