Add env param KV_CACHE_LOCATION to control kv cache memory numanode location#462

Open

a3213105 wants to merge 4 commits intointel:mainfrom a3213105:kvcache_location

+59-23

Commits on Jun 28, 2024

Add env param KV_CACHE_LOCATION to control kv cache memory numanode location
a3213105
committed

Commits on Jul 2, 2024

move env KV_CACHE_LOCATION init & get into environment.h
a3213105
committed

Commits on Jul 3, 2024