KV cache APIs for LLM inference

[prashantaithal]

Does ORT either provide any APIs in python or C++ or an implementation of kv cache that would help optimize LLM inference?
If no, is there any guide or reference on how the kv cache can be implemented in ORT?

[carzh]

ORT GenAI provides a higher-level API that handles the KV cache