流式输出下的batch推理 #1023
LiuChen19960902
started this conversation in
General
流式输出下的batch推理
#1023
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
如题，想请教一下在部署了流式输出的服务中，如何实现batch推理呢
Beta Was this translation helpful? Give feedback.
All reactions