You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Feel free to ask any kind of questions in the issues page, but please use English since other users may find your questions valuable.
Describe the bug
A clear and concise description of what the bug is.
直接用 --workers 2 会出现
WARNING: You must pass the application as an import string to enable 'reload' or 'workers' 然后会退出进程,
To Reproduce
Steps to reproduce the behavior:
需要修改:
原代码: uvicorn.run(app, host=host, port=int(port), workers=args.workers, log_level="info")
修改后代码: uvicorn.run("tools.api:app", host=host, port=int(port), workers=args.workers, log_level="info")
然后就可以启动了。
但是并没有加载两个模型,理解不能同时进行推理,如果希望加载模型同时推理的话,有优化的办法吗?
还有多显卡的话,好像不能device=auto Expected behavior
A clear and concise description of what you expected to happen.
多workers 启动之后使用会出现
接下来不会改了。 谢谢。 Screenshots / log
If applicable, add screenshots / logs to help explain your problem.
Additional context
Add any other context about the problem here.
The text was updated successfully, but these errors were encountered:
Feel free to ask any kind of questions in the issues page, but please use English since other users may find your questions valuable.
Describe the bug
A clear and concise description of what the bug is.
直接用 --workers 2 会出现
WARNING: You must pass the application as an import string to enable 'reload' or 'workers' 然后会退出进程,
To Reproduce
Steps to reproduce the behavior:
需要修改:
原代码: uvicorn.run(app, host=host, port=int(port), workers=args.workers, log_level="info")
修改后代码: uvicorn.run("tools.api:app", host=host, port=int(port), workers=args.workers, log_level="info")
然后就可以启动了。
但是并没有加载两个模型,理解不能同时进行推理,如果希望加载模型同时推理的话,有优化的办法吗?
还有多显卡的话,好像不能device=auto
Expected behavior
A clear and concise description of what you expected to happen.
多workers 启动之后使用会出现
接下来不会改了。 谢谢。
Screenshots / log
If applicable, add screenshots / logs to help explain your problem.
Additional context
Add any other context about the problem here.
The text was updated successfully, but these errors were encountered: