Skip to content
This repository has been archived by the owner on Mar 5, 2024. It is now read-only.

Model reloaded for each client #26

Open
JohnGiorgi opened this issue Mar 12, 2021 · 0 comments
Open

Model reloaded for each client #26

JohnGiorgi opened this issue Mar 12, 2021 · 0 comments

Comments

@JohnGiorgi
Copy link
Contributor

JohnGiorgi commented Mar 12, 2021

I noticed that there is a few-second delay for the first request from each new client. This delay likely corresponds to the loading of the model. The confusing thing is that I would expect the model to be loaded once and then cached, and then not loaded again for the life cycle of the web services, regardless of the client. Figure out why this is not the case.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant