Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scheduler cannot find forward latency #21

Open
levulinh opened this issue Mar 22, 2021 · 1 comment
Open

Scheduler cannot find forward latency #21

levulinh opened this issue Mar 22, 2021 · 1 comment

Comments

@levulinh
Copy link

levulinh commented Mar 22, 2021

Hi, I followed the latest example to run Nexus on docker. However when I start the frontend, the scheduler collapsed and says "F0322 14:16:14.132954 14 model_db.cpp:96] Cannot find forward latency: model=tensorflow:resnet_0:1:224x224 batch=1". Detail in the images below.

image

image

image

Please help me with this, thank you.

@levulinh
Copy link
Author

Not sure if it helps anyone but when I run it on a machine with GPU GTX 1080, the scheduler works fine and it found the batch size of 324 (I think). Before that, I ran it on GTX 1060 and it found the batch size of 0 so maybe that's reason why the schedule cannot load the model.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant