My code keeps blank it doesn't return anything please help #201
-
Hiii all I am using the code below after executing the file its completely blank as attached in screenshot, please help me solve this issue as I am stuck for more than 3 days now apparently if I run this through CLI it works from this command : npx --no node-llama-cpp chat --model .\models\phi-2-orange.Q2_K.gguf But if I use the code shared below its blank I have given the screenshot for the same if anyone can help would be highly appreciated.
|
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
As I mentioned in my other comment, there aren't enough details here for me to be able to help you, please provide the information I mentioned in that comment so I can help you. If you say that the |
Beta Was this translation helpful? Give feedback.
As I mentioned in my other comment, there aren't enough details here for me to be able to help you, please provide the information I mentioned in that comment so I can help you.
If you say that the
chat
command worked for you while using your code withgpu: false
didn't, I suspect that thechat
command utilized some GPU layer on your computer which made inference be much faster, and using the CPU only (withgpu: false
in your code) made the inference so slow you thought nothing happened and that it's stuck, while it's actually doing the inference but very very slowly