You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@xhinker thanks a lot for sharing your code!
Why do you override device='cpu' input https://github.com/xhinker/sd_embed/blob/main/src/sd_embed/embedding_funcs.py#L1532-L1533
I find that copying from GPU to CPU is rather slow so swapping a transformer model with the embedding models and back takes time comparable to running the embedding models on CPU.
So why prevent using CPU if someone wants to?
The text was updated successfully, but these errors were encountered:
@xhinker thanks a lot for sharing your code!
Why do you override device='cpu' input
https://github.com/xhinker/sd_embed/blob/main/src/sd_embed/embedding_funcs.py#L1532-L1533
I find that copying from GPU to CPU is rather slow so swapping a transformer model with the embedding models and back takes time comparable to running the embedding models on CPU.
So why prevent using CPU if someone wants to?
The text was updated successfully, but these errors were encountered: