-
For example, if I download this 6.62GB SDXL model or any other popular models and load it, the VRAM usage goes near 14GB and a high memory utilisation warning is printed in the terminal. I mean 13.6GB just when the model is loaded, not when generating an image. Is this normal? I don't remember exactly but I think the VRAM usage was not this high when I tried it months ago. I tried checking the two vram saving options (low/medium something), but it made no difference. Restarting the PC had no difference. Intel Arc A770, 16GB VRAM, Linux. |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 2 replies
-
Don't use --no-half / FP32. Select BF16 from compute settings and restart. |
Beta Was this translation helpful? Give feedback.
Don't use --no-half / FP32. Select BF16 from compute settings and restart.
Also disable ipex optimize model if you use Loras.