Please add option to adjust GPU Weight since my gpu only has 6GB Vram

[ThepExcel]

Please add option to adjust GPU Weight since my gpu only has 6GB Vram

my RTX 3060 laptop can run with normal fp8 within 100-150 sec,
but it talk super long with nf4 (my gpu run 99% all the time and look like freezing)

in forge, there is option to change gpu weight so it can support low vram gpu, i hope there is option in comfyui too. thx

[F85x]

Here with 4GB, I can run the NF4 model in Forge without any issues, but with this node, unfortunately, I get an OOM (Out of Memory) error. If I try several times, it might eventually start running, but it's infinitely slower than with the FP8 model. I suppose some adjustments are still needed for low VRAM setups. Hopefully, in a future update, it will be functional for our case.