[Feature Request] The ability to use TensorRT Models, includes evaluation #1202
CloudWalker-II
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I would love to be able to use TensorRT-trained models within Krita,
https://github.com/comfyanonymous/ComfyUI_TensorRT
For those who may not be familiar, TensorRT allows models on Nvidia GPUs to leverage the RT cores, resulting in a significant boost in performance.
I think this could be particularly useful for the live mode feature. While TensorRT models don’t currently support adding Loras after training, the speed improvements are impressive—comparable to using the Hyper model settings, in my experience, but without any noticeable loss in quality. You could even train a model with an already integrated Hyper Lora (or lighting, turbo, etc) to double down on the speed gains from both.
Here is some comparisons from my own tests. The results are from a rtx 3080 10GB VRAM, I used a SDXL model at 1024 x 1024px and done with 25 steps, no Hyper-Lora. All images between the normal model and the RT enabled version where visually identical.
Beta Was this translation helpful? Give feedback.
All reactions