Assistance Needed with GPU Transcoding in Jellyfin

[ceckles]

fist off thanks for jumping in and the help or guidance! I am pretty new to proxmox an am learning as i break stuff.

I’ve been struggling for the past couple of days to get GPU transcoding working with my Jellyfin setup on Proxmox. Despite numerous attempts, I’m still having trouble as it seems to be defaulting to CPU transcoding instead of utilizing my NVIDIA GPU.

System Overview:
Proxmox Host: AMD 5900X, NVIDIA GeForce RTX 2080
Jellyfin: Installed using default settings in an LXC container

Steps Taken:
Installed NVIDIA drivers and CUDA on the Proxmox host.
Verified GPU recognition with nvidia-smi and checked device nodes with ls -l /dev/nvidia*.

below are outputs I think you'd ask for to help

HOST

NVIDIA-SMI:

+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 550.107.02             Driver Version: 550.107.02     CUDA Version: 12.4     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce RTX 2080 ...    Off |   00000000:09:00.0 Off |                  N/A |
| 14%   42C    P0             N/A /  250W |       1MiB /   8192MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+
                                                                                         
+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI        PID   Type   Process name                              GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|  No running processes found                                                             |
+-----------------------------------------------------------------------------------------+

>nvidia-smi --query-gpu=gpu_name,gpu_uuid --format=csv
NVIDIA GeForce RTX 2080 SUPER, GPU-4fbadaf0-557d-e5bb-063b-7587ed067e60

Device Nodes:

ls -l /dev/nvidia*
crw-rw-rw- 1 root root 195,   0 Sep 17 15:56 /dev/nvidia0
crw-rw-rw- 1 root root 195, 255 Sep 17 15:56 /dev/nvidiactl
crw-rw-rw- 1 root root 510,   0 Sep 17 15:56 /dev/nvidia-uvm
crw-rw-rw- 1 root root 510,   1 Sep 17 15:56 /dev/nvidia-uvm-tools

/etc/group

root:x:0:
video:x:44:root
render:x:104:root
_ssh:x:105:

/etc/subgid

root:100000:65536
root:44:1
root:104:1

Container Configuration (107.conf):

arch: amd64
cores: 2
dev0: /dev/dri/card0,gid=44
dev1: /dev/dri/renderD128,gid=104
features: keyctl=1,nesting=1
hostname: jellyfin
memory: 2048
net0: name=eth0,bridge=vmbr0,hwaddr=BC:24:11:F0:D0:8D,ip=dhcp,type=veth
onboot: 1
ostype: ubuntu
rootfs: local-lvm:vm-107-disk-0,size=16G
swap: 512
tags: proxmox-helper-scripts
unprivileged: 1

/dev/dri

drwxr-xr-x 2 root root        100 Sep 17 14:12 by-path
crw-rw---- 1 root video  226,   0 Sep 17 14:12 card0
crw-rw---- 1 root video  226,   1 Sep 17 14:12 card1
crw-rw---- 1 root render 226, 128 Sep 17 14:12 renderD128

LXC:

ls -l /dev/dri

total 0
crw-rw---- 1 root video  226,   0 Sep 17 23:47 card0
crw-rw---- 1 root render 226, 128 Sep 17 23:47 renderD128

/etc/group

root:x:0:
video:x:44:jellyfin
render:x:104:jellyfin
_ssh:x:111:
jellyfin:x:118:

this lxc I did not go in and install the nvidia driver on the container but I did in the past install still no luck.

Despite this setup, Jellyfin continues to use the CPU for transcoding. I would appreciate any guidance on what I might be missing or any suggestions for further troubleshooting.

[ceckles]

I've tried 3 version drivers and installing the nvidia driver and cuda on the container also blocked the Nouveau driver still no luck.

gave up on this repo's lxc plex and created a VM worked first time around.