Привет всем! Я немного выбешиваюсь, пытаясь пробросить iGPU моего Ryzen 7 9800X3D в одну из моих виртуальных машин. Ядро (установлены pve-headers): Linux deb 6.11.11-1-pve #1 SMP PREEMPT_DYNAMIC PMX 6.11.11-1 (2025-01-17T15:44Z) x86_64 GNU/Linux.
Процессор: AMD Ryzen 7 9800X3D
Материнская плата: Gigabyte X870E
Оба устройства разделены в собственную группу iommugroup, в которой нет других устройств, поэтому конфликтов нет. У меня нет проблем с пробросом выделенных GPU (Nvidia и AMD).
Конфигурация ВМ:
* agent: 1
* args: -cpu 'host,-hypervisor,kvm=off'
* bios: ovmf
* boot: order=scsi0;ide0;net0
* cores: 8
* cpu: host
* hostpci0: 0000:7c:00.0,pcie=1,romfile=vbios_1002_13c0.bin <- пробовал как мой дамп, так и файл из репозитория GitHub, ничего не помогло.
* hostpci1: 0000:7c:00.1,pcie=1
* efidisk0: local:123/vm-123-disk-0.qcow2,efitype=4m,pre-enrolled-keys=1,size=528K
* machine: pc-q35-9.2
* memory: 8192
* meta: creation-qemu=9.2.0,ctime=1234
* name: iGPUTest
* net0: virtio=AA:BB:CC:D:EE:FF,bridge=vmbr5,firewall=1
* numa: 0
* ostype: win10
* scsi0: local:123/vm-123-disk-1.qcow2,iothread=1,size=50G
* scsihw: virtio-scsi-single
* smbios1: uuid=aaaaaaa-aaaaaaa-aaaaaaa-aaaaaaa-aaaaaaa
* sockets: 1
* vmgenid: aaaaaaa-aaaaaaa-aaaaaaa-aaaaaaa-aaaaaaa
dmesg |grep -e DMAR -e IOMMU -e AMD-Vi
[ 0.159159] AMD-Vi: Using global IVHD EFR:0x246577efa2254afa, EFR2:0x0
dmesg | grep 'remapping'
[ 0.480650] AMD-Vi: Interrupt remapping enabled
dmesg | grep -i vfio
[ 11.129426] VFIO - User Level meta-driver version: 0.3
[ 11.146535] vfio-pci 0000:7c:00.0: vgaarb: deactivate vga console
[ 11.146537] vfio-pci 0000:7c:00.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=io+mem wns=none
[ 11.146643] vfio_pci: add [1002:13c0[ffffffff:ffffffff]] class 0x000000/00000000
[ 11.170511] vfio_pci: add [1002:1640[ffffffff:ffffffff]] class 0x000000/00000000
[ 129.110782] vfio-pci 0000:03:00.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=io+mem wns=none
[ 129.182108] vfio-pci 0000:03:00.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=io+mem wns=none
[ 129.182253] vfio-pci 0000:03:00.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=io+mem wns=none
[ 130.559031] vfio-pci 0000:03:00.0: enabling device (0002 -> 0003)
[ 130.579019] vfio-pci 0000:03:00.1: enabling device (0000 -> 0002)
lspci -nnk (Host)
7c:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Granite Ridge [Radeon Graphics] [1002:13c0] (rev cb)
Subsystem: Gigabyte Technology Co., Ltd Granite Ridge [Radeon Graphics] [1458:d000]
Kernel driver in use: vfio-pci
Kernel modules: amdgpu
7c:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Rembrandt Radeon High Definition Audio Controller [1002:1640]
Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Rembrandt Radeon High Definition Audio Controller [1002:1640]
Kernel driver in use: vfio-pci
Kernel modules: snd_hda_intel
I also tried following by either dumping the vbios myself or using the 9800x3d.bin which the repo provides - or using none at all. Within Linux, i have tried multiple kernels, and Windows the device is being detected by either lspci or AMD Adrenaline during install. However, whenever i try to probe the driver (Linux) or to open the Adrenaline App (Windows), both show errors. To be fair, it has worked ONCE on Linux (iGPU listed in /dev/dri*), but never after. Had problems before that as well. Must have been pure luck. Installing the official AMD drivers on Linux did not help either.
Debian 12 (6.12.12+bpo-amd64) during boot:
shpchp 0000:05:04.0: pci_hp_register failed with error -16
shpchp 0000:05:04.0: Slot initialization failed
snd_hda_intel 0000:00:1b.0: no codecs found!
Debian 12 (6.12.12+bpo-amd64):
dmesg |grep -i vfio
[ 11.129426] VFIO - User Level meta-driver version: 0.3
[ 11.146535] vfio-pci 0000:7c:00.0: vgaarb: deactivate vga console
[ 11.146537] vfio-pci 0000:7c:00.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=io+mem wns=none
[ 11.146643] vfio_pci: add [1002:13c0[ffffffff:ffffffff]] class 0x000000/00000000
[ 11.170511] vfio_pci: add [1002:1640[ffffffff:ffffffff]] class 0x000000/00000000
dmesg |grep -i amdgpu
[ 129.110782] vfio-pci 0000:03:00.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=io+mem wns=none
dmesg |grep -i amdgpu
[ 11.129426] VFIO - User Level meta-driver version: 0.3
[ 11.146535] vfio-pci 0000:7c:00.0: vgaarb: deactivate vga console
[ 11.146537] vfio-pci 0000:7c:00.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=io+mem wns=none
[ 11.146643] vfio_pci: add [1002:13c0[ffffffff:ffffffff]] class 0x000000/00000000
[ 11.170511] vfio_pci: add [1002:1640[ffffffff:ffffffff]] class 0x000000/00000000
dmesg |grep -i amdgpu
[ 11.129426] VFIO - User Level meta-driver version: 0.3
[ 11.146535] vfio-pci 0000:7c:00.0: vgaarb: deactivate vga console
[ 11.146537] vfio-pci 0000:7c:00.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=io+mem wns=none
[ 11.146643] vfio_pci: add [1002:13c0[ffffffff:ffffffff]] class 0x000000/00000000
[ 11.170511] vfio_pci: add [1002:1640[ffffffff:ffffffff]] class 0x000000/00000000
lspci -nnk (VM)
01:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Granite Ridge [Radeon Graphics] [1002:13c0] (rev cb)
Subsystem: Gigabyte Technology Co., Ltd Granite Ridge [Radeon Graphics] [1458:d000]
Kernel modules: amdgpu
02:00.0 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Rembrandt Radeon High Definition Audio Controller [1002:1640]
Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Rembrandt Radeon High Definition Audio Controller [1002:1640]
Kernel driver in use: snd_hda_intel
Kernel modules: snd_hda_intel
At last, i am suffering the reset bug although using the vendor reset service/ module (Windows VM/ Linux Host). My Host won't reboot properly (hangs). I must power cycle. Checking i am not sure if it should be working.
Any help is appreciated, thanks!!!
Процессор: AMD Ryzen 7 9800X3D
Материнская плата: Gigabyte X870E
Оба устройства разделены в собственную группу iommugroup, в которой нет других устройств, поэтому конфликтов нет. У меня нет проблем с пробросом выделенных GPU (Nvidia и AMD).
Конфигурация ВМ:
* agent: 1
* args: -cpu 'host,-hypervisor,kvm=off'
* bios: ovmf
* boot: order=scsi0;ide0;net0
* cores: 8
* cpu: host
* hostpci0: 0000:7c:00.0,pcie=1,romfile=vbios_1002_13c0.bin <- пробовал как мой дамп, так и файл из репозитория GitHub, ничего не помогло.
* hostpci1: 0000:7c:00.1,pcie=1
* efidisk0: local:123/vm-123-disk-0.qcow2,efitype=4m,pre-enrolled-keys=1,size=528K
* machine: pc-q35-9.2
* memory: 8192
* meta: creation-qemu=9.2.0,ctime=1234
* name: iGPUTest
* net0: virtio=AA:BB:CC:D:EE:FF,bridge=vmbr5,firewall=1
* numa: 0
* ostype: win10
* scsi0: local:123/vm-123-disk-1.qcow2,iothread=1,size=50G
* scsihw: virtio-scsi-single
* smbios1: uuid=aaaaaaa-aaaaaaa-aaaaaaa-aaaaaaa-aaaaaaa
* sockets: 1
* vmgenid: aaaaaaa-aaaaaaa-aaaaaaa-aaaaaaa-aaaaaaa
dmesg |grep -e DMAR -e IOMMU -e AMD-Vi
[ 0.159159] AMD-Vi: Using global IVHD EFR:0x246577efa2254afa, EFR2:0x0
dmesg | grep 'remapping'
[ 0.480650] AMD-Vi: Interrupt remapping enabled
dmesg | grep -i vfio
[ 11.129426] VFIO - User Level meta-driver version: 0.3
[ 11.146535] vfio-pci 0000:7c:00.0: vgaarb: deactivate vga console
[ 11.146537] vfio-pci 0000:7c:00.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=io+mem wns=none
[ 11.146643] vfio_pci: add [1002:13c0[ffffffff:ffffffff]] class 0x000000/00000000
[ 11.170511] vfio_pci: add [1002:1640[ffffffff:ffffffff]] class 0x000000/00000000
[ 129.110782] vfio-pci 0000:03:00.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=io+mem wns=none
[ 129.182108] vfio-pci 0000:03:00.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=io+mem wns=none
[ 129.182253] vfio-pci 0000:03:00.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=io+mem wns=none
[ 130.559031] vfio-pci 0000:03:00.0: enabling device (0002 -> 0003)
[ 130.579019] vfio-pci 0000:03:00.1: enabling device (0000 -> 0002)
lspci -nnk (Host)
7c:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Granite Ridge [Radeon Graphics] [1002:13c0] (rev cb)
Subsystem: Gigabyte Technology Co., Ltd Granite Ridge [Radeon Graphics] [1458:d000]
Kernel driver in use: vfio-pci
Kernel modules: amdgpu
7c:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Rembrandt Radeon High Definition Audio Controller [1002:1640]
Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Rembrandt Radeon High Definition Audio Controller [1002:1640]
Kernel driver in use: vfio-pci
Kernel modules: snd_hda_intel
I also tried following by either dumping the vbios myself or using the 9800x3d.bin which the repo provides - or using none at all. Within Linux, i have tried multiple kernels, and Windows the device is being detected by either lspci or AMD Adrenaline during install. However, whenever i try to probe the driver (Linux) or to open the Adrenaline App (Windows), both show errors. To be fair, it has worked ONCE on Linux (iGPU listed in /dev/dri*), but never after. Had problems before that as well. Must have been pure luck. Installing the official AMD drivers on Linux did not help either.
Debian 12 (6.12.12+bpo-amd64) during boot:
shpchp 0000:05:04.0: pci_hp_register failed with error -16
shpchp 0000:05:04.0: Slot initialization failed
snd_hda_intel 0000:00:1b.0: no codecs found!
Debian 12 (6.12.12+bpo-amd64):
dmesg |grep -i vfio
[ 11.129426] VFIO - User Level meta-driver version: 0.3
[ 11.146535] vfio-pci 0000:7c:00.0: vgaarb: deactivate vga console
[ 11.146537] vfio-pci 0000:7c:00.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=io+mem wns=none
[ 11.146643] vfio_pci: add [1002:13c0[ffffffff:ffffffff]] class 0x000000/00000000
[ 11.170511] vfio_pci: add [1002:1640[ffffffff:ffffffff]] class 0x000000/00000000
dmesg |grep -i amdgpu
[ 129.110782] vfio-pci 0000:03:00.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=io+mem wns=none
dmesg |grep -i amdgpu
[ 11.129426] VFIO - User Level meta-driver version: 0.3
[ 11.146535] vfio-pci 0000:7c:00.0: vgaarb: deactivate vga console
[ 11.146537] vfio-pci 0000:7c:00.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=io+mem wns=none
[ 11.146643] vfio_pci: add [1002:13c0[ffffffff:ffffffff]] class 0x000000/00000000
[ 11.170511] vfio_pci: add [1002:1640[ffffffff:ffffffff]] class 0x000000/00000000
dmesg |grep -i amdgpu
[ 11.129426] VFIO - User Level meta-driver version: 0.3
[ 11.146535] vfio-pci 0000:7c:00.0: vgaarb: deactivate vga console
[ 11.146537] vfio-pci 0000:7c:00.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=io+mem wns=none
[ 11.146643] vfio_pci: add [1002:13c0[ffffffff:ffffffff]] class 0x000000/00000000
[ 11.170511] vfio_pci: add [1002:1640[ffffffff:ffffffff]] class 0x000000/00000000
lspci -nnk (VM)
01:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Granite Ridge [Radeon Graphics] [1002:13c0] (rev cb)
Subsystem: Gigabyte Technology Co., Ltd Granite Ridge [Radeon Graphics] [1458:d000]
Kernel modules: amdgpu
02:00.0 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Rembrandt Radeon High Definition Audio Controller [1002:1640]
Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Rembrandt Radeon High Definition Audio Controller [1002:1640]
Kernel driver in use: snd_hda_intel
Kernel modules: snd_hda_intel
At last, i am suffering the reset bug although using the vendor reset service/ module (Windows VM/ Linux Host). My Host won't reboot properly (hangs). I must power cycle. Checking i am not sure if it should be working.
Any help is appreciated, thanks!!!
