hi everyone, i've been having an ongoing issue w/ the 6.14.y kernel (maybe since 6.14.2) where my AMD Radeon RX 7900 XT will only run at PCIe gen 2.0 speeds. This is strange b/c 6.6.y and 6.12.y have no problems whatsoever — all of these versions have patched amdgpu drivers which i cross compile.
the `dmesg` outputs look similar (to my untrained eye), except that the link up speed is initially 8.0 GT/s in 6.14.y, whereas 6.12.y initially links up at 5.0 GT/s — probably recent changes to the brcm pcie controller?
in `lspci`, both kernel versions print "LnkCap: ... Speed 8GT/s" for the root PCI bridge, but in 6.14.y, it only ever links at 5GT/s, "LnkSta: Speed 5GT/s, Width x1". to see the full output, please check out this gist, https://gist.github.com/nicholasaiello/ ... b54fd4ee1f.
other things to note:
6.12.27
6.14.5
any ideas? thanks in advance!
-nick-
the `dmesg` outputs look similar (to my untrained eye), except that the link up speed is initially 8.0 GT/s in 6.14.y, whereas 6.12.y initially links up at 5.0 GT/s — probably recent changes to the brcm pcie controller?
in `lspci`, both kernel versions print "LnkCap: ... Speed 8GT/s" for the root PCI bridge, but in 6.14.y, it only ever links at 5GT/s, "LnkSta: Speed 5GT/s, Width x1". to see the full output, please check out this gist, https://gist.github.com/nicholasaiello/ ... b54fd4ee1f.
other things to note:
- the card is linked as an eGPU, connected from a Pimoroni NVMe Base and this M.2 to OCulink adapter (https://a.co/d/eilIcJV) to a Minisforum DEG1 dock
- running the `nvtop` command confirms the pcie speed used by the gpu
- i've tried multiple variations of settings in both cmdline.txt and config.txt, comparing across kernels without any luck. 6.14.y doesn't work while the others do
- thinking that the issue could be related to recent changes to the pcie controller, i tried applying this revert to 6.14.y w/o luck, https://github.com/raspberrypi/linux/co ... 65639b3354.
- i went back to the commit before the pcie controller changes were merged, and still no luck
Code:
dtparam=pciex1dtparam=pciex1_gen=3dtoverlay=pciex1-compat-pi5,mmio-hilastly, see below for filtered output from `dmesg`:most of the time, the "pciex1-compat-pi5" line is commented out, b/c it doesn't seem make a difference.
6.12.27
Code:
$ dmesg | grep -i pci[ 0.000000] Kernel command line: reboot=w coherent_pool=1M 8250.nr_uarts=1 pci=pcie_bus_safe cgroup_disable=memory numa_policy=interleave nvme.max_host_mem_size_mb=0 clk_ignore_unused numa=fake=4 system_heap.max_order=0 smsc95xx.macaddr=2C:CF:67:E3:D3:C5 vc_mem.mem_base=0x3fc00000 vc_mem.mem_size=0x40000000 console=ttyAMA10,115200 console=tty1 root=PARTUUID=2e387cb1-02 rootfstype=ext4 fsck.repair=yes pci=pcie_bus_safe,realloc iommu.strict=no rootwait quiet splash plymouth.ignore-serial-consoles cfg80211.ieee80211_regdom=US[ 0.060951] PCI: CLS 0 bytes, default 64[ 0.303170] brcm-pcie 1000110000.pcie: host bridge /axi/pcie@1000110000 ranges:[ 0.303174] brcm-pcie 1000110000.pcie: No bus range found for /axi/pcie@1000110000, using [bus 00-ff][ 0.303181] brcm-pcie 1000110000.pcie: MEM 0x1b80000000..0x1bfffffffb -> 0x0080000000[ 0.303184] brcm-pcie 1000110000.pcie: MEM 0x1800000000..0x1b7fffffff -> 0x0400000000[ 0.303189] brcm-pcie 1000110000.pcie: IB MEM 0x0000000000..0x0fffffffff -> 0x1000000000[ 0.303192] brcm-pcie 1000110000.pcie: IB MEM 0x1000131000..0x1000131fff -> 0xfffffff000[ 0.304514] brcm-pcie 1000110000.pcie: PCI host bridge to bus 0001:00[ 0.304518] pci_bus 0001:00: root bus resource [bus 00-ff][ 0.304520] pci_bus 0001:00: root bus resource [mem 0x1b80000000-0x1bfffffffb] (bus address [0x80000000-0xfffffffb])[ 0.304522] pci_bus 0001:00: root bus resource [mem 0x1800000000-0x1b7fffffff pref] (bus address [0x400000000-0x77fffffff])[ 0.304531] pci 0001:00:00.0: [14e4:2712] type 01 class 0x060400 PCIe Root Port[ 0.304536] pci 0001:00:00.0: PCI bridge to [bus 01-03][ 0.304539] pci 0001:00:00.0: bridge window [mem 0x1b80000000-0x1bbfffffff][ 0.304555] pci 0001:00:00.0: PME# supported from D0 D3hot[ 0.408144] brcm-pcie 1000110000.pcie: clkreq-mode set to safe[ 0.408147] brcm-pcie 1000110000.pcie: link up, 5.0 GT/s PCIe x1 (!SSC)[ 0.420503] pci 0001:01:00.0: [1002:1478] type 01 class 0x060400 PCIe Switch Upstream Port[ 0.420516] pci 0001:01:00.0: BAR 0 [mem 0x00000000-0x00003fff][ 0.420529] pci 0001:01:00.0: PCI bridge to [bus 00][ 0.420535] pci 0001:01:00.0: bridge window [io 0x0000-0x0fff][ 0.420539] pci 0001:01:00.0: bridge window [mem 0x00000000-0x000fffff][ 0.420549] pci 0001:01:00.0: bridge window [mem 0x00000000-0x000fffff 64bit pref][ 0.420642] pci 0001:01:00.0: PME# supported from D0 D3hot D3cold[ 0.420722] pci 0001:01:00.0: 7.876 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x1 link at 0001:00:00.0 (capable of 252.048 Gb/s with 16.0 GT/s PCIe x16 link)[ 0.428152] pci 0001:01:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring[ 0.428210] pci 0001:02:00.0: [1002:1479] type 01 class 0x060400 PCIe Switch Downstream Port[ 0.428232] pci 0001:02:00.0: PCI bridge to [bus 00][ 0.428238] pci 0001:02:00.0: bridge window [io 0x0000-0x0fff][ 0.428241] pci 0001:02:00.0: bridge window [mem 0x00000000-0x000fffff][ 0.428251] pci 0001:02:00.0: bridge window [mem 0x00000000-0x000fffff 64bit pref][ 0.428342] pci 0001:02:00.0: PME# supported from D0 D3hot D3cold[ 0.428909] pci 0001:02:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring[ 0.428964] pci 0001:03:00.0: [1002:744c] type 00 class 0x030000 PCIe Legacy Endpoint[ 0.428979] pci 0001:03:00.0: BAR 0 [mem 0x00000000-0x0fffffff 64bit pref][ 0.428988] pci 0001:03:00.0: BAR 2 [mem 0x00000000-0x001fffff 64bit pref][ 0.428993] pci 0001:03:00.0: BAR 4 [io 0x0000-0x00ff][ 0.428999] pci 0001:03:00.0: BAR 5 [mem 0x00000000-0x000fffff][ 0.429004] pci 0001:03:00.0: ROM [mem 0x00000000-0x0001ffff pref][ 0.429104] pci 0001:03:00.0: PME# supported from D1 D2 D3hot D3cold[ 0.429190] pci 0001:03:00.0: 7.876 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x1 link at 0001:00:00.0 (capable of 252.048 Gb/s with 16.0 GT/s PCIe x16 link)[ 0.429263] pci 0001:03:00.0: vgaarb: setting as boot VGA device[ 0.429265] pci 0001:03:00.0: vgaarb: bridge control possible[ 0.429266] pci 0001:03:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none[ 0.429284] pci 0001:03:00.1: [1002:ab30] type 00 class 0x040300 PCIe Legacy Endpoint[ 0.429296] pci 0001:03:00.1: BAR 0 [mem 0x00000000-0x00003fff][ 0.429386] pci 0001:03:00.1: PME# supported from D1 D2 D3hot D3cold[ 0.429519] pci_bus 0001:03: busn_res: [bus 03] end is updated to 03[ 0.429524] pci_bus 0001:02: busn_res: [bus 02-03] end is updated to 03[ 0.429531] pci_bus 0001:00: max bus depth: 3 pci_try_num: 4[ 0.429538] pci 0001:00:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref]: assigned[ 0.429540] pci 0001:00:00.0: bridge window [mem 0x1b80000000-0x1b802fffff]: assigned[ 0.429542] pci 0001:01:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref]: assigned[ 0.429544] pci 0001:01:00.0: bridge window [mem 0x1b80000000-0x1b801fffff]: assigned[ 0.429546] pci 0001:01:00.0: BAR 0 [mem 0x1b80200000-0x1b80203fff]: assigned[ 0.429549] pci 0001:01:00.0: bridge window [io size 0x1000]: can't assign; no space[ 0.429551] pci 0001:01:00.0: bridge window [io size 0x1000]: failed to assign[ 0.429553] pci 0001:02:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref]: assigned[ 0.429555] pci 0001:02:00.0: bridge window [mem 0x1b80000000-0x1b801fffff]: assigned[ 0.429556] pci 0001:02:00.0: bridge window [io size 0x1000]: can't assign; no space[ 0.429558] pci 0001:02:00.0: bridge window [io size 0x1000]: failed to assign[ 0.429560] pci 0001:03:00.0: BAR 0 [mem 0x1800000000-0x180fffffff 64bit pref]: assigned[ 0.429568] pci 0001:03:00.0: BAR 2 [mem 0x1810000000-0x18101fffff 64bit pref]: assigned[ 0.429576] pci 0001:03:00.0: BAR 5 [mem 0x1b80000000-0x1b800fffff]: assigned[ 0.429580] pci 0001:03:00.0: ROM [mem 0x1b80100000-0x1b8011ffff pref]: assigned[ 0.429581] pci 0001:03:00.1: BAR 0 [mem 0x1b80120000-0x1b80123fff]: assigned[ 0.429585] pci 0001:03:00.0: BAR 4 [io size 0x0100]: can't assign; no space[ 0.429586] pci 0001:03:00.0: BAR 4 [io size 0x0100]: failed to assign[ 0.429588] pci 0001:02:00.0: PCI bridge to [bus 03][ 0.429592] pci 0001:02:00.0: bridge window [mem 0x1b80000000-0x1b801fffff][ 0.429595] pci 0001:02:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.429600] pci 0001:01:00.0: PCI bridge to [bus 02-03][ 0.429603] pci 0001:01:00.0: bridge window [mem 0x1b80000000-0x1b801fffff][ 0.429606] pci 0001:01:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.429611] pci 0001:00:00.0: PCI bridge to [bus 01-03][ 0.429612] pci 0001:00:00.0: bridge window [mem 0x1b80000000-0x1b802fffff][ 0.429614] pci 0001:00:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.429616] pci_bus 0001:00: No. 2 try to assign unassigned res[ 0.429619] pci 0001:01:00.0: bridge window [io size 0x1000]: can't assign; no space[ 0.429620] pci 0001:01:00.0: bridge window [io size 0x1000]: failed to assign[ 0.429622] pci 0001:02:00.0: bridge window [io size 0x1000]: can't assign; no space[ 0.429623] pci 0001:02:00.0: bridge window [io size 0x1000]: failed to assign[ 0.429625] pci 0001:03:00.0: BAR 4 [io size 0x0100]: can't assign; no space[ 0.429626] pci 0001:03:00.0: BAR 4 [io size 0x0100]: failed to assign[ 0.429628] pci 0001:02:00.0: PCI bridge to [bus 03][ 0.429631] pci 0001:02:00.0: bridge window [mem 0x1b80000000-0x1b801fffff][ 0.429634] pci 0001:02:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.429638] pci 0001:01:00.0: PCI bridge to [bus 02-03][ 0.429642] pci 0001:01:00.0: bridge window [mem 0x1b80000000-0x1b801fffff][ 0.429645] pci 0001:01:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.429649] pci 0001:00:00.0: PCI bridge to [bus 01-03][ 0.429651] pci 0001:00:00.0: bridge window [mem 0x1b80000000-0x1b802fffff][ 0.429653] pci 0001:00:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.429655] pci_bus 0001:00: No. 3 try to assign unassigned res[ 0.429657] pci 0001:01:00.0: bridge window [io size 0x1000]: can't assign; no space[ 0.429658] pci 0001:01:00.0: bridge window [io size 0x1000]: failed to assign[ 0.429660] pci 0001:02:00.0: bridge window [io size 0x1000]: can't assign; no space[ 0.429661] pci 0001:02:00.0: bridge window [io size 0x1000]: failed to assign[ 0.429662] pci 0001:03:00.0: BAR 4 [io size 0x0100]: can't assign; no space[ 0.429664] pci 0001:03:00.0: BAR 4 [io size 0x0100]: failed to assign[ 0.429665] pci 0001:02:00.0: PCI bridge to [bus 03][ 0.429668] pci 0001:02:00.0: bridge window [mem 0x1b80000000-0x1b801fffff][ 0.429671] pci 0001:02:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.429676] pci 0001:01:00.0: PCI bridge to [bus 02-03][ 0.429679] pci 0001:01:00.0: bridge window [mem 0x1b80000000-0x1b801fffff][ 0.429682] pci 0001:01:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.429686] pci 0001:00:00.0: PCI bridge to [bus 01-03][ 0.429688] pci 0001:00:00.0: bridge window [mem 0x1b80000000-0x1b802fffff][ 0.429690] pci 0001:00:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.429691] pci_bus 0001:00: No. 4 try to assign unassigned res[ 0.429694] pci 0001:01:00.0: bridge window [io size 0x1000]: can't assign; no space[ 0.429695] pci 0001:01:00.0: bridge window [io size 0x1000]: failed to assign[ 0.429697] pci 0001:02:00.0: bridge window [io size 0x1000]: can't assign; no space[ 0.429698] pci 0001:02:00.0: bridge window [io size 0x1000]: failed to assign[ 0.429700] pci 0001:03:00.0: BAR 4 [io size 0x0100]: can't assign; no space[ 0.429701] pci 0001:03:00.0: BAR 4 [io size 0x0100]: failed to assign[ 0.429703] pci 0001:02:00.0: PCI bridge to [bus 03][ 0.429706] pci 0001:02:00.0: bridge window [mem 0x1b80000000-0x1b801fffff][ 0.429709] pci 0001:02:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.429713] pci 0001:01:00.0: PCI bridge to [bus 02-03][ 0.429717] pci 0001:01:00.0: bridge window [mem 0x1b80000000-0x1b801fffff][ 0.429720] pci 0001:01:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.429725] pci 0001:00:00.0: PCI bridge to [bus 01-03][ 0.429726] pci 0001:00:00.0: bridge window [mem 0x1b80000000-0x1b802fffff][ 0.429728] pci 0001:00:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.429730] pci_bus 0001:00: resource 4 [mem 0x1b80000000-0x1bfffffffb][ 0.429732] pci_bus 0001:00: resource 5 [mem 0x1800000000-0x1b7fffffff pref][ 0.429733] pci_bus 0001:01: resource 1 [mem 0x1b80000000-0x1b802fffff][ 0.429735] pci_bus 0001:01: resource 2 [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.429736] pci_bus 0001:02: resource 1 [mem 0x1b80000000-0x1b801fffff][ 0.429738] pci_bus 0001:02: resource 2 [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.429739] pci_bus 0001:03: resource 1 [mem 0x1b80000000-0x1b801fffff][ 0.429741] pci_bus 0001:03: resource 2 [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.429744] pci 0001:00:00.0: Max Payload Size set to 256/ 512 (was 128), Max Read Rq 512[ 0.429751] pci 0001:01:00.0: Max Payload Size set to 256/ 512 (was 128), Max Read Rq 512[ 0.429757] pci 0001:02:00.0: Max Payload Size set to 256/ 512 (was 128), Max Read Rq 512[ 0.429763] pci 0001:03:00.0: Max Payload Size set to 256/ 256 (was 128), Max Read Rq 512[ 0.429769] pci 0001:03:00.1: Max Payload Size set to 256/ 256 (was 128), Max Read Rq 512[ 0.429845] pcieport 0001:00:00.0: enabling device (0000 -> 0002)[ 0.429870] pcieport 0001:00:00.0: PME: Signaling with IRQ 36[ 0.429912] pcieport 0001:00:00.0: AER: enabled with IRQ 36[ 0.430082] pcieport 0001:01:00.0: enabling device (0000 -> 0002)[ 0.430255] pcieport 0001:02:00.0: enabling device (0000 -> 0002)[ 0.430399] pci 0001:03:00.1: D0 power state depends on 0001:03:00.0[ 0.430435] brcm-pcie 1000120000.pcie: host bridge /axi/pcie@1000120000 ranges:[ 0.430438] brcm-pcie 1000120000.pcie: No bus range found for /axi/pcie@1000120000, using [bus 00-ff][ 0.430443] brcm-pcie 1000120000.pcie: MEM 0x1f00000000..0x1ffffffffb -> 0x0000000000[ 0.430446] brcm-pcie 1000120000.pcie: MEM 0x1c00000000..0x1effffffff -> 0x0400000000[ 0.430450] brcm-pcie 1000120000.pcie: IB MEM 0x1f00000000..0x1f003fffff -> 0x0000000000[ 0.430454] brcm-pcie 1000120000.pcie: IB MEM 0x0000000000..0x0fffffffff -> 0x1000000000[ 0.430456] brcm-pcie 1000120000.pcie: IB MEM 0x1000130000..0x1000130fff -> 0xfffffff000[ 0.431591] brcm-pcie 1000120000.pcie: PCI host bridge to bus 0002:00[ 0.431594] pci_bus 0002:00: root bus resource [bus 00-ff][ 0.431596] pci_bus 0002:00: root bus resource [mem 0x1f00000000-0x1ffffffffb] (bus address [0x00000000-0xfffffffb])[ 0.431598] pci_bus 0002:00: root bus resource [mem 0x1c00000000-0x1effffffff pref] (bus address [0x400000000-0x6ffffffff])[ 0.431603] pci 0002:00:00.0: [14e4:2712] type 01 class 0x060400 PCIe Root Port[ 0.431607] pci 0002:00:00.0: PCI bridge to [bus 00][ 0.431609] pci 0002:00:00.0: bridge window [mem 0x1f80000000-0x1fbfffffff][ 0.431621] pci 0002:00:00.0: PME# supported from D0 D3hot[ 0.432058] pci 0002:00:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring[ 0.532142] brcm-pcie 1000120000.pcie: clkreq-mode set to default[ 0.532144] brcm-pcie 1000120000.pcie: link up, 5.0 GT/s PCIe x4 (!SSC)[ 0.532161] pci 0002:01:00.0: [1de4:0001] type 00 class 0x020000 PCIe Endpoint[ 0.532172] pci 0002:01:00.0: BAR 0 [mem 0xffffc000-0xffffffff][ 0.532178] pci 0002:01:00.0: BAR 1 [mem 0xffc00000-0xffffffff][ 0.532183] pci 0002:01:00.0: BAR 2 [mem 0xffff0000-0xffffffff][ 0.532244] pci 0002:01:00.0: supports D1[ 0.532245] pci 0002:01:00.0: PME# supported from D0 D1 D3hot D3cold[ 0.540147] pci_bus 0002:01: busn_res: [bus 01-ff] end is updated to 01[ 0.540150] pci_bus 0002:00: max bus depth: 1 pci_try_num: 2[ 0.540155] pci 0002:00:00.0: bridge window [mem 0x1f00000000-0x1f005fffff]: assigned[ 0.540157] pci 0002:01:00.0: BAR 1 [mem 0x1f00000000-0x1f003fffff]: assigned[ 0.540160] pci 0002:01:00.0: BAR 2 [mem 0x1f00400000-0x1f0040ffff]: assigned[ 0.540164] pci 0002:01:00.0: BAR 0 [mem 0x1f00410000-0x1f00413fff]: assigned[ 0.540168] pci 0002:00:00.0: PCI bridge to [bus 01][ 0.540169] pci 0002:00:00.0: bridge window [mem 0x1f00000000-0x1f005fffff][ 0.540171] pci_bus 0002:00: resource 4 [mem 0x1f00000000-0x1ffffffffb][ 0.540173] pci_bus 0002:00: resource 5 [mem 0x1c00000000-0x1effffffff pref][ 0.540174] pci_bus 0002:01: resource 1 [mem 0x1f00000000-0x1f005fffff][ 0.540177] pci 0002:00:00.0: Max Payload Size set to 256/ 512 (was 128), Max Read Rq 512[ 0.540183] pci 0002:01:00.0: Max Payload Size set to 256/ 256 (was 128), Max Read Rq 512[ 0.540236] pcieport 0002:00:00.0: enabling device (0000 -> 0002)[ 0.540254] pcieport 0002:00:00.0: PME: Signaling with IRQ 38[ 0.540287] pcieport 0002:00:00.0: AER: enabled with IRQ 38[ 1.617303] input: RPI Wired Keyboard 1 as /devices/platform/axi/1000120000.pcie/1f00200000.usb/xhci-hcd.0/usb1/1-2/1-2.1/1-2.1:1.0/0003:04D9:0006.0001/input/input0[ 1.777278] input: RPI Wired Keyboard 1 as /devices/platform/axi/1000120000.pcie/1f00200000.usb/xhci-hcd.0/usb1/1-2/1-2.1/1-2.1:1.1/0003:04D9:0006.0002/input/input1[ 4.919035] amdgpu 0001:03:00.0: amdgpu: PCIE atomic ops is not supported[ 4.919129] pcieport 0001:02:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref]: releasing[ 4.919131] pcieport 0001:01:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref]: releasing[ 4.919134] pcieport 0001:00:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref]: releasing[ 4.919142] pcieport 0001:00:00.0: bridge window [mem size 0xc00000000 64bit pref]: can't assign; no space[ 4.919144] pcieport 0001:00:00.0: bridge window [mem size 0xc00000000 64bit pref]: failed to assign[ 4.919146] pcieport 0001:01:00.0: bridge window [mem size 0xc00000000 64bit pref]: can't assign; no space[ 4.919147] pcieport 0001:01:00.0: bridge window [mem size 0xc00000000 64bit pref]: failed to assign[ 4.919149] pcieport 0001:02:00.0: bridge window [mem size 0xc00000000 64bit pref]: can't assign; no space[ 4.919151] pcieport 0001:02:00.0: bridge window [mem size 0xc00000000 64bit pref]: failed to assign[ 4.919161] pcieport 0001:00:00.0: PCI bridge to [bus 01-03][ 4.919163] pcieport 0001:00:00.0: bridge window [mem 0x1b80000000-0x1b802fffff][ 4.919166] pcieport 0001:00:00.0: PCI bridge to [bus 01-03][ 4.919167] pcieport 0001:00:00.0: bridge window [mem 0x1b80000000-0x1b802fffff][ 4.919169] pcieport 0001:00:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 4.919171] pcieport 0001:01:00.0: PCI bridge to [bus 02-03][ 4.919174] pcieport 0001:01:00.0: bridge window [mem 0x1b80000000-0x1b801fffff][ 4.919177] pcieport 0001:01:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 4.919182] pcieport 0001:02:00.0: PCI bridge to [bus 03][ 4.919186] pcieport 0001:02:00.0: bridge window [mem 0x1b80000000-0x1b801fffff][ 4.919189] pcieport 0001:02:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 4.919200] [drm] Not enough PCI address space for a large BAR.[ 4.919416] [drm] PCIE GART of 512M enabled (table at 0x0000008000000000).Code:
$ dmesg | grep -i pci[ 0.000000] Kernel command line: reboot=w coherent_pool=1M 8250.nr_uarts=1 pci=pcie_bus_safe cgroup_disable=memory numa_policy=interleave nvme.max_host_mem_size_mb=0 clk_ignore_unused numa=fake=4 system_heap.max_order=0 smsc95xx.macaddr=2C:CF:67:E3:D3:C5 vc_mem.mem_base=0x3fc00000 vc_mem.mem_size=0x40000000 console=ttyAMA10,115200 console=tty1 root=PARTUUID=2e387cb1-02 rootfstype=ext4 fsck.repair=yes pci=pcie_bus_safe,realloc iommu.strict=no rootwait quiet splash plymouth.ignore-serial-consoles cfg80211.ieee80211_regdom=US[ 0.062771] PCI: CLS 0 bytes, default 64[ 0.282821] brcm-pcie 1000110000.pcie: host bridge /axi/pcie@1000110000 ranges:[ 0.282829] brcm-pcie 1000110000.pcie: MEM 0x1b80000000..0x1bfffffffb -> 0x0080000000[ 0.282832] brcm-pcie 1000110000.pcie: MEM 0x1800000000..0x1b7fffffff -> 0x0400000000[ 0.282837] brcm-pcie 1000110000.pcie: IB MEM 0x0000000000..0x0fffffffff -> 0x1000000000[ 0.282840] brcm-pcie 1000110000.pcie: IB MEM 0x1000131000..0x1000131fff -> 0xfffffff000[ 0.284181] brcm-pcie 1000110000.pcie: PCI host bridge to bus 0001:00[ 0.284184] pci_bus 0001:00: root bus resource [bus 00-ff][ 0.284187] pci_bus 0001:00: root bus resource [mem 0x1b80000000-0x1bfffffffb] (bus address [0x80000000-0xfffffffb])[ 0.284189] pci_bus 0001:00: root bus resource [mem 0x1800000000-0x1b7fffffff pref] (bus address [0x400000000-0x77fffffff])[ 0.284199] pci 0001:00:00.0: [14e4:2712] type 01 class 0x060400 PCIe Root Port[ 0.284205] pci 0001:00:00.0: PCI bridge to [bus 01-03][ 0.284207] pci 0001:00:00.0: bridge window [mem 0x1b80000000-0x1bbfffffff][ 0.284224] pci 0001:00:00.0: PME# supported from D0 D3hot[ 0.388530] brcm-pcie 1000110000.pcie: clkreq-mode set to safe[ 0.388533] brcm-pcie 1000110000.pcie: link up, 8.0 GT/s PCIe x1 (!SSC)[ 0.388560] pci 0001:01:00.0: [1002:1478] type 01 class 0x060400 PCIe Switch Upstream Port[ 0.388581] pci 0001:01:00.0: BAR 0 [mem 0x00000000-0x00003fff][ 0.388585] pci 0001:01:00.0: PCI bridge to [bus 00][ 0.388592] pci 0001:01:00.0: bridge window [io 0x0000-0x0fff][ 0.388595] pci 0001:01:00.0: bridge window [mem 0x00000000-0x000fffff][ 0.388605] pci 0001:01:00.0: bridge window [mem 0x00000000-0x000fffff 64bit pref][ 0.388697] pci 0001:01:00.0: PME# supported from D0 D3hot D3cold[ 0.388789] pci 0001:01:00.0: 7.876 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x1 link at 0001:00:00.0 (capable of 252.048 Gb/s with 16.0 GT/s PCIe x16 link)[ 0.396540] pci 0001:01:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring[ 0.396598] pci 0001:02:00.0: [1002:1479] type 01 class 0x060400 PCIe Switch Downstream Port[ 0.396621] pci 0001:02:00.0: PCI bridge to [bus 00][ 0.396627] pci 0001:02:00.0: bridge window [io 0x0000-0x0fff][ 0.396630] pci 0001:02:00.0: bridge window [mem 0x00000000-0x000fffff][ 0.396640] pci 0001:02:00.0: bridge window [mem 0x00000000-0x000fffff 64bit pref][ 0.396731] pci 0001:02:00.0: PME# supported from D0 D3hot D3cold[ 0.397341] pci 0001:02:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring[ 0.397399] pci 0001:03:00.0: [1002:744c] type 00 class 0x030000 PCIe Legacy Endpoint[ 0.397435] pci 0001:03:00.0: BAR 0 [mem 0x00000000-0x0fffffff 64bit pref][ 0.397439] pci 0001:03:00.0: BAR 2 [mem 0x00000000-0x001fffff 64bit pref][ 0.397442] pci 0001:03:00.0: BAR 4 [io 0x0000-0x00ff][ 0.397444] pci 0001:03:00.0: BAR 5 [mem 0x00000000-0x000fffff][ 0.397446] pci 0001:03:00.0: ROM [mem 0x00000000-0x0001ffff pref][ 0.397545] pci 0001:03:00.0: PME# supported from D1 D2 D3hot D3cold[ 0.397647] pci 0001:03:00.0: 7.876 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x1 link at 0001:00:00.0 (capable of 252.048 Gb/s with 16.0 GT/s PCIe x16 link)[ 0.397722] pci 0001:03:00.0: vgaarb: setting as boot VGA device[ 0.397723] pci 0001:03:00.0: vgaarb: bridge control possible[ 0.397724] pci 0001:03:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none[ 0.397744] pci 0001:03:00.1: [1002:ab30] type 00 class 0x040300 PCIe Legacy Endpoint[ 0.397779] pci 0001:03:00.1: BAR 0 [mem 0x00000000-0x00003fff][ 0.397847] pci 0001:03:00.1: PME# supported from D1 D2 D3hot D3cold[ 0.397983] pci_bus 0001:03: busn_res: [bus 03] end is updated to 03[ 0.397988] pci_bus 0001:02: busn_res: [bus 02-03] end is updated to 03[ 0.397994] pci_bus 0001:00: max bus depth: 3 pci_try_num: 4[ 0.398002] pci 0001:00:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref]: assigned[ 0.398004] pci 0001:00:00.0: bridge window [mem 0x1b80000000-0x1b802fffff]: assigned[ 0.398006] pci 0001:01:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref]: assigned[ 0.398008] pci 0001:01:00.0: bridge window [mem 0x1b80000000-0x1b801fffff]: assigned[ 0.398010] pci 0001:01:00.0: BAR 0 [mem 0x1b80200000-0x1b80203fff]: assigned[ 0.398013] pci 0001:01:00.0: bridge window [io size 0x1000]: can't assign; no space[ 0.398015] pci 0001:01:00.0: bridge window [io size 0x1000]: failed to assign[ 0.398017] pci 0001:02:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref]: assigned[ 0.398019] pci 0001:02:00.0: bridge window [mem 0x1b80000000-0x1b801fffff]: assigned[ 0.398020] pci 0001:02:00.0: bridge window [io size 0x1000]: can't assign; no space[ 0.398022] pci 0001:02:00.0: bridge window [io size 0x1000]: failed to assign[ 0.398024] pci 0001:03:00.0: BAR 0 [mem 0x1800000000-0x180fffffff 64bit pref]: assigned[ 0.398032] pci 0001:03:00.0: BAR 2 [mem 0x1810000000-0x18101fffff 64bit pref]: assigned[ 0.398040] pci 0001:03:00.0: BAR 5 [mem 0x1b80000000-0x1b800fffff]: assigned[ 0.398043] pci 0001:03:00.0: ROM [mem 0x1b80100000-0x1b8011ffff pref]: assigned[ 0.398045] pci 0001:03:00.1: BAR 0 [mem 0x1b80120000-0x1b80123fff]: assigned[ 0.398048] pci 0001:03:00.0: BAR 4 [io size 0x0100]: can't assign; no space[ 0.398050] pci 0001:03:00.0: BAR 4 [io size 0x0100]: failed to assign[ 0.398051] pci 0001:02:00.0: PCI bridge to [bus 03][ 0.398055] pci 0001:02:00.0: bridge window [mem 0x1b80000000-0x1b801fffff][ 0.398058] pci 0001:02:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.398062] pci 0001:01:00.0: PCI bridge to [bus 02-03][ 0.398066] pci 0001:01:00.0: bridge window [mem 0x1b80000000-0x1b801fffff][ 0.398069] pci 0001:01:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.398073] pci 0001:00:00.0: PCI bridge to [bus 01-03][ 0.398075] pci 0001:00:00.0: bridge window [mem 0x1b80000000-0x1b802fffff][ 0.398076] pci 0001:00:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.398078] pci_bus 0001:00: No. 2 try to assign unassigned res[ 0.398081] pci 0001:01:00.0: bridge window [io size 0x1000]: can't assign; no space[ 0.398083] pci 0001:01:00.0: bridge window [io size 0x1000]: failed to assign[ 0.398084] pci 0001:02:00.0: bridge window [io size 0x1000]: can't assign; no space[ 0.398086] pci 0001:02:00.0: bridge window [io size 0x1000]: failed to assign[ 0.398087] pci 0001:03:00.0: BAR 4 [io size 0x0100]: can't assign; no space[ 0.398089] pci 0001:03:00.0: BAR 4 [io size 0x0100]: failed to assign[ 0.398090] pci 0001:02:00.0: PCI bridge to [bus 03][ 0.398093] pci 0001:02:00.0: bridge window [mem 0x1b80000000-0x1b801fffff][ 0.398096] pci 0001:02:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.398101] pci 0001:01:00.0: PCI bridge to [bus 02-03][ 0.398104] pci 0001:01:00.0: bridge window [mem 0x1b80000000-0x1b801fffff][ 0.398107] pci 0001:01:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.398112] pci 0001:00:00.0: PCI bridge to [bus 01-03][ 0.398113] pci 0001:00:00.0: bridge window [mem 0x1b80000000-0x1b802fffff][ 0.398115] pci 0001:00:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.398117] pci_bus 0001:00: No. 3 try to assign unassigned res[ 0.398119] pci 0001:01:00.0: bridge window [io size 0x1000]: can't assign; no space[ 0.398120] pci 0001:01:00.0: bridge window [io size 0x1000]: failed to assign[ 0.398122] pci 0001:02:00.0: bridge window [io size 0x1000]: can't assign; no space[ 0.398123] pci 0001:02:00.0: bridge window [io size 0x1000]: failed to assign[ 0.398125] pci 0001:03:00.0: BAR 4 [io size 0x0100]: can't assign; no space[ 0.398126] pci 0001:03:00.0: BAR 4 [io size 0x0100]: failed to assign[ 0.398127] pci 0001:02:00.0: PCI bridge to [bus 03][ 0.398130] pci 0001:02:00.0: bridge window [mem 0x1b80000000-0x1b801fffff][ 0.398133] pci 0001:02:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.398138] pci 0001:01:00.0: PCI bridge to [bus 02-03][ 0.398141] pci 0001:01:00.0: bridge window [mem 0x1b80000000-0x1b801fffff][ 0.398144] pci 0001:01:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.398149] pci 0001:00:00.0: PCI bridge to [bus 01-03][ 0.398150] pci 0001:00:00.0: bridge window [mem 0x1b80000000-0x1b802fffff][ 0.398152] pci 0001:00:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.398154] pci_bus 0001:00: No. 4 try to assign unassigned res[ 0.398156] pci 0001:01:00.0: bridge window [io size 0x1000]: can't assign; no space[ 0.398157] pci 0001:01:00.0: bridge window [io size 0x1000]: failed to assign[ 0.398159] pci 0001:02:00.0: bridge window [io size 0x1000]: can't assign; no space[ 0.398160] pci 0001:02:00.0: bridge window [io size 0x1000]: failed to assign[ 0.398162] pci 0001:03:00.0: BAR 4 [io size 0x0100]: can't assign; no space[ 0.398163] pci 0001:03:00.0: BAR 4 [io size 0x0100]: failed to assign[ 0.398165] pci 0001:02:00.0: PCI bridge to [bus 03][ 0.398168] pci 0001:02:00.0: bridge window [mem 0x1b80000000-0x1b801fffff][ 0.398171] pci 0001:02:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.398175] pci 0001:01:00.0: PCI bridge to [bus 02-03][ 0.398179] pci 0001:01:00.0: bridge window [mem 0x1b80000000-0x1b801fffff][ 0.398181] pci 0001:01:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.398186] pci 0001:00:00.0: PCI bridge to [bus 01-03][ 0.398188] pci 0001:00:00.0: bridge window [mem 0x1b80000000-0x1b802fffff][ 0.398189] pci 0001:00:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.398191] pci_bus 0001:00: resource 4 [mem 0x1b80000000-0x1bfffffffb][ 0.398193] pci_bus 0001:00: resource 5 [mem 0x1800000000-0x1b7fffffff pref][ 0.398195] pci_bus 0001:01: resource 1 [mem 0x1b80000000-0x1b802fffff][ 0.398196] pci_bus 0001:01: resource 2 [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.398198] pci_bus 0001:02: resource 1 [mem 0x1b80000000-0x1b801fffff][ 0.398199] pci_bus 0001:02: resource 2 [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.398201] pci_bus 0001:03: resource 1 [mem 0x1b80000000-0x1b801fffff][ 0.398202] pci_bus 0001:03: resource 2 [mem 0x1800000000-0x1817ffffff 64bit pref][ 0.398205] pci 0001:00:00.0: Max Payload Size set to 256/ 512 (was 128), Max Read Rq 512[ 0.398211] pci 0001:01:00.0: Max Payload Size set to 256/ 512 (was 128), Max Read Rq 512[ 0.398218] pci 0001:02:00.0: Max Payload Size set to 256/ 512 (was 128), Max Read Rq 512[ 0.398224] pci 0001:03:00.0: Max Payload Size set to 256/ 256 (was 128), Max Read Rq 512[ 0.398230] pci 0001:03:00.1: Max Payload Size set to 256/ 256 (was 128), Max Read Rq 512[ 0.398311] pcieport 0001:00:00.0: enabling device (0000 -> 0002)[ 0.398338] pcieport 0001:00:00.0: PME: Signaling with IRQ 36[ 0.398380] pcieport 0001:00:00.0: AER: enabled with IRQ 36[ 0.398461] pcieport 0001:01:00.0: enabling device (0000 -> 0002)[ 0.398569] pcieport 0001:02:00.0: enabling device (0000 -> 0002)[ 0.398732] pci 0001:03:00.1: D0 power state depends on 0001:03:00.0[ 0.398781] brcm-pcie 1000120000.pcie: host bridge /axi/pcie@1000120000 ranges:[ 0.398786] brcm-pcie 1000120000.pcie: MEM 0x1f00000000..0x1ffffffffb -> 0x0000000000[ 0.398789] brcm-pcie 1000120000.pcie: MEM 0x1c00000000..0x1effffffff -> 0x0400000000[ 0.398794] brcm-pcie 1000120000.pcie: IB MEM 0x1f00000000..0x1f003fffff -> 0x0000000000[ 0.398798] brcm-pcie 1000120000.pcie: IB MEM 0x0000000000..0x0fffffffff -> 0x1000000000[ 0.398800] brcm-pcie 1000120000.pcie: IB MEM 0x1000130000..0x1000130fff -> 0xfffffff000[ 0.399935] brcm-pcie 1000120000.pcie: PCI host bridge to bus 0002:00[ 0.399938] pci_bus 0002:00: root bus resource [bus 00-ff][ 0.399940] pci_bus 0002:00: root bus resource [mem 0x1f00000000-0x1ffffffffb] (bus address [0x00000000-0xfffffffb])[ 0.399942] pci_bus 0002:00: root bus resource [mem 0x1c00000000-0x1effffffff pref] (bus address [0x400000000-0x6ffffffff])[ 0.399947] pci 0002:00:00.0: [14e4:2712] type 01 class 0x060400 PCIe Root Port[ 0.399952] pci 0002:00:00.0: PCI bridge to [bus 00][ 0.399954] pci 0002:00:00.0: bridge window [mem 0x1f80000000-0x1fbfffffff][ 0.399966] pci 0002:00:00.0: PME# supported from D0 D3hot[ 0.400443] pci 0002:00:00.0: bridge configuration invalid ([bus 00-00]), reconfiguring[ 0.500528] brcm-pcie 1000120000.pcie: clkreq-mode set to default[ 0.500530] brcm-pcie 1000120000.pcie: link up, 5.0 GT/s PCIe x4 (!SSC)[ 0.500549] pci 0002:01:00.0: [1de4:0001] type 00 class 0x020000 PCIe Endpoint[ 0.500585] pci 0002:01:00.0: BAR 0 [mem 0xffffc000-0xffffffff][ 0.500587] pci 0002:01:00.0: BAR 1 [mem 0xffc00000-0xffffffff][ 0.500590] pci 0002:01:00.0: BAR 2 [mem 0xffff0000-0xffffffff][ 0.500635] pci 0002:01:00.0: supports D1[ 0.500637] pci 0002:01:00.0: PME# supported from D0 D1 D3hot D3cold[ 0.500703] pci_bus 0002:01: busn_res: [bus 01-ff] end is updated to 01[ 0.500706] pci_bus 0002:00: max bus depth: 1 pci_try_num: 2[ 0.500710] pci 0002:00:00.0: bridge window [mem 0x1f00000000-0x1f005fffff]: assigned[ 0.500713] pci 0002:01:00.0: BAR 1 [mem 0x1f00000000-0x1f003fffff]: assigned[ 0.500717] pci 0002:01:00.0: BAR 2 [mem 0x1f00400000-0x1f0040ffff]: assigned[ 0.500720] pci 0002:01:00.0: BAR 0 [mem 0x1f00410000-0x1f00413fff]: assigned[ 0.500724] pci 0002:00:00.0: PCI bridge to [bus 01][ 0.500726] pci 0002:00:00.0: bridge window [mem 0x1f00000000-0x1f005fffff][ 0.500728] pci_bus 0002:00: resource 4 [mem 0x1f00000000-0x1ffffffffb][ 0.500729] pci_bus 0002:00: resource 5 [mem 0x1c00000000-0x1effffffff pref][ 0.500731] pci_bus 0002:01: resource 1 [mem 0x1f00000000-0x1f005fffff][ 0.500733] pci 0002:00:00.0: Max Payload Size set to 256/ 512 (was 128), Max Read Rq 512[ 0.500740] pci 0002:01:00.0: Max Payload Size set to 256/ 256 (was 128), Max Read Rq 512[ 0.500803] pcieport 0002:00:00.0: enabling device (0000 -> 0002)[ 0.500823] pcieport 0002:00:00.0: PME: Signaling with IRQ 38[ 0.500860] pcieport 0002:00:00.0: AER: enabled with IRQ 38[ 1.577768] input: RPI Wired Keyboard 1 as /devices/platform/axi/1000120000.pcie/1f00200000.usb/xhci-hcd.0/usb1/1-2/1-2.1/1-2.1:1.0/0003:04D9:0006.0001/input/input0[ 1.705744] input: RPI Wired Keyboard 1 as /devices/platform/axi/1000120000.pcie/1f00200000.usb/xhci-hcd.0/usb1/1-2/1-2.1/1-2.1:1.1/0003:04D9:0006.0002/input/input1[ 5.192310] amdgpu 0001:03:00.0: amdgpu: PCIE atomic ops is not supported[ 5.192408] pcieport 0001:02:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref]: releasing[ 5.192411] pcieport 0001:01:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref]: releasing[ 5.192413] pcieport 0001:00:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref]: releasing[ 5.192422] pcieport 0001:00:00.0: bridge window [mem size 0xc00000000 64bit pref]: can't assign; no space[ 5.192423] pcieport 0001:00:00.0: bridge window [mem size 0xc00000000 64bit pref]: failed to assign[ 5.192426] pcieport 0001:01:00.0: bridge window [mem size 0xc00000000 64bit pref]: can't assign; no space[ 5.192427] pcieport 0001:01:00.0: bridge window [mem size 0xc00000000 64bit pref]: failed to assign[ 5.192429] pcieport 0001:02:00.0: bridge window [mem size 0xc00000000 64bit pref]: can't assign; no space[ 5.192431] pcieport 0001:02:00.0: bridge window [mem size 0xc00000000 64bit pref]: failed to assign[ 5.192440] pcieport 0001:00:00.0: PCI bridge to [bus 01-03][ 5.192443] pcieport 0001:00:00.0: bridge window [mem 0x1b80000000-0x1b802fffff][ 5.192445] pcieport 0001:00:00.0: PCI bridge to [bus 01-03][ 5.192447] pcieport 0001:00:00.0: bridge window [mem 0x1b80000000-0x1b802fffff][ 5.192448] pcieport 0001:00:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 5.192450] pcieport 0001:01:00.0: PCI bridge to [bus 02-03][ 5.192454] pcieport 0001:01:00.0: bridge window [mem 0x1b80000000-0x1b801fffff][ 5.192457] pcieport 0001:01:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 5.192462] pcieport 0001:02:00.0: PCI bridge to [bus 03][ 5.192466] pcieport 0001:02:00.0: bridge window [mem 0x1b80000000-0x1b801fffff][ 5.192468] pcieport 0001:02:00.0: bridge window [mem 0x1800000000-0x1817ffffff 64bit pref][ 5.192479] [drm] Not enough PCI address space for a large BAR.[ 5.192738] [drm] PCIE GART of 512M enabled (table at 0x0000008000000000).-nick-
Statistics: Posted by changeforabutton — Mon May 12, 2025 1:14 pm — Replies 2 — Views 102