CM4 PCIe issues

I tried installing Raspberry Pi OS (Linux raspberrypi 5.10.17-v8+ #1403 SMP PREEMPT Mon Feb 22 11:37:54 GMT 2021 aarch64 GNU/Linux) and it boots successfully, and finds the card (though drivers don’t load)

lshw output:

*-pci
          description: PCI bridge
          product: Broadcom Limited
          vendor: Broadcom Limited
          physical id: 0
          bus info: pci@0000:00:00.0
          version: 20
          width: 32 bits
          clock: 33MHz
          capabilities: pci normal_decode bus_master cap_list
          resources: memory:600000000-6000fffff
        *-network UNCLAIMED
             description: Network controller
             product: AR93xx Wireless Network Adapter
             vendor: Qualcomm Atheros
             physical id: 0
             bus info: pci@0000:01:00.0
             version: 01
             width: 64 bits
             clock: 33MHz
             capabilities: cap_list
             configuration: latency=0
             resources: memory:600000000-60001ffff memory:600020000-60002ffff

Update:
I tried installing the Arm64 RaspiOS buster build from 2020-05-27 and it works great. Still no luck with any Balena images, though. Installed 2.75.0+rev1 this morning and it still hangs on boot.

Hi, you get the problem with just this adapter card plugged in? https://www.amazon.com/gp/product/B07JBCL1CJ/ref=ppx_yo_dt_b_asin_title_o00_s00?ie=UTF8&psc=1
Or does it need to have the Atheros WPEA-121N/W card plugged in to?

I was mistaken about the image version in my last message on this thread. I accidentally pulled down the Pi4, not CM4. The CM4 only has one release, and it’s not 2.75.0 :slight_smile:

I tested again just now using the CM4 image. The board boots up fine with only the adapter in place, and hangs when the adapter has the WiFi card installed.

Ok, we’ll order the adapter and see if we can reproduce it with any wifi card first.

Just a heads-up up, we ordered the adapter but they have pretty long shipping times to our location: 20May-15June. So keep you in the loop once we have it

Thanks a bunch @floion! I really appreciate you chasing this problem down.

Hey @floion I’m chasing down an issue with Ubuntu which might provide some context for your efforts:

Hi, can you also try and do CM4 PCIe issues - #48 by floion again but also copy over bcm2711-rpi-cm4.dtb ?
I believe this should allow you to boot now. There still might be the issue with the driver loading but we can check that later if the above works.

Hi @floion sorry to keep you waiting on a response. Installing the CM4 dtb as described above seems to disable the ethernet NIC, because now I get the 4x flash on the board’s LED. I’ll do more troubleshooting later today and try to get some logs for you.

Hi, did you get a chance to try the instructions Florin provided? Let us know if that helped in the meantime.

Hi @pipex @floion
I’m sorry to keep you waiting. I’ve done some more troubleshooting. When I follow the instructions above, the device boots. However, it no longer sees the ethernet NIC. It tries and fails to load the ath9k driver, but doesn’t freeze like it did before.

The ath9k driver fails to load at 7.246876. This may be related to a bug in the kernel, mentioned above (Launchpad link from May 11, in this thread, and here’s the specific comment in that thread: Comment #9 : Bug #1927037 : Bugs : linux-raspi package : Ubuntu)

Screen output:

U-Boo 2021.04-rc3 (Mar 03 2021 - 15:10:34 +0000)

DRAM:  2 GiB
RPI Compute Module 4 (0xb03140)
MMC:   mmcnr@7e300000: 1, emmc2@7e340000: 0
Loading Environment from FAT... *** Warning - bad CRC, using default environment

In:    serial
Out:   serial
rr:   serial
Net:   eth0: ethernet@7d580000
PCIe BRCM: link up, 2.5 Gbps x1 (SSC)
starting USB...
No working controllers found
switch to partitions #0, OK
mm0(part 0) is current device
Scanning mmc 0:1...
Found U-Boot script /boot.scr
516 bytes read in 10 ms (49.8 KiB/s)
## Executing script at 0240000
Scanning mmc usb devices 0 1 2
24 bytes read in 14 ms (1000 Bytes/s)
Found resin image on mmc 0
Loading resinOS_uEnv.txt from mmc device0 partition 1
Failed to load 'resinOS_uEnv.txt'
Loading extra_uEnv.txt from mmc device 0 partition 1
0 bytes read in 11 ms (0 Bytes/s)
mport extra_uEnv.txt in environment
Loading bootcount.env from mmc device 0 partition 1
Failed to load 'bootcount.env'
No bootcunt.env file. Setting bootcount=0 in environment
12469316 bytes read in 558 ms (21.3 MiB/s)
Uncompressed size: 28365312 = 0x1B0D200
## Fattened Device Tree blob at 2eff3800
   Booting using the fdt blob at 0x2eff3800
   Using Device Tree in place at 00000002eff3800, end 000000002f002f5d

Starting kernel ...

[    0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd083]
[    0.000000] Linux version 5.4.83-v8 (oe-user@oe-host) (gcc version 9.3.0 (GCC)) #1 SMP PREEMPT Mon Dec 14 12:43:54 UTC 2020
[    0.000000] Machine model: Raspberry Pi Compute Module 4 Rev 1.0
[    0.000000] efi: Getting EFI parameters from FDT:
[    0.000000] efi: UEFI not found.
[    0.000000] Reserved memory: created CMA memory pool at 0x000000001ec00000, size 256 MiB
[    0.000000] OF: reserved mem: initialized node linux,cma, compatible id shared-dma-pool
[    0.000000] percpu: Embedded 32 pages/cpu s90392 r8192 d32488 u131072
[    0.000000] Detected PIPT I-cache on CPU0
[    0.000000] CPU features: detected: EL2 vector hardening
[    0.000000] ARM_SMCCC_ARCH_WORKAROUND_1 missing from firmware
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 509440
[    0.000000] Kernel command line: coherent_pool=1M 8250.nr_uarts=1 snd_bcm2835.enable_compat_alsa=0 snd_bcm2835.enable_hdmi=1  smsc95xx.macaddr=DC:A6:32:F4:5C:0C vc_mem.mem_base=0x3f000000 vc_mem.mem_size=0x3f600000  dwc_otg.lpm_enable=0 console=tty1 console=ttyS0,115200 rootwait     cgroup_enable=memory root=UUID=ba1eadef-b3cb-47a8-b362-9c2ea8673d25 rootwait
[    0.000000] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    0.000000] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] software IO TLB: mapped [mem 0x3a600000-0x3e600000] (64MB)
[    0.000000] Memory: 1672796K/2070528K available (11068K kernel code, 1204K rwdata, 3908K rodata, 11456K init, 1246K bss, 135588K reserved, 262144K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.000000] ftrace: allocating 37237 entries in 146 pages
[    0.000000] rcu: Preemptible hierarchical RCU implementation.
[    0.000000] rcu: 	RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=4.
[    0.000000] 	Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
[    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] GIC: Using split EOI/Deactivate mode
[    0.000000] random: get_random_bytes called from start_kernel+0x320/0x4b0 with crng_init=0
[    0.000000] arch_timer: cp15 timer(s) running at 54.00MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0xc743ce346, max_idle_ns: 440795203123 ns
[    0.000005] sched_clock: 56 bits at 54MHz, resolution 18ns, wraps every 4398046511102ns
[    0.000227] Console: colour dummy device 80x25
[    0.000632] printk: console [tty1] enabled
[    0.000692] Calibrating delay loop (skipped), value calculated using timer frequency.. 108.00 BogoMIPS (lpj=216000)
[    0.000725] pid_max: default: 32768 minimum: 301
[    0.000880] LSM: Security Framework initializing
[    0.001084] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)
[    0.001134] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)
[    0.003449] ASID allocator initialised with 32768 entries
[    0.003666] rcu: Hierarchical SRCU implementation.
[    0.004385] EFI services will not be available.
[    0.004830] smp: Bringing up secondary CPUs ...
[    0.005753] Detected PIPT I-cache on CPU1
[    0.005810] CPU1: Booted secondary processor 0x0000000001 [0x410fd083]
[    0.006848] Detected PIPT I-cache on CPU2
[    0.006887] CPU2: Booted secondary processor 0x0000000002 [0x410fd083]
[    0.007845] Detected PIPT I-cache on CPU3
[    0.007884] CPU3: Booted secondary processor 0x0000000003 [0x410fd083]
[    0.008102] smp: Brought up 1 node, 4 CPUs
[    0.008189] SMP: Total of 4 processors activated.
[    0.008211] CPU features: detected: 32-bit EL0 Support
[    0.008232] CPU features: detected: CRC32 instructions
[    0.034215] CPU: All CPU(s) started at EL2
[    0.034284] alternatives: patching kernel code
[    0.035684] devtmpfs: initialized
[    0.045752] Enabled cp15_barrier support
[    0.045804] Enabled setend support
[    0.046368] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.046418] futex hash table entries: 1024 (order: 4, 65536 bytes, linear)
[    0.053340] pinctrl core: initialized pinctrl subsystem
[    0.054038] DMI not present or invalid.
[    0.054409] NET: Registered protocol family 16
[    0.057093] DMA: preallocated 1024 KiB pool for atomic allocations
[    0.057151] audit: initializing netlink subsys (disabled)
[    0.057457] audit: type=2000 audit(0.056:1): state=initialized audit_enabled=0 res=1
[    0.058216] cpuidle: using governor menu
[    0.058576] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
[    0.058816] Serial: AMBA PL011 UART driver
[    0.061517] bcm2835-mbox fe00b880.mailbox: mailbox enabled
[    0.076219] raspberrypi-firmware soc:firmware: Attached to firmware from 2021-04-30 15:54, variant start_cd
[    0.080230] raspberrypi-firmware soc:firmware: Firmware hash is 3e104c5ed69dc796755b7195973a8d00482d76dd
[    0.122318] bcm2835-dma fe007000.dma: DMA legacy API manager, dmachans=0x1
[    0.125730] vgaarb: loaded
[    0.126162] SCSI subsystem initialized
[    0.126398] usbcore: registered new interface driver usbfs
[    0.126464] usbcore: registered new interface driver hub
[    0.126584] usbcore: registered new device driver usb
[    0.126878] usb_phy_generic phy: phy supply vcc not found, using dummy regulator
[    0.128599] clocksource: Switched to clocksource arch_sys_counter
[    0.875553] VFS: Disk quotas dquot_6.6.0
[    0.875683] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.875888] FS-Cache: Loaded
[    0.876117] CacheFiles: Loaded
[    0.886448] thermal_sys: Registered thermal governor 'step_wise'
[    0.886820] NET: Registered protocol family 2
[    0.887590] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)
[    0.887644] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)
[    0.887765] TCP bind hash table entries: 16384 (order: 6, 262144 bytes, linear)
[    0.888008] TCP: Hash tables configured (established 16384 bind 16384)
[    0.888212] UDP hash table entries: 1024 (order: 3, 32768 bytes, linear)
[    0.888269] UDP-Lite hash table entries: 1024 (order: 3, 32768 bytes, linear)
[    0.888529] NET: Registered protocol family 1
[    0.889414] RPC: Registered named UNIX socket transport module.
[    0.889440] RPC: Registered udp transport module.
[    0.889459] RPC: Registered tcp transport module.
[    0.889478] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    0.889509] PCI: CLS 0 bytes, default 64
[    0.967949] hw perfevents: enabled with armv8_cortex_a72 PMU driver, 7 counters available
[    0.968196] kvm: Limiting the IPA size due to kernel Virtual Address limit
[    0.968220] kvm [1]: IPA Size Limit: 43bits
[    0.969348] kvm [1]: vgic interrupt IRQ1
[    0.969598] kvm [1]: Hyp mode initialized successfully
[    0.971922] Initialise system trusted keyrings
[    0.972214] workingset: timestamp_bits=46 max_order=19 bucket_order=0
[    0.981180] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.981465] FS-Cache: Netfs 'nfs' registered for caching
[    0.982133] NFS: Registering the id_resolver key type
[    0.982187] Key type id_resolver registered
[    0.982206] Key type id_legacy registered
[    0.982235] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[    0.983567] Key type asymmetric registered
[    0.983591] Asymmetric key parser 'x509' registered
[    0.983645] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 249)
[    0.983885] io scheduler mq-deadline registered
[    0.983908] io scheduler kyber registered
[    0.987767] GPIO line 507 (ant1) hogged as output/high
[    0.989139] GPIO line 511 (ant2) hogged as output/low
[    0.990174] brcm-pcie fd500000.pcie: host bridge /scb/pcie@7d500000 ranges:
[    0.990210] brcm-pcie fd500000.pcie:   No bus range found for /scb/pcie@7d500000, using [bus 00-ff]
[    0.990285] brcm-pcie fd500000.pcie:      MEM 0x0600000000..0x063fffffff -> 0x00c0000000
[    0.990357] brcm-pcie fd500000.pcie:   IB MEM 0x0000000000..0x007fffffff -> 0x0400000000
[    1.006711] brcm-pcie fd500000.pcie: link up, 2.5 GT/s x1 (SSC)
[    1.007036] brcm-pcie fd500000.pcie: PCI host bridge to bus 0000:00
[    1.007066] pci_bus 0000:00: root bus resource [bus 00-ff]
[    1.007093] pci_bus 0000:00: root bus resource [mem 0x600000000-0x63fffffff] (bus address [0xc0000000-0xffffffff])
[    1.007164] pci 0000:00:00.0: [14e4:2711] type 01 class 0x060400
[    1.007399] pci 0000:00:00.0: PME# supported from D0 D3hot
[    1.011147] pci 0000:01:00.0: [168c:0030] type 00 class 0x028000
[    1.011243] pci 0000:01:00.0: reg 0x10: [mem 0x00000000-0x0001ffff 64bit]
[    1.011343] pci 0000:01:00.0: reg 0x30: [mem 0x00000000-0x0000ffff pref]
[    1.011542] pci 0000:01:00.0: supports D1
[    1.011564] pci 0000:01:00.0: PME# supported from D0 D1 D3hot
[    1.015021] pci 0000:00:00.0: BAR 8: assigned [mem 0x600000000-0x6000fffff]
[    1.015056] pci 0000:01:00.0: BAR 0: assigned [mem 0x600000000-0x60001ffff 64bit]
[    1.015107] pci 0000:01:00.0: BAR 6: assigned [mem 0x600020000-0x60002ffff pref]
[    1.015136] pci 0000:00:00.0: PCI bridge to [bus 01]
[    1.015165] pci 0000:00:00.0:   bridge window [mem 0x600000000-0x6000fffff]
[    1.019294] Serial: 8250/16550 driver, 1 ports, IRQ sharing enabled
[    1.022085] iproc-rng200 fe104000.rng: hwrng registered
[    1.022396] vc-mem: phys_addr:0x00000000 mem_base=0x3f000000 mem_size:0x3f600000(1014 MiB)
[    1.023187] gpiomem-bcm2835 fe200000.gpiomem: Initialised: Registers at 0xfe200000
[    1.023593] cacheinfo: Unable to detect cache hierarchy for CPU 0
[    1.034479] brd: module loaded
[    1.046590] loop: module loaded
[    1.047204] zram: Added device: zram0
[    1.048527] Loading iSCSI transport class v2.0-870.
[    1.050517] libphy: Fixed MDIO Bus: probed
[    1.050569] tun: Universal TUN/TAP device driver, 1.6
[    1.051421] dwc_otg: version 3.00a 10-AUG-2012 (platform bus)
[    1.052152] usbcore: registered new interface driver uas
[    1.052222] usbcore: registered new interface driver usb-storage
[    1.052345] usbcore: registered new interface driver usbserial_generic
[    1.052392] usbserial: USB Serial support registered for generic
[    1.052645] mousedev: PS/2 mouse device common for all mice
[    1.054785] bcm2835-wdt bcm2835-wdt: Broadcom BCM2835 watchdog timer
[    1.057797] sdhci: Secure Digital Host Controller Interface driver
[    1.057823] sdhci: Copyright(c) Pierre Ossman
[    1.058350] mmc-bcm2835 fe300000.mmcnr: could not get clk, deferring probe
[    1.058803] sdhci-pltfm: SDHCI platform and OF driver helper
[    1.063771] ledtrig-cpu: registered to indicate activity on CPUs
[    1.063907] hidraw: raw HID events driver (C) Jiri Kosina
[    1.063983] usbcore: registered new interface driver usbhid
[    1.063991] usbhid: USB HID core driver
[    1.064174] ashmem: initialized
[    1.064822] vchiq: vchiq_init_state: slot_zero = (____ptrval____)
[    1.067240] IPVS: Registered protocols (TCP, UDP, SCTP, AH, ESP)
[    1.067275] IPVS: Connection hash table configured (size=4096, memory=64Kbytes)
[    1.067416] IPVS: ipvs loaded.
[    1.067621] Initializing XFRM netlink socket
[    1.067926] NET: Registered protocol family 10
[    1.068618] Segment Routing with IPv6
[    1.068683] NET: Registered protocol family 17
[    1.068717] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[    1.068783] Key type dns_resolver registered
[    1.069104] registered taskstats version 1
[    1.069121] Loading compiled-in X.509 certificates
[    1.069258] Key type ._fscrypt registered
[    1.069267] Key type .fscrypt registered
[    1.073726] uart-pl011 fe201000.serial: cts_event_workaround enabled
[    1.073801] fe201000.serial: ttyAMA0 at MMIO 0xfe201000 (irq = 13, base_baud = 0) is a PL011 rev2
[    1.079984] printk: console [ttyS0] disabled
[    1.080031] fe215040.serial: ttyS0 at MMIO 0x0 (irq = 15, base_baud = 62500000) is a 16550
[    2.183291] printk: console [ttyS0] enabled
[    2.189338] bcm2835-power bcm2835-power: Broadcom BCM2835 power domains driver
[    2.197436] mmc-bcm2835 fe300000.mmcnr: mmc_debug:0 mmc_debug2:0
[    2.203543] mmc-bcm2835 fe300000.mmcnr: DMA channel allocated
[    2.277099] mmc0: SDHCI controller on fe340000.emmc2 [fe340000.emmc2] using ADMA
[    2.286710] of_cfs_init
[    2.289303] of_cfs_init: OK
[    2.304838] Freeing unused kernel memory: 11456K
[    2.309607] Run /init as init process
[    2.382461] mmc0: new DDR MMC card at address 0001
[    2.388127] mmcblk0: mmc0:0001 AJTD4R 14.6 GiB
[    2.393123] mmcblk0boot0: mmc0:0001 AJTD4R partition 1 4.00 MiB
[    2.399640] mmcblk0boot1: mmc0:0001 AJTD4R partition 2 4.00 MiB
[    2.405866] mmcblk0rpmb: mmc0:0001 AJTD4R partition 3 4.00 MiB, chardev (245:0)
[    2.417261]  mmcblk0: p1 p2 p3 p4 < p5 p6 >
Starting version 244.3+
[    2.657202] random: fast init done
[    2.835805] zram0: detected capacity change from 0 to 996556800
[    3.593582] EXT4-fs (mmcblk0p2): mounted filesystem with ordered data mode. Opts: (null)
[    3.617821] EXT4-fs (mmcblk0p5): mounted filesystem with ordered data mode. Opts: (null)
[    3.835805] EXT4-fs (mmcblk0p2): re-mounted. Opts: (null)
[    3.935667] EXT4-fs (mmcblk0p6): recovery complete
[    3.941112] EXT4-fs (mmcblk0p6): mounted filesystem with ordered data mode. Opts: (null)
[    4.053908] systemd[1]: System time before build time, advancing clock.

Welcome to balenaOS 2.71.3+rev5!

[    4.229733] systemd[1]: /lib/systemd/system/balena-host.socket:5: ListenStream= references a path below legacy directory /var/run/, updating /var/run/balena-host.sock → /run/balena-host.sock; please update the unit file accordingly.
[    4.258518] systemd[1]: /lib/systemd/system/balena-engine.socket:6: ListenStream= references a path below legacy directory /var/run/, updating /var/run/balena-engine.sock → /run/balena-engine.sock; please update the unit file accordingly.
[    4.399554] random: systemd: uninitialized urandom read (16 bytes read)
[  OK  ] Created slice system-getty.slice.
[    4.424773] random: systemd: uninitialized urandom read (16 bytes read)
[  OK  ] Created slice system-resin\x2dinfo.slice.
[    4.448754] random: systemd: uninitialized urandom read (16 bytes read)
[  OK  ] Created slice system-serial\x2dgetty.slice.
[  OK  ] Created slice User and Session Slice.
[  OK  ] Started Forward Password R…uests to Wall Directory Watch.
[  OK  ] Reached target Remote File Systems.
[  OK  ] Reached target Slices.
[  OK  ] Reached target Swap.
[  OK  ] Listening on initctl Compatibility Named Pipe.
[  OK  ] Listening on Journal Audit Socket.
[  OK  ] Listening on Journal Socket (/dev/log).
[  OK  ] Listening on Journal Socket.
[  OK  ] Listening on udev Control Socket.
[  OK  ] Listening on udev Kernel Socket.
         Mounting POSIX Message Queue File System...
         Mounting Kernel Debug File System...
         Starting Create list of st…odes for the current kernel...
         Starting Resin active root partition mount service...
         Starting Resin boot partition mount service...
         Starting Resin state partition mount service...
         Starting Rollback clear bo…boot crumb is still present...
         Mounting Kernel Configuration File System...
         Starting Remount Root and Kernel File Systems...
         Starting Apply Kernel Variables...
         Starting udev Coldplug all Devices...
         Starting Setup Virtual Console...
         Starting Set the system clock from the build timestamp...
[  OK  ] Mounted POSIX Message Queue File System.
[  OK  ] Mounted Kernel Debug File System.
[  OK  ] Started Create list of sta… nodes for the current kernel.
[  OK  ] Started Resin active root partition mount service.
[  OK  ] Started Resin boot partition mount service.
[  OK  ] Started Resin state partition mount service.
[  OK  ] Started Rollback clear boo…ltboot crumb is still present.
[  OK  ] Mounted Kernel Configuration File System.
[  OK  ] Started Remount Root and Kernel File Systems.
[  OK  ] Started Apply Kernel Variables.
[  OK  ] Started Setup Virtual Console.
[  OK  ] Started Set the system clock from the build timestamp.
         Starting OS configuration device key service...
         Starting Expand resin-data partition...
         Starting Create Static Device Nodes in /dev...
[  OK  ] Started udev Coldplug all Devices.
[  OK  ] Started Expand resin-data partition.
[  OK  ] Started Create Static Device Nodes in /dev.
[  OK  ] Started OS configuration device key service.
[  OK  ] Reached target Local File Systems (Pre).
[  OK  ] Set up automount mnt-sysroot-inactive partition.
         Mounting Bind mount for /etc/fake-hwclock...
         Mounting /var/volatile...
         Starting Resin data partition mount service...
         Starting udev Wait for Complete Device Initialization...
[  OK  ] Mounted Bind mount for /etc/fake-hwclock.
[  OK  ] Mounted /var/volatile.
[  OK  ] Started Resin data partition mount service.
         Mounting resin-data bind mount...
         Starting Restore/save the current clock...
         Starting Bind mount volatile /var/cache...
         Starting Bind mount volatile /var/lib...
         Starting Bind mount volatile /var/spool...
         Starting Bind mount volatile /srv...
[  OK  ] Mounted resin-data bind mount.
[  OK  ] Started Restore/save the current clock.
[  OK  ] Started Bind mount volatile /var/cache.
[  OK  ] Started Bind mount volatile /var/lib.
[  OK  ] Started Bind mount volatile /var/spool.
[  OK  ] Started Bind mount volatile /srv.
         Mounting Docker data mountpoint...
         Starting Journal Service...
[  OK  ] Mounted Docker data mountpoint.
[  OK  ] Reached target Local File Systems.
         Starting Tell Plymouth To Write Out Runtime Data...
[  OK  ] Started Tell Plymouth To Write Out Runtime Data.
[  OK  ] Started Journal Service.
         Starting Create Volatile Files and Directories...
[  OK  ] Started Create Volatile Files and Directories.
         Starting Bind mount for /etc/NetworkManager/conf.d...
         Starting Bind mount for /e…kManager/system-connections...
         Starting Bind mount for /etc/docker...
         Starting Bind mount for /etc/hostname...
         Starting Bind mount for /etc/openvpn...
         Starting Bind mount for /etc/resin-supervisor...
         Starting Bind mount for /etc/ssh/hostkeys...
         Starting Bind mount for /etc/udev/rules.d...
         Starting Bind mount for /home/root/.docker...
         Starting Bind mount for /home/root/.rnd...
         Starting Bind mount for /home/root/.ssh...
         Starting Bind mount for /u…hare/ca-certificates/balena...
         Starting Bind mount for /var/lib/NetworkManager...
         Starting Bind mount for /var/lib/bluetooth...
         Starting Bind mount for /var/lib/chrony...
         Starting Bind mount for /var/lib/systemd...
         Starting Update UTMP about System Boot/Shutdown...
[  OK  ] Started Bind mount for /etc/NetworkManager/conf.d.
[  OK  ] Started Bind mount for /et…orkManager/system-connections.
[  OK  ] Started Bind mount for /etc/docker.
[  OK  ] Started Bind mount for /etc/hostname.
[  OK  ] Started Bind mount for /etc/openvpn.
[  OK  ] Started Bind mount for /etc/resin-supervisor.
[  OK  ] Started Bind mount for /etc/ssh/hostkeys.
[  OK  ] Started Bind mount for /etc/udev/rules.d.
[  OK  ] Started Bind mount for /home/root/.docker.
[  OK  ] Started Bind mount for /home/root/.rnd.
[  OK  ] Started Bind mount for /home/root/.ssh.
[  OK  ] Started Bind mount for /usr/share/ca-certificates/balena.
[  OK  ] Started Bind mount for /var/lib/NetworkManager.
[  OK  ] Started Bind mount for /var/lib/bluetooth.
[  OK  ] Started Bind mount for /var/lib/chrony.
[  OK  ] Started Bind mount for /var/lib/systemd.
         Starting Load/Save Random Seed...
         Starting udev Kernel Device Manager...
[  OK  ] Started Update UTMP about System Boot/Shutdown.
[  OK  ] Started udev Kernel Device Manager.
[    6.829400] rpivid-mem feb00000.hevc-decoder: rpivid-hevcmem initialised: Registers at 0xfeb00000 length 0x00010000
[    6.840362] rpivid-mem feb10000.rpivid-local-intc: rpivid-intcmem initialised: Registers at 0xfeb10000 length 0x00001000
[    6.853284] rpivid-mem feb20000.h264-decoder: rpivid-h264mem initialised: Registers at 0xfeb20000 length 0x00010000
[    6.864164] vc_sm_cma: module is from the staging directory, the quality is unknown, you have been warned.
[    6.866084] rpivid-mem feb30000.vp9-decoder: rpivid-vp9mem initialised: Registers at 0xfeb30000 length 0x00010000
[    6.888290] bcm2835_vc_sm_cma_probe: Videocore shared memory driver
[    6.895334] mc: Linux media interface: v0.10
[    6.898284] [vc_sm_connected_init]: start
[  OK  ] Found device /dev/serial1.
[    6.909262] vc_sm_cma_vchi_init: failed to open VCHI service (-1)
[    6.909268] [vc_sm_connected_init]: failed to initialize shared memory service
[    6.928780] videodev: Linux video capture interface: v2.00
[    6.951205] snd_bcm2835: module is from the staging directory, the quality is unknown, you have been warned.
[    6.983945] bcm2835_mmal_vchiq: module is from the staging directory, the quality is unknown, you have been warned.
[    6.987299] cfg80211: Loading compiled-in X.509 certificates for regulatory database
[    6.995537] bcm2835_mmal_vchiq: module is from the staging directory, the quality is unknown, you have been warned.
[    7.019380] bcm2835_isp: module is from the staging directory, the quality is unknown, you have been warned.
[    7.019612] [drm] Initialized v3d 1.0.0 20180419 for fec00000.v3d on minor 0
[    7.040272] bcm2835_mmal_vchiq: Failed to open VCHI service connection (status=-1)
[    7.053949] bcm2835_codec: module is from the staging directory, the quality is unknown, you have been warned.
[    7.061499] bcm2835_v4l2: module is from the staging directory, the quality is unknown, you have been warned.
[    7.079847] [drm] No displays found. Consider forcing hotplug if HDMI is attached
[    7.091994] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
[    7.092222] vc4-drm gpu: bound fe600000.firmwarekms (ops vc4_fkms_ops [vc4])
[    7.100690] bcm2835_mmal_vchiq: Failed to open VCHI service connection (status=-1)
[    7.106166] [drm] Supports vblank timestamp caching Rev 2 (21.10.2013).
[    7.122083] bcm2835_mmal_vchiq: Failed to open VCHI service connection (status=-1)
[    7.129883] [drm] No driver support for vblank timestamp query.
[    7.136538] [drm] Setting vblank_disable_immediate to false because get_vblank_timestamp == NULL
[    7.150872] [drm] Initialized vc4 0.0.0 20140616 for gpu on minor 1
[    7.221606] pci 0000:00:00.0: enabling device (0000 -> 0002)
[    7.238736] ath9k 0000:01:00.0: enabling device (0000 -> 0002)
[    7.246876] ath9k: 32-bit DMA not available
[    7.251411] ath9k: probe of 0000:01:00.0 failed with error -5
[    7.378791] zram: Can't change algorithm for initialized device
[  OK  ] Found device /dev/zram0.
[  OK  ] Listening on Load/Save RF …itch Status /dev/rfkill Watch.
[    8.084610] random: crng init done
[    8.088071] random: 7 urandom warning(s) missed due to ratelimiting
[  OK  ] Started Load/Save Random Seed.
[  OK  ] Started udev Wait for Complete Device Initialization.
         Activating swap Enable com…d swap in memory using zram...
         Startin[    8.856672] Adding 973196k swap on /dev/zram0.  Priority:-2 extents:1 across:973196k SSFS
g Show Plymouth Boot Screen...
[    9.145210] uart-pl011 fe201000.serial: no DMA platform data
[   11.122332] i2c /dev entries driver
[   12.424936] Bridge firewalling registered
[   12.600614] audit: type=1325 audit(1581090660.541:2): table=nat family=2 entries=5
[   12.624635] audit: type=1325 audit(1581090660.565:3): table=filter family=2 entries=4
[   12.636734] audit: type=1325 audit(1581090660.581:4): table=filter family=2 entries=6
[   12.648743] audit: type=1325 audit(1581090660.593:5): table=filter family=2 entries=8
[   12.664784] audit: type=1325 audit(1581090660.609:6): table=filter family=2 entries=10
[   12.676964] audit: type=1325 audit(1581090660.621:7): table=filter family=2 entries=11
[   12.685147] audit: type=1325 audit(1581090660.629:8): table=filter family=2 entries=12
[   12.741040] audit: type=1325 audit(1581090660.685:9): table=nat family=2 entries=7
[   12.756860] audit: type=1325 audit(1581090660.701:10): table=nat family=2 entries=8
[   12.777036] audit: type=1325 audit(1581090660.721:11): table=filter family=2 entries=12
[   14.815084] cgroup: cgroup: disabling cgroup2 socket matching due to net_prio or net_cls activation

balenaOS 2.71.3 1c95e71 serial0

1c95e71 login: [   23.084468] kauditd_printk_skb: 39 callbacks suppressed
[   23.084473] audit: type=1325 audit(1581090671.025:51): table=filter family=2 entries=29
[   23.123569] audit: type=1325 audit(1581090671.065:52): table=filter family=10 entries=0
[   23.159956] audit: type=1325 audit(1581090671.085:53): table=filter family=10 entries=4

1c95e71 login: 
1c95e71 login: 
1c95e71 login: root
root@1c95e71:~# ifconfig
balena0   Link encap:Ethernet  HWaddr 02:42:C8:69:70:A3  
          inet addr:10.114.101.1  Bcast:10.114.101.255  Mask:255.255.255.0
          UP BROADCAST MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

lo        Link encap:Local Loopback  
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:65536  Metric:1
          RX packets:288 errors:0 dropped:0 overruns:0 frame:0
          TX packets:288 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:19648 (19.1 KiB)  TX bytes:19648 (19.1 KiB)

resin-dns Link encap:Ethernet  HWaddr 12:1D:97:4E:B1:23  
          inet addr:10.114.102.1  Bcast:0.0.0.0  Mask:255.255.255.0
          UP BROADCAST MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

supervisor0 Link encap:Ethernet  HWaddr 02:42:9B:E2:75:86  
          inet addr:10.114.104.1  Bcast:10.114.104.127  Mask:255.255.255.128
          UP BROADCAST MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

From Launchpad (bugs fixed):

TL;DR: fixes are now available for the ath9k driver issue as well as the 32-bit DMA issue (dt overlay).

Hi. Do you know if these kernel patches made it into GitHub - raspberrypi/linux: Kernel source tree for Raspberry Pi Foundation-provided kernel builds. Issues unrelated to the linux kernel should be posted on the community forum at https://www.raspberrypi.org/forum ?

Hi @floion I had to switch my test fleet to manually-managed ubuntu because I have a testing deadline coming up.

In the next week or so I hope to free up some hardware to test with Balena again. Balena is where I want the fleet to be. I was getting into a time crunch and had to make a decision.

I’ll test again in a few weeks, when I have spare hardware to test with. FWIW it looks like the fixes to Ubuntu had to do with the kernel package build configuration (enabling ath9k PCI) and adding the pcie-32bit-dma overlay.

Can you direct me to docs that will walk me though the BalenaOS build process?

Hello @awilson
The documentation for building the balenaOS Raspberry Pi repository can be found here