USB3-SSD Write Speed in balenaOS

[David]

Hey @alexgg @jakogut, hello from the other side!

I am testing an application that “requires” 180mb/s write speed on a Pi4 via the use of a USB3 SSD adapter. I have a Pi4 (4gb RAM), balenaOS v2.95.8, and get this performance:

Connecting to e82a8ecaf2b58ac3895b5c54130987a7...
Spawning shell...
=============================================================
    Welcome to balenaOS
=============================================================
root@e82a8ec:~# mkdir /mnt/data/ssd
root@e82a8ec:~# mount /dev/sda1 /mnt/data/ssd
root@e82a8ec:~# dd if=/dev/zero of=/mnt/data/ssd/test bs=64k count=16k conv=fdatasync; rm -rf /mnt/data/ssd/test
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 8.03628 s, 134 MB/s
root@e82a8ec:~# dd if=/dev/zero of=/mnt/data/ssd/test bs=64k count=16k conv=fdatasync; rm -rf /mnt/data/ssd/test
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.36435 s, 146 MB/s
root@e82a8ec:~# dd if=/dev/zero of=/mnt/data/ssd/test bs=64k count=16k conv=fdatasync; rm -rf /mnt/data/ssd/test
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.60197 s, 141 MB/s

So, roughly 140 mb/s on average.

However, same SD Card, same Pi, same SSD adapter, same SSD, booted with Raspbian, I get over 200mb/s:

pi@raspberrypi:~ $ sudo mount /dev/sda1 /mnt
pi@raspberrypi:~ $ sudo dd if=/dev/zero of=/mnt/test bs=64k count=16k conv=fdatasync; sudo rm -rf /mnt/test
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 5.15202 s, 208 MB/s
pi@raspberrypi:~ $ uname -a
Linux raspberrypi 5.10.92-v8+ #1514 SMP PREEMPT Mon Jan 17 17:39:38 GMT 2022 aarch64 GNU/Linux

Any ideas what could be going on here? I promise, power supply and SD Card are good.

Joking aside, identical setup, balenaOS is about 30% slower as you can see. Kernel issue, firmware, or non-optimal driver in the OS, perhaps??

Have a good one, and thanks!

[David]

cc: @mpous

[jakogut]

Hey, David!

Very interesting, thanks for sharing. Can you paste the output of uname -a for balenaOS, as you did for Raspbian?

Also, would it be possible to get the dmesg output for both?

Thanks!

[David]

Sure thing @jakogut! And hey maybe @klutchell will stop by for a browse, too!

Here’s uname and dmesg from Raspbian.

NOTE: I’m getting hit by maximum character count of 32000, so I am going to <snip> a few lines related to sound, gpu, and my USB mouse and keyboard to get under the limit.

pi@raspberrypi:~ $ uname -a
Linux raspberrypi 5.10.92-v8+ #1514 SMP PREEMPT Mon Jan 17 17:39:38 GMT 2022 aarch64 GNU/Linux
pi@raspberrypi:~ $ dmesg
[    0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd083]
[    0.000000] Linux version 5.10.92-v8+ (dom@buildbot) (aarch64-linux-gnu-gcc-8 (Ubuntu/Linaro 8.4.0-3ubuntu1) 8.4.0, GNU ld (GNU Binutils for Ubuntu) 2.34) #1514 SMP PREEMPT Mon Jan 17 17:39:38 GMT 2022
[    0.000000] random: fast init done
[    0.000000] Machine model: Raspberry Pi 4 Model B Rev 1.1
[    0.000000] efi: UEFI not found.
[    0.000000] Reserved memory: created CMA memory pool at 0x000000001ac00000, size 320 MiB
[    0.000000] OF: reserved mem: initialized node linux,cma, compatible id shared-dma-pool
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000000000-0x000000003fffffff]
[    0.000000]   DMA32    [mem 0x0000000040000000-0x00000000fbffffff]
[    0.000000]   Normal   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000000000-0x000000003b3fffff]
[    0.000000]   node   0: [mem 0x0000000040000000-0x00000000fbffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x00000000fbffffff]
[    0.000000] On node 0 totalpages: 1012736
[    0.000000]   DMA zone: 3792 pages used for memmap
[    0.000000]   DMA zone: 0 pages reserved
[    0.000000]   DMA zone: 242688 pages, LIFO batch:63
[    0.000000]   DMA32 zone: 12032 pages used for memmap
[    0.000000]   DMA32 zone: 770048 pages, LIFO batch:63
[    0.000000] percpu: Embedded 32 pages/cpu s91416 r8192 d31464 u131072
[    0.000000] pcpu-alloc: s91416 r8192 d31464 u131072 alloc=32*4096
[    0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3
[    0.000000] Detected PIPT I-cache on CPU0
[    0.000000] CPU features: detected: Spectre-v2
[    0.000000] CPU features: detected: Spectre-v4
[    0.000000] CPU features: detected: ARM errata 1165522, 1319367, or 1530923
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 996912
[    0.000000] Kernel command line: coherent_pool=1M 8250.nr_uarts=0 snd_bcm2835.enable_compat_alsa=0 snd_bcm2835.enable_hdmi=1 video=HDMI-A-1:1600x1200M@60 smsc95xx.macaddr=DC:A6:32:0E:CD:AA vc_mem.mem_base=0x3ec00000 vc_mem.mem_size=0x40000000  console=ttyS0,115200 console=tty1 root=PARTUUID=1096847e-02 rootfstype=ext4 fsck.repair=yes rootwait quiet splash plymouth.ignore-serial-consoles
[    0.000000] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)
[    0.000000] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] software IO TLB: mapped [mem 0x0000000037400000-0x000000003b400000] (64MB)
[    0.000000] Memory: 3554704K/4050944K available (11136K kernel code, 1950K rwdata, 3988K rodata, 3712K init, 1253K bss, 168560K reserved, 327680K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.000000] ftrace: allocating 36801 entries in 144 pages
[    0.000000] ftrace: allocated 144 pages with 2 groups
[    0.000000] rcu: Preemptible hierarchical RCU implementation.
[    0.000000] rcu:     RCU event tracing is enabled.
[    0.000000] rcu:     RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=4.
[    0.000000]  Trampoline variant of Tasks RCU enabled.
[    0.000000]  Rude variant of Tasks RCU enabled.
[    0.000000]  Tracing variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
[    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] GIC: Using split EOI/Deactivate mode
[    0.000000] irq_brcmstb_l2: registered L2 intc (/soc/interrupt-controller@7ef00100, parent irq: 10)
[    0.000000] random: get_random_bytes called from start_kernel+0x3b0/0x570 with crng_init=1
[    0.000000] arch_timer: cp15 timer(s) running at 54.00MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0xc743ce346, max_idle_ns: 440795203123 ns
[    0.000007] sched_clock: 56 bits at 54MHz, resolution 18ns, wraps every 4398046511102ns
[    0.000273] Console: colour dummy device 80x25
[    0.000328] printk: console [tty1] enabled
[    0.000381] Calibrating delay loop (skipped), value calculated using timer frequency.. 108.00 BogoMIPS (lpj=216000)
[    0.000408] pid_max: default: 32768 minimum: 301
[    0.000559] LSM: Security Framework initializing
[    0.000801] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    0.000871] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    0.002209] cgroup: Disabling memory control group subsystem
[    0.004659] rcu: Hierarchical SRCU implementation.
[    0.005691] EFI services will not be available.
[    0.006228] smp: Bringing up secondary CPUs ...
[    0.007233] Detected PIPT I-cache on CPU1
[    0.007321] CPU1: Booted secondary processor 0x0000000001 [0x410fd083]
[    0.008516] Detected PIPT I-cache on CPU2
[    0.008566] CPU2: Booted secondary processor 0x0000000002 [0x410fd083]
[    0.009674] Detected PIPT I-cache on CPU3
[    0.009724] CPU3: Booted secondary processor 0x0000000003 [0x410fd083]
[    0.009878] smp: Brought up 1 node, 4 CPUs
[    0.009894] SMP: Total of 4 processors activated.
[    0.009909] CPU features: detected: 32-bit EL0 Support
[    0.009924] CPU features: detected: CRC32 instructions
[    0.009937] CPU features: detected: 32-bit EL1 Support
[    0.044270] CPU: All CPU(s) started at EL2
[    0.044334] alternatives: patching kernel code
[    0.046020] devtmpfs: initialized
[    0.057657] Enabled cp15_barrier support
[    0.057697] Enabled setend support
[    0.057903] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.057935] futex hash table entries: 1024 (order: 4, 65536 bytes, linear)
[    0.067195] pinctrl core: initialized pinctrl subsystem
[    0.067997] DMI not present or invalid.
[    0.068440] NET: Registered protocol family 16
[    0.071608] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations
[    0.071872] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    0.072826] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    0.072943] audit: initializing netlink subsys (disabled)
[    0.073324] audit: type=2000 audit(0.072:1): state=initialized audit_enabled=0 res=1
[    0.073843] thermal_sys: Registered thermal governor 'step_wise'
[    0.074306] cpuidle: using governor menu
[    0.074716] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
[    0.074891] ASID allocator initialised with 65536 entries
[    0.075023] Serial: AMBA PL011 UART driver
[    0.114326] bcm2835-mbox fe00b880.mailbox: mailbox enabled
[    0.120462] raspberrypi-firmware soc:firmware: Attached to firmware from 2022-01-20T13:56:48, variant start
[    0.124471] raspberrypi-firmware soc:firmware: Firmware hash is bd88f66f8952d34e4e0613a85c7a6d3da49e13e2
[    0.159505] bcm2835-dma fe007000.dma: DMA legacy API manager, dmachans=0x1
[    0.164219] vgaarb: loaded
[    0.164789] SCSI subsystem initialized
[    0.165021] usbcore: registered new interface driver usbfs
[    0.165084] usbcore: registered new interface driver hub
[    0.165158] usbcore: registered new device driver usb
[    0.165519] usb_phy_generic phy: supply vcc not found, using dummy regulator
[    0.167414] clocksource: Switched to clocksource arch_sys_counter
[    1.203524] VFS: Disk quotas dquot_6.6.0
[    1.203626] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    1.203783] FS-Cache: Loaded
[    1.204038] CacheFiles: Loaded
[    1.205345] simple-framebuffer 3e474000.framebuffer: framebuffer at 0x3e474000, 0x753000 bytes, mapped to 0x(____ptrval____)
[    1.205361] simple-framebuffer 3e474000.framebuffer: format=a8r8g8b8, mode=1600x1200x32, linelength=6400
[    1.205843] Console: switching to colour frame buffer device 200x75
[    1.216446] simple-framebuffer 3e474000.framebuffer: fb0: simplefb registered!
[    1.226945] NET: Registered protocol family 2
[    1.227533] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    1.231064] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear)
[    1.231120] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear)
[    1.231348] TCP bind hash table entries: 32768 (order: 7, 524288 bytes, linear)
[    1.231954] TCP: Hash tables configured (established 32768 bind 32768)
[    1.232214] UDP hash table entries: 2048 (order: 4, 65536 bytes, linear)
[    1.232284] UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes, linear)
[    1.232606] NET: Registered protocol family 1
[    1.233558] RPC: Registered named UNIX socket transport module.
[    1.233572] RPC: Registered udp transport module.
[    1.233582] RPC: Registered tcp transport module.
[    1.233593] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    1.233616] PCI: CLS 0 bytes, default 64
[    1.236184] hw perfevents: enabled with armv8_cortex_a72 PMU driver, 7 counters available
[    1.236511] kvm [1]: IPA Size Limit: 44 bits
[    1.237691] kvm [1]: vgic interrupt IRQ9
[    1.237978] kvm [1]: Hyp mode initialized successfully
[    1.240514] Initialise system trusted keyrings
[    1.240884] workingset: timestamp_bits=46 max_order=20 bucket_order=0
[    1.247338] zbud: loaded
[    1.249175] FS-Cache: Netfs 'nfs' registered for caching
[    1.249878] NFS: Registering the id_resolver key type
[    1.249928] Key type id_resolver registered
[    1.249940] Key type id_legacy registered
[    1.250060] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[    1.250075] nfs4flexfilelayout_init: NFSv4 Flexfile Layout Driver Registering...
[    1.251278] Key type asymmetric registered
[    1.251291] Asymmetric key parser 'x509' registered
[    1.251342] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 249)
[    1.251678] io scheduler mq-deadline registered
[    1.251691] io scheduler kyber registered
[    1.256241] brcm-pcie fd500000.pcie: host bridge /scb/pcie@7d500000 ranges:
[    1.256272] brcm-pcie fd500000.pcie:   No bus range found for /scb/pcie@7d500000, using [bus 00-ff]
[    1.256341] brcm-pcie fd500000.pcie:      MEM 0x0600000000..0x063fffffff -> 0x00c0000000
[    1.256418] brcm-pcie fd500000.pcie:   IB MEM 0x0000000000..0x00bfffffff -> 0x0400000000
[    1.305512] brcm-pcie fd500000.pcie: link up, 5.0 GT/s PCIe x1 (SSC)
[    1.305898] brcm-pcie fd500000.pcie: PCI host bridge to bus 0000:00
[    1.305917] pci_bus 0000:00: root bus resource [bus 00-ff]
[    1.305936] pci_bus 0000:00: root bus resource [mem 0x600000000-0x63fffffff] (bus address [0xc0000000-0xffffffff])
[    1.306024] pci 0000:00:00.0: [14e4:2711] type 01 class 0x060400
[    1.306266] pci 0000:00:00.0: PME# supported from D0 D3hot
[    1.310227] pci 0000:01:00.0: [1106:3483] type 00 class 0x0c0330
[    1.310347] pci 0000:01:00.0: reg 0x10: [mem 0x00000000-0x00000fff 64bit]
[    1.310763] pci 0000:01:00.0: PME# supported from D0 D3cold
[    1.314457] pci 0000:00:00.0: BAR 8: assigned [mem 0x600000000-0x6000fffff]
[    1.314480] pci 0000:01:00.0: BAR 0: assigned [mem 0x600000000-0x600000fff 64bit]
[    1.314516] pci 0000:00:00.0: PCI bridge to [bus 01]
[    1.314537] pci 0000:00:00.0:   bridge window [mem 0x600000000-0x6000fffff]
[    1.325871] iproc-rng200 fe104000.rng: hwrng registered
[    1.326276] vc-mem: phys_addr:0x00000000 mem_base=0x3ec00000 mem_size:0x40000000(1024 MiB)
[    1.327779] gpiomem-bcm2835 fe200000.gpiomem: Initialised: Registers at 0xfe200000
[    1.328201] cacheinfo: Unable to detect cache hierarchy for CPU 0
[    1.339627] brd: module loaded
[    1.352471] loop: module loaded
[    1.354448] Loading iSCSI transport class v2.0-870.
[    1.357619] libphy: Fixed MDIO Bus: probed
[    1.359305] bcmgenet fd580000.ethernet: GENET 5.0 EPHY: 0x0000
[    1.371438] libphy: bcmgenet MII bus: probed
[    1.419543] unimac-mdio unimac-mdio.-19: Broadcom UniMAC MDIO bus
[    1.420714] usbcore: registered new interface driver r8152
[    1.420787] usbcore: registered new interface driver lan78xx
[    1.420842] usbcore: registered new interface driver smsc95xx
[    1.423505] pci 0000:00:00.0: enabling device (0000 -> 0002)
[    1.423539] xhci_hcd 0000:01:00.0: enabling device (0000 -> 0002)
[    1.423652] xhci_hcd 0000:01:00.0: xHCI Host Controller
[    1.423685] xhci_hcd 0000:01:00.0: new USB bus registered, assigned bus number 1
[    1.424471] xhci_hcd 0000:01:00.0: hcc params 0x002841eb hci version 0x100 quirks 0x00000e0000000890
[    1.425418] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10
[    1.425434] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.425448] usb usb1: Product: xHCI Host Controller
[    1.425461] usb usb1: Manufacturer: Linux 5.10.92-v8+ xhci-hcd
[    1.425473] usb usb1: SerialNumber: 0000:01:00.0
[    1.426222] hub 1-0:1.0: USB hub found
[    1.426318] hub 1-0:1.0: 1 port detected
[    1.426938] xhci_hcd 0000:01:00.0: xHCI Host Controller
[    1.426960] xhci_hcd 0000:01:00.0: new USB bus registered, assigned bus number 2
[    1.426982] xhci_hcd 0000:01:00.0: Host supports USB 3.0 SuperSpeed
[    1.427384] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.10
[    1.427442] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.427456] usb usb2: Product: xHCI Host Controller
[    1.427469] usb usb2: Manufacturer: Linux 5.10.92-v8+ xhci-hcd
[    1.427482] usb usb2: SerialNumber: 0000:01:00.0
[    1.428140] hub 2-0:1.0: USB hub found
[    1.428214] hub 2-0:1.0: 4 ports detected
[    1.429873] dwc_otg: version 3.00a 10-AUG-2012 (platform bus)
[    1.430194] dwc_otg: FIQ enabled
[    1.430205] dwc_otg: NAK holdoff enabled
[    1.430216] dwc_otg: FIQ split-transaction FSM enabled
[    1.430230] Module dwc_common_port init
[    1.430786] usbcore: registered new interface driver uas
[    1.430910] usbcore: registered new interface driver usb-storage
[    1.431125] mousedev: PS/2 mouse device common for all mice
[    1.433303] bcm2835-wdt bcm2835-wdt: Broadcom BCM2835 watchdog timer
[    1.436707] sdhci: Secure Digital Host Controller Interface driver
[    1.436724] sdhci: Copyright(c) Pierre Ossman
[    1.437432] mmc-bcm2835 fe300000.mmcnr: could not get clk, deferring probe
[    1.438010] sdhci-pltfm: SDHCI platform and OF driver helper
[    1.441267] ledtrig-cpu: registered to indicate activity on CPUs
[    1.441598] hid: raw HID events driver (C) Jiri Kosina
[    1.441817] usbcore: registered new interface driver usbhid
[    1.441828] usbhid: USB HID core driver
[    1.442160] ashmem: initialized
[    1.450553] Initializing XFRM netlink socket
[    1.450599] NET: Registered protocol family 17
[    1.450734] Key type dns_resolver registered
[    1.451512] registered taskstats version 1
[    1.451550] Loading compiled-in X.509 certificates
[    1.452077] Key type ._fscrypt registered
[    1.452089] Key type .fscrypt registered
[    1.452100] Key type fscrypt-provisioning registered
[    1.463853] uart-pl011 fe201000.serial: there is not valid maps for state default
[    1.464139] uart-pl011 fe201000.serial: cts_event_workaround enabled
[    1.464267] fe201000.serial: ttyAMA0 at MMIO 0xfe201000 (irq = 23, base_baud = 0) is a PL011 rev2
[    1.472754] bcm2835-power bcm2835-power: Broadcom BCM2835 power domains driver
[    1.473716] mmc-bcm2835 fe300000.mmcnr: mmc_debug:0 mmc_debug2:0
[    1.473729] mmc-bcm2835 fe300000.mmcnr: DMA channel allocated
[    1.502619] of_cfs_init
[    1.502798] of_cfs_init: OK
[    1.519325] mmc1: queuing unknown CIS tuple 0x80 (2 bytes)
[    1.520995] mmc1: queuing unknown CIS tuple 0x80 (3 bytes)
[    1.522659] mmc1: queuing unknown CIS tuple 0x80 (3 bytes)
[    1.525646] mmc1: queuing unknown CIS tuple 0x80 (7 bytes)
[    1.527311] mmc1: queuing unknown CIS tuple 0x80 (3 bytes)
[    1.540398] mmc0: SDHCI controller on fe340000.mmc [fe340000.mmc] using ADMA
[    1.541328] Waiting for root device PARTUUID=1096847e-02...
[    1.592728] mmc1: new high speed SDIO card at address 0001
[    1.641873] mmc0: new ultra high speed DDR50 SDHC card at address aaaa
[    1.642885] mmcblk0: mmc0:aaaa SB32G 29.7 GiB
[    1.646487]  mmcblk0: p1 p2
[    1.661987] EXT4-fs (mmcblk0p2): mounted filesystem with ordered data mode. Opts: (null)
[    1.662094] VFS: Mounted root (ext4 filesystem) readonly on device 179:2.
[    1.662859] devtmpfs: mounted
[    1.672626] Freeing unused kernel memory: 3712K
[    1.683481] usb 1-1: new high-speed USB device number 2 using xhci_hcd
[    1.683630] Run /sbin/init as init process
[    1.683641]   with arguments:
[    1.683651]     /sbin/init
[    1.683660]     splash
[    1.683670]   with environment:
[    1.683680]     HOME=/
[    1.683689]     TERM=linux
[    1.834263] usb 1-1: New USB device found, idVendor=2109, idProduct=3431, bcdDevice= 4.21
[    1.834286] usb 1-1: New USB device strings: Mfr=0, Product=1, SerialNumber=0
[    1.834299] usb 1-1: Product: USB2.0 Hub
[    1.836261] hub 1-1:1.0: USB hub found
[    1.836578] hub 1-1:1.0: 4 ports detected
[    1.959994] usb 2-2: new SuperSpeed Gen 1 USB device number 2 using xhci_hcd
[    1.981127] usb 2-2: New USB device found, idVendor=174c, idProduct=55aa, bcdDevice= 1.00
[    1.981150] usb 2-2: New USB device strings: Mfr=2, Product=3, SerialNumber=1
[    1.981164] usb 2-2: Product:  SA400S37240G
[    1.981177] usb 2-2: Manufacturer: KINGSTON
[    1.981190] usb 2-2: SerialNumber: 12345679BBFF
[    1.995146] scsi host0: uas
[    1.996792] scsi 0:0:0:0: Direct-Access     KINGSTON  SA400S37240G    0    PQ: 0 ANSI: 6
[    1.998980] sd 0:0:0:0: [sda] 468862128 512-byte logical blocks: (240 GB/224 GiB)
[    1.999166] sd 0:0:0:0: [sda] Write Protect is off
[    1.999184] sd 0:0:0:0: [sda] Mode Sense: 43 00 00 00
[    1.999541] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    2.000285] sd 0:0:0:0: [sda] Optimal transfer size 33553920 bytes
[    2.032817]  sda: sda1
[    2.035863] sd 0:0:0:0: [sda] Attached SCSI disk
[    2.045745] systemd[1]: System time before build time, advancing clock.
[    2.139507] usb 1-1.3: new full-speed USB device number 3 using xhci_hcd
[    2.146220] NET: Registered protocol family 10
[    2.147891] Segment Routing with IPv6
[    2.204755] systemd[1]: systemd 247.3-6 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +ZSTD +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=unified)
[    2.206661] systemd[1]: Detected architecture arm64.
[    2.208786] systemd[1]: Set hostname to <raspberrypi>.
[    2.253903] usb 1-1.3: New USB device found, idVendor=046d, idProduct=c534, bcdDevice=29.01
[    2.734927] systemd[1]: /lib/systemd/system/plymouth-start.service:16: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed.
[    2.872809] systemd[1]: Queued start job for default target Graphical Interface.
[    2.874445] random: systemd: uninitialized urandom read (16 bytes read)
[    2.876834] systemd[1]: Created slice system-getty.slice.
[    2.877212] random: systemd: uninitialized urandom read (16 bytes read)
[    2.878197] systemd[1]: Created slice system-modprobe.slice.
[    2.878305] random: systemd: uninitialized urandom read (16 bytes read)
[    2.879205] systemd[1]: Created slice system-systemd\x2dfsck.slice.
[    2.880056] systemd[1]: Created slice User and Session Slice.
[    2.880587] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[    2.881690] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[    2.882197] systemd[1]: Reached target Slices.
[    2.882365] systemd[1]: Reached target Swap.
[    2.890151] systemd[1]: Listening on Syslog Socket.
[    2.890953] systemd[1]: Listening on fsck to fsckd communication Socket.
[    2.891373] systemd[1]: Listening on initctl Compatibility Named Pipe.
[    2.892626] systemd[1]: Listening on Journal Audit Socket.
[    2.893461] systemd[1]: Listening on Journal Socket (/dev/log).
[    2.894401] systemd[1]: Listening on Journal Socket.
[    2.896284] systemd[1]: Listening on udev Control Socket.
[    2.897091] systemd[1]: Listening on udev Kernel Socket.
[    2.898001] systemd[1]: Condition check resulted in Huge Pages File System being skipped.
[    2.902051] systemd[1]: Mounting POSIX Message Queue File System...
[    2.906523] systemd[1]: Mounting RPC Pipe File System...
[    2.911726] systemd[1]: Mounting Kernel Debug File System...
[    2.917059] systemd[1]: Mounting Kernel Trace File System...
[    2.917493] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped.
[    2.924039] systemd[1]: Starting Restore / save the current clock...
[    2.933328] systemd[1]: Starting Set the console keyboard layout...
[    2.938994] systemd[1]: Starting Create list of static device nodes for the current kernel...
[    2.947172] systemd[1]: Starting Load Kernel Module configfs...
[    2.952984] systemd[1]: Starting Load Kernel Module drm...
[    2.959043] systemd[1]: Starting Load Kernel Module fuse...
[    2.962266] systemd[1]: Condition check resulted in Set Up Additional Binary Formats being skipped.
[    2.968022] systemd[1]: Starting File System Check on Root Device...
[    2.977974] systemd[1]: Starting Journal Service...
[    2.996851] systemd[1]: Starting Load Kernel Modules...
[    3.000379] fuse: init (API version 7.32)
[    3.002505] systemd[1]: Starting Coldplug All udev Devices...
[    3.016938] systemd[1]: Mounted POSIX Message Queue File System.
[    3.017904] systemd[1]: Mounted RPC Pipe File System.
[    3.020604] systemd[1]: Mounted Kernel Debug File System.
[    3.021584] systemd[1]: Mounted Kernel Trace File System.
[    3.023970] systemd[1]: Finished Create list of static device nodes for the current kernel.
[    3.029105] systemd[1]: modprobe@configfs.service: Succeeded.
[    3.034008] systemd[1]: Finished Load Kernel Module configfs.
[    3.036741] systemd[1]: modprobe@fuse.service: Succeeded.
[    3.038577] systemd[1]: Finished Load Kernel Module fuse.
[    3.061964] systemd[1]: Mounting FUSE Control File System...
[    3.069235] systemd[1]: Mounting Kernel Configuration File System...
[    3.080418] cryptd: max_cpu_qlen set to 1000
[    3.087289] systemd[1]: Started File System Check Daemon to report status.
[    3.098185] systemd[1]: Finished Restore / save the current clock.
[    3.100494] systemd[1]: modprobe@drm.service: Succeeded.
[    3.102148] systemd[1]: Finished Load Kernel Module drm.
[    3.104265] systemd[1]: Mounted FUSE Control File System.
[    3.107310] systemd[1]: Mounted Kernel Configuration File System.
[    3.152679] i2c /dev entries driver
[    3.157871] systemd[1]: Finished Load Kernel Modules.
[    3.163244] systemd[1]: Starting Apply Kernel Variables...
[    3.208315] systemd[1]: Finished Apply Kernel Variables.
[    3.233963] systemd[1]: Finished File System Check on Root Device.
[    3.239659] systemd[1]: Starting Remount Root and Kernel File Systems...
[    3.399374] systemd[1]: Started Journal Service.
[    3.441923] EXT4-fs (mmcblk0p2): re-mounted. Opts: (null)
[    3.500577] systemd-journald[138]: Received client request to flush runtime journal.
[    3.516414] systemd-journald[138]: File /var/log/journal/9d7dca86a6e54e1791c491ea8876ed26/system.journal corrupted or uncleanly shut down, renaming and replacing.
[    4.628477] rpivid-mem feb00000.hevc-decoder: rpivid-hevcmem initialised: Registers at 0xfeb00000 length 0x00010000
[    4.646503] rpivid-mem feb10000.rpivid-local-intc: rpivid-intcmem initialised: Registers at 0xfeb10000 length 0x00001000
[    4.650487] rpivid-mem feb20000.h264-decoder: rpivid-h264mem initialised: Registers at 0xfeb20000 length 0x00010000
[    4.655942] rpivid-mem feb30000.vp9-decoder: rpivid-vp9mem initialised: Registers at 0xfeb30000 length 0x00010000
[    4.763533] vc_sm_cma: module is from the staging directory, the quality is unknown, you have been warned.
[    4.776561] bcm2835_vc_sm_cma_probe: Videocore shared memory driver
[    4.776599] [vc_sm_connected_init]: start
[    4.807039] mc: Linux media interface: v0.10
[    4.841447] videodev: Linux video capture interface: v2.00
[    4.843569] [vc_sm_connected_init]: installed successfully
[    4.880019] bcm2835_mmal_vchiq: module is from the staging directory, the quality is unknown, you have been warned.
[    4.887120] bcm2835_isp: module is from the staging directory, the quality is unknown, you have been warned.
[    4.938155] bcm2835-isp bcm2835-isp: Loaded V4L2 bcm2835-isp
[    5.018283] snd_bcm2835: module is from the staging directory, the quality is unknown, you have been warned.
[    5.026197] bcm2835_audio bcm2835_audio: card created with 8 channels
[    5.093286] bcm2835_codec: module is from the staging directory, the quality is unknown, you have been warned.
[    5.148357] brcmstb-i2c fef04500.i2c:  @97500hz registered in polling mode
[    5.149297] brcmstb-i2c fef09500.i2c:  @97500hz registered in polling mode
[    5.227022] cfg80211: Loading compiled-in X.509 certificates for regulatory database
[    5.273166] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
[    5.292262] cfg80211: loaded regulatory.db is malformed or signature is missing/invalid
[    5.296554] bcm2835-codec bcm2835-codec: Device registered as /dev/video10
[    5.296603] bcm2835-codec bcm2835-codec: Loaded V4L2 decode
[    5.330292] checking generic (3e474000 753000) vs hw (0 ffffffffffffffff)
[    5.330320] fb0: switching to vc4drmfb from simple
[    5.330841] Console: switching to colour dummy device 80x25
[    5.341757] brcmfmac: F1 signature read @0x18000000=0x15264345
[    5.370722] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops [vc4])
[    5.371349] bcm2835-codec bcm2835-codec: Device registered as /dev/video11
[    5.373897] bcm2835-codec bcm2835-codec: Loaded V4L2 encode
[    5.374663] brcmfmac: brcmf_fw_alloc_request: using brcm/brcmfmac43455-sdio for chip BCM4345/6
[    5.375668] usbcore: registered new interface driver brcmfmac
[    5.427868] bcm2835-codec bcm2835-codec: Device registered as /dev/video12
[    5.427917] bcm2835-codec bcm2835-codec: Loaded V4L2 isp
[    5.457284] bcm2835-codec bcm2835-codec: Device registered as /dev/video18
[    5.457355] bcm2835-codec bcm2835-codec: Loaded V4L2 image_fx
[    5.489535] Registered IR keymap rc-cec
[    5.489749] rc rc0: vc4 as /devices/platform/soc/fef00700.hdmi/rc/rc0
[    5.489962] input: vc4 as /devices/platform/soc/fef00700.hdmi/rc/rc0/input6
[    5.550448] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops [vc4])
[    5.553799] [drm] Initialized v3d 1.0.0 20180419 for fec00000.v3d on minor 1
[    5.577928] Registered IR keymap rc-cec
[    5.578151] rc rc0: vc4 as /devices/platform/soc/fef00700.hdmi/rc/rc0
[    5.578385] input: vc4 as /devices/platform/soc/fef00700.hdmi/rc/rc0/input7
[    5.673087] random: crng init done
[    5.673108] random: 7 urandom warning(s) missed due to ratelimiting
[    5.694872] sd 0:0:0:0: Attached scsi generic sg0 type 0
[    5.703440] brcmfmac: brcmf_fw_alloc_request: using brcm/brcmfmac43455-sdio for chip BCM4345/6
[    5.703585] brcmfmac: brcmf_fw_alloc_request: using brcm/brcmfmac43455-sdio for chip BCM4345/6
[    5.716343] brcmfmac: brcmf_c_preinit_dcmds: Firmware: BCM4345/6 wl0: Nov  1 2021 00:37:25 version 7.45.241 (1a2f2fa CY) FWID 01-703fd60
[    5.846418] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops [vc4])
[    5.850791] Registered IR keymap rc-cec
[    5.851013] rc rc0: vc4 as /devices/platform/soc/fef00700.hdmi/rc/rc0
[    5.851223] input: vc4 as /devices/platform/soc/fef00700.hdmi/rc/rc0/input8
[    6.339991] Registered IR keymap rc-cec
[    6.387952] rc rc0: vc4 as /devices/platform/soc/fef00700.hdmi/rc/rc0
[    6.388363] input: vc4 as /devices/platform/soc/fef00700.hdmi/rc/rc0/input21
[    6.511217] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops [vc4])
[    6.517606] Registered IR keymap rc-cec
[    6.517934] rc rc0: vc4 as /devices/platform/soc/fef00700.hdmi/rc/rc0
[    6.518201] input: vc4 as /devices/platform/soc/fef00700.hdmi/rc/rc0/input22
[    6.642922] 8021q: 802.1Q VLAN Support v1.8
[    6.744239] uart-pl011 fe201000.serial: no DMA platform data
[    6.853391] bcmgenet fd580000.ethernet: configuring instance for external RGMII (RX delay)
[    6.853891] bcmgenet fd580000.ethernet eth0: Link is Down
[    6.923526] Adding 102396k swap on /var/swap.  Priority:-2 extents:2 across:110588k SSFS
[    6.932968] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops [vc4])
[    6.966467] Registered IR keymap rc-cec
[    6.970137] rc rc0: vc4 as /devices/platform/soc/fef00700.hdmi/rc/rc0
[    6.970370] input: vc4 as /devices/platform/soc/fef00700.hdmi/rc/rc0/input23
[    6.986091] vc4-drm gpu: bound fef00700.hdmi (ops vc4_hdmi_ops [vc4])
[    7.041842] Registered IR keymap rc-cec
[    7.042167] rc rc1: vc4 as /devices/platform/soc/fef05700.hdmi/rc/rc1
[    7.042583] input: vc4 as /devices/platform/soc/fef05700.hdmi/rc/rc1/input24
[    7.071728] vc4-drm gpu: bound fef05700.hdmi (ops vc4_hdmi_ops [vc4])
[    7.072128] vc4-drm gpu: bound fe004000.txp (ops vc4_txp_ops [vc4])
[    7.072423] vc4-drm gpu: bound fe206000.pixelvalve (ops vc4_crtc_ops [vc4])
[    7.072691] vc4-drm gpu: bound fe207000.pixelvalve (ops vc4_crtc_ops [vc4])
[    7.072954] vc4-drm gpu: bound fe20a000.pixelvalve (ops vc4_crtc_ops [vc4])
[    7.073151] vc4-drm gpu: bound fe216000.pixelvalve (ops vc4_crtc_ops [vc4])
[    7.073399] vc4-drm gpu: bound fec12000.pixelvalve (ops vc4_crtc_ops [vc4])
[    7.200125] [drm] Initialized vc4 0.0.0 20140616 for gpu on minor 0
[    7.269015] Console: switching to colour frame buffer device 200x75
[    7.296423] vc4-drm gpu: [drm] fb0: vc4drmfb frame buffer device
[    7.670004] brcmfmac: brcmf_cfg80211_set_power_mgmt: power save enabled
[   13.722469] IPv6: ADDRCONF(NETDEV_CHANGE): wlan0: link becomes ready
[   14.225186] Bluetooth: Core ver 2.22
[   14.225337] NET: Registered protocol family 31
[   14.225347] Bluetooth: HCI device and connection manager initialized
[   14.225375] Bluetooth: HCI socket layer initialized
[   14.225390] Bluetooth: L2CAP socket layer initialized
[   14.225418] Bluetooth: SCO socket layer initialized
[   14.253286] Bluetooth: HCI UART driver ver 2.3
[   14.253310] Bluetooth: HCI UART protocol H4 registered
[   14.253425] Bluetooth: HCI UART protocol Three-wire (H5) registered
[   14.253955] Bluetooth: HCI UART protocol Broadcom registered
[   14.642093] Bluetooth: BNEP (Ethernet Emulation) ver 1.3
[   14.642105] Bluetooth: BNEP filters: protocol multicast
[   14.642119] Bluetooth: BNEP socket layer initialized
[   14.667247] NET: Registered protocol family 38
[   14.799454] Bluetooth: RFCOMM TTY layer initialized
[   14.799478] Bluetooth: RFCOMM socket layer initialized
[   14.799507] Bluetooth: RFCOMM ver 1.11
[   15.456261] ICMPv6: process `dhcpcd' is using deprecated sysctl (syscall) net.ipv6.neigh.wlan0.retrans_time - use net.ipv6.neigh.wlan0.retrans_time_ms instead
[   17.912813] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: errors=remount-ro
[   31.711561] cam-dummy-reg: disabling
[   31.711598] cam1-reg: disabling
pi@raspberrypi:~ $

Next post will be balenaOS output.

[David]

And dmesg from balenaOS:

Connecting to e82a8ecaf2b58ac3895b5c54130987a7...
Spawning shell...
=============================================================
    Welcome to balenaOS
=============================================================
root@e82a8ec:~# dmesg
[    0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd083]
[    0.000000] Linux version 5.10.83-v8 (oe-user@oe-host) (aarch64-poky-linux-gcc (GCC) 11.2.0, GNU ld (GNU Binutils) 2.37.20210721) #1 SMP PREEMPT Tue Dec 7 13:42:57 UTC 2021
[    0.000000] random: fast init done
[    0.000000] Machine model: Raspberry Pi 4 Model B Rev 1.1
[    0.000000] efi: UEFI not found.
[    0.000000] Reserved memory: created CMA memory pool at 0x000000001ac00000, size 320 MiB
[    0.000000] OF: reserved mem: initialized node linux,cma, compatible id shared-dma-pool
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000000000-0x000000003fffffff]
[    0.000000]   DMA32    [mem 0x0000000040000000-0x00000000fbffffff]
[    0.000000]   Normal   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000000000-0x000000003e5fffff]
[    0.000000]   node   0: [mem 0x0000000040000000-0x00000000fbffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x00000000fbffffff]
[    0.000000] On node 0 totalpages: 1025536
[    0.000000]   DMA zone: 4096 pages used for memmap
[    0.000000]   DMA zone: 0 pages reserved
[    0.000000]   DMA zone: 255488 pages, LIFO batch:63
[    0.000000]   DMA32 zone: 12032 pages used for memmap
[    0.000000]   DMA32 zone: 770048 pages, LIFO batch:63
[    0.000000] On node 0, zone DMA32: 512 pages in unavailable ranges
[    0.000000] percpu: Embedded 32 pages/cpu s92376 r8192 d30504 u131072
[    0.000000] pcpu-alloc: s92376 r8192 d30504 u131072 alloc=32*4096
[    0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3 
[    0.000000] Detected PIPT I-cache on CPU0
[    0.000000] CPU features: detected: Spectre-v2
[    0.000000] CPU features: detected: Spectre-v4
[    0.000000] CPU features: detected: ARM errata 1165522, 1319367, or 1530923
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 1009408
[    0.000000] Kernel command line: coherent_pool=1M 8250.nr_uarts=0 snd_bcm2835.enable_compat_alsa=0 snd_bcm2835.enable_hdmi=1 video=HDMI-A-1:1600x1200M@60 smsc95xx.macaddr=DC:A6:32:0E:CD:AA vc_mem.mem_base=0x3f000000 vc_mem.mem_size=0x3f600000  dwc_otg.lpm_enable=0 rootfstype=ext4 rootwait dwc_otg.lpm_enable=0 rootwait vt.global_cursor_default=0 console=null cgroup_enable=memory root=UUID=ba1eadef-0578-47e8-a91d-5cd49a51fef3 rootwait
[    0.000000] cgroup: Enabling memory control group subsystem
[    0.000000] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)
[    0.000000] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] software IO TLB: mapped [mem 0x000000003a600000-0x000000003e600000] (64MB)
[    0.000000] Memory: 3594544K/4102144K available (11392K kernel code, 2022K rwdata, 4456K rodata, 14208K init, 1284K bss, 179920K reserved, 327680K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.000000] ftrace: allocating 44233 entries in 173 pages
[    0.000000] ftrace: allocated 173 pages with 5 groups
[    0.000000] rcu: Preemptible hierarchical RCU implementation.
[    0.000000] rcu:     RCU event tracing is enabled.
[    0.000000] rcu:     RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=4.
[    0.000000]  Trampoline variant of Tasks RCU enabled.
[    0.000000]  Rude variant of Tasks RCU enabled.
[    0.000000]  Tracing variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
[    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] GIC: Using split EOI/Deactivate mode
[    0.000000] irq_brcmstb_l2: registered L2 intc (/soc/interrupt-controller@7ef00100, parent irq: 10)
[    0.000000] random: get_random_bytes called from start_kernel+0x3a4/0x570 with crng_init=1
[    0.000000] arch_timer: cp15 timer(s) running at 54.00MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0xc743ce346, max_idle_ns: 440795203123 ns
[    0.000007] sched_clock: 56 bits at 54MHz, resolution 18ns, wraps every 4398046511102ns
[    0.000325] Console: colour dummy device 80x25
[    0.000404] Calibrating delay loop (skipped), value calculated using timer frequency.. 108.00 BogoMIPS (lpj=216000)
[    0.000441] pid_max: default: 32768 minimum: 301
[    0.000652] LSM: Security Framework initializing
[    0.000937] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    0.001017] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    0.005139] rcu: Hierarchical SRCU implementation.
[    0.006477] EFI services will not be available.
[    0.007114] smp: Bringing up secondary CPUs ...
[    0.008531] Detected PIPT I-cache on CPU1
[    0.008622] CPU1: Booted secondary processor 0x0000000001 [0x410fd083]
[    0.010045] Detected PIPT I-cache on CPU2
[    0.010109] CPU2: Booted secondary processor 0x0000000002 [0x410fd083]
[    0.011540] Detected PIPT I-cache on CPU3
[    0.011603] CPU3: Booted secondary processor 0x0000000003 [0x410fd083]
[    0.011839] smp: Brought up 1 node, 4 CPUs
[    0.011894] SMP: Total of 4 processors activated.
[    0.012021] CPU features: detected: 32-bit EL0 Support
[    0.012045] CPU features: detected: CRC32 instructions
[    0.012067] CPU features: detected: 32-bit EL1 Support
[    0.016799] CPU: All CPU(s) started at EL2
[    0.016878] alternatives: patching kernel code
[    0.018639] devtmpfs: initialized
[    0.034904] Enabled cp15_barrier support
[    0.034958] Enabled setend support
[    0.035416] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.035458] futex hash table entries: 1024 (order: 4, 65536 bytes, linear)
[    0.048337] pinctrl core: initialized pinctrl subsystem
[    0.049337] DMI not present or invalid.
[    0.049780] NET: Registered protocol family 16
[    0.053840] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations
[    0.054145] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    0.055256] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    0.055397] audit: initializing netlink subsys (disabled)
[    0.055873] audit: type=2000 audit(0.052:1): state=initialized audit_enabled=0 res=1
[    0.056658] thermal_sys: Registered thermal governor 'step_wise'
[    0.057259] cpuidle: using governor menu
[    0.057820] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
[    0.058064] ASID allocator initialised with 65536 entries
[    0.058238] Serial: AMBA PL011 UART driver
[    0.106472] bcm2835-mbox fe00b880.mailbox: mailbox enabled
[    0.112583] raspberrypi-firmware soc:firmware: Attached to firmware from 2022-01-20T13:57:04, variant start_cd
[    0.116599] raspberrypi-firmware soc:firmware: Firmware hash is bd88f66f8952d34e4e0613a85c7a6d3da49e13e2
[    0.165415] bcm2835-dma fe007000.dma: DMA legacy API manager, dmachans=0x1
[    0.170492] vgaarb: loaded
[    0.171091] SCSI subsystem initialized
[    0.171388] usbcore: registered new interface driver usbfs
[    0.171466] usbcore: registered new interface driver hub
[    0.171552] usbcore: registered new device driver usb
[    0.171993] usb_phy_generic phy: supply vcc not found, using dummy regulator
[    0.173388] Advanced Linux Sound Architecture Driver Initialized.
[    0.175006] clocksource: Switched to clocksource arch_sys_counter
[    1.593963] VFS: Disk quotas dquot_6.6.0
[    1.594101] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    1.594310] FS-Cache: Loaded
[    1.594612] CacheFiles: Loaded
[    1.595938] simple-framebuffer 3ec1f000.framebuffer: framebuffer at 0x3ec1f000, 0x3a9800 bytes, mapped to 0x(____ptrval____)
[    1.595966] simple-framebuffer 3ec1f000.framebuffer: format=r5g6b5, mode=1600x1200x16, linelength=3200
[    1.603724] Console: switching to colour frame buffer device 200x75
[    1.610768] simple-framebuffer 3ec1f000.framebuffer: fb0: simplefb registered!
[    1.625529] NET: Registered protocol family 2
[    1.626093] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    1.630086] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear)
[    1.630157] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear)
[    1.630378] TCP bind hash table entries: 32768 (order: 7, 524288 bytes, linear)
[    1.630900] TCP: Hash tables configured (established 32768 bind 32768)
[    1.631248] UDP hash table entries: 2048 (order: 4, 65536 bytes, linear)
[    1.631330] UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes, linear)
[    1.631724] NET: Registered protocol family 1
[    1.632878] RPC: Registered named UNIX socket transport module.
[    1.632903] RPC: Registered udp transport module.
[    1.632922] RPC: Registered tcp transport module.
[    1.632941] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    1.632971] PCI: CLS 0 bytes, default 64
[    1.747398] hw perfevents: enabled with armv8_cortex_a72 PMU driver, 7 counters available
[    1.747764] kvm [1]: IPA Size Limit: 44 bits
[    1.749269] kvm [1]: vgic interrupt IRQ9
[    1.749618] kvm [1]: Hyp mode initialized successfully
[    1.753515] Initialise system trusted keyrings
[    1.753935] workingset: timestamp_bits=46 max_order=20 bucket_order=0
[    1.763187] zbud: loaded
[    1.765389] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    1.765729] FS-Cache: Netfs 'nfs' registered for caching
[    1.766646] NFS: Registering the id_resolver key type
[    1.766694] Key type id_resolver registered
[    1.766714] Key type id_legacy registered
[    1.766889] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[    1.766913] nfs4flexfilelayout_init: NFSv4 Flexfile Layout Driver Registering...
[    1.768576] Key type asymmetric registered
[    1.768601] Asymmetric key parser 'x509' registered
[    1.768667] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    1.769008] io scheduler mq-deadline registered
[    1.769031] io scheduler kyber registered
[    1.774345] brcm-pcie fd500000.pcie: host bridge /scb/pcie@7d500000 ranges:
[    1.774389] brcm-pcie fd500000.pcie:   No bus range found for /scb/pcie@7d500000, using [bus 00-ff]
[    1.774487] brcm-pcie fd500000.pcie:      MEM 0x0600000000..0x063fffffff -> 0x00c0000000
[    1.774583] brcm-pcie fd500000.pcie:   IB MEM 0x0000000000..0x00bfffffff -> 0x0400000000
[    1.825202] brcm-pcie fd500000.pcie: link up, 5.0 GT/s PCIe x1 (SSC)
[    1.825673] brcm-pcie fd500000.pcie: PCI host bridge to bus 0000:00
[    1.825702] pci_bus 0000:00: root bus resource [bus 00-ff]
[    1.825730] pci_bus 0000:00: root bus resource [mem 0x600000000-0x63fffffff] (bus address [0xc0000000-0xffffffff])
[    1.825849] pci 0000:00:00.0: [14e4:2711] type 01 class 0x060400
[    1.826117] pci 0000:00:00.0: PME# supported from D0 D3hot
[    1.830788] pci 0000:01:00.0: [1106:3483] type 00 class 0x0c0330
[    1.830922] pci 0000:01:00.0: reg 0x10: [mem 0x00000000-0x00000fff 64bit]
[    1.831474] pci 0000:01:00.0: PME# supported from D0 D3cold
[    1.846819] pci 0000:00:00.0: BAR 8: assigned [mem 0x600000000-0x6000fffff]
[    1.846853] pci 0000:01:00.0: BAR 0: assigned [mem 0x600000000-0x600000fff 64bit]
[    1.846901] pci 0000:00:00.0: PCI bridge to [bus 01]
[    1.846932] pci 0000:00:00.0:   bridge window [mem 0x600000000-0x6000fffff]
[    1.857956] iproc-rng200 fe104000.rng: hwrng registered
[    1.858441] vc-mem: phys_addr:0x00000000 mem_base=0x3f000000 mem_size:0x3f600000(1014 MiB)
[    1.860221] gpiomem-bcm2835 fe200000.gpiomem: Initialised: Registers at 0xfe200000
[    1.872569] checking generic (3ec1f000 3a9800) vs hw (0 ffffffffffffffff)
[    1.872588] fb0: switching to vc4drmfb from simple
[    1.873026] Console: switching to colour dummy device 80x25
[    1.909193] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    1.910244] cacheinfo: Unable to detect cache hierarchy for CPU 0
[    1.925660] brd: module loaded
[    1.940927] loop: module loaded
[    1.941750] zram: Added device: zram0
[    1.944114] Loading iSCSI transport class v2.0-870.
[    1.948569] libphy: Fixed MDIO Bus: probed
[    1.949844] tun: Universal TUN/TAP device driver, 1.6
[    1.950957] bcmgenet fd580000.ethernet: GENET 5.0 EPHY: 0x0000
[    1.963085] libphy: bcmgenet MII bus: probed
[    2.023173] unimac-mdio unimac-mdio.-19: Broadcom UniMAC MDIO bus
[    2.026203] pci 0000:00:00.0: enabling device (0000 -> 0002)
[    2.026250] xhci_hcd 0000:01:00.0: enabling device (0000 -> 0002)
[    2.026369] xhci_hcd 0000:01:00.0: xHCI Host Controller
[    2.026416] xhci_hcd 0000:01:00.0: new USB bus registered, assigned bus number 1
[    2.027301] xhci_hcd 0000:01:00.0: hcc params 0x002841eb hci version 0x100 quirks 0x00000e0000000890
[    2.028450] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10
[    2.028478] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    2.028499] usb usb1: Product: xHCI Host Controller
[    2.028520] usb usb1: Manufacturer: Linux 5.10.83-v8 xhci-hcd
[    2.028540] usb usb1: SerialNumber: 0000:01:00.0
[    2.029441] hub 1-0:1.0: USB hub found
[    2.029580] hub 1-0:1.0: 1 port detected
[    2.030493] xhci_hcd 0000:01:00.0: xHCI Host Controller
[    2.030527] xhci_hcd 0000:01:00.0: new USB bus registered, assigned bus number 2
[    2.030565] xhci_hcd 0000:01:00.0: Host supports USB 3.0 SuperSpeed
[    2.031326] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.10
[    2.031351] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    2.031372] usb usb2: Product: xHCI Host Controller
[    2.031393] usb usb2: Manufacturer: Linux 5.10.83-v8 xhci-hcd
[    2.031412] usb usb2: SerialNumber: 0000:01:00.0
[    2.032279] hub 2-0:1.0: USB hub found
[    2.032384] hub 2-0:1.0: 4 ports detected
[    2.034502] dwc_otg: version 3.00a 10-AUG-2012 (platform bus)
[    2.034893] dwc_otg: FIQ enabled
[    2.034908] dwc_otg: NAK holdoff enabled
[    2.034921] dwc_otg: FIQ split-transaction FSM enabled
[    2.034939] Module dwc_common_port init
[    2.035666] usbcore: registered new interface driver uas
[    2.035790] usbcore: registered new interface driver usb-storage
[    2.035944] usbcore: registered new interface driver usbserial_generic
[    2.036016] usbserial: USB Serial support registered for generic
[    2.036317] mousedev: PS/2 mouse device common for all mice
[    2.039690] bcm2835-wdt bcm2835-wdt: Broadcom BCM2835 watchdog timer
[    2.045368] sdhci: Secure Digital Host Controller Interface driver
[    2.045391] sdhci: Copyright(c) Pierre Ossman
[    2.046383] mmc-bcm2835 fe300000.mmcnr: could not get clk, deferring probe
[    2.047843] sdhci-pltfm: SDHCI platform and OF driver helper
[    2.051496] ledtrig-cpu: registered to indicate activity on CPUs
[    2.051703] hid: raw HID events driver (C) Jiri Kosina
[    2.051820] usbcore: registered new interface driver usbhid
[    2.051829] usbhid: USB HID core driver
[    2.052057] ashmem: initialized
[    2.057132] IPVS: Registered protocols (TCP, UDP, SCTP, AH, ESP)
[    2.057175] IPVS: Connection hash table configured (size=4096, memory=64Kbytes)
[    2.057632] IPVS: ipvs loaded.
[    2.057996] Initializing XFRM netlink socket
[    2.058362] NET: Registered protocol family 10
[    2.059266] Segment Routing with IPv6
[    2.059351] NET: Registered protocol family 17
[    2.059395] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[    2.059479] Key type dns_resolver registered
[    2.060013] registered taskstats version 1
[    2.060034] Loading compiled-in X.509 certificates
[    2.060347] Key type ._fscrypt registered
[    2.060359] Key type .fscrypt registered
[    2.060369] Key type fscrypt-provisioning registered
[    2.069133] uart-pl011 fe201000.serial: there is not valid maps for state default
[    2.069330] uart-pl011 fe201000.serial: cts_event_workaround enabled
[    2.069411] fe201000.serial: ttyAMA0 at MMIO 0xfe201000 (irq = 23, base_baud = 0) is a PL011 rev2
[    2.078303] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    2.078820] bcm2835-power bcm2835-power: Broadcom BCM2835 power domains driver
[    2.080108] mmc-bcm2835 fe300000.mmcnr: mmc_debug:0 mmc_debug2:0
[    2.080119] mmc-bcm2835 fe300000.mmcnr: DMA channel allocated
[    2.110644] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    2.120670] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    2.122462] of_cfs_init
[    2.122542] of_cfs_init: OK
[    2.129725] mmc1: queuing unknown CIS tuple 0x80 (2 bytes)
[    2.131356] mmc1: queuing unknown CIS tuple 0x80 (3 bytes)
[    2.132973] mmc1: queuing unknown CIS tuple 0x80 (3 bytes)
[    2.135918] mmc1: queuing unknown CIS tuple 0x80 (7 bytes)
[    2.137577] mmc1: queuing unknown CIS tuple 0x80 (3 bytes)
[    2.143515] mmc0: SDHCI controller on fe340000.mmc [fe340000.mmc] using ADMA
[    2.147154] ALSA device list:
[    2.147177]   No soundcards found.
[    2.147269] Warning: unable to open an initial console.
[    2.149953] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    2.168633] Freeing unused kernel memory: 14208K
[    2.179079] Run /init as init process
[    2.179088]   with arguments:
[    2.179126]     /init
[    2.179131]   with environment:
[    2.179137]     HOME=/
[    2.179141]     TERM=linux
[    2.203390] mmc1: new high speed SDIO card at address 0001
[    2.248926] mmc0: new ultra high speed DDR50 SDHC card at address aaaa
[    2.249597] mmcblk0: mmc0:aaaa SB32G 29.7 GiB
[    2.253590]  mmcblk0: p1 p2 p3 p4 < p5 p6 >
[    2.257719] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    2.291052] usb 1-1: new high-speed USB device number 2 using xhci_hcd
[    2.441682] usb 1-1: New USB device found, idVendor=2109, idProduct=3431, bcdDevice= 4.21
[    2.441705] usb 1-1: New USB device strings: Mfr=0, Product=1, SerialNumber=0
[    2.441719] usb 1-1: Product: USB2.0 Hub
[    2.443390] hub 1-1:1.0: USB hub found
[    2.443709] hub 1-1:1.0: 4 ports detected
[    2.455647] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    2.567473] usb 2-2: new SuperSpeed Gen 1 USB device number 2 using xhci_hcd
[    2.588657] usb 2-2: New USB device found, idVendor=174c, idProduct=55aa, bcdDevice= 1.00
[    2.588682] usb 2-2: New USB device strings: Mfr=2, Product=3, SerialNumber=1
[    2.588698] usb 2-2: Product:  SA400S37240G
[    2.588712] usb 2-2: Manufacturer: KINGSTON
[    2.588726] usb 2-2: SerialNumber: 12345679BBFF
[    2.599182] scsi host0: uas
[    2.602690] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    2.603426] scsi 0:0:0:0: Direct-Access     KINGSTON  SA400S37240G    0    PQ: 0 ANSI: 6
[    2.605141] sd 0:0:0:0: [sda] 468862128 512-byte logical blocks: (240 GB/224 GiB)
[    2.605288] sd 0:0:0:0: [sda] Write Protect is off
[    2.605301] sd 0:0:0:0: [sda] Mode Sense: 43 00 00 00
[    2.605984] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    2.606592] sd 0:0:0:0: [sda] Optimal transfer size 33553920 bytes
[    2.643326]  sda: sda1
[    2.645444] sd 0:0:0:0: [sda] Attached SCSI disk
[    2.648240] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    2.751026] usb 1-1.3: new full-speed USB device number 3 using xhci_hcd
[    2.865475] usb 1-1.3: New USB device found, idVendor=046d, idProduct=c534, bcdDevice=29.01
[    2.865493] usb 1-1.3: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    2.865503] usb 1-1.3: Product: USB Receiver
[    2.865512] usb 1-1.3: Manufacturer: Logitech
[    2.875851] input: Logitech USB Receiver as /devices/platform/scb/fd500000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/usb1/1-1/1-1.3/1-1.3:1.0/0003:046D:C534.0001/input/input0
[    2.936070] hid-generic 0003:046D:C534.0001: input,hidraw0: USB HID v1.11 Keyboard [Logitech USB Receiver] on usb-0000:01:00.0-1.3/input0
[    2.939448] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    2.950434] input: Logitech USB Receiver Mouse as /devices/platform/scb/fd500000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/usb1/1-1/1-1.3/1-1.3:1.1/0003:046D:C534.0002/input/input1
[    2.951101] input: Logitech USB Receiver Consumer Control as /devices/platform/scb/fd500000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/usb1/1-1/1-1.3/1-1.3:1.1/0003:046D:C534.0002/input/input2
[    2.956610] zram0: detected capacity change from 0 to 2015453184
[    3.011383] input: Logitech USB Receiver System Control as /devices/platform/scb/fd500000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/usb1/1-1/1-1.3/1-1.3:1.1/0003:046D:C534.0002/input/input3
[    3.011830] hid-generic 0003:046D:C534.0002: input,hiddev96,hidraw1: USB HID v1.11 Mouse [Logitech USB Receiver] on usb-0000:01:00.0-1.3/input1
[    3.014767] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    4.571367] EXT4-fs (mmcblk0p2): mounted filesystem with ordered data mode. Opts: (null)
[    4.606710] EXT4-fs (mmcblk0p5): mounted filesystem with ordered data mode. Opts: (null)
[    5.012668] EXT4-fs (mmcblk0p2): re-mounted. Opts: (null)
[    5.164953] EXT4-fs (mmcblk0p6): mounted filesystem with ordered data mode. Opts: (null)
[    5.481903] systemd[1]: System time before build time, advancing clock.
[    5.827567] systemd[1]: /lib/systemd/system/balena-host.socket:5: ListenStream= references a path below legacy directory /var/run/, updating /var/run/balena-host.sock \xe2\x86\x92 /run/balena-host.sock; please update the unit file accordingly.
[    5.848778] systemd[1]: /lib/systemd/system/balena-engine.socket:7: ListenStream= references a path below legacy directory /var/run/, updating /var/run/balena-engine.sock \xe2\x86\x92 /run/balena-engine.sock; please update the unit file accordingly.
[    6.028146] systemd[1]: /lib/systemd/system/plymouth-start.service:17: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed.
[    6.067271] random: systemd: uninitialized urandom read (16 bytes read)
[    6.106101] random: systemd: uninitialized urandom read (16 bytes read)
[    6.108102] random: systemd: uninitialized urandom read (16 bytes read)
[    6.200658] fuse: init (API version 7.32)
[    7.353144] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    7.408323] rpivid-mem feb00000.hevc-decoder: rpivid-hevcmem initialised: Registers at 0xfeb00000 length 0x00010000
[    7.411066] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    7.428923] rpivid-mem feb10000.rpivid-local-intc: rpivid-intcmem initialised: Registers at 0xfeb10000 length 0x00001000
[    7.431798] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    7.438672] rpivid-mem feb20000.h264-decoder: rpivid-h264mem initialised: Registers at 0xfeb20000 length 0x00010000
[    7.441923] rpivid-mem feb30000.vp9-decoder: rpivid-vp9mem initialised: Registers at 0xfeb30000 length 0x00010000
[    7.442577] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    7.445741] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    7.473192] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    7.486956] brcmstb-i2c fef04500.i2c:  @97500hz registered in polling mode
[    7.489695] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    7.500467] brcmstb-i2c fef09500.i2c:  @97500hz registered in polling mode
[    7.507950] vc_sm_cma: module is from the staging directory, the quality is unknown, you have been warned.
[    7.509031] bcm2835_vc_sm_cma_probe: Videocore shared memory driver
[    7.509045] [vc_sm_connected_init]: start
[    7.509542] Registered IR keymap rc-cec
[    7.509714] rc rc0: vc4 as /devices/platform/soc/fef00700.hdmi/rc/rc0
[    7.509921] input: vc4 as /devices/platform/soc/fef00700.hdmi/rc/rc0/input6
[    7.511298] vc_sm_cma_vchi_init: failed to open VCHI service (-1)
[    7.511311] [vc_sm_connected_init]: failed to initialize shared memory service
[    7.513778] vc4-drm gpu: bound fef00700.hdmi (ops vc4_hdmi_ops)
[    7.520286] Registered IR keymap rc-cec
[    7.520412] rc rc1: vc4 as /devices/platform/soc/fef05700.hdmi/rc/rc1
[    7.520528] input: vc4 as /devices/platform/soc/fef05700.hdmi/rc/rc1/input7
[    7.523338] vc4-drm gpu: bound fef05700.hdmi (ops vc4_hdmi_ops)
[    7.523522] vc4-drm gpu: bound fe004000.txp (ops vc4_txp_ops)
[    7.523648] vc4-drm gpu: bound fe206000.pixelvalve (ops vc4_crtc_ops)
[    7.523768] vc4-drm gpu: bound fe207000.pixelvalve (ops vc4_crtc_ops)
[    7.523891] vc4-drm gpu: bound fe20a000.pixelvalve (ops vc4_crtc_ops)
[    7.523980] vc4-drm gpu: bound fe216000.pixelvalve (ops vc4_crtc_ops)
[    7.524097] vc4-drm gpu: bound fec12000.pixelvalve (ops vc4_crtc_ops)
[    7.528204] mc: Linux media interface: v0.10
[    7.531313] [drm] Initialized vc4 0.0.0 20140616 for gpu on minor 0
[    7.566296] videodev: Linux video capture interface: v2.00
[    7.588998] Console: switching to colour frame buffer device 200x75
[    7.611197] vc4-drm gpu: [drm] fb0: vc4drmfb frame buffer device
[    7.617886] bcm2835_mmal_vchiq: module is from the staging directory, the quality is unknown, you have been warned.
[    7.619627] bcm2835_mmal_vchiq: module is from the staging directory, the quality is unknown, you have been warned.
[    7.648586] bcm2835_v4l2: module is from the staging directory, the quality is unknown, you have been warned.
[    7.652625] bcm2835_mmal_vchiq: Failed to open VCHI service connection (status=-1)
[    7.652879] bcm2835_isp: module is from the staging directory, the quality is unknown, you have been warned.
[    7.656241] bcm2835_codec: module is from the staging directory, the quality is unknown, you have been warned.
[    7.668071] bcm2835_mmal_vchiq: Failed to open VCHI service connection (status=-1)
[    7.673137] [drm] Initialized v3d 1.0.0 20180419 for fec00000.v3d on minor 1
[    7.673800] bcm2835_mmal_vchiq: Failed to open VCHI service connection (status=-1)
[    7.675464] : Unregister from media controller
[    7.675477] (efault): Unregistering node (null)[0] device node /dev/video0
[    7.675484] (efault): Unregistering node (null)[0] device node /dev/video0
[    7.675490] (efault): Unregistering node (null)[0] device node /dev/video0
[    7.675497] (efault): Unregistering node (null)[0] device node /dev/video0
[    7.747961] logitech-djreceiver 0003:046D:C534.0001: hidraw0: USB HID v1.11 Keyboard [Logitech USB Receiver] on usb-0000:01:00.0-1.3/input0
[    7.761139] zram: Can't change algorithm for initialized device
[    7.834526] cfg80211: Loading compiled-in X.509 certificates for regulatory database
[    7.859286] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
[    7.892482] brcmfmac: F1 signature read @0x18000000=0x15264345
[    7.908617] brcmfmac: brcmf_fw_alloc_request: using brcm/brcmfmac43455-sdio for chip BCM4345/6
[    7.909354] usbcore: registered new interface driver brcmfmac
[    7.986587] logitech-djreceiver 0003:046D:C534.0002: hiddev96,hidraw1: USB HID v1.11 Mouse [Logitech USB Receiver] on usb-0000:01:00.0-1.3/input1
[    8.054112] logitech-djreceiver 0003:046D:C534.0002: device of type eQUAD nano Lite (0x0a) connected on slot 1
[    8.056055] input: Logitech Wireless Keyboard PID:4023 Keyboard as /devices/platform/scb/fd500000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/usb1/1-1/1-1.3/1-1.3:1.1/0003:046D:C534.0002/0003:046D:4023.0003/input/input8
[    8.056774] input: Logitech Wireless Keyboard PID:4023 Consumer Control as /devices/platform/scb/fd500000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/usb1/1-1/1-1.3/1-1.3:1.1/0003:046D:C534.0002/0003:046D:4023.0003/input/input9
[    8.057003] input: Logitech Wireless Keyboard PID:4023 System Control as /devices/platform/scb/fd500000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/usb1/1-1/1-1.3/1-1.3:1.1/0003:046D:C534.0002/0003:046D:4023.0003/input/input10
[    8.057286] hid-generic 0003:046D:4023.0003: input,hidraw2: USB HID v1.11 Keyboard [Logitech Wireless Keyboard PID:4023] on usb-0000:01:00.0-1.3/input1:1
[    8.070102] logitech-djreceiver 0003:046D:C534.0002: device of type eQUAD nano Lite (0x0a) connected on slot 2
[    8.071496] input: Logitech Wireless Mouse PID:4054 Mouse as /devices/platform/scb/fd500000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/usb1/1-1/1-1.3/1-1.3:1.1/0003:046D:C534.0002/0003:046D:4054.0004/input/input15
[    8.071886] hid-generic 0003:046D:4054.0004: input,hidraw3: USB HID v1.11 Mouse [Logitech Wireless Mouse PID:4054] on usb-0000:01:00.0-1.3/input1:2
[    8.142542] brcmfmac: brcmf_fw_alloc_request: using brcm/brcmfmac43455-sdio for chip BCM4345/6
[    8.142688] brcmfmac: brcmf_fw_alloc_request: using brcm/brcmfmac43455-sdio for chip BCM4345/6
[    8.152604] brcmfmac: brcmf_c_preinit_dcmds: Firmware: BCM4345/6 wl0: Jan  4 2021 19:56:29 version 7.45.229 (617f1f5 CY) FWID 01-2dbd9d2e
[    8.207063] random: crng init done
[    8.207075] random: 7 urandom warning(s) missed due to ratelimiting
[    8.694667] input: Logitech Wireless Keyboard PID:4023 as /devices/platform/scb/fd500000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/usb1/1-1/1-1.3/1-1.3:1.1/0003:046D:C534.0002/0003:046D:4023.0003/input/input19
[    8.696084] logitech-hidpp-device 0003:046D:4023.0003: input,hidraw2: USB HID v1.11 Keyboard [Logitech Wireless Keyboard PID:4023] on usb-0000:01:00.0-1.3/input1:1
[    8.790585] input: Logitech Wireless Mouse as /devices/platform/scb/fd500000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/usb1/1-1/1-1.3/1-1.3:1.1/0003:046D:C534.0002/0003:046D:4054.0004/input/input20
[    8.791591] logitech-hidpp-device 0003:046D:4054.0004: input,hidraw3: USB HID v1.11 Mouse [Logitech Wireless Mouse] on usb-0000:01:00.0-1.3/input1:2
[    9.119094] Adding 1968212k swap on /dev/zram0.  Priority:-2 extents:1 across:1968212k SSFS
[    9.340674] uart-pl011 fe201000.serial: no DMA platform data
[   11.713881] i2c /dev entries driver
[   12.819958] bcmgenet fd580000.ethernet: configuring instance for external RGMII (RX delay)
[   12.823343] bcmgenet fd580000.ethernet eth0: Link is Down
[   12.871913] brcmfmac: brcmf_cfg80211_set_power_mgmt: power save disabled
[   13.416372] brcmfmac: brcmf_cfg80211_set_power_mgmt: power save disabled
[   16.086331] Bluetooth: Core ver 2.22
[   16.086482] NET: Registered protocol family 31
[   16.086491] Bluetooth: HCI device and connection manager initialized
[   16.086518] Bluetooth: HCI socket layer initialized
[   16.086532] Bluetooth: L2CAP socket layer initialized
[   16.086557] Bluetooth: SCO socket layer initialized
[   16.098975] Bluetooth: HCI UART driver ver 2.3
[   16.099024] Bluetooth: HCI UART protocol H4 registered
[   16.099126] Bluetooth: HCI UART protocol Three-wire (H5) registered
[   16.099411] Bluetooth: HCI UART protocol Broadcom registered
[   16.541023] Bluetooth: BNEP (Ethernet Emulation) ver 1.3
[   16.541035] Bluetooth: BNEP filters: protocol multicast
[   16.541056] Bluetooth: BNEP socket layer initialized
[   16.557564] NET: Registered protocol family 38
[   16.838263] brcmfmac: brcmf_cfg80211_set_power_mgmt: power save disabled
[   22.126553] IPv6: ADDRCONF(NETDEV_CHANGE): wlan0: link becomes ready
[   33.576321] Bridge firewalling registered
[   35.982986] cgroup: cgroup: disabling cgroup2 socket matching due to net_prio or net_cls activation
[   51.040065] EXT4-fs (mmcblk0p3): mounted filesystem with ordered data mode. Opts: (null)
[  427.519974] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[ 1547.752998] logitech-hidpp-device 0003:046D:4054.0004: HID++ 4.5 device connected.
root@e82a8ec:~# 

[alexgg]

Hi David, maybe try disabling USB autosuspend for that device?

[David]

Hey @alexgg, no dice:

Connecting to e82a8ecaf2b58ac3895b5c54130987a7...
Spawning shell...
=============================================================
    Welcome to balenaOS
=============================================================
root@e82a8ec:~# cat /mnt/boot/cmdline.txt 
usbcore.autosuspend=-1 dwc_otg.lpm_enable=0 rootfstype=ext4 rootwait dwc_otg.lpm_enable=0 rootwait vt.global_cursor_default=0 console=null cgroup_enable=memory
root@e82a8ec:~# mount /dev/sda1 /mnt/data/ssd
root@e82a8ec:~# dd if=/dev/zero of=/mnt/data/ssd/test bs=64k count=16k conv=fdatasync; rm -rf /mnt/data/ssd/test
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.96993 s, 135 MB/s
root@e82a8ec:~# dd if=/dev/zero of=/mnt/data/ssd/test bs=64k count=16k conv=fdatasync; rm -rf /mnt/data/ssd/test
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.89854 s, 136 MB/s
root@e82a8ec:~# dmesg
[    0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd083]
[    0.000000] Linux version 5.10.83-v8 (oe-user@oe-host) (aarch64-poky-linux-gcc (GCC) 11.2.0, GNU ld (GNU Binutils) 2.37.20210721) #1 SMP PREEMPT Tue Dec 7 13:42:57 UTC 2021
[    0.000000] random: fast init done
[    0.000000] Machine model: Raspberry Pi 4 Model B Rev 1.1
[    0.000000] efi: UEFI not found.
[    0.000000] Reserved memory: created CMA memory pool at 0x000000001ac00000, size 320 MiB
[    0.000000] OF: reserved mem: initialized node linux,cma, compatible id shared-dma-pool
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000000000-0x000000003fffffff]
[    0.000000]   DMA32    [mem 0x0000000040000000-0x00000000fbffffff]
[    0.000000]   Normal   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000000000-0x0000000037ffffff]
[    0.000000]   node   0: [mem 0x0000000040000000-0x00000000fbffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x00000000fbffffff]
[    0.000000] On node 0 totalpages: 999424
[    0.000000]   DMA zone: 3584 pages used for memmap
[    0.000000]   DMA zone: 0 pages reserved
[    0.000000]   DMA zone: 229376 pages, LIFO batch:63
[    0.000000]   DMA32 zone: 12032 pages used for memmap
[    0.000000]   DMA32 zone: 770048 pages, LIFO batch:63
[    0.000000] percpu: Embedded 32 pages/cpu s92376 r8192 d30504 u131072
[    0.000000] pcpu-alloc: s92376 r8192 d30504 u131072 alloc=32*4096
[    0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3 
[    0.000000] Detected PIPT I-cache on CPU0
[    0.000000] CPU features: detected: Spectre-v2
[    0.000000] CPU features: detected: Spectre-v4
[    0.000000] CPU features: detected: ARM errata 1165522, 1319367, or 1530923
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 983808
[    0.000000] Kernel command line: coherent_pool=1M 8250.nr_uarts=0 snd_bcm2835.enable_compat_alsa=0 snd_bcm2835.enable_hdmi=1 video=HDMI-A-1:1600x1200M@60 smsc95xx.macaddr=DC:A6:32:0E:CD:AA vc_mem.mem_base=0x3ec00000 vc_mem.mem_size=0x40000000  usbcore.autosuspend=-1 dwc_otg.lpm_enable=0 rootfstype=ext4 rootwait dwc_otg.lpm_enable=0 rootwait vt.global_cursor_default=0 console=null cgroup_enable=memory root=UUID=ba1eadef-0578-47e8-a91d-5cd49a51fef3 rootwait
[    0.000000] cgroup: Enabling memory control group subsystem
[    0.000000] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)
[    0.000000] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] software IO TLB: mapped [mem 0x0000000034000000-0x0000000038000000] (64MB)
[    0.000000] Memory: 3490300K/3997696K available (11392K kernel code, 2022K rwdata, 4456K rodata, 14208K init, 1284K bss, 179716K reserved, 327680K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.000000] ftrace: allocating 44233 entries in 173 pages
[    0.000000] ftrace: allocated 173 pages with 5 groups
[    0.000000] rcu: Preemptible hierarchical RCU implementation.
[    0.000000] rcu:     RCU event tracing is enabled.
[    0.000000] rcu:     RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=4.
[    0.000000]  Trampoline variant of Tasks RCU enabled.
[    0.000000]  Rude variant of Tasks RCU enabled.
[    0.000000]  Tracing variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
[    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] GIC: Using split EOI/Deactivate mode
[    0.000000] irq_brcmstb_l2: registered L2 intc (/soc/interrupt-controller@7ef00100, parent irq: 10)
[    0.000000] random: get_random_bytes called from start_kernel+0x3a4/0x570 with crng_init=1
[    0.000000] arch_timer: cp15 timer(s) running at 54.00MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0xc743ce346, max_idle_ns: 440795203123 ns
[    0.000007] sched_clock: 56 bits at 54MHz, resolution 18ns, wraps every 4398046511102ns
[    0.000331] Console: colour dummy device 80x25
[    0.000410] Calibrating delay loop (skipped), value calculated using timer frequency.. 108.00 BogoMIPS (lpj=216000)
[    0.000447] pid_max: default: 32768 minimum: 301
[    0.000665] LSM: Security Framework initializing
[    0.000960] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    0.001041] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    0.005251] rcu: Hierarchical SRCU implementation.
[    0.006607] EFI services will not be available.
[    0.007257] smp: Bringing up secondary CPUs ...
[    0.008698] Detected PIPT I-cache on CPU1
[    0.008796] CPU1: Booted secondary processor 0x0000000001 [0x410fd083]
[    0.010234] Detected PIPT I-cache on CPU2
[    0.010299] CPU2: Booted secondary processor 0x0000000002 [0x410fd083]
[    0.011753] Detected PIPT I-cache on CPU3
[    0.011817] CPU3: Booted secondary processor 0x0000000003 [0x410fd083]
[    0.012054] smp: Brought up 1 node, 4 CPUs
[    0.012112] SMP: Total of 4 processors activated.
[    0.012135] CPU features: detected: 32-bit EL0 Support
[    0.012157] CPU features: detected: CRC32 instructions
[    0.012178] CPU features: detected: 32-bit EL1 Support
[    0.016981] CPU: All CPU(s) started at EL2
[    0.017060] alternatives: patching kernel code
[    0.018855] devtmpfs: initialized
[    0.035361] Enabled cp15_barrier support
[    0.035420] Enabled setend support
[    0.035890] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.035932] futex hash table entries: 1024 (order: 4, 65536 bytes, linear)
[    0.049354] pinctrl core: initialized pinctrl subsystem
[    0.050389] DMI not present or invalid.
[    0.050850] NET: Registered protocol family 16
[    0.055001] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations
[    0.055306] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    0.056442] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    0.056590] audit: initializing netlink subsys (disabled)
[    0.057069] audit: type=2000 audit(0.056:1): state=initialized audit_enabled=0 res=1
[    0.057819] thermal_sys: Registered thermal governor 'step_wise'
[    0.058442] cpuidle: using governor menu
[    0.059017] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
[    0.059268] ASID allocator initialised with 65536 entries
[    0.059446] Serial: AMBA PL011 UART driver
[    0.107796] bcm2835-mbox fe00b880.mailbox: mailbox enabled
[    0.116849] raspberrypi-firmware soc:firmware: Attached to firmware from 2022-01-20T13:56:48, variant start
[    0.120863] raspberrypi-firmware soc:firmware: Firmware hash is bd88f66f8952d34e4e0613a85c7a6d3da49e13e2
[    0.169718] bcm2835-dma fe007000.dma: DMA legacy API manager, dmachans=0x1
[    0.174812] vgaarb: loaded
[    0.175436] SCSI subsystem initialized
[    0.175737] usbcore: registered new interface driver usbfs
[    0.175815] usbcore: registered new interface driver hub
[    0.175906] usbcore: registered new device driver usb
[    0.176349] usb_phy_generic phy: supply vcc not found, using dummy regulator
[    0.177732] Advanced Linux Sound Architecture Driver Initialized.
[    0.179399] clocksource: Switched to clocksource arch_sys_counter
[    1.600511] VFS: Disk quotas dquot_6.6.0
[    1.600655] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    1.600872] FS-Cache: Loaded
[    1.601196] CacheFiles: Loaded
[    1.602671] simple-framebuffer 3e474000.framebuffer: framebuffer at 0x3e474000, 0x753000 bytes, mapped to 0x(____ptrval____)
[    1.602699] simple-framebuffer 3e474000.framebuffer: format=a8r8g8b8, mode=1600x1200x32, linelength=6400
[    1.614955] Console: switching to colour frame buffer device 200x75
[    1.626514] simple-framebuffer 3e474000.framebuffer: fb0: simplefb registered!
[    1.641277] NET: Registered protocol family 2
[    1.641867] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    1.645900] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear)
[    1.645974] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear)
[    1.646210] TCP bind hash table entries: 32768 (order: 7, 524288 bytes, linear)
[    1.646763] TCP: Hash tables configured (established 32768 bind 32768)
[    1.647024] UDP hash table entries: 2048 (order: 4, 65536 bytes, linear)
[    1.647103] UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes, linear)
[    1.647575] NET: Registered protocol family 1
[    1.648768] RPC: Registered named UNIX socket transport module.
[    1.648792] RPC: Registered udp transport module.
[    1.648811] RPC: Registered tcp transport module.
[    1.648830] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    1.648861] PCI: CLS 0 bytes, default 64
[    1.764620] hw perfevents: enabled with armv8_cortex_a72 PMU driver, 7 counters available
[    1.764983] kvm [1]: IPA Size Limit: 44 bits
[    1.766525] kvm [1]: vgic interrupt IRQ9
[    1.766878] kvm [1]: Hyp mode initialized successfully
[    1.770845] Initialise system trusted keyrings
[    1.771282] workingset: timestamp_bits=46 max_order=20 bucket_order=0
[    1.780646] zbud: loaded
[    1.782895] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    1.783244] FS-Cache: Netfs 'nfs' registered for caching
[    1.784218] NFS: Registering the id_resolver key type
[    1.784273] Key type id_resolver registered
[    1.784294] Key type id_legacy registered
[    1.784472] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[    1.784496] nfs4flexfilelayout_init: NFSv4 Flexfile Layout Driver Registering...
[    1.786160] Key type asymmetric registered
[    1.786186] Asymmetric key parser 'x509' registered
[    1.786253] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    1.786587] io scheduler mq-deadline registered
[    1.786611] io scheduler kyber registered
[    1.792100] brcm-pcie fd500000.pcie: host bridge /scb/pcie@7d500000 ranges:
[    1.792147] brcm-pcie fd500000.pcie:   No bus range found for /scb/pcie@7d500000, using [bus 00-ff]
[    1.792234] brcm-pcie fd500000.pcie:      MEM 0x0600000000..0x063fffffff -> 0x00c0000000
[    1.792329] brcm-pcie fd500000.pcie:   IB MEM 0x0000000000..0x00bfffffff -> 0x0400000000
[    1.841526] brcm-pcie fd500000.pcie: link up, 5.0 GT/s PCIe x1 (SSC)
[    1.842000] brcm-pcie fd500000.pcie: PCI host bridge to bus 0000:00
[    1.842030] pci_bus 0000:00: root bus resource [bus 00-ff]
[    1.842058] pci_bus 0000:00: root bus resource [mem 0x600000000-0x63fffffff] (bus address [0xc0000000-0xffffffff])
[    1.842181] pci 0000:00:00.0: [14e4:2711] type 01 class 0x060400
[    1.842453] pci 0000:00:00.0: PME# supported from D0 D3hot
[    1.846920] pci 0000:01:00.0: [1106:3483] type 00 class 0x0c0330
[    1.847055] pci 0000:01:00.0: reg 0x10: [mem 0x00000000-0x00000fff 64bit]
[    1.847605] pci 0000:01:00.0: PME# supported from D0 D3cold
[    1.851820] pci 0000:00:00.0: BAR 8: assigned [mem 0x600000000-0x6000fffff]
[    1.851854] pci 0000:01:00.0: BAR 0: assigned [mem 0x600000000-0x600000fff 64bit]
[    1.851903] pci 0000:00:00.0: PCI bridge to [bus 01]
[    1.851935] pci 0000:00:00.0:   bridge window [mem 0x600000000-0x6000fffff]
[    1.863214] iproc-rng200 fe104000.rng: hwrng registered
[    1.863795] vc-mem: phys_addr:0x00000000 mem_base=0x3ec00000 mem_size:0x40000000(1024 MiB)
[    1.865576] gpiomem-bcm2835 fe200000.gpiomem: Initialised: Registers at 0xfe200000
[    1.877865] checking generic (3e474000 753000) vs hw (0 ffffffffffffffff)
[    1.877884] fb0: switching to vc4drmfb from simple
[    1.878363] Console: switching to colour dummy device 80x25
[    1.912211] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    1.913264] cacheinfo: Unable to detect cache hierarchy for CPU 0
[    1.928857] brd: module loaded
[    1.944101] loop: module loaded
[    1.944888] zram: Added device: zram0
[    1.947043] Loading iSCSI transport class v2.0-870.
[    1.951625] libphy: Fixed MDIO Bus: probed
[    1.952895] tun: Universal TUN/TAP device driver, 1.6
[    1.954013] bcmgenet fd580000.ethernet: GENET 5.0 EPHY: 0x0000
[    1.963470] libphy: bcmgenet MII bus: probed
[    2.019582] unimac-mdio unimac-mdio.-19: Broadcom UniMAC MDIO bus
[    2.022625] pci 0000:00:00.0: enabling device (0000 -> 0002)
[    2.022672] xhci_hcd 0000:01:00.0: enabling device (0000 -> 0002)
[    2.022788] xhci_hcd 0000:01:00.0: xHCI Host Controller
[    2.022835] xhci_hcd 0000:01:00.0: new USB bus registered, assigned bus number 1
[    2.023712] xhci_hcd 0000:01:00.0: hcc params 0x002841eb hci version 0x100 quirks 0x00000e0000000890
[    2.024857] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.10
[    2.024884] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    2.024906] usb usb1: Product: xHCI Host Controller
[    2.024927] usb usb1: Manufacturer: Linux 5.10.83-v8 xhci-hcd
[    2.024948] usb usb1: SerialNumber: 0000:01:00.0
[    2.025872] hub 1-0:1.0: USB hub found
[    2.025998] hub 1-0:1.0: 1 port detected
[    2.026920] xhci_hcd 0000:01:00.0: xHCI Host Controller
[    2.026968] xhci_hcd 0000:01:00.0: new USB bus registered, assigned bus number 2
[    2.027007] xhci_hcd 0000:01:00.0: Host supports USB 3.0 SuperSpeed
[    2.027675] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.10
[    2.027700] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    2.027721] usb usb2: Product: xHCI Host Controller
[    2.027742] usb usb2: Manufacturer: Linux 5.10.83-v8 xhci-hcd
[    2.027762] usb usb2: SerialNumber: 0000:01:00.0
[    2.028624] hub 2-0:1.0: USB hub found
[    2.028747] hub 2-0:1.0: 4 ports detected
[    2.030817] dwc_otg: version 3.00a 10-AUG-2012 (platform bus)
[    2.031205] dwc_otg: FIQ enabled
[    2.031219] dwc_otg: NAK holdoff enabled
[    2.031232] dwc_otg: FIQ split-transaction FSM enabled
[    2.031250] Module dwc_common_port init
[    2.031961] usbcore: registered new interface driver uas
[    2.032086] usbcore: registered new interface driver usb-storage
[    2.032239] usbcore: registered new interface driver usbserial_generic
[    2.032301] usbserial: USB Serial support registered for generic
[    2.032600] mousedev: PS/2 mouse device common for all mice
[    2.035962] bcm2835-wdt bcm2835-wdt: Broadcom BCM2835 watchdog timer
[    2.040064] sdhci: Secure Digital Host Controller Interface driver
[    2.040088] sdhci: Copyright(c) Pierre Ossman
[    2.041080] mmc-bcm2835 fe300000.mmcnr: could not get clk, deferring probe
[    2.043763] sdhci-pltfm: SDHCI platform and OF driver helper
[    2.045977] ledtrig-cpu: registered to indicate activity on CPUs
[    2.046185] hid: raw HID events driver (C) Jiri Kosina
[    2.046303] usbcore: registered new interface driver usbhid
[    2.046311] usbhid: USB HID core driver
[    2.046534] ashmem: initialized
[    2.051774] IPVS: Registered protocols (TCP, UDP, SCTP, AH, ESP)
[    2.051814] IPVS: Connection hash table configured (size=4096, memory=64Kbytes)
[    2.052131] IPVS: ipvs loaded.
[    2.052689] Initializing XFRM netlink socket
[    2.053210] NET: Registered protocol family 10
[    2.054243] Segment Routing with IPv6
[    2.054349] NET: Registered protocol family 17
[    2.054398] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[    2.054486] Key type dns_resolver registered
[    2.055122] registered taskstats version 1
[    2.055148] Loading compiled-in X.509 certificates
[    2.055595] Key type ._fscrypt registered
[    2.055610] Key type .fscrypt registered
[    2.055622] Key type fscrypt-provisioning registered
[    2.066947] uart-pl011 fe201000.serial: there is not valid maps for state default
[    2.067115] uart-pl011 fe201000.serial: cts_event_workaround enabled
[    2.067179] fe201000.serial: ttyAMA0 at MMIO 0xfe201000 (irq = 23, base_baud = 0) is a PL011 rev2
[    2.078671] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    2.079482] bcm2835-power bcm2835-power: Broadcom BCM2835 power domains driver
[    2.081260] mmc-bcm2835 fe300000.mmcnr: mmc_debug:0 mmc_debug2:0
[    2.081276] mmc-bcm2835 fe300000.mmcnr: DMA channel allocated
[    2.114002] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    2.121650] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    2.123455] of_cfs_init
[    2.123535] of_cfs_init: OK
[    2.133117] mmc1: queuing unknown CIS tuple 0x80 (2 bytes)
[    2.134718] mmc1: queuing unknown CIS tuple 0x80 (3 bytes)
[    2.136350] mmc1: queuing unknown CIS tuple 0x80 (3 bytes)
[    2.139217] mmc1: queuing unknown CIS tuple 0x80 (7 bytes)
[    2.140837] mmc1: queuing unknown CIS tuple 0x80 (3 bytes)
[    2.149028] mmc0: SDHCI controller on fe340000.mmc [fe340000.mmc] using ADMA
[    2.153037] ALSA device list:
[    2.153059]   No soundcards found.
[    2.153151] Warning: unable to open an initial console.
[    2.157301] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    2.170361] Freeing unused kernel memory: 14208K
[    2.179463] Run /init as init process
[    2.179473]   with arguments:
[    2.179478]     /init
[    2.179483]   with environment:
[    2.179489]     HOME=/
[    2.179494]     TERM=linux
[    2.204055] mmc1: new high speed SDIO card at address 0001
[    2.250380] mmc0: new ultra high speed DDR50 SDHC card at address aaaa
[    2.251060] mmcblk0: mmc0:aaaa SB32G 29.7 GiB
[    2.254956]  mmcblk0: p1 p2 p3 p4 < p5 p6 >
[    2.258823] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    2.283443] usb 1-1: new high-speed USB device number 2 using xhci_hcd
[    2.434624] usb 1-1: New USB device found, idVendor=2109, idProduct=3431, bcdDevice= 4.21
[    2.434647] usb 1-1: New USB device strings: Mfr=0, Product=1, SerialNumber=0
[    2.434661] usb 1-1: Product: USB2.0 Hub
[    2.436889] hub 1-1:1.0: USB hub found
[    2.437143] hub 1-1:1.0: 4 ports detected
[    2.449019] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    2.559931] usb 2-2: new SuperSpeed Gen 1 USB device number 2 using xhci_hcd
[    2.580882] usb 2-2: New USB device found, idVendor=174c, idProduct=55aa, bcdDevice= 1.00
[    2.580904] usb 2-2: New USB device strings: Mfr=2, Product=3, SerialNumber=1
[    2.580917] usb 2-2: Product:  SA400S37240G
[    2.580928] usb 2-2: Manufacturer: KINGSTON
[    2.580939] usb 2-2: SerialNumber: 12345679BBFF
[    2.592285] scsi host0: uas
[    2.596383] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    2.597075] scsi 0:0:0:0: Direct-Access     KINGSTON  SA400S37240G    0    PQ: 0 ANSI: 6
[    2.598779] sd 0:0:0:0: [sda] 468862128 512-byte logical blocks: (240 GB/224 GiB)
[    2.598951] sd 0:0:0:0: [sda] Write Protect is off
[    2.598966] sd 0:0:0:0: [sda] Mode Sense: 43 00 00 00
[    2.599237] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    2.599868] sd 0:0:0:0: [sda] Optimal transfer size 33553920 bytes
[    2.619964]  sda: sda1
[    2.622403] sd 0:0:0:0: [sda] Attached SCSI disk
[    2.625507] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    2.731433] usb 1-1.3: new full-speed USB device number 3 using xhci_hcd
[    2.841502] usb 1-1.3: New USB device found, idVendor=046d, idProduct=c534, bcdDevice=29.01
[    2.841518] usb 1-1.3: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    2.841528] usb 1-1.3: Product: USB Receiver
[    2.841537] usb 1-1.3: Manufacturer: Logitech
[    2.850425] input: Logitech USB Receiver as /devices/platform/scb/fd500000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/usb1/1-1/1-1.3/1-1.3:1.0/0003:046D:C534.0001/input/input0
[    2.908404] hid-generic 0003:046D:C534.0001: input,hidraw0: USB HID v1.11 Keyboard [Logitech USB Receiver] on usb-0000:01:00.0-1.3/input0
[    2.911819] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    2.921139] input: Logitech USB Receiver Mouse as /devices/platform/scb/fd500000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/usb1/1-1/1-1.3/1-1.3:1.1/0003:046D:C534.0002/input/input1
[    2.921557] input: Logitech USB Receiver Consumer Control as /devices/platform/scb/fd500000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/usb1/1-1/1-1.3/1-1.3:1.1/0003:046D:C534.0002/input/input2
[    2.979896] input: Logitech USB Receiver System Control as /devices/platform/scb/fd500000.pcie/pci0000:00/0000:00:00.0/0000:01:00.0/usb1/1-1/1-1.3/1-1.3:1.1/0003:046D:C534.0002/input/input3
[    2.980345] hid-generic 0003:046D:C534.0002: input,hiddev96,hidraw1: USB HID v1.11 Mouse [Logitech USB Receiver] on usb-0000:01:00.0-1.3/input1
[    2.983201] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    3.001608] zram0: detected capacity change from 0 to 1962082304
[    4.431073] EXT4-fs (mmcblk0p2): mounted filesystem with ordered data mode. Opts: (null)
[    4.461427] EXT4-fs (mmcblk0p5): mounted filesystem with ordered data mode. Opts: (null)
[    4.869435] EXT4-fs (mmcblk0p2): re-mounted. Opts: (null)
[    4.939190] EXT4-fs (mmcblk0p6): mounted filesystem with ordered data mode. Opts: (null)
[    5.199950] systemd[1]: System time before build time, advancing clock.
[    5.533721] systemd[1]: /lib/systemd/system/balena-host.socket:5: ListenStream= references a path below legacy directory /var/run/, updating /var/run/balena-host.sock \xe2\x86\x92 /run/balena-host.sock; please update the unit file accordingly.
[    5.554729] systemd[1]: /lib/systemd/system/balena-engine.socket:7: ListenStream= references a path below legacy directory /var/run/, updating /var/run/balena-engine.sock \xe2\x86\x92 /run/balena-engine.sock; please update the unit file accordingly.
[    5.729473] systemd[1]: /lib/systemd/system/plymouth-start.service:17: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed.
[    5.768411] random: systemd: uninitialized urandom read (16 bytes read)
[    5.805577] random: systemd: uninitialized urandom read (16 bytes read)
[    5.807308] random: systemd: uninitialized urandom read (16 bytes read)
[    5.899733] fuse: init (API version 7.32)
[    7.042766] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    7.084998] rpivid-mem feb00000.hevc-decoder: rpivid-hevcmem initialised: Registers at 0xfeb00000 length 0x00010000
[    7.088842] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    7.099803] rpivid-mem feb10000.rpivid-local-intc: rpivid-intcmem initialised: Registers at 0xfeb10000 length 0x00001000
[    7.102366] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    7.103170] rpivid-mem feb20000.h264-decoder: rpivid-h264mem initialised: Registers at 0xfeb20000 length 0x00010000
[    7.105874] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    7.106691] rpivid-mem feb30000.vp9-decoder: rpivid-vp9mem initialised: Registers at 0xfeb30000 length 0x00010000
[    7.109636] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    7.129200] vc_sm_cma: module is from the staging directory, the quality is unknown, you have been warned.
[    7.130896] bcm2835_vc_sm_cma_probe: Videocore shared memory driver
[    7.130912] [vc_sm_connected_init]: start
[    7.139110] [vc_sm_connected_init]: installed successfully
[    7.142710] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    7.157518] mc: Linux media interface: v0.10
[    7.163989] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    7.177936] videodev: Linux video capture interface: v2.00
[    7.199114] brcmstb-i2c fef04500.i2c:  @97500hz registered in polling mode
[    7.201961] vc4-drm gpu: bound fe400000.hvs (ops vc4_hvs_ops)
[    7.202567] brcmstb-i2c fef09500.i2c:  @97500hz registered in polling mode
[    7.204171] bcm2835_mmal_vchiq: module is from the staging directory, the quality is unknown, you have been warned.
[    7.204769] Registered IR keymap rc-cec
[    7.204932] rc rc0: vc4 as /devices/platform/soc/fef00700.hdmi/rc/rc0
[    7.205073] input: vc4 as /devices/platform/soc/fef00700.hdmi/rc/rc0/input6
[    7.206693] bcm2835_mmal_vchiq: module is from the staging directory, the quality is unknown, you have been warned.
[    7.209633] vc4-drm gpu: bound fef00700.hdmi (ops vc4_hdmi_ops)
[    7.213644] bcm2835_isp: module is from the staging directory, the quality is unknown, you have been warned.
[    7.220508] Registered IR keymap rc-cec
[    7.220670] rc rc1: vc4 as /devices/platform/soc/fef05700.hdmi/rc/rc1
[    7.220815] input: vc4 as /devices/platform/soc/fef05700.hdmi/rc/rc1/input7
[    7.221392] bcm2835_v4l2: module is from the staging directory, the quality is unknown, you have been warned.
[    7.222670] bcm2835-isp bcm2835-isp: Device node output[0] registered as /dev/video13
[    7.223485] bcm2835-isp bcm2835-isp: Device node capture[0] registered as /dev/video14
[    7.225046] bcm2835_codec: module is from the staging directory, the quality is unknown, you have been warned.
[    7.225426] bcm2835-isp bcm2835-isp: Device node capture[1] registered as /dev/video15
[    7.225963] vc4-drm gpu: bound fef05700.hdmi (ops vc4_hdmi_ops)
[    7.226208] vc4-drm gpu: bound fe004000.txp (ops vc4_txp_ops)
[    7.226351] vc4-drm gpu: bound fe206000.pixelvalve (ops vc4_crtc_ops)
[    7.226467] vc4-drm gpu: bound fe207000.pixelvalve (ops vc4_crtc_ops)
[    7.226605] vc4-drm gpu: bound fe20a000.pixelvalve (ops vc4_crtc_ops)
[    7.226621] bcm2835-isp bcm2835-isp: Device node stats[2] registered as /dev/video16
[    7.226637] bcm2835-isp bcm2835-isp: Register output node 0 with media controller
[    7.226649] bcm2835-isp bcm2835-isp: Register capture node 1 with media controller
[    7.226659] bcm2835-isp bcm2835-isp: Register capture node 2 with media controller
[    7.226673] bcm2835-isp bcm2835-isp: Register capture node 3 with media controller
[    7.226692] vc4-drm gpu: bound fe216000.pixelvalve (ops vc4_crtc_ops)
[    7.226815] vc4-drm gpu: bound fec12000.pixelvalve (ops vc4_crtc_ops)
[    7.233034] bcm2835-isp bcm2835-isp: Device node output[0] registered as /dev/video20
[    7.233894] bcm2835-isp bcm2835-isp: Device node capture[0] registered as /dev/video21
[    7.234551] bcm2835-isp bcm2835-isp: Device node capture[1] registered as /dev/video22
[    7.235088] bcm2835-isp bcm2835-isp: Device node stats[2] registered as /dev/video23
[    7.235108] bcm2835-isp bcm2835-isp: Register output node 0 with media controller
[    7.235120] bcm2835-isp bcm2835-isp: Register capture node 1 with media controller
[    7.235130] bcm2835-isp bcm2835-isp: Register capture node 2 with media controller
[    7.235139] bcm2835-isp bcm2835-isp: Register capture node 3 with media controller
[    7.235547] bcm2835-isp bcm2835-isp: Loaded V4L2 bcm2835-isp
[    7.236168] bcm2835-codec bcm2835-codec: Device registered as /dev/video10
[    7.236194] bcm2835-codec bcm2835-codec: Loaded V4L2 decode
[    7.240414] bcm2835-codec bcm2835-codec: Device registered as /dev/video11
[    7.240469] bcm2835-codec bcm2835-codec: Loaded V4L2 encode
[    7.249164] [drm] Initialized vc4 0.0.0 20140616 for gpu on minor 0
[    7.255706] bcm2835-codec bcm2835-codec: Device registered as /dev/video12
[    7.255734] bcm2835-codec bcm2835-codec: Loaded V4L2 isp
[    7.262992] bcm2835-codec bcm2835-codec: Device registered as /dev/video18
[    7.263031] bcm2835-codec bcm2835-codec: Loaded V4L2 image_fx
[    7.303099] cfg80211: Loading compiled-in X.509 certificates for regulatory database
[    7.305676] Console: switching to colour frame buffer device 200x75
[    7.311128] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
[    7.327788] vc4-drm gpu: [drm] fb0: vc4drmfb frame buffer device
[    7.353514] [drm] Initialized v3d 1.0.0 20180419 for fec00000.v3d on minor 1
[    7.365583] logitech-djreceiver 0003:046D:C534.0001: hidraw0: USB HID v1.11 Keyboard [Logitech USB Receiver] on usb-0000:01:00.0-1.3/input0
[    7.373189] brcmfmac: F1 signature read @0x18000000=0x15264345
[    7.381380] brcmfmac: brcmf_fw_alloc_request: using brcm/brcmfmac43455-sdio for chip BCM4345/6
[    7.382019] usbcore: registered new interface driver brcmfmac
[    7.522440] zram: Can't change algorithm for initialized device
[    7.612379] logitech-djreceiver 0003:046D:C534.0002: hiddev96,hidraw1: USB HID v1.11 Mouse [Logitech USB Receiver] on usb-0000:01:00.0-1.3/input1
[    7.628634] brcmfmac: brcmf_fw_alloc_request: using brcm/brcmfmac43455-sdio for chip BCM4345/6
[    7.628776] brcmfmac: brcmf_fw_alloc_request: using brcm/brcmfmac43455-sdio for chip BCM4345/6
[    7.639319] brcmfmac: brcmf_c_preinit_dcmds: Firmware: BCM4345/6 wl0: Jan  4 2021 19:56:29 version 7.45.229 (617f1f5 CY) FWID 01-2dbd9d2e
[    8.019430] random: crng init done
[    8.019446] random: 7 urandom warning(s) missed due to ratelimiting
[    8.803807] Adding 1916092k swap on /dev/zram0.  Priority:-2 extents:1 across:1916092k SSFS
[    9.113729] uart-pl011 fe201000.serial: no DMA platform data
[   11.038701] i2c /dev entries driver
[   12.179754] bcmgenet fd580000.ethernet: configuring instance for external RGMII (RX delay)
[   12.188723] bcmgenet fd580000.ethernet eth0: Link is Down
[   12.237555] brcmfmac: brcmf_cfg80211_set_power_mgmt: power save disabled
[   12.774656] brcmfmac: brcmf_cfg80211_set_power_mgmt: power save disabled
[   15.884469] Bluetooth: Core ver 2.22
[   15.884581] NET: Registered protocol family 31
[   15.884588] Bluetooth: HCI device and connection manager initialized
[   15.884606] Bluetooth: HCI socket layer initialized
[   15.884617] Bluetooth: L2CAP socket layer initialized
[   15.884636] Bluetooth: SCO socket layer initialized
[   15.893165] Bluetooth: HCI UART driver ver 2.3
[   15.893185] Bluetooth: HCI UART protocol H4 registered
[   15.893297] Bluetooth: HCI UART protocol Three-wire (H5) registered
[   15.893564] Bluetooth: HCI UART protocol Broadcom registered
[   16.163198] brcmfmac: brcmf_cfg80211_set_power_mgmt: power save disabled
[   16.337793] Bluetooth: BNEP (Ethernet Emulation) ver 1.3
[   16.337811] Bluetooth: BNEP filters: protocol multicast
[   16.337841] Bluetooth: BNEP socket layer initialized
[   16.360608] NET: Registered protocol family 38
[   21.449717] IPv6: ADDRCONF(NETDEV_CHANGE): wlan0: link becomes ready
[   29.809840] Bridge firewalling registered
[   32.234335] cgroup: cgroup: disabling cgroup2 socket matching due to net_prio or net_cls activation
[   41.143939] EXT4-fs (mmcblk0p3): mounted filesystem with ordered data mode. Opts: (null)
[  121.673168] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
root@e82a8ec:~# 

[jakogut]

Hey David, I just had a thought. The version of dd provided by balenaOS in the host OS is actually a busybox applet, and is not as optimized as what comes as part of the coreutils package. If these results are using that version of dd, I would try again with the same debian container on both OSes to rule out userspace differences first.

If that reproduces the disparity, I notice that the Raspbian kernel is a bit newer, is it possible you could downgrade the kernel to the same (or similar) version as balenaOS? Alternatively, you could probably copy the kernel, modules, and maybe even the firmware (if necessary) to your Raspbian installation to see if you get the same performance as on balenaOS. If so this would tell us if the problem is in the kernel/kconfig.

[jakogut]

Actually, I was wrong. The version of dd we ship is not a busybox applet, but I would still try a containerized version on both to rule out any differences if you haven’t already.

[David]

Will have to tackle it tomorrow @jakout, but easy enough. I’ll install a vanilla Docker on Raspbian, and use a vanilla Debian container. Then same plain Debian container on balenaOS.

[David]

No luck @jakogut @alexgg – roughly the same performance when just living in containers.

balenaOS:

Connecting to e82a8ecaf2b58ac3895b5c54130987a7...
Spawning shell...
=============================================================
    Welcome to balenaOS
=============================================================
root@e82a8ec:~# balena run --privileged -it balenalib/raspberrypi4-64-debian /bin/bash
Unable to find image 'balenalib/raspberrypi4-64-debian:latest' locally
latest: Pulling from balenalib/raspberrypi4-64-debian
2203022c5aa9: Pull complete 
ac9d75a14c91: Pull complete 
c43ad6a88b14: Pull complete 
b1b739d7cce6: Pull complete 
bb65a9041486: Pull complete 
0af6afe68c1c: Pull complete 
862f3812885a: Pull complete 
53244cb45b2b: Pull complete 
05c640b4abe5: Pull complete 
c2fef34d0927: Pull complete 
da76a24a4fd0: Pull complete 
7fb665852a6c: Pull complete 
509c75473ed9: Pull complete 
ca1e27e81389: Pull complete 
f4c3085695f5: Pull complete 
82ecba8645cc: Pull complete 
Total:  [==================================================>]   71.9MB/71.9MB
Digest: sha256:5e9a5f9dab5506943a2850562bf646ed15e7f05b910c7d0ab461aabf3198f596
Status: Downloaded newer image for balenalib/raspberrypi4-64-debian:latest
root@22f27cebd50e:/# cat /etc/os-release
PRETTY_NAME="Debian GNU/Linux 11 (bullseye)"
NAME="Debian GNU/Linux"
VERSION_ID="11"
VERSION="11 (bullseye)"
VERSION_CODENAME=bullseye
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"
root@22f27cebd50e:/# mount /dev/sda1 /mnt
root@22f27cebd50e:/# dd if=/dev/zero of=/mnt/test bs=64k count=16k conv=fdatasync; sudo rm -rf /mnt/test
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.79682 s, 138 MB/s
root@22f27cebd50e:/# dd if=/dev/zero of=/mnt/test bs=64k count=16k conv=fdatasync; sudo rm -rf /mnt/test
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 7.47684 s, 144 MB/s
root@22f27cebd50e:/# 

Raspbian:

pi@raspberrypi:~ $ docker run --privileged -it balenalib/raspberrypi4-64-debian /bin/bash
root@ce0def129877:/# cat /etc/os-release 
PRETTY_NAME="Debian GNU/Linux 11 (bullseye)"
NAME="Debian GNU/Linux"
VERSION_ID="11"
VERSION="11 (bullseye)"
VERSION_CODENAME=bullseye
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"
root@ce0def129877:/# mount /dev/sda1 /mnt
root@ce0def129877:/# dd if=/dev/zero of=/mnt/test bs=64k count=16k conv=fdatasync; sudo rm -rf /mnt/test
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 5.34601 s, 201 MB/s
root@ce0def129877:/# dd if=/dev/zero of=/mnt/test bs=64k count=16k conv=fdatasync; sudo rm -rf /mnt/test
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 5.24775 s, 205 MB/s

[jakogut]

Alrighty, do you feel up to copying the kernel and modules from balenaOS to your Raspbian install to see if that’s the culprit?

[David]

I can do it @jakout - but I’ll need some guided notes.

Which files / directories / artifacts need to get copied, and to where on Raspbian? I’m headed into uncharted territory, I’ve never hacked and mashed them up like this!

[jakogut]

You need to copy the balenaOS kernel, which is going to be in the active root partition, /balena/volumes/[volume-id]/_data/Image.gz, to the boot partition of your raspbian install. By default, the RPi firmware boots kernel8.img`, so you may need to replace this file. You can save a backup in case this doesn’t work. Also, the RPi firmware doesn’t support decompressing gzipped images, so decompress this file.

You also need to copy the modules from the balenaOS sysroot, /lib/modules/5.10.83-v8 for example, to /lib/modules in Raspbian, same path. Assuming the Raspbian kernel is close in version to the balena kernel, this should boot without any firmware changes or updates. Let me know if this helps.

[David]

@jakogut @alexgg Yes, looks like the kernel is the culprit. Those instructions above worked perfect, I dropped balenaOS kernel (5.10.83) into Raspbian, and although my speeds seem a bit higher today than last week, there is still a big perf drop compared to Raspbian native kernel 5.10.92. First, here is balenaOS kernel mashed into Raspbian:

pi@raspberrypi:~ $ sudo su
root@raspberrypi:/home/pi# dd if=/dev/zero of=/mnt/test bs=64k count=16k conv=fdatasync; rm -rf /mnt/test
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.54074 s, 164 MB/s
root@raspberrypi:/home/pi# dd if=/dev/zero of=/mnt/test bs=64k count=16k conv=fdatasync; rm -rf /mnt/test
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.59559 s, 163 MB/s
root@raspberrypi:/home/pi# uname -a
Linux raspberrypi 5.10.83-v8 #1 SMP PREEMPT Tue Dec 7 13:42:57 UTC 2021 aarch64 GNU/Linux
root@raspberrypi:/home/pi# cat /etc/os-release 
PRETTY_NAME="Debian GNU/Linux 11 (bullseye)"
NAME="Debian GNU/Linux"
VERSION_ID="11"
VERSION="11 (bullseye)"
VERSION_CODENAME=bullseye
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"
root@raspberrypi:/home/pi# 

And then here is native Raspbian:

pi@raspberrypi:~ $ sudo su
root@raspberrypi:/home/pi# dd if=/dev/zero of=/mnt/test bs=64k count=16k conv=fdatasync; rm -rf /mnt/test
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 4.9452 s, 217 MB/s
root@raspberrypi:/home/pi# dd if=/dev/zero of=/mnt/test bs=64k count=16k conv=fdatasync; rm -rf /mnt/test
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 5.01482 s, 214 MB/s
root@raspberrypi:/home/pi# uname -a
Linux raspberrypi 5.10.92-v8+ #1514 SMP PREEMPT Mon Jan 17 17:39:38 GMT 2022 aarch64 GNU/Linux
root@raspberrypi:/home/pi# cat /etc/os-release 
PRETTY_NAME="Debian GNU/Linux 11 (bullseye)"
NAME="Debian GNU/Linux"
VERSION_ID="11"
VERSION="11 (bullseye)"
VERSION_CODENAME=bullseye
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"

Not sure what they are doing differently, but they are clearly getting better USB-SSD speed.

[jakogut]

I wouldn’t be surprised if this is actually a result of our using the kernel config CONFIG_CC_OPTIMIZE_FOR_SIZE=y, which cuts down on kernel size, but at the expense of some performance. We enabled this on the Pi series of device types in this commit: linux-raspberrypi: Enable configs to reduce kernel size · balena-os/balena-raspberrypi@8adb848 · GitHub

We can confirm by trying an OS release before v2.89.3+rev1

[iayanpahwa]

Hi David, would love to also know your use case which require these write speeds if you’re okay to share

[David]

@jakogut - nice find! Flashing v2.85.2+rev3 does give me a bit better results, though still off the pace from Raspbian. There is definitely improvement here though:

root@ff978fe:~# mount /dev/sda1 /mnt/data/ssd 
root@ff978fe:~# dd if=/dev/zero of=/mnt/data/ssd/test bs=64k count=16k conv=fdatasync; rm -rf /mnt/data/ssd/test
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 5.73417 s, 187 MB/s
root@ff978fe:~# dd if=/dev/zero of=/mnt/data/ssd/test bs=64k count=16k conv=fdatasync; rm -rf /mnt/data/ssd/test
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.0664 s, 177 MB/s
root@ff978fe:~# dd if=/dev/zero of=/mnt/data/ssd/test bs=64k count=16k conv=fdatasync; rm -rf /mnt/data/ssd/test
16384+0 records in
16384+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 6.01877 s, 178 MB/s
root@ff978fe:~# uname -a
Linux ff978fe 5.10.31-v8 #1 SMP PREEMPT Fri Apr 23 15:16:49 UTC 2021 aarch64 aarch64 aarch64 GNU/Linux

So now that we’ve isolated the issue to kernel configuration, its probably not worth deep-diving or troubleshooting any further, as I would not expect balenaOS to focus on maximum USB3-SSD performance, it’s not really a design goal of the host OS I don’t believe. And, further tweaking / experimentation I can handle via custom builds of the kernel + OS. This is an outlier with a niche use-case.

@iayanpahwa - I got talked into containerizing a Web3 node for a buddy, Flux.

They enforce minimum requirements such as cores, RAM, I/O, bandwidth, etc. Thus the need to hit 180mb write speed, ha.

[jakogut]

I’m glad we were able to get to the bottom of it, David. It was a pleasure, as always.