Build BalenaOS for jetson nx emmc - add custom KERNEL_ROOTSPEC

Langhalsdino · February 10, 2022, 2:18pm

Hi,

i am currently trying to get the edge TPU to work on the jetson nx emmc image. This could be solved for the jetson-nano by apending the KERNEL_ROOTSPEC with gasket.dma_bit_mask=32 pcie_aspm=off. Sadly changing the KERNEL_ROOTSPEC:jetson-xavier-nx-devkit-emmc (layers/meta-balena-jetson/recipes-kernel/linux/linux-tegra_%.bbappend) has no effect.
Since this flag is empty and the jetson nx does not use u-boot and is loading the kernel from a raw partition, the flags will probably need to be appended at another place. Could you point me in some direction?

Lastly i can not build a dev image by using the -d flag of barys. Did something change over the course of the past releases of barys or is this a issue with the xavier nx too?

Thank you for your support

dtischler · February 10, 2022, 4:11pm

Hey @Langhalsdino hope you are well!

Just one quick question: By “Edge TPU”, you are talking about this, correct? Products | Coral (scroll down about half-way, to “Production Products”). And if so, which one are you using, exactly?

In the meantime, @acostach – do you have any guidance on where Frederic can append kernel variables to get included in a local build of Jetson Xavier NX? What recipe handles kernel args on Xavier NX?

Langhalsdino · February 10, 2022, 4:25pm

Yes, i am talking about the coral edge tpu pcie module. Specially about the dual edge tpu M.2 Accelerator with Dual Edge TPU | Coral . As described in the coral issue KERNEL_ROOTSPEC need to be added e.g. pcie_aspm=off".

Just in case some one else reads this:
In order to make the dual edge tpu work, you will need a pcie multiplexer https://github.com/magic-blue-smoke/Dual-Edge-TPU-Adapter/issues/3 . Otherwise just one will work

acostach · February 10, 2022, 5:08pm

Hi @Langhalsdino , can you please try do the append to the OS_KERNEL_CMDLINE after:

github.com

balena-os/balena-jetson/blob/6126bbf0c3296aa6a971436fd21d4e0d3e0026fd/layers/meta-balena-jetson/recipes-bsp/tegra-binaries/tegra194-nxde-flash-dry_32.6.1.bb#L47

      
        
            IMAGE_TEGRAFLASH_FS_TYPE ??= "ext4"
            IMAGE_TEGRAFLASH_ROOTFS ?= "${IMGDEPLOYDIR}/${IMAGE_LINK_NAME}.${IMAGE_TEGRAFLASH_FS_TYPE}"
            
            
LDK_DIR = "${TMPDIR}/work-shared/L4T-${SOC_FAMILY}-${PV}-${PR}/Linux_for_Tegra"
            B = "${WORKDIR}/build"
            S = "${WORKDIR}"
            LNXFILE="${KERNEL_IMAGETYPE}${KERNEL_INITRAMFS}-${MACHINE}.bin"
            IMAGE_TEGRAFLASH_KERNEL ?= "${DEPLOY_DIR_IMAGE}/${LNXFILE}"
            BINARY_INSTALL_PATH = "/opt/tegra-binaries"
            
            
OS_KERNEL_CMDLINE = "${@bb.utils.contains('DISTRO_FEATURES','osdev-image','console=ttyTHS0,115200n8 console=tty1 debug loglevel=7','console=null quiet splash vt.global_cursor_default=0 consoleblank=0',d)}"
            ROOTA_ARGS="root=LABEL=resin-rootA ro rootwait rootfstype=ext4 ${KERNEL_ARGS} ${OS_KERNEL_CMDLINE}"
            ROOTB_ARGS="root=LABEL=resin-rootB ro rootwait rootfstype=ext4 ${KERNEL_ARGS} ${OS_KERNEL_CMDLINE}"
            
            
BOOTFILES = "\
                adsp-fw.bin \
                bpmp_t194.bin \
                camera-rtcpu-rce.img \
                eks.img \
                mb1_t194_prod.bin \
                nvtboot_applet_t194.bin \

eg: OS_KERNEL_CMDLINE:append = " pcie_aspm=off "

Langhalsdino · February 10, 2022, 5:21pm

I will try it and flash the jetson tomorrow. Thank you

Langhalsdino · February 11, 2022, 2:07pm

Thank you @acostach appending the OS_KERNEL_CMDLINE appears to be working. Furthermore appending KERNEL_ARGS is probably the cleaner way for the future.

I still struggle to get the gasket-dkms and apex recipe to work, but this is my code and my challenge