Hi
I’m having an issue with my container. Sometimes, I cannot find out the exact reason, balena kills the container with the following info:
Oct 10 07:28:14 e1dba8e systemd[1]: Failed to trim compat systemd cgroup /system.slice/docker-b6dd0211667dae1da0251852b2707d6e61f5ead2d778307eef3dea84b5192178.scope: Device or resource busy
Oct 10 07:28:14 e1dba8e systemd[1]: docker-b6dd0211667dae1da0251852b2707d6e61f5ead2d778307eef3dea84b5192178.scope: Consumed 2min 41.055s CPU time.
Oct 10 07:28:14 e1dba8e balenad[1187]: time=“2022-10-10T07:28:14.128936107Z” level=info msg=“shim reaped” id=b6dd0211667dae1da0251852b2707d6e61f5ead2d778307eef3dea84b5192178
Oct 10 07:28:14 e1dba8e balenad[1035]: time=“2022-10-10T07:28:14.138415815Z” level=info msg=“ignoring event” module=libcontainerd namespace=moby topic=/tasks/delete type=“*events.TaskDelete”
Oct 10 07:28:14 e1dba8e balenad[1035]: time=“2022-10-10T07:28:14.160082228Z” level=error msg=“exit event” container=b6dd0211667dae1da0251852b2707d6e61f5ead2d778307eef3dea84b5192178 error=“no such container” module=libcontainerd namespace=moby process=1774a08a83a21fca88986e6265bf563044eacddec53e4a7b616426af46be8290
Oct 10 07:28:14 e1dba8e 336a9617d808[1035]: [event] Event: Service exit {“service”:{“appId”:1944074,“serviceId”:1626861,“serviceName”:“ctrl-services”,“commit”:“f1caf1db2bd20bf434b1e96b5aba7ee6”,“releaseId”:2325488}}
Oct 10 07:28:14 e1dba8e balena-supervisor[1765774]: [event] Event: Service exit {“service”:{“appId”:1944074,“serviceId”:1626861,“serviceName”:“ctrl-services”,“commit”:“f1caf1db2bd20bf434b1e96b5aba7ee6”,“releaseId”:2325488}}
Oct 10 07:28:14 e1dba8e balenad[1187]: time=“2022-10-10T07:28:14.256644610Z” level=info msg=“shim balena-engine-containerd-shim started” address=/containerd-shim/f3a0602bee50fa456eb3ba7ebc9bf6095cd80985d939dd4c693a9ad271ced56b.sock debug=false pid=1801016
Can anyone give me some pointers about how to debug this issue?
System configs:
balenaOS: 2.89.15
supervisor: 14.0.6
image: FROM balenalib/amd64-debian-node:16-buster-build
device: Intel NUC with 16Gb of RAM and 1TB SSD
systemd version: 244 (244.5+)
-PAM -AUDIT -SELINUX +IMA -APPARMOR -SMACK +SYSVINIT +UTMP -LIBCRYPTSETUP -GCRYPT -GNUTLS +ACL +XZ -LZ4 -SECCOMP +BLKID -ELFUTILS +KMOD -IDN2 -IDN -PCRE2 default-hierarchy=hybrid