Duplicate entries in `balena logs` after boot.

Yes I can see the duplicates too. I will open an issue for this now

I have opened an issue here: https://github.com/balena-io/balena-cli/issues/2083

Thanks again for reporting this and for investigating it with me

Are you still seeing the issue with the nemo container?

The duplicates issue, or one of the other issues? I’m currently still seeing three issues:

  1. The duplicate entries on power cycle if I touch nothing (this ticket)
  2. Nemo unexpectedly restarted by supervisor if I power cycle after restarting Nemo manually from teh dashboard (https://forums.balena.io/t/unexpected-supervisor-crash-container-restart-on-network-change)
  3. Docker occasionally has a fork/exec error trying to SSH into Nemo, and when that is happening Nemo cannot seem to reach the internet (AWS queries failing) that we think is related to the device starting up with the wrong date (https://forums.balena.io/t/chronyc-config-is-bad-if-device-comes-online-without-internet)

#3 is the most critical for us right now since the only way to resolve it is to reboot the device and hope it doesn’t happen again, or to restart Nemo from the dashboard. Our customers can’t restart the service, and having to reboot and cross their fingers is a pretty bad solution. Unfortunately I can’t seem to replicate it reliably or figure out exactly what triggers it. I’ve been able to replicate it occasionally (maybe 1 in 10 times) with a sequence of:

  1. Power cycle with ethernet unplugged
  2. Use date -s to set the date back a month or more (not sure what the actual min time is so just using a lot)
  3. Wait a bit (a minute, a few? sometimes helps, sometimes doesn’t)
  4. Plug the ethernet in

I figured I’d update https://forums.balena.io/t/chronyc-config-is-bad-if-device-comes-online-without-internet to continue tracking this issue. I was waiting until I found a way to replicate it, or at least gathered a little more information. I can update it now, though I’m not sure if maybe it should actually be an entirely new thread?

Ah, thanks for summarizing. I’ll see what I can find out about those other issues. I’ll stick to discussing them on their separate threads