balenaCLI / balenaOS local deploy does not start anymore

[nmaas87]

Hey there,
are there any known issues with the latest raspberrypi3-64-2.101.7-v14.0.13.img and raspberrypi3-64-2.101.7+rev1-v14.0.13.img balenaOS versions? (64 bit, RPi 3, dev Mode).

On first boot, as usual, the balenaCLI does not work, meaning I cannot push to the RPi, because the balena supervisor never starts up. This is a known problem reported by me about a year ago. After a quick reboot, I can do a

 balena.cmd push IP

of my gpsTime project.
This does also work, however it ends at

[Build]   [gpsTime] Step 9/10 : LABEL io.resin.local.image=1
[Build]   [gpsTime]  ---> Running in f838c3ba1445
[Build]   [gpsTime] Removing intermediate container f838c3ba1445
[Build]   [gpsTime]  ---> ac907c7fb268
[Build]   [gpsTime] Step 10/10 : LABEL io.resin.local.service=gpsTime
[Build]   [gpsTime]  ---> Running in 921f1d49c8c8
[Build]   [gpsTime] Removing intermediate container 921f1d49c8c8
[Build]   [gpsTime]  ---> 756d787ccc32
[Build]   [gpsTime] Successfully built 756d787ccc32
[Build]   [gpsTime] Successfully tagged local_gpstime:latest

from this point on, the image is build and also shown by balena images

REPOSITORY                                                       TAG        IMAGE ID       CREATED         SIZE
local_gpstime                                                    latest     756d787ccc32   5 minutes ago   467MB

however, the image is never run, no matter how long I keep the balenaCLI open and wait for it to make any further step after the tagging. balena CLI version is 14.3.0 - so the latest available on Windows 10.

Thanks!

[nmaas87]

Ah, I saw the comment that local deployment is broken since end of 2021:

Allow setting local mode without cloud access

Also shown here:

Balena push not working - offline mode

I’ve been trying for a few days to use balena push to update a device in offline-mode. Using the --debug flag doesn’t show anything useful. Are there any other flags I can use to get more logs? Inside the device docker images shows the images I’ve been trying to push, but they never actually start. Here are some logs: [Debug] Using build source directory: . [Debug] Pushing to local device: 192.168.0.16 [Debug] Checking we can access device [Debug] Sending request to http://192.168.0.…

Any plans to fix that?

Thanks

[nmaas87]

One additional important piece of information: balena push does freeze up the powershell window after the “tagged” info. I cannot STRG/CTRL+C out of it, it just ignores it. Seems like it locks up.

[nmaas87]

With --debug on at push, this is what happens

[Build]   [gpsTime]  ---> Using cache
[Build]   [gpsTime]  ---> 756d787ccc32
[Build]   [gpsTime] Successfully built 756d787ccc32
[Build]   [gpsTime] Successfully tagged local_gpstime:latest

[Debug]   Setting device state...
[Debug]   Sending request to http://192.168.16.2:48484/v2/local/target-state
[Debug]   Sending target state: {"local":{"name":"local","config":{"SUPERVISOR_POLL_INTERVAL":"900000","SUPERVISOR_INSTANT_UPDATE_TRIGGER":"true","SUPERVISOR_LOCAL_MODE":"true","SUPERVISOR_CONNECTIVITY_CHECK":"true","SUPERVISOR_LOG_CONTROL":"true","SUPERVISOR_DELTA":"false","SUPERVISOR_DELTA_REQUEST_TIMEOUT":"59000","SUPERVISOR_DELTA_APPLY_TIMEOUT":"0","SUPERVISOR_DELTA_RETRY_COUNT":"30","SUPERVISOR_DELTA_RETRY_INTERVAL":"10000","SUPERVISOR_DELTA_VERSION":"2","SUPERVISOR_OVERRIDE_LOCK":"false","SUPERVISOR_PERSISTENT_LOGGING":"false","HOST_FIREWALL_MODE":"","HOST_DISCOVERABILITY":"true","SUPERVISOR_HARDWARE_METRICS":"true","SUPERVISOR_VPN_CONTROL":"false","HOST_CONFIG_disable_overscan":"1","HOST_CONFIG_dtparam":"\"audio=on\",\"i2c_arm=on\",\"spi=on\",\"audio=on\"","HOST_CONFIG_disable_splash":"1","HOST_CONFIG_avoid_warnings":"1","HOST_CONFIG_dtoverlay":"\"vc4-fkms-v3d\",\"disable-bt\",\"pps-gpio,gpiopin=18,capture_clear\"","HOST_CONFIG_enable_uart":"1","HOST_CONFIG_gpu_mem":"16"},"apps":{"1":{"name":"localapp","commit":"localrelease","releaseId":"1","services":{"1":{"environment":{"DBUS_ADDRESS":"unix:path=/session/dbus/session_bus_socket","DBUS_SYSTEM_BUS_ADDRESS":"unix:path=/host/run/dbus/system_bus_socket"},"labels":{"io.balena.features.dbus":"1","io.balena.features.kernel-modules":"1","io.balena.features.sysfs":"1","io.balena.features.supervisor-api":"1"},"container_name":"gpsTime","restart":"unless-stopped","privileged":true,"ipc":"host","devices":["/dev/ttyAMA0:/dev/ttyAMA0","/dev/pps0:/dev/pps0","/dev/rtc:/dev/rtc"],"ports":["123","123/udp"],"imageId":1,"serviceName":"gpsTime","serviceId":1,"image":"local_gpstime","running":true}},"volumes":{},"networks":{}}}},"dependent":{"apps":[],"devices":[]}}
[Debug]   Sending request to http://192.168.16.2:48484/v2/local/target-state

When I try to access the get via my local webbrowser I get:

{"status":"success","state":{"local":{"name":"local","config":{"SUPERVISOR_POLL_INTERVAL":"900000","SUPERVISOR_INSTANT_UPDATE_TRIGGER":"true","SUPERVISOR_LOCAL_MODE":"true","SUPERVISOR_CONNECTIVITY_CHECK":"true","SUPERVISOR_LOG_CONTROL":"true","SUPERVISOR_DELTA":"false","SUPERVISOR_DELTA_REQUEST_TIMEOUT":"59000","SUPERVISOR_DELTA_APPLY_TIMEOUT":"0","SUPERVISOR_DELTA_RETRY_COUNT":"30","SUPERVISOR_DELTA_RETRY_INTERVAL":"10000","SUPERVISOR_DELTA_VERSION":"2","SUPERVISOR_OVERRIDE_LOCK":"false","SUPERVISOR_PERSISTENT_LOGGING":"false","HOST_FIREWALL_MODE":"","HOST_DISCOVERABILITY":"true","SUPERVISOR_HARDWARE_METRICS":"true","SUPERVISOR_VPN_CONTROL":"false","HOST_CONFIG_disable_overscan":"1","HOST_CONFIG_dtparam":"\"audio=on\",\"i2c_arm=on\",\"spi=on\",\"audio=on\"","HOST_CONFIG_disable_splash":"1","HOST_CONFIG_avoid_warnings":"1","HOST_CONFIG_dtoverlay":"\"vc4-fkms-v3d\",\"disable-bt\",\"pps-gpio,gpiopin=18,capture_clear\"","HOST_CONFIG_enable_uart":"1","HOST_CONFIG_gpu_mem":"16"},"apps":{}},"dependent":{"apps":[],"devices":[]}}}

and balenaCLI locks up at that step as well

[nmaas87]

Using the old balenaOS version rpi3-64-2.94.4 it worked, so it seems like its an error that just has been introduced.

[Build]   [gpsTime] Step 7/10 : COPY etc /etc/
[Build]   [gpsTime]  ---> 197362fc254a
[Build]   [gpsTime] Step 8/10 : CMD ["/usr/app/start.sh"]
[Build]   [gpsTime]  ---> Running in f5625763b1c3
[Build]   [gpsTime] Removing intermediate container f5625763b1c3
[Build]   [gpsTime]  ---> ff0ef967e9d7
[Build]   [gpsTime] Step 9/10 : LABEL io.resin.local.image=1
[Build]   [gpsTime]  ---> Running in d604c1cb3198
[Build]   [gpsTime] Removing intermediate container d604c1cb3198
[Build]   [gpsTime]  ---> 180752eb7b51
[Build]   [gpsTime] Step 10/10 : LABEL io.resin.local.service=gpsTime
[Build]   [gpsTime]  ---> Running in 36972f64a97c
[Build]   [gpsTime] Removing intermediate container 36972f64a97c
[Build]   [gpsTime]  ---> 9b77a21ffa7d
[Build]   [gpsTime] Successfully built 9b77a21ffa7d
[Build]   [gpsTime] Successfully tagged local_gpstime:latest

[Debug]   Setting device state...
[Debug]   Sending request to http://192.168.16.2:48484/v2/local/target-state
[Debug]   Sending target state: {"local":{"name":"local","config":{"SUPERVISOR_POLL_INTERVAL":"900000","SUPERVISOR_INSTANT_UPDATE_TRIGGER":"true","SUPERVISOR_LOCAL_MODE":"true","SUPERVISOR_CONNECTIVITY_CHECK":"true","SUPERVISOR_LOG_CONTROL":"true","SUPERVISOR_DELTA":"false","SUPERVISOR_DELTA_REQUEST_TIMEOUT":"59000","SUPERVISOR_DELTA_APPLY_TIMEOUT":"0","SUPERVISOR_DELTA_RETRY_COUNT":"30","SUPERVISOR_DELTA_RETRY_INTERVAL":"10000","SUPERVISOR_DELTA_VERSION":"2","SUPERVISOR_OVERRIDE_LOCK":"false","SUPERVISOR_PERSISTENT_LOGGING":"false","HOST_FIREWALL_MODE":"","HOST_DISCOVERABILITY":"true","SUPERVISOR_HARDWARE_METRICS":"true","SUPERVISOR_VPN_CONTROL":"false","HOST_CONFIG_disable_overscan":"1","HOST_CONFIG_dtparam":"\"audio=on\",\"i2c_arm=on\",\"spi=on\",\"audio=on\"","HOST_CONFIG_disable_splash":"1","HOST_CONFIG_avoid_warnings":"1","HOST_CONFIG_dtoverlay":"\"vc4-fkms-v3d\",\"disable-bt\",\"pps-gpio,gpiopin=18,capture_clear\"","HOST_CONFIG_enable_uart":"1","HOST_CONFIG_gpu_mem":"16"},"apps":{"1":{"name":"localapp","commit":"localrelease","releaseId":"1","services":{"1":{"environment":{"DBUS_ADDRESS":"unix:path=/session/dbus/session_bus_socket","DBUS_SYSTEM_BUS_ADDRESS":"unix:path=/host/run/dbus/system_bus_socket"},"labels":{"io.balena.features.dbus":"1","io.balena.features.kernel-modules":"1","io.balena.features.sysfs":"1","io.balena.features.supervisor-api":"1"},"container_name":"gpsTime","restart":"unless-stopped","privileged":true,"ipc":"host","devices":["/dev/ttyAMA0:/dev/ttyAMA0","/dev/pps0:/dev/pps0","/dev/rtc:/dev/rtc"],"ports":["123","123/udp"],"imageId":1,"serviceName":"gpsTime","serviceId":1,"image":"local_gpstime","running":true}},"volumes":{},"networks":{}}}},"dependent":{"apps":[],"devices":[]}}
[Debug]   Sending request to http://192.168.16.2:48484/v2/local/target-state
> [Debug]   Sending target state: {"local":{"name":"local","config":{"SUPERVISOR_POLL_INTERVAL":"900000","SUPERVISOR_INSTANT_UPDATE_TRIGGER":"true","SUPERVISOR_LOCAL_MODE":"true","SUPERVISOR_CONNECTIVITY_CHECK":"true","SUPERVISOR_LOG_CONTROL":"true","SUPERVISOR_DELTA":"false","SUPERVISOR_DELTA_REQUEST_TIMEOUT":"59000","SUPERVISOR_DELTA_APPLY_TIMEOUT":"0","SUPERVISOR_DELTA_RETRY_COUNT":"30","SUPERVISOR_DELTA_RETRY_INTERVAL":"10000","SUPERVISOR_DELTA_VERSION":"2","SUPERVISOR_OVERRIDE_LOCK":"false","SUPERVISOR_PERSISTENT_LOGGING":"false","HOST_FIREWALL_MODE":"","HOST_DISCOVERABILITY":"true","SUPERVISOR_HARDWARE_METRICS":"true","SUPERVISOR_VPN_CONTROL":"false","HOST_CONFIG_disable_overscan":"1","HOST_CONFIG_dtparam":"\"audio=on\",\"i2c_arm=on\",\"spi=on\",\"audio=on\"","HOST_CONFIG_disable_splash":"1","HOST_CONFIG_avoid_warnings":"1","HOST_CONFIG_dtoverlay":"\"vc4-fkms-v3d\",\"disable-bt\",\"pps-gpio,gpiopin=18,capture_clear\"","HOST_CONFIG_enable_uart":"1","HOST_CONFIG_gpu_mem":"16"},"apps":{"1":{"name":"localapp","commit":"localrelease","releaseId":"1","services":{"1":{"environment":{"DBUS_ADDRESS":"unix:path=/session/dbus/session_bus_socket","DBUS_SYSTEM_BUS_ADDRESS":"unix:path=/host/run/dbus/system_bus_socket"},"labels":{"io.balena.features.dbus":"1","io.balena.features.kernel-modules":"1","io.balena.features.sysfs":"1","io.balena.features.supervisor-api":"1"},"container_name":"gpsTime","restart":"unless-stopped","privileged":true,"ipc":"host","devices":["/dev/ttyAMA0:/dev/ttyAMA0","/dev/pps0:/dev/pps0","/dev/rtc:/dev/rtc"],"ports":["123","123/udp"],"imageId":1,"serviceName":"gpsTime","serviceId":1,"image":"local_gpstime","running":true}},"volumes":{},"networks":{}}}},"dependent":{"apps":[],"devices":[]}}21ffa7dd0cd4ecf6086d0f012c63f8cc7aea7e79a661c2102fc
[Debug]   Sending request to http://192.168.16.2:48484/v2/local/target-state
>Debug]   Device state not settled, retrying in 1000ms
[Debug]   Sending request to http://192.168.16.2:48484/v2/local/device-info04 sender=:1.0 -> destination=:1.68 serial=1
[Live]    Watching for file changes...
[Live]    Waiting for device state to settle...ect path "/org/freedesktop/systemd1/job/2111"
[Debug]   Device state not settled, retrying in 1000ms
[Logs]    [2022-8-30 18:51:03] Creating network 'default't bind to IPv6 port gpsd, Cannot assign requested address
[Debug]   Device state not settled, retrying in 1000ms:50:57Z chronyd version 4.0 starting (+CMDMON +NTP +REFCLOCK +RTC
> [Logs]    [2022-8-30 18:51:04] Installing service 'gpsTime sha256:9b77a21ffa7dd0cd4ecf6086d0f012c63f8cc7aea7e79a661c2102fc07ed8f30'
[Debug]   Device state not settled, retrying in 1000ms
> [Logs]    [2022-8-30 18:51:05] Installed service 'gpsTime sha256:9b77a21ffa7dd0cd4ecf6086d0f012c63f8cc7aea7e79a661c2102fc07ed8f30'
> [Logs]    [2022-8-30 18:51:05] Starting service 'gpsTime sha256:9b77a21ffa7dd0cd4ecf6086d0f012c63f8cc7aea7e79a661c2102fc07ed8f30'
> [Logs]    [2022-8-30 18:51:09] Started service 'gpsTime sha256:9b77a21ffa7dd0cd4ecf6086d0f012c63f8cc7aea7e79a661c2102fc07ed8f30'
[Debug]   Device state not settled, retrying in 1000ms
> [Logs]    [2022-8-30 18:50:55] [gpsTime] method return time=1661878255.323304 sender=:1.0 -> destination=:1.68 serial=1528 reply_serial=2
[Logs]    [2022-8-30 18:50:55] [gpsTime]    object path "/org/freedesktop/systemd1/job/2111"
[Live]    Device state settled
[Logs]    [2022-8-30 18:50:56] [gpsTime] gpsd:ERROR: can't bind to IPv6 port gpsd, Cannot assign requested address
> [Logs]    [2022-8-30 18:50:57] [gpsTime] 2022-08-30T16:50:57Z chronyd version 4.0 starting (+CMDMON +NTP +REFCLOCK +RTC +PRIVDROP +SCFILTER +SIGND +ASYNCDNS +NTS +SECHASH +IPV6 -DEBUG)