Hi Everyone,
I am trying to get screenly up and running on balena but my device is repeatedly failing to download the screenly services - leaving it overnight didn’t make any difference.
I have pushed the latest version of screenly to balena successfuly, burnt my image to the SD card, plugged into the card into the raspberry pi 3 and redis and the screenly web socket were downloaded. The other screenly services would only partially download.
I will try and attach logs.
Any ideas what might be the problem. I can reproduce it time and time again.
08.12.19 06:46:49 (+0000) <redis> |`-._`-...-` __...-.``-._|'` _.-'| Port: 6379
08.12.19 06:46:49 (+0000) <redis> | `-._ `._ / _.-' | PID: 1
08.12.19 06:46:49 (+0000) <redis> `-._ `-._ `-./ _.-' _.-'
08.12.19 06:46:49 (+0000) <redis> |`-._`-._ `-.__.-' _.-'_.-'|
08.12.19 06:46:49 (+0000) <redis> | `-._`-._ _.-'_.-' | http://redis.io
08.12.19 06:46:49 (+0000) <redis> `-._ `-._`-.__.-'_.-' _.-'
08.12.19 06:46:49 (+0000) <redis> |`-._`-._ `-.__.-' _.-'_.-'|
08.12.19 06:46:49 (+0000) <redis> | `-._`-._ _.-'_.-' |
08.12.19 06:46:49 (+0000) <redis> `-._ `-._`-.__.-'_.-' _.-'
08.12.19 06:46:49 (+0000) <redis> `-._ `-.__.-' _.-'
08.12.19 06:46:49 (+0000) <redis> `-._ _.-'
08.12.19 06:46:49 (+0000) <redis> `-.__.-'
08.12.19 06:46:49 (+0000) <redis>
08.12.19 06:46:49 (+0000) <redis> [1] 08 Dec 06:46:49.692 # Server started, Redis version 2.8.17
08.12.19 06:46:49 (+0000) <redis> [1] 08 Dec 06:46:49.695 * The server is now ready to accept connections on port 6379
08.12.19 06:47:23 (+0000) Downloading delta for image 'registry2.balena-cloud.com/v2/73f916cd15650b33ff3dd45228750b6d@sha256:d5936504fbc38e9609cbc441570f0d0cd8bc982b2210ffaca2ba4a216b0e994a'
08.12.19 06:47:23 (+0000) Downloading delta for image 'registry2.balena-cloud.com/v2/f55202da99e58e2131ff4b7e05ddcf62@sha256:41f956c211ae9d50736d2dad475ed25f9e9840dfff69da87a7d3515d33e4c8ad'
08.12.19 06:47:23 (+0000) Downloading delta for image 'registry2.balena-cloud.com/v2/fb5fd2d69f75b6c19230b9b29e84d0f1@sha256:3bcee6f915231d4497c273d53265e583f1888161f9d70b98d3742292604c0871'
08.12.19 06:54:48 (+0000) Supervisor starting
08.12.19 06:31:39 (+0000) <redis> [1] 08 Dec 06:31:39.589 # Warning: no config file specified, using the default config. In order to specify a config file use /usr/bin/redis-server /path/to/redis.conf
08.12.19 06:31:39 (+0000) <redis> [1] 08 Dec 06:31:39.596 # Warning: 32 bit instance detected but no memory limit set. Setting 3 GB maxmemory limit with 'noeviction' policy now.
08.12.19 06:31:39 (+0000) <redis> _._
08.12.19 06:31:39 (+0000) <redis> _.-``__ ''-._
08.12.19 06:31:39 (+0000) <redis> _.-`` `. `_. ''-._ Redis 2.8.17 (00000000/0) 32 bit
08.12.19 06:31:39 (+0000) <redis> .-`` .-```. ```\/ _.,_ ''-._
08.12.19 06:31:39 (+0000) <redis> ( ' , .-` | `, ) Running in stand alone mode
08.12.19 06:31:39 (+0000) <redis> |`-._`-...-` __...-.``-._|'` _.-'| Port: 6379
08.12.19 06:31:39 (+0000) <redis> | `-._ `._ / _.-' | PID: 1
08.12.19 06:31:39 (+0000) <redis> `-._ `-._ `-./ _.-' _.-'
08.12.19 06:31:39 (+0000) <redis> |`-._`-._ `-.__.-' _.-'_.-'|
08.12.19 06:31:39 (+0000) <redis> | `-._`-._ _.-'_.-' | http://redis.io
08.12.19 06:31:39 (+0000) <redis> `-._ `-._`-.__.-'_.-' _.-'
08.12.19 06:31:39 (+0000) <redis> |`-._`-._ `-.__.-' _.-'_.-'|
08.12.19 06:31:39 (+0000) <redis> | `-._`-._ _.-'_.-' |
08.12.19 06:31:39 (+0000) <redis> `-._ `-._`-.__.-'_.-' _.-'
08.12.19 06:31:39 (+0000) <redis> `-._ `-.__.-' _.-'
08.12.19 06:31:39 (+0000) <redis> `-._ _.-'
08.12.19 06:31:39 (+0000) <redis> `-.__.-'
08.12.19 06:31:39 (+0000) <redis>
08.12.19 06:31:39 (+0000) <redis> [1] 08 Dec 06:31:39.597 # Server started, Redis version 2.8.17
08.12.19 06:31:39 (+0000) <redis> [1] 08 Dec 06:31:39.597 * The server is now ready to accept connections on port 6379
08.12.19 06:38:35 (+0000) <redis> [1] 08 Dec 06:38:35.398 # Warning: no config file specified, using the default config. In order to specify a config file use /usr/bin/redis-server /path/to/redis.conf
08.12.19 06:38:35 (+0000) <redis> [1] 08 Dec 06:38:35.403 # Warning: 32 bit instance detected but no memory limit set. Setting 3 GB maxmemory limit with 'noeviction' policy now.
08.12.19 06:38:35 (+0000) <redis> _._
08.12.19 06:38:35 (+0000) <redis> _.-``__ ''-._
08.12.19 06:38:35 (+0000) <redis> _.-`` `. `_. ''-._ Redis 2.8.17 (00000000/0) 32 bit
08.12.19 06:38:35 (+0000) <redis> .-`` .-```. ```\/ _.,_ ''-._
08.12.19 06:38:35 (+0000) <redis> ( ' , .-` | `, ) Running in stand alone mode
08.12.19 06:38:35 (+0000) <redis> |`-._`-...-` __...-.``-._|'` _.-'| Port: 6379
08.12.19 06:38:35 (+0000) <redis> | `-._ `._ / _.-' | PID: 1
08.12.19 06:38:35 (+0000) <redis> `-._ `-._ `-./ _.-' _.-'
08.12.19 06:38:35 (+0000) <redis> |`-._`-._ `-.__.-' _.-'_.-'|
08.12.19 06:38:35 (+0000) <redis> | `-._`-._ _.-'_.-' | http://redis.io
08.12.19 06:38:35 (+0000) <redis> `-._ `-._`-.__.-'_.-' _.-'
08.12.19 06:38:35 (+0000) <redis> |`-._`-._ `-.__.-' _.-'_.-'|
08.12.19 06:38:35 (+0000) <redis> | `-._`-._ _.-'_.-' |
08.12.19 06:38:35 (+0000) <redis> `-._ `-._`-.__.-'_.-' _.-'
08.12.19 06:38:35 (+0000) <redis> `-._ `-.__.-' _.-'
08.12.19 06:38:35 (+0000) <redis> `-._ _.-'
08.12.19 06:38:35 (+0000) <redis> `-.__.-'
08.12.19 06:38:35 (+0000) <redis>
08.12.19 06:38:35 (+0000) <redis> [1] 08 Dec 06:38:35.404 # Server started, Redis version 2.8.17
08.12.19 06:38:35 (+0000) <redis> [1] 08 Dec 06:38:35.405 * The server is now ready to accept connections on port 6379
08.12.19 06:46:49 (+0000) <redis> [1] 08 Dec 06:46:49.683 # Warning: no config file specified, using the default config. In order to specify a config file use /usr/bin/redis-server /path/to/redis.conf
08.12.19 06:46:49 (+0000) <redis> [1] 08 Dec 06:46:49.690 # Warning: 32 bit instance detected but no memory limit set. Setting 3 GB maxmemory limit with 'noeviction' policy now.
08.12.19 06:46:49 (+0000) <redis> _._
08.12.19 06:46:49 (+0000) <redis> _.-``__ ''-._
08.12.19 06:46:49 (+0000) <redis> _.-`` `. `_. ''-._ Redis 2.8.17 (00000000/0) 32 bit
08.12.19 06:46:49 (+0000) <redis> .-`` .-```. ```\/ _.,_ ''-._
08.12.19 06:46:49 (+0000) <redis> ( ' , .-` | `, ) Running in stand alone mode
08.12.19 06:46:49 (+0000) <redis> |`-._`-...-` __...-.``-._|'` _.-'| Port: 6379
08.12.19 06:46:49 (+0000) <redis> | `-._ `._ / _.-' | PID: 1
08.12.19 06:46:49 (+0000) <redis> `-._ `-._ `-./ _.-' _.-'
08.12.19 06:46:49 (+0000) <redis> |`-._`-._ `-.__.-' _.-'_.-'|
08.12.19 06:46:49 (+0000) <redis> | `-._`-._ _.-'_.-' | http://redis.io
08.12.19 06:46:49 (+0000) <redis> `-._ `-._`-.__.-'_.-' _.-'
08.12.19 06:46:49 (+0000) <redis> |`-._`-._ `-.__.-' _.-'_.-'|
08.12.19 06:46:49 (+0000) <redis> | `-._`-._ _.-'_.-' |
08.12.19 06:46:49 (+0000) <redis> `-._ `-._`-.__.-'_.-' _.-'
08.12.19 06:46:49 (+0000) <redis> `-._ `-.__.-' _.-'
08.12.19 06:46:49 (+0000) <redis> `-._ _.-'
08.12.19 06:46:49 (+0000) <redis> `-.__.-'
08.12.19 06:46:49 (+0000) <redis>
08.12.19 06:46:49 (+0000) <redis> [1] 08 Dec 06:46:49.692 # Server started, Redis version 2.8.17
08.12.19 06:46:49 (+0000) <redis> [1] 08 Dec 06:46:49.695 * The server is now ready to accept connections on port 6379
08.12.19 06:54:20 (+0000) <redis> [1] 08 Dec 06:54:20.152 # Warning: no config file specified, using the default config. In order to specify a config file use /usr/bin/redis-server /path/to/redis.conf
08.12.19 06:54:20 (+0000) <redis> [1] 08 Dec 06:54:20.157 # Warning: 32 bit instance detected but no memory limit set. Setting 3 GB maxmemory limit with 'noeviction' policy now.
08.12.19 06:54:20 (+0000) <redis> _._
08.12.19 06:54:20 (+0000) <redis> _.-``__ ''-._
08.12.19 06:54:20 (+0000) <redis> _.-`` `. `_. ''-._ Redis 2.8.17 (00000000/0) 32 bit
08.12.19 06:54:20 (+0000) <redis> .-`` .-```. ```\/ _.,_ ''-._
08.12.19 06:54:20 (+0000) <redis> ( ' , .-` | `, ) Running in stand alone mode
08.12.19 06:54:20 (+0000) <redis> |`-._`-...-` __...-.``-._|'` _.-'| Port: 6379
08.12.19 06:54:20 (+0000) <redis> | `-._ `._ / _.-' | PID: 1
08.12.19 06:54:20 (+0000) <redis> `-._ `-._ `-./ _.-' _.-'
08.12.19 06:54:20 (+0000) <redis> |`-._`-._ `-.__.-' _.-'_.-'|
08.12.19 06:54:20 (+0000) <redis> | `-._`-._ _.-'_.-' | http://redis.io
08.12.19 06:54:20 (+0000) <redis> `-._ `-._`-.__.-'_.-' _.-'
08.12.19 06:54:20 (+0000) <redis> |`-._`-._ `-.__.-' _.-'_.-'|
08.12.19 06:54:20 (+0000) <redis> | `-._`-._ _.-'_.-' |
08.12.19 06:54:20 (+0000) <redis> `-._ `-._`-.__.-'_.-' _.-'
08.12.19 06:54:20 (+0000) <redis> `-._ `-.__.-' _.-'
08.12.19 06:54:20 (+0000) <redis> `-._ _.-'
08.12.19 06:54:20 (+0000) <redis> `-.__.-'
08.12.19 06:54:20 (+0000) <redis>
08.12.19 06:54:20 (+0000) <redis> [1] 08 Dec 06:54:20.158 # Server started, Redis version 2.8.17
08.12.19 06:54:20 (+0000) <redis> [1] 08 Dec 06:54:20.159 * The server is now ready to accept connections on port 6379
08.12.19 06:54:52 (+0000) Downloading delta for image 'registry2.balena-cloud.com/v2/73f916cd15650b33ff3dd45228750b6d@sha256:d5936504fbc38e9609cbc441570f0d0cd8bc982b2210ffaca2ba4a216b0e994a'
08.12.19 06:54:52 (+0000) Downloading delta for image 'registry2.balena-cloud.com/v2/f55202da99e58e2131ff4b7e05ddcf62@sha256:41f956c211ae9d50736d2dad475ed25f9e9840dfff69da87a7d3515d33e4c8ad'
08.12.19 06:54:52 (+0000) Downloading delta for image 'registry2.balena-cloud.com/v2/fb5fd2d69f75b6c19230b9b29e84d0f1@sha256:3bcee6f915231d4497c273d53265e583f1888161f9d70b98d3742292604c0871'
08.12.19 07:02:17 (+0000) Supervisor starting
08.12.19 06:46:49 (+0000) <redis> [1] 08 Dec 06:46:49.683 # Warning: no config file specified, using the default config. In order to specify a config file use /usr/bin/redis-server /path/to/redis.conf
08.12.19 06:46:49 (+0000) <redis> [1] 08 Dec 06:46:49.690 # Warning: 32 bit instance detected but no memory limit set. Setting 3 GB maxmemory limit with 'noeviction' policy now.
08.12.19 06:46:49 (+0000) <redis> _._
08.12.19 06:46:49 (+0000) <redis> _.-``__ ''-._
08.12.19 06:46:49 (+0000) <redis> _.-`` `. `_. ''-._ Redis 2.8.17 (00000000/0) 32 bit
08.12.19 06:46:49 (+0000) <redis> .-`` .-```. ```\/ _.,_ ''-._
08.12.19 06:46:49 (+0000) <redis> ( ' , .-` | `, ) Running in stand alone mode
08.12.19 06:46:49 (+0000) <redis> |`-._`-...-` __...-.``-._|'` _.-'| Port: 6379
08.12.19 06:46:49 (+0000) <redis> | `-._ `._ / _.-' | PID: 1
08.12.19 06:46:49 (+0000) <redis> `-._ `-._ `-./ _.-' _.-'
08.12.19 06:46:49 (+0000) <redis> |`-._`-._ `-.__.-' _.-'_.-'|
08.12.19 06:46:49 (+0000) <redis> | `-._`-._ _.-'_.-' | http://redis.io
08.12.19 06:46:49 (+0000) <redis> `-._ `-._`-.__.-'_.-' _.-'
08.12.19 06:46:49 (+0000) <redis> |`-._`-._ `-.__.-' _.-'_.-'|
08.12.19 06:46:49 (+0000) <redis> | `-._`-._ _.-'_.-' |
08.12.19 06:46:49 (+0000) <redis> `-._ `-._`-.__.-'_.-' _.-'
08.12.19 06:46:49 (+0000) <redis> `-._ `-.__.-' _.-'
08.12.19 06:46:49 (+0000) <redis> `-._ _.-'
08.12.19 06:46:49 (+0000) <redis> `-.__.-'
08.12.19 06:46:49 (+0000) <redis>
08.12.19 06:46:49 (+0000) <redis> [1] 08 Dec 06:46:49.692 # Server started, Redis version 2.8.17
08.12.19 06:46:49 (+0000) <redis> [1] 08 Dec 06:46:49.695 * The server is now ready to accept connections on port 6379
08.12.19 06:54:20 (+0000) <redis> [1] 08 Dec 06:54:20.152 # Warning: no config file specified, using the default config. In order to specify a config file use /usr/bin/redis-server /path/to/redis.conf
08.12.19 06:54:20 (+0000) <redis> [1] 08 Dec 06:54:20.157 # Warning: 32 bit instance detected but no memory limit set. Setting 3 GB maxmemory limit with 'noeviction' policy now.
08.12.19 06:54:20 (+0000) <redis> _._
08.12.19 06:54:20 (+0000) <redis> _.-``__ ''-._
08.12.19 06:54:20 (+0000) <redis> _.-`` `. `_. ''-._ Redis 2.8.17 (00000000/0) 32 bit
08.12.19 06:54:20 (+0000) <redis> .-`` .-```. ```\/ _.,_ ''-._
08.12.19 06:54:20 (+0000) <redis> ( ' , .-` | `, ) Running in stand alone mode
08.12.19 06:54:20 (+0000) <redis> |`-._`-...-` __...-.``-._|'` _.-'| Port: 6379
08.12.19 06:54:20 (+0000) <redis> | `-._ `._ / _.-' | PID: 1
08.12.19 06:54:20 (+0000) <redis> `-._ `-._ `-./ _.-' _.-'
08.12.19 06:54:20 (+0000) <redis> |`-._`-._ `-.__.-' _.-'_.-'|
08.12.19 06:54:20 (+0000) <redis> | `-._`-._ _.-'_.-' | http://redis.io
08.12.19 06:54:20 (+0000) <redis> `-._ `-._`-.__.-'_.-' _.-'
08.12.19 06:54:20 (+0000) <redis> |`-._`-._ `-.__.-' _.-'_.-'|
08.12.19 06:54:20 (+0000) <redis> | `-._`-._ _.-'_.-' |
08.12.19 06:54:20 (+0000) <redis> `-._ `-._`-.__.-'_.-' _.-'
08.12.19 06:54:20 (+0000) <redis> `-._ `-.__.-' _.-'
08.12.19 06:54:20 (+0000) <redis> `-._ _.-'
08.12.19 06:54:20 (+0000) <redis> `-.__.-'
08.12.19 06:54:20 (+0000) <redis>
08.12.19 06:54:20 (+0000) <redis> [1] 08 Dec 06:54:20.158 # Server started, Redis version 2.8.17
08.12.19 06:54:20 (+0000) <redis> [1] 08 Dec 06:54:20.159 * The server is now ready to accept connections on port 6379
08.12.19 07:01:50 (+0000) <redis> [1] 08 Dec 07:01:50.446 # Warning: no config file specified, using the default config. In order to specify a config file use /usr/bin/redis-server /path/to/redis.conf
08.12.19 07:01:50 (+0000) <redis> [1] 08 Dec 07:01:50.453 # Warning: 32 bit instance detected but no memory limit set. Setting 3 GB maxmemory limit with 'noeviction' policy now.
08.12.19 07:01:50 (+0000) <redis> _._
08.12.19 07:01:50 (+0000) <redis> _.-``__ ''-._
08.12.19 07:01:50 (+0000) <redis> _.-`` `. `_. ''-._ Redis 2.8.17 (00000000/0) 32 bit
08.12.19 07:01:50 (+0000) <redis> .-`` .-```. ```\/ _.,_ ''-._
08.12.19 07:01:50 (+0000) <redis> ( ' , .-` | `, ) Running in stand alone mode
08.12.19 07:01:50 (+0000) <redis> |`-._`-...-` __...-.``-._|'` _.-'| Port: 6379
08.12.19 07:01:50 (+0000) <redis> | `-._ `._ / _.-' | PID: 1
08.12.19 07:01:50 (+0000) <redis> `-._ `-._ `-./ _.-' _.-'
08.12.19 07:01:50 (+0000) <redis> |`-._`-._ `-.__.-' _.-'_.-'|
08.12.19 07:01:50 (+0000) <redis> | `-._`-._ _.-'_.-' | http://redis.io
08.12.19 07:01:50 (+0000) <redis> `-._ `-._`-.__.-'_.-' _.-'
08.12.19 07:01:50 (+0000) <redis> |`-._`-._ `-.__.-' _.-'_.-'|
08.12.19 07:01:50 (+0000) <redis> | `-._`-._ _.-'_.-' |
08.12.19 07:01:50 (+0000) <redis> `-._ `-._`-.__.-'_.-' _.-'
08.12.19 07:01:50 (+0000) <redis> `-._ `-.__.-' _.-'
08.12.19 07:01:50 (+0000) <redis> `-._ _.-'
08.12.19 07:01:50 (+0000) <redis> `-.__.-'
08.12.19 07:01:50 (+0000) <redis>
08.12.19 07:01:50 (+0000) <redis> [1] 08 Dec 07:01:50.456 # Server started, Redis version 2.8.17
08.12.19 07:01:50 (+0000) <redis> [1] 08 Dec 07:01:50.457 * The server is now ready to accept connections on port 6379
08.12.19 07:02:20 (+0000) Downloading delta for image 'registry2.balena-cloud.com/v2/73f916cd15650b33ff3dd45228750b6d@sha256:d5936504fbc38e9609cbc441570f0d0cd8bc982b2210ffaca2ba4a216b0e994a'
08.12.19 07:02:20 (+0000) Downloading delta for image 'registry2.balena-cloud.com/v2/f55202da99e58e2131ff4b7e05ddcf62@sha256:41f956c211ae9d50736d2dad475ed25f9e9840dfff69da87a7d3515d33e4c8ad'
08.12.19 07:02:20 (+0000) Downloading delta for image 'registry2.balena-cloud.com/v2/fb5fd2d69f75b6c19230b9b29e84d0f1@sha256:3bcee6f915231d4497c273d53265e583f1888161f9d70b98d3742292604c0871'
08.12.19 07:10:04 (+0000) Supervisor starting
08.12.19 06:46:49 (+0000) <redis> [1] 08 Dec 06:46:49.683 # Warning: no config file specified, using the default config. In order to specify a config file use /usr/bin/redis-server /path/to/redis.conf
08.12.19 06:46:49 (+0000) <redis> [1] 08 Dec 06:46:49.690 # Warning: 32 bit instance detected but no memory limit set. Setting 3 GB maxmemory limit with 'noeviction' policy now.
Seems like the supervisor is restarting after downloading the deltas. Which should not be happening. Is it possible for you to share support access to the device with it’s UUID or the dashboard URL?
lstocky
December 10, 2019, 5:26pm
6
Thanks for the fast response. That’s interesting.
So I actually resolved it. I’ve come across this a couple of times and have no real explanation for why this solution works.
After repeatedly writing the balena image to the card and it behaving in the way described I have taken to flashing a completely different image on the card. In this case i flashed regular screenly. I then power the pi up with this, confirm it works and then re flash a fresh balana image. At this point the whole thing downloads and runs like clockwork.
Any clue on why this might resolve things? Some weird issue related to the SD card perhaps? I’m thinking FAT type issue?
zvin
December 10, 2019, 5:41pm
7
Hello,
What do you mean by “completely different image”.
After flashing the “regular screenly” image did you reflash the same balena image?
Have you checked dmesg
for SD card problems ?
lstocky
December 13, 2019, 12:08pm
10
Hi Zvin,
I mean a new device, does that make sense?
What is dmesg and how do I utilise it?
thanks
ls
lstocky
December 13, 2019, 12:10pm
11
support access granted - thanks anuj
805e234806a298b61247dc22b5a879e8
hedss
December 13, 2019, 12:40pm
12
Hi @lstocky ,
Thanks for the support access. Unfortunately we can’t the device as the connection isn’t stable. We also don’t see any further download progress, which tends to suggest that there’s a critical problem. This does seem to point to the SD card either being seriously corrupt or unable to process read/writes quickly enough. Have you tried a different SD card (including differing make and model) to ensure this isn’t a problem with the card?
We recommend San Disk Extreme Pro cards, as these have been heavily tested both by us and other customers and we know they’re able to deal with the requirements balenaOS makes on I/O.
Best regards,
Heds
lstocky
December 15, 2019, 2:23pm
14
hedss:
San Disk Extreme Pro
Thanks for the info heads up - it’s a Kingston 80MB/s UHS-1 Class 10 that’s in there. But I take your point and will go for the SD Extreme Pro in future.
Interesting - I just pulled the power cord on the raspberry pi - and balena continues to report the balena device as being online (which it isn’t). Does that concur with what you’d expect? After about 5 minutes, it finally reports it offline.
afitzek
December 16, 2019, 10:52am
15
Hi @lstocky ,
A device is reported online, as long as a VPN connection exists. If you pull the power cord, it will take a little bit until the VPN detects that the device is not there anymore, basically until the keep alive check times out. So it will take some time to propagate the information that a device went offline.
Best Regards,