Hi all,
The resin supervisor on our application is acting weird where it’s CPU usage and memory usage would sky rocket, causing high latency and excessive CPU usage on our device.
Details:
- device: jetson-nano
- host os: balenaOS 2.69.1+rev1
- supervisor version: 12.3.0
- container running: 8 (not including resin-supervisor)
Metrics:
- CPU and memory usage:
282bfb67b176 resin_supervisor 75.01% 1.597GiB / 3.869GiB 41.28% 0B / 0B 441MB / 42.6MB 12
- logs from resin-supervisor
[api] GET /v1/healthy 200 - 4.863 ms
[debug] Attempting container log timestamp flush…
[debug] Container log timestamp flush complete
[event] Event: Device state report failure {“error”:{“message”:“”}}
[api] GET /v1/healthy 200 - 338.178 ms
[event] Event: Device state report failure {“error”:{“message”:“”}}
[api] GET /v1/healthy 200 - 2.870 ms
[debug] Attempting container log timestamp flush…
[debug] Container log timestamp flush complete
[api] GET /v1/healthy 200 - 2.885 ms
[api] GET /v1/healthy 200 - 3.086 ms
[debug] Attempting container log timestamp flush…
[debug] Container log timestamp flush complete
[api] GET /v1/healthy 200 - 3.158 ms
[error] Error from the API: 503
[error] Non-200 response from the API! Status code: 503 - message: Error
[error] at /usr/src/app/dist/app.js:22:554480
[error] at runMicrotasks ()
[error] at processTicksAndRejections (internal/process/task_queues.js:97:5)
[error] at async /usr/src/app/dist/app.js:22:553788
[error] at async /usr/src/app/dist/app.js:22:555310
[api] GET /v1/healthy 200 - 341.618 ms
[debug] Attempting container log timestamp flush…
[debug] Container log timestamp flush complete
[api] GET /v1/healthy 200 - 8.252 ms
[api] GET /v1/healthy 200 - 362.491 ms
[debug] Attempting container log timestamp flush…
[debug] Container log timestamp flush complete
[api] GET /v1/healthy 200 - 3.540 ms
[api] GET /v1/healthy 200 - 3.129 ms
[debug] Attempting container log timestamp flush…
[debug] Container log timestamp flush complete
[error] Error from the API: 503
[error] Non-200 response from the API! Status code: 503 - message: Error
[error] at /usr/src/app/dist/app.js:22:554480
[error] at runMicrotasks ()
[error] at processTicksAndRejections (internal/process/task_queues.js:97:5)
[error] at async /usr/src/app/dist/app.js:22:553788
[error] at async /usr/src/app/dist/app.js:22:555310
[api] GET /v1/healthy 200 - 20.501 ms
[api] GET /v1/healthy 200 - 3.139 ms
[debug] Attempting container log timestamp flush…
[debug] Container log timestamp flush complete
[error] Error from the API: 503
[error] Non-200 response from the API! Status code: 503 - message: Error
[error] at /usr/src/app/dist/app.js:22:554480
[error] at runMicrotasks ()
[error] at processTicksAndRejections (internal/process/task_queues.js:97:5)
[error] at async /usr/src/app/dist/app.js:22:553788
[error] at async /usr/src/app/dist/app.js:22:555310
any help on this would be nice, thanks.