Hello, I am looking for the feasibility of OpenBalena to deploy and manage my services(Docker-based, Video analyze, Not IoT) which are running on Cuda enabled GPU machines on multiple sites. So, I just have gone through brief OpenBalena documents. However, it seems x86_64 is limited to use OpenBalena. Host Machine: x86_64(Intel i7 Core), Nvidia GPUs, Ubuntu 18.04 Is there any workaround for this case? I would appreciate it if you could help or add any comment to go forward and try it out. Thanks, LimPro

Also thanks for the feedback. Generic x86_64 is a new device type are we will be updating the docs and download links here(https://www.balena.io/os/#download) soon

hey @limpro, I don’t quite follow, So which device can I choose from Machine names and architectures - Balena Documentation ? For your use case, you should use the genericx86-64-ext device type which you mentioned you were able to download above. However, it is not (yet) listed here: Machine names and architectures - Balena Documentation

Hello Balena Team, Looking for two helps~ :hugs: First one, Is there any guide to install CUDA on BalenaOS x86_64? I referred https://www.balena.io/blog/getting-started-with-the-nvidia-jetson-nano-using-balena/ But failed with genericx86-64-ext devices. Second one, Regarding Docker-compose on Balena, do you support --shm-size and --gpus options? I found that Balena seems took https://github.com/docker/compose/issues/6691 in recent few months. However, these options are not working. [Screen Shot 2020-07-14 at 5.28.04 PM] [Screen Shot 2020-07-14 at 5.16.54 PM]

Hi @limpro, some questions to understand better: At what stage of the provisioning process does the error happen? What’s the error that you see when it fails? For your second question, I’m not sure what you refer to with that issue, but you should be able to use the shm_size property as documented here along with the other listed properties. If they’re not listed, they’re most likely not available yet

Hi @thundron, To verify whether balena can support GPU available container(nvidia/cuda:10.1-base), I ran below command in the device (OS Ver.: balenaOS 2.48.0+rev5 / Device Type: genericx86-64-ext) balena-engine run --gpus all,capabilities=utility nvidia/cuda:10.1-base nvidia-smi Please refer attached screenshot [Screen Shot 2020-07-14 at 5.52.13 PM]

Hello, I don’t see the attachment in our system. Please could you try attaching again?

Hello @srlowe, [Screen Shot 2020-07-14 at 5.52.13 PM] Can you see my screenshot?

Hi Balena Team, My project needs to deploy AI services on GPU machines(x86_64, Nvidia GPU). I am considering to use Balena for the project(GPU machines as balenaDevices). So it is critical that CUDA enabled docker can run on balenaDevice. [image] limpro: Is there any guide to install CUDA on BalenaOS x86_64? Could you help me figure out whether GPU inference(using Nvidia Docker) can run on balenaDevcie(x86_64), please?

Just to clarify your device is a computer with a GPU. If so can you send us the GPU that you’ll use?

Support x86_64. Video analyze services (Not IoT)

openBalena

srlowe July 14, 2020, 10:54am 56

Yes, I have it now thank you. Looking into this.

Topic		Replies	Views
Enable GPU on Container balenaOS docker , nvidia	79	5906	January 20, 2021
openBalena Production ready? openBalena	6	1960	October 3, 2019
Configuring balena os for the jetson-xavier-nx-devkit-emmc openBalena	23	1419	March 10, 2022
Supported devices in Open Balena openBalena	14	1920	June 16, 2022
Running CUDA service(s) balenaOS	3	465	September 4, 2021

Support x86_64. Video analyze services (Not IoT)

Related topics