Support x86_64. Video analyze services (Not IoT)

openBalena
#38

Hey @limpro

genericx86-64-ext is the machine name device type for Generic x86_64 device type. is is similar to the intel nuc image but comes with more built in drivers.

Thanks

#39

Hi Rahul,

Thanks for your comment. So which device can I choose from https://www.balena.io/docs/reference/base-images/devicetypes/ ?

Thanks, LimPro

#40

Also thanks for the feedback. Generic x86_64 is a new device type are we will be updating the docs and download links here(https://www.balena.io/os/#download) soon

#41

hey @limpro,

I don’t quite follow,

So which device can I choose from https://www.balena.io/docs/reference/base-images/devicetypes/ ?

For your use case, you should use the genericx86-64-ext device type which you mentioned you were able to download above. However, it is not (yet) listed here: https://www.balena.io/docs/reference/base-images/devicetypes/

#47

Hello Balena Team,

Looking for two helps~ :hugs:

First one, Is there any guide to install CUDA on BalenaOS x86_64?
I referred https://www.balena.io/blog/getting-started-with-the-nvidia-jetson-nano-using-balena/
But failed with genericx86-64-ext devices.

Second one,
Regarding Docker-compose on Balena, do you support --shm-size and --gpus options?
I found that Balena seems took https://github.com/docker/compose/issues/6691 in recent few months.
However, these options are not working.

Screen Shot 2020-07-14 at 5.28.04 PM
Screen Shot 2020-07-14 at 5.28.04 PM1912×276 62.3 KB

Screen Shot 2020-07-14 at 5.16.54 PM
Screen Shot 2020-07-14 at 5.16.54 PM2114×640 234 KB

#50

Hi @limpro, some questions to understand better:

  • At what stage of the provisioning process does the error happen?
  • What’s the error that you see when it fails?

For your second question, I’m not sure what you refer to with that issue, but you should be able to use the shm_size property as documented here along with the other listed properties. If they’re not listed, they’re most likely not available yet

#52

Hi @thundron,

To verify whether balena can support GPU available container(nvidia/cuda:10.1-base), I ran below command in the device (OS Ver.: balenaOS 2.48.0+rev5 / Device Type: genericx86-64-ext)

balena-engine run --gpus all,capabilities=utility nvidia/cuda:10.1-base nvidia-smi

Please refer attached screenshot

Screen Shot 2020-07-14 at 5.52.13 PM
Screen Shot 2020-07-14 at 5.52.13 PM2048×752 223 KB

#54

Hello, I don’t see the attachment in our system. Please could you try attaching again?

#55

Hello @srlowe,

Screen Shot 2020-07-14 at 5.52.13 PM
Screen Shot 2020-07-14 at 5.52.13 PM2048×752 223 KB

Can you see my screenshot?

#56

Yes, I have it now thank you. Looking into this.

#59

Hi Balena Team,

My project needs to deploy AI services on GPU machines(x86_64, Nvidia GPU). I am considering to use Balena for the project(GPU machines as balenaDevices). So it is critical that CUDA enabled docker can run on balenaDevice.

Could you help me figure out whether GPU inference(using Nvidia Docker) can run on balenaDevcie(x86_64), please?

#61

Just to clarify your device is a computer with a GPU. If so can you send us the GPU that you’ll use?

#62

=> YES. Support x86_64. Video analyze services (Not IoT)

Hi @mbalamat

If so can you send us the GPU that you’ll use?

=> Do you ask me to send GPU machine to you? Sorry it cannot be.

Balena team, could you help me find answers to below simple questions, please? Then my project can go forward

  • Is there any guide to install CUDA on BalenaOS x86_64?
  • Could you help me figure out whether GPU inference(using Nvidia Docker) can run on balenaDevcie( x86_64 ), please?

Thank you! LimPro

#63

Excuse me, sorry I meant to send us the name of the GPU you’ll use eg GTX1050, not the physical GPU. I have routed your questions to the devices and balena-engine teams, we’ll get back to you as soon as possible. In the meantime, if it’s ok with you, it would be great to tell us more about what hardware setup (GPU model) are you planning to use.

#64

Oh haha. sorry. Currently, my developing machine has two GTX 1080Ti but I will use GTX2080 also in near future.
The number of GPUs can be varied(depends on each project situation). Some machines have 3 GPUs or just one.

#65

the image you mentioned above nvidia/cuda:10.1-base is it able to handle multiple GPUs?

#66

the image you mentioned above nvidia/cuda:10.1-base is it able to handle multiple GPUs?

Yes, it can access one and/or all GPUs

#72

Thanks for the feedback.
We will get back to you once we have more details regarding using --gpus with balena engine.

#75

Hello Belena team,

I am looking for the answers :sweat_smile:

Thank you! LimPro

#77

Hi!

Excuses for the delay, we have forwarded your question to the engine maintainer but he is not around at the moment, he should be able to have a look at your questions next week :slight_smile:

Thanks!

1 Like