# Enable GPU on Container

**URL:** <https://forums.balena.io/t/enable-gpu-on-container/194366>\
**Category:** balenaOS\
**Tags:** docker, nvidia\
**Created:** [September 28, 2020, 9:06pm UTC](https://forums.balena.io/t/enable-gpu-on-container/194366 "2020-09-28T21:06:11Z")\
**Posts on this page:** 20\
**Page:** 3

<div class="post-metadata">

**Author:** ![scarlyon](https://avatars.discourse-cdn.com/v4/letter/s/a5b964/32.png) [@scarlyon](https://forums.balena.io/u/scarlyon)\
**Post date:** [October 14, 2020, 12:02pm UTC](https://forums.balena.io/t/enable-gpu-on-container/194366/93 "2020-10-14T12:02:11Z")

</div>

@robertgzr  
Ok, which image should I flash? (Intel NUC, Up board, MS Surface, etc)

I will sign up to balenaCloud and create a project. Please send me an email to s.carlyon@viso.ai and will send the link.

Cheers,  
Shane.

---

<div class="post-metadata">

**Author:** ![robertgzr](https://sea2.discourse-cdn.com/balena/user_avatar/forums.balena.io/robertgzr/32/1387_2.png) [@robertgzr](https://forums.balena.io/u/robertgzr)\
**Post date:** [October 14, 2020, 12:29pm UTC](https://forums.balena.io/t/enable-gpu-on-container/194366/94 "2020-10-14T12:29:09Z")

</div>

There should be a `generic-x86_64` device type that you can use

---

<div class="post-metadata">

**Author:** ![scarlyon](https://avatars.discourse-cdn.com/v4/letter/s/a5b964/32.png) [@scarlyon](https://forums.balena.io/u/scarlyon)\
**Post date:** [October 14, 2020, 12:40pm UTC](https://forums.balena.io/t/enable-gpu-on-container/194366/95 "2020-10-14T12:40:21Z")

</div>

Cool.

Please give me your email and let me add you as a collaborator to my application.

Device should be ready soon.

Cheers,  
Shane.

---

<div class="post-metadata">

**Author:** ![robertgzr](https://sea2.discourse-cdn.com/balena/user_avatar/forums.balena.io/robertgzr/32/1387_2.png) [@robertgzr](https://forums.balena.io/u/robertgzr)\
**Post date:** [October 14, 2020, 12:51pm UTC](https://forums.balena.io/t/enable-gpu-on-container/194366/96 "2020-10-14T12:51:51Z")

</div>

you shouldn’t have to add me as a collaborator right now. granting support access should suffice.

![image](https://global.discourse-cdn.com/balena/original/2X/6/6cdd8d7a43469cd82242286c3bd362912d937505.png)

---

<div class="post-metadata">

**Author:** ![scarlyon](https://avatars.discourse-cdn.com/v4/letter/s/a5b964/32.png) [@scarlyon](https://forums.balena.io/u/scarlyon)\
**Post date:** [October 15, 2020, 6:12am UTC](https://forums.balena.io/t/enable-gpu-on-container/194366/99 "2020-10-15T06:12:07Z")

</div>

@robertgzr  
Ok, I have just enabled support access.

 ![image](https://global.discourse-cdn.com/balena/original/2X/2/211aa07c8e57cec3be063bb8270abfa5c7736cac.png)

Anything else needed? 🙂

Cheers,  
Shane.

---

<div class="post-metadata">

**Author:** ![georgiats](https://sea2.discourse-cdn.com/balena/user_avatar/forums.balena.io/georgiats/32/2571_2.png) [@georgiats](https://forums.balena.io/u/georgiats)\
**Post date:** [October 15, 2020, 2:29pm UTC](https://forums.balena.io/t/enable-gpu-on-container/194366/109 "2020-10-15T14:29:19Z")

</div>

Hi there, could you please share the UUID of your device with us here?  
Thanks!

---

<div class="post-metadata">

**Author:** ![scarlyon](https://avatars.discourse-cdn.com/v4/letter/s/a5b964/32.png) [@scarlyon](https://forums.balena.io/u/scarlyon)\
**Post date:** [October 15, 2020, 11:27pm UTC](https://forums.balena.io/t/enable-gpu-on-container/194366/112 "2020-10-15T23:27:34Z")

</div>

@georgiats

8c645a90dcb2e128bb821b10f8ae2914

Thanks!

---

<div class="post-metadata">

**Author:** ![scarlyon](https://avatars.discourse-cdn.com/v4/letter/s/a5b964/32.png) [@scarlyon](https://forums.balena.io/u/scarlyon)\
**Post date:** [October 16, 2020, 10:35am UTC](https://forums.balena.io/t/enable-gpu-on-container/194366/115 "2020-10-16T10:35:51Z")

</div>

@georgiats @robertgzr  
Were you able to SSH into our device?

---

<div class="post-metadata">

**Author:** ![richbayliss](https://sea2.discourse-cdn.com/balena/user_avatar/forums.balena.io/richbayliss/32/1054_2.png) [@richbayliss](https://forums.balena.io/u/richbayliss)\
**Post date:** [October 16, 2020, 10:38am UTC](https://forums.balena.io/t/enable-gpu-on-container/194366/116 "2020-10-16T10:38:30Z")

</div>

This is being investigated by Robert and we will update you when he has some progress.

---

<div class="post-metadata">

**Author:** ![scarlyon](https://avatars.discourse-cdn.com/v4/letter/s/a5b964/32.png) [@scarlyon](https://forums.balena.io/u/scarlyon)\
**Post date:** [October 20, 2020, 4:30am UTC](https://forums.balena.io/t/enable-gpu-on-container/194366/119 "2020-10-20T04:30:11Z")

</div>

Hey, guys.  
Any update here?

---

<div class="post-metadata">

**Author:** ![nghiant2710](https://avatars.discourse-cdn.com/v4/letter/n/90db22/32.png) [@nghiant2710](https://forums.balena.io/u/nghiant2710)\
**Post date:** [October 20, 2020, 5:24am UTC](https://forums.balena.io/t/enable-gpu-on-container/194366/120 "2020-10-20T05:24:42Z")

</div>

Hi,

We don’t have anything to share yet, we will update you as soon as possible.

---

<div class="post-metadata">

**Author:** ![robertgzr](https://sea2.discourse-cdn.com/balena/user_avatar/forums.balena.io/robertgzr/32/1387_2.png) [@robertgzr](https://forums.balena.io/u/robertgzr)\
**Post date:** [October 20, 2020, 12:43pm UTC](https://forums.balena.io/t/enable-gpu-on-container/194366/122 "2020-10-20T12:43:23Z")

</div>

hey sorry this took a bit. could you put the device online for me? I can take a look now

---

<div class="post-metadata">

**Author:** ![scarlyon](https://avatars.discourse-cdn.com/v4/letter/s/a5b964/32.png) [@scarlyon](https://forums.balena.io/u/scarlyon)\
**Post date:** [October 20, 2020, 12:53pm UTC](https://forums.balena.io/t/enable-gpu-on-container/194366/123 "2020-10-20T12:53:03Z")

</div>

@robertgzr  
Yes, it’s online now.

---

<div class="post-metadata">

**Author:** ![robertgzr](https://sea2.discourse-cdn.com/balena/user_avatar/forums.balena.io/robertgzr/32/1387_2.png) [@robertgzr](https://forums.balena.io/u/robertgzr)\
**Post date:** [October 20, 2020, 1:36pm UTC](https://forums.balena.io/t/enable-gpu-on-container/194366/128 "2020-10-20T13:36:53Z")

</div>

alright, so assuming this device has a gpu and ubuntu includes the drivers you need you should be able to build something along the lines of [https://github.com/balena-io-playground/jetson-base-images/tree/master/jetson-nano-cuda](https://github.com/balena-io-playground/jetson-base-images/tree/master/jetson-nano-cuda) for your application. Basically you would need to package everything (drivers, system libs, etc.) needed to use the gpu in your container image.

then you can run the container similar to this: [https://github.com/balenalabs-incubator/opendatacam](https://github.com/balenalabs-incubator/opendatacam) (I think `privileged` is the main takeaway)

* * *

we are working on a simpler/nicer solution to this that would move a lot of those requirements (drivers and system libs) into host os space - and make us deal with it ^^  
we will definitely make some noise in this thread when that work is ready

---

<div class="post-metadata">

**Author:** ![scarlyon](https://avatars.discourse-cdn.com/v4/letter/s/a5b964/32.png) [@scarlyon](https://forums.balena.io/u/scarlyon)\
**Post date:** [October 20, 2020, 10:58pm UTC](https://forums.balena.io/t/enable-gpu-on-container/194366/130 "2020-10-20T22:58:52Z")

</div>

Mate, the problem is that the installed nvidia driver is not working! 🤣

Once we get the driver working, cuda/cudnn should work without any issue.

So were you able to get `nvidia-smi` command working on my PC?

Cheers,  
Shane.

---

<div class="post-metadata">

**Author:** ![robertgzr](https://sea2.discourse-cdn.com/balena/user_avatar/forums.balena.io/robertgzr/32/1387_2.png) [@robertgzr](https://forums.balena.io/u/robertgzr)\
**Post date:** [October 21, 2020, 9:17am UTC](https://forums.balena.io/t/enable-gpu-on-container/194366/132 "2020-10-21T09:17:59Z")

</div>

Heyo @scarlyon I just re-read this thread and went back to the other one that was solved by switching to the 435 drivers

I was just trying to clear up some of the confusing information in this thread, in particular around the gpu supervisor label 🙂

so let’s backtrack… you are running a x86\_64 AMD machine with a GTX970 card.  
you had gpu integration working previously but using the intel-nuc `balenaOS 2.50.1+rev1` image it doesn’t work anymore.

can you tell me on which version of balenaOS you had it working?

---

<div class="post-metadata">

**Author:** ![scarlyon](https://avatars.discourse-cdn.com/v4/letter/s/a5b964/32.png) [@scarlyon](https://forums.balena.io/u/scarlyon)\
**Post date:** [October 21, 2020, 9:56am UTC](https://forums.balena.io/t/enable-gpu-on-container/194366/134 "2020-10-21T09:56:05Z")

</div>

Hmm, I can’t remember which version I was using in the last year… 😕

---

<div class="post-metadata">

**Author:** ![robertgzr](https://sea2.discourse-cdn.com/balena/user_avatar/forums.balena.io/robertgzr/32/1387_2.png) [@robertgzr](https://forums.balena.io/u/robertgzr)\
**Post date:** [October 21, 2020, 11:20am UTC](https://forums.balena.io/t/enable-gpu-on-container/194366/135 "2020-10-21T11:20:25Z")

</div>

I can have a look through the changes to figure out which in particular could have an impact?

---

<div class="post-metadata">

**Author:** ![robertgzr](https://sea2.discourse-cdn.com/balena/user_avatar/forums.balena.io/robertgzr/32/1387_2.png) [@robertgzr](https://forums.balena.io/u/robertgzr)\
**Post date:** [October 21, 2020, 11:21am UTC](https://forums.balena.io/t/enable-gpu-on-container/194366/136 "2020-10-21T11:21:06Z")

</div>

but I would need some version range…

---

<div class="post-metadata">

**Author:** ![scarlyon](https://avatars.discourse-cdn.com/v4/letter/s/a5b964/32.png) [@scarlyon](https://forums.balena.io/u/scarlyon)\
**Post date:** [October 21, 2020, 11:33am UTC](https://forums.balena.io/t/enable-gpu-on-container/194366/138 "2020-10-21T11:33:40Z")

</div>

Please check what was the latest version on the last November?

This was written on last Nov… 😂

> [@NVIDIA drivers on Intel Nuc](https://forums.balena.io/t/nvidia-drivers-on-intel-nuc/2903/58):
>
> Yeah, 435 works!!! Thanks for your help! Really appreciated.

[Previous page](https://forums.balena.io/t/enable-gpu-on-container/194366.md?page=2)

[Next page](https://forums.balena.io/t/enable-gpu-on-container/194366.md?page=4)
