Regarding that next step with openCV, I think there were people experimenting with it. It’s seems to be an old project, but might have some clue to get things running https://github.com/Mobile-CHAP/resin-opencv There’s also https://docs.resin.io/examples/projects/#smartbin (though it might be even older). At our spring hackathon there were people working with OpenCV, so definitley experience recently as well, though can’t seem to find any code uploaded somewhere so it’s more anecdotal…
Looking forward hearing what you build!