Are you playing a source that contains video by any change? We have this documentation entry on the problem that seems to be describing exactly what you are facing: https://sound.balenalabs.io/docs/troubleshooting#audio-is-delayed. It might be worth trying some of the workarounds described there and see how it goes
Yes it was a video I had tested, but it will mostly only be music. I will look into the article.