Update:
I was able to solve the issue, the issue was not a missing library, but rather tegra-egl path is not in the ldconfig configs.
I updated the BSP installation part of the docker container to include echo "/usr/lib/aarch64-linux-gnu/tegra-egl" > /etc/ld.so.conf.d/nvidia-tegra-egl.conf and that fixes the issue of gstreamer blacklisting the deepstream plugins.
However, whenever I do a gst-inspect-1.0 nvtracker to show its information, it would still crashes from a seg fault (similar to what I posted in my earlier post). This however doesn’t seem to cause any issue when running the sample apps.