These .local domains should work via mDNS. Majority of OS distributions support this protocol, and you should see the domain names resolved on your working machine so long as device is connected to the same network.
The first thing I would check is whether your devices are actually connected. On PI4, for example, you should not see a blinking LED. If it’s blinking like described on the referred page, your device does not have connectivity (a typical reason for me personally is a typo in Wi-Fi credentials). You might also see if devices are connected using some local router web page that displays the devices in your network.
This depends a bit on the router, as some of them will assign the numbers sequentially, but just this morning my router decided to skip all the way to http://foldforcovid-18.local !
So, you may need to query your local IP leases to find out what hostname got assigned, thanks.