Shout out to #TsDProxy (Tailscale Docker Proxy). Such a neat tool and works wonderfully.
Please do yourself a favour and go check it out if you #selfhost services in #docker and proxy through #tailscale.
Ii was looking for this exact solution and couldn't really believe it when I found it.