You need a reverse proxy container, one that can listen on 443 and direct requests to the appropriate container.
I'm a fan of Traefik for docker scenarios. It's a little complicated compared to something like nginx, but is indirectly flexible and powerful.
Here's my config as a starting point, the docs for Traefik are pretty good.