Look at using docker, one of the tool that would help you the most is Portainer
https://mariushosting.com/synology-30-second-portainer-install-using-task-scheduler-docker/
For media sharing : Plex and Jellyfin are the most used, there is Emby too. you can try and see wish one suits you the most.
And u/thekrautboy already mentioned : https://github.com/awesome-selfhosted/awesome-selfhosted
Photo/Video editing would be limited due to the cpu on the machine so be aware :)
Have fun !
You should take a look a this website below
If you're coming from pfsense, opnsense will be your best alternative
Lots of good articles to begin with opnsense : https://homenetworkguy.com/tags/opnsense/