I'm using Syncthing. It doesn't feel like overkill, especially since I'm also using it for music and photos. I basically just set it up and forget about it.
Selfhosted
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
Same, but apparently android app is no longer supported since google play was too annoying for the developer. So wondering how long I can keep it up.
Syncthing-Fork has been out for years and has more options too
Perhaps take a look at this :)
Planning to close my Google Play Developer Account. Please say hi if you are interested in obtaining the latest gplay release files from me to help in publishing this app.
Seems like most open source project are leaving Google's official store? That's nice but will leave out some potential visibility for people who have no idea other than Google Store.
I wish their was also an easy way to leave github behind :/. Wait&See !!
When Google doesn't restrict apps via the Android APIs, they restrict them via the BS Play Store review requirements. I've seen apps loose important functionality over this, meanwhile there's still rampant viruses roaming free in that dump.
I predict we'll see more and more 'Power user' apps move away from the Play Store as time goes on
Just like @BearOfaTime@lemm.ee suggested, Syncthing-fork works fine for now, I've been using it on my phone to sync logseq notes and I haven't had any issues so far
F-droid
It seems to me that Syncthing is the exact right thing to use here; what is "overkill" about it that makes you think you should use something else?
No Syncthing is perfect. The problem is the Android app development issue. The main all had it last update ever earlier this month.
This is what i do. Just ensure version control is enabled. Works perfectly.
I know you don't want to pay for their sync service and this is the self-hosted community, but I just wanted to note that they service does work well and gives you access to note history. I decided to pay because Obsidian is excellent and I wanted to support it. I just wish it were open source.
Yep, I used to sync my Obsidian vault with Syncthing but I had some trouble with it once where stuff wasn't properly synced and led to conflicts so I switched to paying for Obsidian Sync and have been very happy with it. I was especially happy to see that now offer a cheaper tier that has enough storage if you only sync text files.
Look at the LiveSync plugin as another option. It's pretty robust but does require a CouchDB server accessible to whatever devices will be syncing information. The developer has several repos of slightly different server options, but if you use Tailscale there's one that runs CouchDB through Tailscale Funnel.
I’m using LiveSync & it has been working great for me.
I know this doesn't answer your question, but I love obsidian and have no problem paying for the sync. If anyone can't afford to do so, I completely get it and am not judging. But the company behind obsidian has taken zero VC funding, and are doing amazing things. I highly encourage folks to support them if you have the means.
Not what you're asking, but in case it helps. I don't use Obsidian, I use https://silverbullet.md/ it's very similar, markdown files with the ``[[other note]]` syntax (as well as some querying mechanism that I believe Obsidian also has), in short it's almost an open source version of obsidian but it has some advantages IMO:
- It is open source
- It provides a sync mode, where you download the text to your device and it's accessible offline to get sync afterwards.
- It's hackable so you can write your own functions and styles
I'm surprised almost no one has heard of it, the main developer is here on Lemmy, that's how I found out about it. BTW I also use syncthing to keep backups of my data, and even specifically to not sync a work folder outside of the work computer even though the rest is synced, so I can access Silverbullet from localhost on the work computer and get everything there and any changes to non-work stuff get synced to my home server, and from my personal server get everything except work stuff.
I would love to remove non floss obsidian from my day but its just so gosh darn useful. I came across Silverbullet a while ago in one of my periodic searches for alternatives.
Main issue getting in the way for me to even try it is docker. I understand that once you are comfortable with it, its convenient, but I never got there. I have tried running it every so often and its always some kind of issue that makes me give up. I keep a list of docker-only software to try in the event I ever get over that hump and this is on it.
As a competitor against obsidian, Joplin etc the docker pre req is a very high bar to clear. Overwhelming majority of users of note taking apps have not and will not run docker.
Knowing this, it makes me less excited about this project as it exists today because the best thing about obsidian is the giant user base creating so many plugins and tools to work with it. I wouldn't care for vanilla obsidian at all, it is made great by all the community generated add ons. So a small user base is kind of inherently a knock against any given project for me.
I don't know or presume this projects goals. If they want to be an alternative to desktop apps for less technical user-base, this would have to be resolved. But totally legit if that's not the priority.
I know you probably heard this thousands of times, but really, if you're into self-hosting docker is a blessing. People make it harder than it needs to be when explaining all of the ins and outs. I assume you have a Linux box where you run your stuff, just install docker and docker compose there (you might need to enable the docker service, add your user to the docker group and reboot, unless you're using a user friendly distro like Ubuntu). Then just make a folder anywhere for Silverbullet, create a file named compose.yaml
and put the following text there:
# services means that everything inside is a service to be deployed
services:
# this is the name of the service, you can put whatever you want
silverbullet:
# this is the docker image to use
image: zefhemel/silverbullet
# this is the rule to restart in case of crashes
restart: unless-stopped
# these are environment variables you want defined
environment:
# this is a specific variable for Silverbullet, it's essentially username:password change this accordingly
- SB_USER=admin:admin
# volumes are local folders you want to be available
volumes:
# in this case we want that the folder ./space be mounted as /space inside the container
- ./space:/space
# these are the ports we want to expose
ports:
# This means expose port 3000 on port 3000, if you want to access Silverbullet on port 8080 this would be 8080:3000 (because internally the service is still listening to 3000)
- 3000:3000
Then run docker compose up
and you should be able to access it on the port 3000.
Ling story short docker compose looks for a file named compose.yaml
in the local directory, and that file above has all of the information it needs to run the server. I've annotated each line there, feel free to remove the comments.
I really appreciate the time you took to help me but seriously there is always issues even when it's supposed to be simple/basic. Nevertheless I am in the mood to be wrong and pleasantly surprised so I follow your instructions. (Spoiler: It doesn't work. But I am not trying to request further help about this, because I am fairly resigned to the situation. I am just showing you, that I tried.)
I already had docker
and docker-compose
installed; I was already in the docker
group; and the service was already active per systemctl
. I guess from last time I tried this (not too long ago). Create directory, file etc.
$ docker compose up
unable to get image 'zefhemel/silverbullet': Cannot connect to the Docker daemon at unix:///home/username/.docker/run/docker.sock. Is the docker daemon running?
So I find Troubleshooting the Docker daemon | Docker Docs. It has several methods to find out if docker is even running which now I am confused about.
reports as inactive:
# systemctl is-active docker
,
# systemctl status docker.service
,
$ docker info
report as active:
$ systemctl status docker.service
,
# systemctl is-active docker
,
$ systemctl is-active docker
,
# docker info
$ env | grep DOCKER_HOST
and # env | grep DOCKER_HOST
have no output.
ps aux | grep docker
and top | grep docker
tell me dockerd
is running by root
. So I think maybe I need to start it as a regular user for this exercise?
Found Start the daemon | Docker Docs which advises the use of dockerd
either with or without sudo
depending on environment.
normal user:
Starting up
dockerd needs to be started with root privileges. To run dockerd in rootless mode as an unprivileged user, see https://docs.docker.com/go/rootless/
Oh it needs to be root. OK, try again with sudo:
Starting up
failed to start daemon, ensure docker is not running or delete /var/run/docker.pid: process with PID 3952 is still running
So it is running? 3952
was pid reported by top
and ps
. It is running. But it's not running.
Who knows... honestly this is how it goes every time. Maybe I am running services wrong... maybe I set something up last time because I was trying to solve another problem and it was suggested and that thing is now causing me am issue. I could chase my tail on this all week.
Like I said I completely believe everyone that once you're rolling with it, it's great. I'm happy for everyone who is able to access this. I will continue to live without it for the time being.
Wow, that's very unfortunate. If you installed docker through package manager and have added yourself to the group I believe this to be self-imposed, I don't know which mechanism Docker uses to give access to users in the group to its service, but seems related to that since it looks like the service is running but just your user can't access it. To confirm it's just that run the compose command as root, i.e. sudo docker compose up
, this is not ideal but if that works you know it's a permission problem with your user.
You seem to know your way around Linux, so it's probably not something obvious. I'm almost sure it's something stupid and self imposed, I've done my fair share of stupid shit like leaving a config file malformatted or deleting a library or installing something through manually copying files only for something else to break because I overwrote something important.
sudo docker compose up
OK, well that works enough to access the specified port and loads the webapp. So that's cool. :) There's a tcp error printed in the page itself but ?maybe? that is caused by improperly running it.
It could well be some self imposed error. But I'm always gonna be making those. If it is, it happened because I was trying to solve some other rudimentary issue. I've never gotten anything functional with this so it's not like I was trying to do something fancy and got in over my head.
Part of the issue with docker in this attempt and other times is it doesn't give good enough errors/output to diagnose. It's really kind of you to help me here but I can't call you every step. The documentation is too focused on making things look simple even when they're not, and therefor glossing over whatever system weirdies are getting in the way. You identified a user issue and even I suspected it (that's why I tried all those commands with and without sudo
in the above comment). Yet it is not in the official documentation as a potential cause of said error. And now that I have confirmed it, I have no idea how to solve it. I see in my browser history I've previously looked up "rootless mode". Maybe that's how I screwed this up in the first place.
Moral of the story is, docker becomes a mess immediately. :D
the obsidian-git plugin. Auto commits and pulls/push every x minutes. Works great for me, I get full version control and works on all my platforms (Linux, Windows, Android). You just need to be careful with your .gitignore and add at least .obsidian/workspace.json to prevent conflicts.
Probably not suitable if you store larger files, but after a year of daily usage with tons of small images I'm still below 150 MB.
Does this plugin work on mobile too? I'm looking to try out Obsidian and this sounds promising.
For what it's worth, I ended up choosing the obsidian sync service. While it goes against my "self host everything" mantra, I do also want to support software makers who make great products that respect peoples privacy. As such, I decided the $8/m investment was warranted.
My son in highschool uses Obsidian for all his school note taking, so he actually is able to use the same sync subscription.. As each vault has separate keys, there's no privacy issues between us...
My favourite part of this solution is it supports live update from multiple devices at once, so I have the vault open on phone, tablet, home laptop and work laptop simultaneously, and it just works...
Just thought it was worth sharing.
That's fair. It's just a lot of money right now.
Don't know if you saw that they added a $4/mo tier for Obsidian Sync. I thought $8/mo was too high and went to cancel it and saw the cheaper price. For how well it works as far as speed and reliability of syncing with version control, it's worth that for me.
Oh, I totally get it.... I've been in the same place many times (and I'm sure I will be again...)
I just have a policy of trying to support these things whenever I'm able to, otherwise I feel I'm not able to grumble when privacy respecting apps disappear from existence through lack of financial support...
12€ (I believe) is way too much to using it maybe once every week for private use.
If it was something like Bitwarden where it's around 10€ per year I would be totally up to paying it
I wrote a guide with a few options: https://avidandrew.com/elevate-your-note-taking-with-obsidian.html
I personally use SyncThing with the SyncThing-Fork app now
I just have my vault default location saved on a cloud drive. iCloud in my case as I have an IPhone but I guess it could be done with any cloud or owncloud if you have a server.
I used to use Git, but it is easier to just move the vault on a network/cloud drive as you don’t need to pull/push. As obsidian auto save when you type a character this makes the sync instantaneous with zero effort.
I’m using the plugin remotely save and sync via WebDAV. Nextcloud provides a WebDAV interface so it’s pretty straight forward, and I can read my vault online via Nextcloud Web. Im mostly happy with it but sometimes there are some sync hiccups if versions of the plugin are very far apart but I also have 5-6 instances of obsidian that I need to keep in sync.
this is my setup as well, shout out to removely save. and i never have any sync issues with 3 clients.
I use git to sync Obsidian. Termux on Android and git on any other device. I have two scripts, one .sh one .psh, that I run to just commit and push the latest changes. On Windows I use the plugin shell commands for one-click running the script, on Android I need to use termux.
It's not the easiest but it is, at least to me, easy to set up :)
I personally use the Obsidian Git plugin and sync it to a self-hosted Gitea server. You could also use GitHub or something similar, if you don’t mind them.
I just dumped my obsidian workspace into a folder synced by Google Drive.
You and also use crypmator to encrypt your notes inncase google ai starts reading them.
@lambda@programming.dev Syncthing worked wonders for me, though it is only recently that I knew about Syncthing plugin on Obsidian; I used syncthing without it. I used it to sync notes for three separate vaults between my laptop and android phone.
The plugin is nice to know about. I was just putting the vault in a syncthing folder.
I simply use Nextcloud to sync the vault directory. It has clients for both desktop and mobile and works perfectly fine. I use it to sync basically everything between my work, home, laptop, and mobile.
The only drawback is that I don't know if Obsidian automatically reloads a file if it is changed - if not, and you leave the file open in the editor, you might accidentally overwrite the new file with old data.
Just sync it using whatever cloud service you use, doesnt matter if selfhosted or not. ie. DIY
BTW if your library gets large and has a lot of plugins, it wont run to any useful degree on your phone.
I sync my vaults using Nextcloud.
I would love a way to only keep it on a server (like S3) and access it live with a local cache.