@pertho @jae @amd @matthew Both the BSD Cafe and illumos Cafe's S3 media server is powered by #SeaweedFS - the performance is great.
I tried with Garage and, for this specific use case, it was much slower. But it was an old version, so I'm planning to perform some new tests with a recent one.
My minio instance has very basic needs and continues to chug along, but they've clearly made every effort to do away with the community version and I need to figure out a plan before I'm stuck.
Anyone switched to Garage?
Any other suggestions for self-hosting S3 compatible storage?
I'm basically only using it for hosting static pages, restic backup target, and sometimes as a media store for matrix / GoToSocial (though I think neither at this exact moment).
Maybe #SeaWeedFS
I haven't used it, but looks interesting to me.
https://github.com/seaweedfs/seaweedfs
jbz
boosted
After the newest fuckery from #MinIO, I tried #SeaweedFS and Garage, and then decided to just go with #Backblaze for my server backups, with local replication to my Synology NAS.
Sometimes, #selfhosting is the tedious, nerve-wrecking answer to a question, whose real solution is paying $0.5 a month. 🫠
After the newest fuckery from #MinIO, I tried #SeaweedFS and Garage, and then decided to just go with #Backblaze for my server backups, with local replication to my Synology NAS.
Sometimes, #selfhosting is the tedious, nerve-wrecking answer to a question, whose real solution is paying $0.5 a month. 🫠
@stefano, I just watched the recording of Patrick Hausen's @EuroBSDCon distributed storage session and at the end of the session somebody said you might have compared #SeaweedFS with #Garage and that you found SeaweedFS more suitable.
I know that you blogged about running SeaweedFS but I wasn't aware you compared different #S3 platforms, if you indeed did, would you mind sharing your experiences?
For example: The blinking you're seeing is due to the replication of the BSD Cafe's media, which happens almost in real-time thanks to SeaweedFS, via VPN. And yes, all that excites me.
Hm, has there always been an "Enterprise" license of #seaweedfs? https://seaweedfs.com/docs/comparison/
Michael Dexter
boosted
Thanks to SeaweedFS, I've set up two replicas of the BSD Cafe's media. One is on a backup server (for disaster recovery purposes only, also containing the hourly zfs-autobackup backups), and the other is on a Raspberry Pi 4 running FreeBSD, which is one of my home backup servers - just one meter away from my desk.
I've also configured Nginx in a jail, so when I'm at home, the BSD Cafe's media is served directly from the local replica.
The performance is lightning fast.
#BSDCafe #SeaweedFS #S3 #Mastodon #SelfHosting #Homelab #FreeBSD #RunBSD
@psyhackological@Tubsta I conducted some experimental tests. I set up Garage and SeaweedFS on the same machine - with rotating disks - the same one on which Minio runs. I then used rclone to copy files from Minio (which was in production) to Garage and SeaweedFS. I repeated the test several times.
With Garage, after a few GB, the process slows down, the CPU load increases (and by a lot), and the I/O wait becomes high. After about 80GB, I have to stop; the load becomes extremely high, and the latencies are monstrous.
With SeaweedFS, the load remains constant, and the performance is the same. The I/O wait remains minimal.
I've attached a graph of the machine's CPU load. On the left is when I performed the rclone to Garage. On the right, to SeaweedFS. Note that the bulk of the load in the second part is caused by Minio's reads.
With Garage, after a few GB, the process slows down, the CPU load increases (and by a lot), and the I/O wait becomes high. After about 80GB, I have to stop; the load becomes extremely high, and the latencies are monstrous.
With SeaweedFS, the load remains constant, and the performance is the same. The I/O wait remains minimal.
I've attached a graph of the machine's CPU load. On the left is when I performed the rclone to Garage. On the right, to SeaweedFS. Note that the bulk of the load in the second part is caused by Minio's reads.
Thanks to SeaweedFS, I've set up two replicas of the BSD Cafe's media. One is on a backup server (for disaster recovery purposes only, also containing the hourly zfs-autobackup backups), and the other is on a Raspberry Pi 4 running FreeBSD, which is one of my home backup servers - just one meter away from my desk.
I've also configured Nginx in a jail, so when I'm at home, the BSD Cafe's media is served directly from the local replica.
The performance is lightning fast.
#BSDCafe #SeaweedFS #S3 #Mastodon #SelfHosting #Homelab #FreeBSD #RunBSD
Michael Dexter
boosted
I've switched the BSD Cafe Mastodon media over to SeaweedFS.
Posts from the last few hours might not show media, as I'm doing the final 'rclone' migration from MinIO and the ETA is around 3 hours.
Stay tuned 🙂
I've switched the BSD Cafe Mastodon media over to SeaweedFS.
Posts from the last few hours might not show media, as I'm doing the final 'rclone' migration from MinIO and the ETA is around 3 hours.
Stay tuned 🙂
Michael Dexter
boosted
After conducting some performance tests, I believe #SeaweedFS will be the new S3-compatible software for BSD Cafe media storage. The results have been promising
After conducting some performance tests, I believe #SeaweedFS will be the new S3-compatible software for BSD Cafe media storage. The results have been promising