Discussion
Loading...

#Tag

Log in
  • About
  • Code of conduct
  • Privacy
  • Users
  • Instances
  • About Bonfire
Mauricio Teixeira 🇺🇸🇧🇷
Mauricio Teixeira 🇺🇸🇧🇷
@badnetmask@hachyderm.io  ·  activity timestamp 2 weeks ago

So, I want to add an S3-compatible storage service local to my home lab (currently I'm using Backblaze). Basically I want it to run as a Docker service on my Synology NAS. It needs to run in the Synology because I want it to be external to my servers. I'm undecided between Garage or SeaweedFS.

Not MinIO. No, not Ceph. Not a VM. Not a Pi. Not in Kubernetes.

Anyone have/had that very particular setup and can share their experiences? Thanks in advance.

#HomeLab #Synology #Garage #SeaweedFS @homelab

  • Copy link
  • Flag this post
  • Block
Michael Dexter boosted
Stefano Marinelli
Stefano Marinelli
@stefano@mastodon.bsd.cafe  ·  activity timestamp 3 months ago

Self-hosting your Mastodon media with SeaweedFS

https://it-notes.dragas.net/2025/11/06/self-hosting-your-mastodon-media-with-seaweedfs/

#FreeBSD #SeaweedFS #Mastodon #ITNotes #Fediverse #Hosting #OwnYourData #RunBSD

IT Notes

Self-hosting your Mastodon media with SeaweedFS

A practical guide to boosting Mastodon performance by self-hosting your media with SeaweedFS. Configure a fast, S3-compatible storage backend to efficiently handle your instance's files and take full control of your data.
⁂
More from
Stefano Marinelli
  • Copy link
  • Flag this post
  • Block
bioinformatician_next_door and 1 other boosted
IT Notes
IT Notes
@itnotes@snac.it-notes.dragas.net  ·  activity timestamp 3 months ago
Self-hosting your Mastodon media with SeaweedFS

https://it-notes.dragas.net/2025/11/06/self-hosting-your-mastodon-media-with-seaweedfs/

#ITNotes #NoteHUB #container #fediverse #freebsd #hosting #jail #mastodon #networking #ownyourdata #seaweedfs #server #tutorial #web
IT Notes

Self-hosting your Mastodon media with SeaweedFS

A practical guide to boosting Mastodon performance by self-hosting your media with SeaweedFS. Configure a fast, S3-compatible storage backend to efficiently handle your instance's files and take full control of your data.
⁂
More from
Stefano Marinelli
  • Copy link
  • Flag this post
  • Block
Stefano Marinelli
Stefano Marinelli
@stefano@mastodon.bsd.cafe  ·  activity timestamp 3 months ago

Self-hosting your Mastodon media with SeaweedFS

https://it-notes.dragas.net/2025/11/06/self-hosting-your-mastodon-media-with-seaweedfs/

#FreeBSD #SeaweedFS #Mastodon #ITNotes #Fediverse #Hosting #OwnYourData #RunBSD

IT Notes

Self-hosting your Mastodon media with SeaweedFS

A practical guide to boosting Mastodon performance by self-hosting your media with SeaweedFS. Configure a fast, S3-compatible storage backend to efficiently handle your instance's files and take full control of your data.
⁂
More from
Stefano Marinelli
  • Copy link
  • Flag this post
  • Block
IT Notes
IT Notes
@itnotes@snac.it-notes.dragas.net  ·  activity timestamp 3 months ago
Self-hosting your Mastodon media with SeaweedFS

https://it-notes.dragas.net/2025/11/06/self-hosting-your-mastodon-media-with-seaweedfs/

#ITNotes #NoteHUB #container #fediverse #freebsd #hosting #jail #mastodon #networking #ownyourdata #seaweedfs #server #tutorial #web
IT Notes

Self-hosting your Mastodon media with SeaweedFS

A practical guide to boosting Mastodon performance by self-hosting your media with SeaweedFS. Configure a fast, S3-compatible storage backend to efficiently handle your instance's files and take full control of your data.
⁂
More from
Stefano Marinelli
  • Copy link
  • Flag this post
  • Block
IT Notes
IT Notes
@itnotes@snac.it-notes.dragas.net  ·  activity timestamp 3 months ago
Self-hosting your Mastodon media with SeaweedFS

https://it-notes.dragas.net/2025/11/06/self-hosting-your-mastodon-media-with-seaweedfs/

#ITNotes #NoteHUB #container #fediverse #freebsd #hosting #jail #mastodon #networking #ownyourdata #seaweedfs #server #tutorial #web
IT Notes

Self-hosting your Mastodon media with SeaweedFS

A practical guide to boosting Mastodon performance by self-hosting your media with SeaweedFS. Configure a fast, S3-compatible storage backend to efficiently handle your instance's files and take full control of your data.
⁂
More from
Stefano Marinelli
  • Copy link
  • Flag this post
  • Block
Stefano Marinelli
Stefano Marinelli
@stefano@mastodon.bsd.cafe  ·  activity timestamp 3 months ago

@pertho @jae @amd @matthew Both the BSD Cafe and illumos Cafe's S3 media server is powered by #SeaweedFS - the performance is great.
I tried with Garage and, for this specific use case, it was much slower. But it was an old version, so I'm planning to perform some new tests with a recent one.

  • Copy link
  • Flag this post
  • Block
amd
amd
@amd@gts.amd.im  ·  activity timestamp 3 months ago

My minio instance has very basic needs and continues to chug along, but they've clearly made every effort to do away with the community version and I need to figure out a plan before I'm stuck.

Anyone switched to Garage?

Any other suggestions for self-hosting S3 compatible storage?

I'm basically only using it for hosting static pages, restic backup target, and sometimes as a media store for matrix / GoToSocial (though I think neither at this exact moment).

#homelab #selfhosting

matthew - retroedge.tech
matthew - retroedge.tech
@matthew@social.retroedge.tech replied  ·  activity timestamp 3 months ago

Maybe #SeaWeedFS

I haven't used it, but looks interesting to me.

https://github.com/seaweedfs/seaweedfs

GitHub

GitHub - seaweedfs/seaweedfs: SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, xDC replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. Enterprise version is at seaweedfs.com.

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, xDC replica...

RetroEdgeTech

  • Copy link
  • Flag this comment
  • Block
Kevin Woblick
Kevin Woblick
@Kovah@mastodon.social  ·  activity timestamp 3 months ago

After the newest fuckery from #MinIO, I tried #SeaweedFS and Garage, and then decided to just go with #Backblaze for my server backups, with local replication to my Synology NAS.

Sometimes, #selfhosting is the tedious, nerve-wrecking answer to a question, whose real solution is paying $0.5 a month. 🫠

  • Copy link
  • Flag this post
  • Block
Stephan Lichtenauer | נח סתו
Stephan Lichtenauer | נח סתו
@hnygd@mastodon.africa  ·  activity timestamp 4 months ago

@stefano, I just watched the recording of Patrick Hausen's @EuroBSDCon distributed storage session and at the end of the session somebody said you might have compared #SeaweedFS with #Garage and that you found SeaweedFS more suitable.

I know that you blogged about running SeaweedFS but I wasn't aware you compared different #S3 platforms, if you indeed did, would you mind sharing your experiences?

#FreeBSD

  • Copy link
  • Flag this post
  • Block
Stefano Marinelli
Stefano Marinelli
@stefano@mastodon.bsd.cafe  ·  activity timestamp 4 months ago

For example: The blinking you're seeing is due to the replication of the BSD Cafe's media, which happens almost in real-time thanks to SeaweedFS, via VPN. And yes, all that excites me.

#BSDCafe #SeaweedFS #ForeverYoung

Your browser does not support the video tag.
This video cannot be previewed
Open original
A raspberry pi 4 connected to an external disk, that is blinking
  • Copy link
  • Flag this post
  • Block
not Evander Sinque
not Evander Sinque
@FiLiS@mastodon.social  ·  activity timestamp 5 months ago

Hm, has there always been an "Enterprise" license of #seaweedfs? https://seaweedfs.com/docs/comparison/

  • Copy link
  • Flag this post
  • Block
Psyhackological
Psyhackological
@psyhackological@fosstodon.org  ·  activity timestamp 6 months ago
@stefano@Tubsta and Garage couldn't handle it that well? Do you have some simple benchmark? For example also compared to not so many bigger files?
Stefano Marinelli
Stefano Marinelli
@stefano@mastodon.bsd.cafe replied  ·  activity timestamp 6 months ago
@psyhackological@Tubsta I conducted some experimental tests. I set up Garage and SeaweedFS on the same machine - with rotating disks - the same one on which Minio runs. I then used rclone to copy files from Minio (which was in production) to Garage and SeaweedFS. I repeated the test several times.
With Garage, after a few GB, the process slows down, the CPU load increases (and by a lot), and the I/O wait becomes high. After about 80GB, I have to stop; the load becomes extremely high, and the latencies are monstrous.
With SeaweedFS, the load remains constant, and the performance is the same. The I/O wait remains minimal.
I've attached a graph of the machine's CPU load. On the left is when I performed the rclone to Garage. On the right, to SeaweedFS. Note that the bulk of the load in the second part is caused by Minio's reads.

#Minio#SeaweedFS

The graph shows the CPU load of a machine over time, from Saturday 12:00 to Saturday 18:00. The y-axis represents the CPU load, and the x-axis represents time. The graph is divided into two main sections. The first section, on the left, shows a very high and sustained CPU load, peaking significantly. This corresponds to the rclone operation to Garage. The second section, on the right, shows a lower, more consistent, and fluctuating CPU load, with several smaller peaks. This corresponds to the rclone operation to SeaweedFS. The overall load in the second section is considerably less intense than in the first, reflecting the difference in performance between the two systems.
The graph shows the CPU load of a machine over time, from Saturday 12:00 to Saturday 18:00. The y-axis represents the CPU load, and the x-axis represents time. The graph is divided into two main sections. The first section, on the left, shows a very high and sustained CPU load, peaking significantly. This corresponds to the rclone operation to Garage. The second section, on the right, shows a lower, more consistent, and fluctuating CPU load, with several smaller peaks. This corresponds to the rclone operation to SeaweedFS. The overall load in the second section is considerably less intense than in the first, reflecting the difference in performance between the two systems.
The graph shows the CPU load of a machine over time, from Saturday 12:00 to Saturday 18:00. The y-axis represents the CPU load, and the x-axis represents time. The graph is divided into two main sections. The first section, on the left, shows a very high and sustained CPU load, peaking significantly. This corresponds to the rclone operation to Garage. The second section, on the right, shows a lower, more consistent, and fluctuating CPU load, with several smaller peaks. This corresponds to the rclone operation to SeaweedFS. The overall load in the second section is considerably less intense than in the first, reflecting the difference in performance between the two systems.
  • Copy link
  • Flag this comment
  • Block
Michael Dexter boosted
Stefano Marinelli
Stefano Marinelli
@stefano@mastodon.bsd.cafe  ·  activity timestamp 6 months ago

I've switched the BSD Cafe Mastodon media over to SeaweedFS.
Posts from the last few hours might not show media, as I'm doing the final 'rclone' migration from MinIO and the ETA is around 3 hours.

Stay tuned 🙂

#BSDCafe#Minio#SeaweedFS#Mastodon

  • Copy link
  • Flag this post
  • Block
Stefano Marinelli
Stefano Marinelli
@stefano@mastodon.bsd.cafe  ·  activity timestamp 6 months ago

I've switched the BSD Cafe Mastodon media over to SeaweedFS.
Posts from the last few hours might not show media, as I'm doing the final 'rclone' migration from MinIO and the ETA is around 3 hours.

Stay tuned 🙂

#BSDCafe#Minio#SeaweedFS#Mastodon

  • Copy link
  • Flag this post
  • Block
Michael Dexter boosted
Stefano Marinelli
Stefano Marinelli
@stefano@mastodon.bsd.cafe  ·  activity timestamp 6 months ago

After conducting some performance tests, I believe #SeaweedFS will be the new S3-compatible software for BSD Cafe media storage. The results have been promising

#S3#IT#SysAdmin

  • Copy link
  • Flag this post
  • Block
Stefano Marinelli
Stefano Marinelli
@stefano@mastodon.bsd.cafe  ·  activity timestamp 6 months ago

After conducting some performance tests, I believe #SeaweedFS will be the new S3-compatible software for BSD Cafe media storage. The results have been promising

#S3#IT#SysAdmin

  • Copy link
  • Flag this post
  • Block

bonfire.cafe

A space for Bonfire maintainers and contributors to communicate

bonfire.cafe: About · Code of conduct · Privacy · Users · Instances
Bonfire social · 1.0.1 no JS en
Automatic federation enabled
Log in
  • Explore
  • About
  • Members
  • Code of Conduct