Discussion
Bloblin is pretty neat, it streams deltas to disk really fast! So fast that the storage backend is no longer the bottleneck.
We already have fairly efficient serialization that's smart and only serializes the deltas of the objects that changed. Bloblin makes things much better by streaming update by update individually to an open file in a directory for that store, compacting and garbage collecting writing into new files occasionally.
@cwebber very cute!
@cwebber can i use bloblin to store all my binary blobs 👉👈🥺
@aeva maybe not all of them but it's certainly a big improvement for that kinda thing :)
With Bloblin added, Goblins is moving to a point where it could become more useful for a distributed storage system and also distributed database systems. Which yes, we are thinking about those kinds of things ;)
(Actually, the first half of the animation loop appeared in a previous release... I finished the loop for this release!)
Bloblin is pretty neat, it streams deltas to disk really fast! So fast that the storage backend is no longer the bottleneck.
We already have fairly efficient serialization that's smart and only serializes the deltas of the objects that changed. Bloblin makes things much better by streaming update by update individually to an open file in a directory for that store, compacting and garbage collecting writing into new files occasionally.
I started the work and design on Bloblin, and @tsyesika carried it across the finish line (itself not a trivial task!)
On a somewhat self-indulgent level, this release is nice because I often am caught up in the day-to-day operations these days as Executive Director. Bloblin was a group effort, but I built out the core of the design, which was nice to do that kind of engineering again.
Plus I got to do the animation :)
If you like the animation and like Blender, the source file is here if you want to take a look! https://files.spritely.institute/videos/aurie-crystal-cycle.blend
I should also clarify that @tsyesika *in general* is the one who has made our persistence system into something as awesome as it is. Aurie is in many ways Jessica's baby, even if I contributed this backend, and she's done incredible work on it. So proud of her and its' such a privilege to work with her :)
Speaking of spreading the credit around, this release also continues the history of characters that were co-designed by @davidrevoy and myself. I'm really happy to complete the loop on this character's serialization, and I consider myself so lucky to have been able to work with @davidrevoy who really took my tiny sketches and made them into something magical. All artwork we've done since has much to thank from @davidrevoy's strong legacy :)
A space for Bonfire maintainers and contributors to communicate
