Discussion
Loading...

Post

Log in
  • About
  • Code of conduct
  • Privacy
  • Users
  • Instances
  • About Bonfire
DrBusySloth
DrBusySloth
@drbusysloth@mastodon.social  ·  activity timestamp 5 days ago

Cloud spending hit $107 billion in Q3 2025, according to Synergy Research Group data. AWS around 29%, Azure 20%, and Google Cloud 13%.

Sure, they offer exceptional tech and service, right?

Well, let's take an orchestrator like Apache Airflow (no exception): it'll easily set you back €300+/month, whereas a comparable setup on self-hosted hardware (e.g., a VPS) can be €5/month. 2x I get it, 5x maybe, 10x that's greedy-but 100x more?

Self-hosting!

#Cloud #MLOps #DevOps #SelfHosting #OpenSource

  • Copy link
  • Flag this post
  • Block
d@nny disc@ mc²
d@nny disc@ mc²
@hipsterelectron@circumstances.run replied  ·  activity timestamp 5 days ago

@drbusysloth twitter inc always self hosted everything. i managed several apache airflow orchestrations

  • Copy link
  • Flag this comment
  • Block
DrBusySloth
DrBusySloth
@drbusysloth@mastodon.social replied  ·  activity timestamp 5 days ago

@hipsterelectron Hosting at Twitter scale is absolutely massive, props 😉

Honestly, even well below Twitter scale, self-hosting these packages is still quite complicated. Wouldn’t it be nice if it were as easy as “press a button and here you go with a solid, production-ready setup”?

For huge orgs that won't work, I get it. But for smaller teams and indie devs, it really should. Esp. when you consider that Airflow is just one service in a whole production suite: MLflow, Kafka, vector DBs, aso 🦥

  • Copy link
  • Flag this comment
  • Block
d@nny disc@ mc²
d@nny disc@ mc²
@hipsterelectron@circumstances.run replied  ·  activity timestamp 4 days ago

@drbusysloth that is exactly the kind of thing we were building with pants https://pantsbuild.org unfortunately google convinced twitter to stop funding it

  • Copy link
  • Flag this comment
  • Block
DrBusySloth
DrBusySloth
@drbusysloth@mastodon.social replied  ·  activity timestamp 4 days ago

@hipsterelectron Awesome! I definitely gonna give it a try 😀

My project (mlox.org) comes from a different angle: specialized, opinionated, and hands-off. Less "build your own world" and more "these are the 3 things you can do, it should just work". Also very early days compared to something as mature as Pantsbuild.

I actually think both approaches make sense together: I have a small pilot where MLOX CLI is used from the build system to deploy models. Still a tad clumsy, but promising 🙂

  • Copy link
  • Flag this comment
  • Block
d@nny disc@ mc²
d@nny disc@ mc²
@hipsterelectron@circumstances.run replied  ·  activity timestamp 4 days ago

@drbusysloth these monopolists are vicious

  • Copy link
  • Flag this comment
  • Block

bonfire.cafe

A space for Bonfire maintainers and contributors to communicate

bonfire.cafe: About · Code of conduct · Privacy · Users · Instances
Bonfire social · 1.0.2-alpha.7 no JS en
Automatic federation enabled
Log in
  • Explore
  • About
  • Members
  • Code of Conduct