Sorry, but it's bad news: we haven't been able to restore the DB primary filesystem to a state we're confident in running as a primary (especially given our experiences with slow-burning postgres db corruption). So we're having to do a full 55TB DB snapshot restore from last night, which will take >10h to recover the data, and then >4h to actually restore, and then >3h to catch up on missing traffic. Huge apologies for the outage. Again, folks using their own homeservers are not impacted.

Emelia 👸🏻
boosted
#HugOps to our friends on instances using OVH:
https://mastodon.social/@mastohost/115135680198909142
Remember to support your mods and admins, even if it's just with empathy, kindness, and understanding.
#HugOps to our friends on instances using OVH:
https://mastodon.social/@mastohost/115135680198909142
Remember to support your mods and admins, even if it's just with empathy, kindness, and understanding.