Post
Google Chrome Team: We are disabling RTTI in our builds because it adds 10-20% to the size of the final binary and that overhead is too much. Download times and installed disk space are really important.
Also the Google Chrome Team: We’re going to bundle an LLM with the install. Sure, it’s ten times the size of the whole of the rest of the browser, but I’m sure it’s fine.
@david_chisnall I'd bet money the decision to bundle the LLM wasn't made by chrome team but above them.
@david_chisnall at least the build process doesn't have you train it from scratch
@david_chisnall as far as I remember Firefox also bundles an LLM with the install (useful at least for in browser translations) but it still manages to keep the size reasonable...
I think the Firefox translation models are downloaded on demand, the first time you request on-device translation from a specific language. Each language pair is about 60 MiB.
These are an amazing piece of engineering. They’re designed so that they can be trained on a single (powerful) desktop and they’re trained from corpora that are specifically built (and licensed) for improving machine translation.
@david_chisnall ah, I see, I missed that somehow, but it makes total sense.
Install bonfire.cafe
Get the full app experience
