OMG, I can turn off the fucking #gemini button in Messages!? How long has this been hiding in settings and I missed it??

Profile pic -> Messages settings -> Gemini in Messages

Disable with a vengeance.