Discussion
Loading...

Post

Log in
  • About
  • Code of conduct
  • Privacy
  • Users
  • Instances
  • About Bonfire
Micr0byte
Micr0byte
@micr0@wetdry.world  ·  activity timestamp 2 days ago

altbot v2.5 is out!

fixed non-english support! switched to a two model setup: gemma3:1b handles translations while qwen3-vl does the image processing stuff. gemma3:1b is surprisingly good at translations for such a tiny model??

now running 23.7gb out of 24gb vram on my server, but everything stays hot and loaded so no cold start penalty (which would have been very bad for power usage especially)

also pixelfed should work again since thes gdpr update (hopefully?? i don't have an account to test with so if you're on pixelfed lmk if it breaks)

https://github.com/micr0-dev/Altbot

edit: reworded "vision stuff" to "image processing stuff" poor word choice on my part, was thinking about the term VLLM (Vision Large Language Model) when writing that

GitHub

GitHub - micr0-dev/Altbot: Accessibility bot designed to enhance the Fediverse by generating alt-text descriptions for images, video, and audio.

Accessibility bot designed to enhance the Fediverse by generating alt-text descriptions for images, video, and audio. - micr0-dev/Altbot
  • Copy link
  • Flag this post
  • Block

bonfire.cafe

A space for Bonfire maintainers and contributors to communicate

bonfire.cafe: About · Code of conduct · Privacy · Users · Instances
Bonfire social · 1.0.1-alpha.41 no JS en
Automatic federation enabled
Log in
  • Explore
  • About
  • Members
  • Code of Conduct