Discussion
Loading...

Post

Log in
  • About
  • Code of conduct
  • Privacy
  • Users
  • Instances
  • About Bonfire
Al Sutton
Al Sutton
@alsutton@alsutton.social  ·  activity timestamp 7 months ago

Looking at the latest #qwen3 coder #AI models…. my rough calculations are that you’d need two of these to run its maximum parameter set model at the full precision.

So if you’ve got more than 120k GBP to burn, and think it’s OK to use about the same amount of power as a toaster to generate unreliable answers, this might be something you want.

For the rest of us I think it’s a hard pass on the idea of local running that model in a way that could minimise hallucinations

https://uk.insight.com/en_GB/shop/product/4X67A97315/lenovo/4X67A97315/NVIDIA-H200-NVL-GPU-computing-processor-H200-Tensor-Core-141-GB/

  • Copy link
  • Flag this post
  • Block

bonfire.cafe

A space for Bonfire maintainers and contributors to communicate

bonfire.cafe: About · Code of conduct · Privacy · Users · Instances
Bonfire social · 1.0.2-alpha.7 no JS en
Automatic federation enabled
Log in
  • Explore
  • About
  • Members
  • Code of Conduct