The Macs announced today have huge potential for those who want to run LLMs locally. These Macs still need to be tested, but Federico has run some numbers that show just how much potential there is: https://www.macstories.net/notes/the-potential-of-m6-and-m5-ultra-for-local-ai-on-macos/
No replies yet
Be the first to share your thoughts.