By the way, if you're interested to know which local models can run on your system (based on hardware specs), someone on bluesky linked to https://github.com/AlexsJones/llmfit which is a TUI that gives you a list and recommended use case.
Here is what it shows on one of my lab macs:
