RE: https://graphics.social/@metin/116929283984909484
"Large language models do not scale logarithmically. When they’re given more words to process, they get slower and use more memory—the time and resources increase faster as the input grows. In technical terms, LLMs scale quadratically. Any computer-science student knows that this is very bad."