SSE sucks for transporting LLM tokens
https://zknill.io/posts/sse-sucks-for-transporting-llm-tokens/
#HackerNews #SSE #LLM #Tokens #Transport #Issues #HackerNews #Tech #News
SSE sucks for transporting LLM tokens
https://zknill.io/posts/sse-sucks-for-transporting-llm-tokens/
#HackerNews #SSE #LLM #Tokens #Transport #Issues #HackerNews #Tech #News
Similar to my experiments right now. But only starting on a higher level. #Requirements in #Markdown, generate the #Spec containing references to the requirements with #AI, take second AI to review it (and on my own), generate code with an AI and once again review it with another another one. Costs some #tokens, but it’s interesting.
https://mastodon.uno/@laravista/115374148860323466