Can Socratic reflection improve #AI answers to medical questions?
Adding a critic to a #languageModel pipeline improved performance on two measures of medical question-answering.
The improvement didn't depend on the critic's model.
Can Socratic reflection improve #AI answers to medical questions?
Adding a critic to a #languageModel pipeline improved performance on two measures of medical question-answering.
The improvement didn't depend on the critic's model.
I use an app called Cronometer to estimate my meal carbs so I can determine my insulin dose. It's a pretty solid system for my diabetes management as their library of food and their nutritional value is vast.
In our diabetes support community, we strongly discourage using LLMs to make medical decisions. And here's why:
An LLM just told me my meal was nearly twice as many grams of carbs as Cronometer indicated. This is a meal I have saved in Cronometer so I've dosed for it using its information in the past and trust it.
Had I dosed for the carbs the LLM gave me, I would have overdosed on insulin.
This is why we say don't use AI to make medical decisions. They have no problem trying to kill you.
#AI #AritificalIntelligence #LLM #LanguageModel #LargeLanguageModel #ChatGPT
I use an app called Cronometer to estimate my meal carbs so I can determine my insulin dose. It's a pretty solid system for my diabetes management as their library of food and their nutritional value is vast.
In our diabetes support community, we strongly discourage using LLMs to make medical decisions. And here's why:
An LLM just told me my meal was nearly twice as many grams of carbs as Cronometer indicated. This is a meal I have saved in Cronometer so I've dosed for it using its information in the past and trust it.
Had I dosed for the carbs the LLM gave me, I would have overdosed on insulin.
This is why we say don't use AI to make medical decisions. They have no problem trying to kill you.
#AI #AritificalIntelligence #LLM #LanguageModel #LargeLanguageModel #ChatGPT