#Tag · bonfire.cafe

#Tag

Nick Byrd, Ph.D.

Can low-code, custom #AI agents beat off-the-shelf #LLMs on expert knowledge tests?

This Evidence-Based #Nursing (EBN) agent included a reflection and evaluation step.

It outperformed ChatGPT-o1, DeepSeek-R1 and Kimi across 124 standardized test items:

https://doi.org/10.1016/j.nepr.2026.104710

4 media

"To provide nursing educators and students with accurate and efficient AI-powered support, the EBN-Expert system was developed using Coze, a low-code platform that enables the creation of intelligent conversational agents through graphical interfaces and modular components, requiring minimal manual programming. ... This design supports ...metacognitive processes such as structured reflection [via] built-in integration tools [that] connect to: OpenAI’s text-embedding-ada-002 model for vectorization; Pinecone for semantic search; Bing and Baidu application programming interfaces (APIs) for web retrieval; Deepseek-R1 for language generation. ... The overall reasoning workflow, illustrating how these components operate in sequence, is visualized in Fig. 1."

Fig. 1. Workflow design of the evidence-based nursing expert (EBN‑Expert).

"The Reflection Module operates within a single-agent architecture and is activated immediately following the generation of a candidate answer. Its primary function is to evaluate both the answer and the associate reasoning trace.... The module uses three knowledge sources: an internal embedded textbook corpus and two external web-based search tools—Bing and Baidu—via APIs."

"The Decision-Making Module... operates using a structured hard voting mechanism. It receives three independent reflection outputs—each comprising an Output field ('Sufficient' or 'Insufficient') and an associated reasoning trace—as produced by the Reflection Module (see Box 3). If most outputs (i.e., at least two out of three) are labeled “Sufficient”, the candidate answer is classified as 'Correct'. ... If the decision is “Incorrect”, the system re-initiates the retrieval–reflection–decision cycle... enabling iterative refinement...." — Fig. 1. Workflow design of the evidence-based nursing expert (EBN‑Expert). "The Reflection Module operates within a single-agent architecture and is activated immediately following the generation of a candidate answer. Its primary function is to evaluate both the answer and the associate reasoning trace.... The module uses three knowledge sources: an internal embedded textbook corpus and two external web-based search tools—Bing and Baidu—via APIs." "The Decision-Making Module... operates using a structured hard voting mechanism. It receives three independent reflection outputs—each comprising an Output field ('Sufficient' or 'Insufficient') and an associated reasoning trace—as produced by the Reflection Module (see Box 3). If most outputs (i.e., at least two out of three) are labeled “Sufficient”, the candidate answer is classified as 'Correct'. ... If the decision is “Incorrect”, the system re-initiates the retrieval–reflection–decision cycle... enabling iterative refinement...."

"As shown in Table 1, the overall performance scores differed significantly among the four models (P < 0.001). The EBN-Expert achieved the highest mean score of 1035.00 (SD 17.32), with a minimum of 1025 and a maximum of 1055."

"The results of multiple comparisons, as presented in Table 2, demonstrate that the EBN-Expert significantly outperformed DeepSeek, Kimi and ChatGPT-o1 (P < 0.05 for all comparisons). Additionally, DeepSeek achieved a significantly higher score than Kimi (P < 0.001), while ChatGPT-o1 also outperformed Kimi (P = 0.009). However, the difference between DeepSeek and ChatGPT-o1 was not statistically significant (P = 0.084)."

A large language model-powered reflective AI agent for evidence-based nursing education: Design and evaluation

Box464 boosted

Bích-Mây Nguyễn :verified:

@bicmay@med-mastodon.com · 3 months ago

"Following direction from the Trump administration’s One Big Beautiful Bill, the Department of Education determined that nursing was among the programs that would now be excluded from the 'professional degree' list. This would affect how those seeking a nursing degree would be reimbursed for student loan payments."

https://www.newsweek.com/nurses-union-says-trump-policy-will-worsen-crisis-level-conditions-access-health-11101654

#healthcare #education #HigherEd #StudentLoans #nurses #nursing #DOE #labor #hospitals #massachusetts #USpol

Bích-Mây Nguyễn :verified:

@bicmay@med-mastodon.com · 3 months ago

https://www.newsweek.com/nurses-union-says-trump-policy-will-worsen-crisis-level-conditions-access-health-11101654

#healthcare #education #HigherEd #StudentLoans #nurses #nursing #DOE #labor #hospitals #massachusetts #USpol

Box464

@box464@mastodon.social · 3 months ago

Less access to education for nursing professionals will make our healthcare system even worse.

https://www.msn.com/en-us/news/us/nursing-is-no-longer-considered-a-professional-degree-what-changed/ar-AA1QUzcv

#Nursing #NursePractitioner #PhysicianAssistant

Hacker News

@h4ckernews@mastodon.social · 3 months ago

Nursing Excluded as 'Professional' Degree by Department of Education

https://nurse.org/news/nursing-excluded-as-professional-degree-dept-of-ed/

#HackerNews #Nursing #Professional #Degree #Education #Exclusion #Healthcare #Advocacy

everton137 boosted

Tropical Reason

@tropicalreason@blog.eza.link · 3 months ago

⁂ Article

From a Cold Hospital in Switzerland to a Warm Trip to the Jungle

While visiting my brother in Italy over the past two weeks, I came across a poster featuring Leonie Benesch, a German actress I really like. She stars in the Swiss-German film The Last Turn (Heldin), portraying a deeply human and dedicated nurse from a wealthy country. I was glad that I could understand most of the dialogue dubbed in Italian, and it was moving to hear her sing in German to comfort an elderly woman who needed it. [...]

Tropical Reason

@tropicalreason@blog.eza.link · 3 months ago

⁂ Article

From a Cold Hospital in Switzerland to a Warm Trip to the Jungle

bonfire.cafe

A space for Bonfire maintainers and contributors to communicate

bonfire.cafe: About · Code of conduct · Privacy · Users · Instances

Bonfire social · 1.0.2-alpha.25 no JS en

Automatic federation enabled