Discussion
Loading...

Post

Log in
  • About
  • Code of conduct
  • Privacy
  • Users
  • Instances
  • About Bonfire
Nick Byrd, Ph.D.
Nick Byrd, Ph.D.
@ByrdNick@nerdculture.de  ·  activity timestamp last week

#AI #Education experiments can be great, if careful.

A 6-week #writing course gave one group an in-person instructor and the other group a #languageModel.

But the AI group accessed the #LLM *during* the pre-test?

Shouldn’t baseline conditions be equal?

https://doi.org/10.1007/s44217-026-01153-1

4 media
Overview of the quasi-experiment
Overview of the quasi-experiment
Overview of the quasi-experiment
How writing assignments were scored: two independent, trained graders.
How writing assignments were scored: two independent, trained graders.
How writing assignments were scored: two independent, trained graders.
The appendix shows that the experimental group (EG) had access to AI during the pre-test, but the control group (CG) did not. So the pre-test or baseline measurement was not identical.
The appendix shows that the experimental group (EG) had access to AI during the pre-test, but the control group (CG) did not. So the pre-test or baseline measurement was not identical.
The appendix shows that the experimental group (EG) had access to AI during the pre-test, but the control group (CG) did not. So the pre-test or baseline measurement was not identical.
The results show more improvement in the AI group and the control group, but one has to wonder if the AI group may have improved more if their pre-test/baseline score could not have been inflated by access to AI.
The results show more improvement in the AI group and the control group, but one has to wonder if the AI group may have improved more if their pre-test/baseline score could not have been inflated by access to AI.
The results show more improvement in the AI group and the control group, but one has to wonder if the AI group may have improved more if their pre-test/baseline score could not have been inflated by access to AI.

Evaluating the impact of using ChatGPT on EFL students’ argumentative skills

  • Copy link
  • Flag this post
  • Block

bonfire.cafe

A space for Bonfire maintainers and contributors to communicate

bonfire.cafe: About · Code of conduct · Privacy · Users · Instances
Bonfire social · 1.0.2-alpha.34 no JS en
Automatic federation enabled
Log in
Instance logo
  • Explore
  • About
  • Members
  • Code of Conduct