Discussion
Loading...

Post

Log in
  • About
  • Code of conduct
  • Privacy
  • Users
  • Instances
  • About Bonfire
Nick Byrd, Ph.D.
Nick Byrd, Ph.D.
@ByrdNick@nerdculture.de  ·  activity timestamp last week

Do humans fail to cite sources in casual chats? Probably.

But our human colleagues in #academia deviate from the #AI case above in a few ways:

(1) My human peers often admit when they don't remember a source, "I don't recall the citation, but I was recently reading a study which found that...."

(2) When #writing, my human colleagues and I fight like hell to track down citations for every claim. We search online, ask colleagues on #socialMedia, etc.

(3) If we can't find the citation, we revise: the claim becomes a hypothesis, the claim is abandoned, etc.

I don't see #AI do 1-3. It should.

  • Copy link
  • Flag this post
  • Block
Layne Farmen
Layne Farmen
@Lfarmega@hcommons.social replied  ·  activity timestamp last week

@ByrdNick This is such a massive problem, really makes LLMs a total non-starter for me with students in humanities classes. Why would you use a tool with such a high likelihood of innaccuracy and theft? "just keep prompting it" or "learn how to prompt it better" is often the response, but why would I even start with a technology like that? I'll do it the correct way thank you very much.

  • Copy link
  • Flag this comment
  • Block
Nick Byrd, Ph.D.
Nick Byrd, Ph.D.
@ByrdNick@nerdculture.de replied  ·  activity timestamp last week

Hiya @Lfarmega

Seems like we probably agree.

But to be fair to people that may disagree with us, I should probably mention that some people think there are AI tools that can perform better when it comes to provenance, etc.: https://bsky.app/profile/ribozyme.bsky.social/post/3maofbbdaak2q

Those allegedly better AI tools may not be the free chat boxes most people encounter, but rather the paid, tailor-made, software-integrated tools that fewer people use (or know about).

So perhaps the future is brighter …if those more expensive and tailor-made tools become more widely used than one-shot chatbot responses or AI overviews

https://bsky.app
View
  • Copy link
  • Flag this comment
  • Block
Layne Farmen
Layne Farmen
@Lfarmega@hcommons.social replied  ·  activity timestamp 6 days ago

@ByrdNick Interesting! Yeah I've heard of LLMs like Consensus that theoretically could be really helpful, although being able to compose a Lit Review oneself will remain absolutely essential. I'm oriented towards skepticism with all of it, but I still utilize it in my classes, as I want to help curb what I see as a growing crisis in digital literacy with students.

  • Copy link
  • Flag this comment
  • Block

bonfire.cafe

A space for Bonfire maintainers and contributors to communicate

bonfire.cafe: About · Code of conduct · Privacy · Users · Instances
Bonfire social · 1.0.1-alpha.41 no JS en
Automatic federation enabled
Log in
  • Explore
  • About
  • Members
  • Code of Conduct