We began day 2 of our Large Language Models (LLM) for linguistics research workshop @UniKoeln with a fascinating keynote by Charlotte Pouw on "Interpreting models for speech generation and understanding using methods from #psycholinguistics". Charlotte shared insights from two studies from her #PhD research. Check out the papers: https://aclanthology.org/2025.conll-1.9/ and https://direct.mit.edu/coli/article/50/4/1557/123790. 7/馃У
Discussion
Loading...
Discussion
But what do we mean by LLMs exactly? To ensure that everyone is on the same page, co-organiser @nilsreiter is giving a pre-workshop lecture "An Introduction to Large Language Models: LLMs 101". Attendees get introduced to important distinctions such as user prompt vs. system prompt, pre-training vs. fine-tuning, and commercial vs. locally-run open-source models. 2/馃У
Our first keynote speaker is @tschfflr from the Ruhr University Bochum. Tatjana's talk is entitled "Linguistic analysis with LLMs? The case of discourse and pragmatics" and she's brought along no fewer than three studies from her team's work on metaphor detection in religious language, the semantics and pragmatics of emojis, and the detection of hate and candy speech. Her implications for #linguistics research are both very cautious and optimistic as to the future of linguistics. 3/馃У
Tatjana presenting a slide on annotation, data and corpora.
Tatjana speaking at the lectern with an opening slide featuring the image of a robot writing with a feather
Our second keynote speaker of the day is a Mercator Fellow of the CRC "Prominence in Language" @dingemansemark. Mark's asks "What makes LLMs so irresistible?" and begins with our ancient "amazing ability to make sense of nonsense" citing bone-throwing, hand-reading, and horoscopes, before moving to ELIZA and ChatGPT. Mark stresses the need to distinguish between 'understanding' and 'regurgitating', and 'predicting' and 'responding' and introduces what he sees as useful mental models to describe LLMs such as 'stochastic parrots' and 'mansplaining as a service'. In the second half, Mark walked us through the many problems he sees with a recent publication on the supposed metalinguistic abilities of LLMs. Much food for thought for the discussion over coffee and the poster session! 4/馃У
Mark presenting a slide with a quote:
"Decisions made by the general public about emergent technologies depend much more on what that public attributes to such technologies than on what they actually are or can and cannot do"
Joseph Weizenbaum
Computer Power and Human Reason
1976
Mark presenting at the lectern.
It was a busy and lively poster session with presenters ranging from M.A. students to professors (check out the full list: https://sfb1252.github.io/llm-workshop/#poster-presentations), lots of discussions on the use of #LLMs for #linguistics research fulled by copious quantities of coffee and tray-fulls of cup cakes! We now take a short break before continuing the conversations over dinner. 5/馃У
Two people looking at poster, whilst holding a cup of coffee. Cup cakes in the background.
A person presenting a poster and two people listening.
Three people discussing a poster.
Tatjana and J眉rgen in front of poster about "Simulating Human Judgments
The Potential of LLMs in Linguistic Experiments on Prominence"
Oups, I nearly forgot to present our own poster... Luckily, Tiziana Ilie, M.A. student and first author on this project, did a grand job presenting our work on how DeepL deals with pronomial pickups of the hybrid noun "M盲dchen". For this study, we used the #OpenSource model OLMo-2-7B to generate our experimental stimuli. Our abstract is here: https://paths.to/m%C3%A4dchen-poster and we will have a preprint out soon so watch this space...
We began day 2 of our Large Language Models (LLM) for linguistics research workshop @UniKoeln with a fascinating keynote by Charlotte Pouw on "Interpreting models for speech generation and understanding using methods from #psycholinguistics". Charlotte shared insights from two studies from her #PhD research. Check out the papers: https://aclanthology.org/2025.conll-1.9/ and https://direct.mit.edu/coli/article/50/4/1557/123790. 7/馃У
1 more replies (not shown)
bonfire.cafe
A space for Bonfire maintainers and contributors to communicate
Automatic federation enabled