This sign is a great example for helping to explain why chatbots present such a potent illusion.
A probably not short thread 🧵>>
('Splainers of Mastodon -- thread means please read what I've written before jumping in here to share your ideas.)
![Photo of a sign with a doorbell attached. The printed sign reads:
CURRENT GUGGENHEIM ACCES BY HUSKY CARD ONLY
[Logos for Amazon, FedEx, UPS]
DELIVERIES/VISITORS
PLEASE RING THIS DOORBELL
Delivery hours M-F 9:00am-(obscured)
University of Washington
Taped next to the doorbell is a hand written note that reads:
yes! it rang! Pelase wait 30 seconds before pressing again.
thanks!](https://cdn.masto.host/daircommunitysocial/media_attachments/files/117/128/663/635/636/605/original/3e2e51c30e0e9a6a.jpg)
48
Replies
0
Boosts
A point I frequently make when talking about chatbots is that their output only seems to make sense because we are making sense of it. And worse, we can only do that sense-making by projecting a mind behind the text, something we do reflexively.
>>
@emilymbender And LLM creators go to great lengths to use rhetorical tricks to push that illusion, such as first-person pronouns and use of emotion terms.
While you might think that understanding something someone wrote is simply a matter of unpacking the meaning (or message) they packed into the words, in fact what we do is much cooler and more involved:
>>
We keep in mind everything we know or believe about the authors knowledge and beliefs, about our common ground with the author, and about what the author believes about their intended audience, which might not be us.
(For more details and with citations, see the "... is a parlor trick" section of my recent encyclopedia entry on "AI"
https://faculty.washington.edu/ebender/papers/Bender-AI-2026.pdf )
>>
So, coming back to the sign, there are two mini-conversations here, with two diffferent authors, and with two overlapping intended audiences:
>>
![Photo of a sign with a doorbell attached. The printed sign reads:
CURRENT GUGGENHEIM ACCES BY HUSKY CARD ONLY
[Logos for Amazon, FedEx, UPS]
DELIVERIES/VISITORS
PLEASE RING THIS DOORBELL
Delivery hours M-F 9:00am-(obscured)
University of Washington
Taped next to the doorbell is a hand written note that reads:
yes! it rang! Pelase wait 30 seconds before pressing again.
thanks!](https://cdn.masto.host/daircommunitysocial/media_attachments/files/117/128/672/063/781/688/original/037ad013924df029.jpg)
@emilymbender cool points! I guess humans simply can't help anthropomorphising the world around them? We'll just keep talking to our pets, malfunctioning toasters and yeah: chatbots.
The first author is a person or group of people speaking for the institution, giving instructions to people who wish to enter Guggenheim Hall but don't have a Husky card that is registered for the building.
It's the second author I'm particularly interested in here. The one behind the hand-written note.
>>
I am a bystander to both of these conversations. (My Husky card works here.) But the hand-written note immediately evokes for me someone who works in the building, likely has responsibility for reacting to the doorbell rings, and has an office not immediately next to this door.
>>
@emilymbender
Hmm. What about Alsatian cards? (Asking as a German)
@wauz 🙄
US universities have mascots, and usually name their various bits of infrastructure after those mascots. UW, where I work, has the husky as its mascot.
Meanwhile, I also see them modeling the state of mind of the impatient delivery person, who has pushed the button, but hasn't heard the ring (since the bell is close to the person's office, not this door), and then is doubting whether they pushed hard enough.
>>
@emilymbender I need such a note. I keep having to tell delivery people that ringing twice won't make me any faster, just more nervous.
The sign caught my attention because of the juxtaposition of the institutional language (fairly static information, stated by people who don't expect to actually interact with most readers directly) and the much more conversational hand-written note.
>>
The author of the note was a little flashy with their ability to model the state of mind of doorbell-pushers: The note was likely written in the wake of several noisy experiences on their end, with the solid expectation that similar circumstances would arise again, but it's addressed to someone(s) they haven't interacted with (yet).
>>
@emilymbender The door bell button lacks a feedback that pushing it did really ring the bell.
Because it only works because the readers can do the same thing, and construct what's going on for the writer by imagining their point of view.
When we do this with other people, it is lovely. Literally the stuff of relationships, communities, societies.
But it is also fundamental to how we interpret language and we can't just turn it off. And that is what chatbot purveyors are preying on with their product design.
/fin
@emilymbender The problem with LLMbeciles is that they short-circuit an until-now very useful proxy we had for detecting intellect: fluency.
For tens or even hundreds of thousands of years, fluency in communication was a decent proxy for identifying the presence of intellect. Nothing without intellect had any linguistic fluency whatsoever. Thus in the presence of fluency you must be in the presence of intellect, Q.E.D.
LLMbeciles have fluency without intellect. We have not evolved for this.
@emilymbender You make me miss my time in the linguistics mines. I was always more syntax and minority language fieldwork oriented, but this thread is something I would happily show an undergrad to convince them to take a semantics and pragmatics course; it really captures the beauty of that subfield.
@emilymbender I'm being forced to use llms at work, and lately I've been experiencing intense rage while using the chatbot at least once a day. What's the point of being angry at a machine? But like you said, I can't turn it off as much as I try.
@alter_kaker I'm so sorry you are being forced into this. The rage is a good thing though! Hold onto it.
As i read your analysis, I realized that I had had the same/similar response to the handwritten note. That gave me a concrete form for my anxieties about my oldest grandchild's use of Chatbot. But, it also gives me another illustration for him of why he should use it less ( I'm shooting for total abandonment, but he has to get there himself).
I know (from experience) that you can write purposely disconnected nonsense and people will find meaning in it.
Even after you tell them:
"No, that's, actually just some disconnected nonsense that I strung together a a goof."
They will insist that there's meaning there.
@emilymbender
in terms of the communication model it's interesting.
Nevertheless on a practical level, my view on this handwritten note is
"passive-aggressive venting, will not resolve the situation for the writer in most cases. Ineffective communication for probably 50% of delivery drivers. Writer did care more about being snarky than in actually resolving the issue, leaving room for future complaints about illiterate readers."
@emilymbender
A short glance onto your profile page reminded me, you are a linguist. As my mom were. That explains a lot. This thread is, what linguistics are for.
But I still wonder in which states of mind post-it notes are constitutional...
@emilymbender I navigate this kind of inferred knowledge, audience issues all the time as an engineer. In a public safety, inspection heavy industry.
For whatever reason, people get scared to state reality in a simple way, defaulting to language so clinical it assumes shared knowledge. It's so reflexive, I think it is a human thing.
There is a world of difference in "inspect to new design standard" and "inspect for this exact broken part because it killed 7 people."
One tells the reader what is important and one assumes shared knowledge.
In your case it's a annoying doorbell, but it highlights the difference between that clinical communication and what is actually necessary for smooth operations.
@emilymbender So, like, for LLMs... there's a ghost in the machine, but not in the sense of a spirit or something with agency, but rather in the sense that we are imagining it as an explanation?
A door closes suddenly, and we're so used to thinking someone must be there to slam a door, so we imagine a spirit rather than realizing that wind can also slam a door… but for text?
Idk i might have gotten lost in the metaphor here... am I kinda maybe getting your point correctly?
"Similar" experience by me:
Living at the "crowded end" of this cul-de-sac, I regularly received delivery attempts and packages for my next door neighbor:
The mailbox to the right of the white vehicle in the driveway is his. showing his address, which is "978". But the front door you see at the end of the sidewalk behind it (under the tree) is mine, at "982".
…
@emilymbender This reminds me of the labor theory of value. If we're just rearranging energy and matter, then how can we be ending up with more than we had to start with? It's because labor is a social act, where a person anticipates the needs and desires of other people; it's where energy and matter are bound into human social structures.
That's exactly why "generative AI" is a dead end.
And I think it's exactly this flaunting of the ability to perform intersubjectivity across space and time that makes this such a lovely example for helping to understand the illusion of chatbots.
>>
@emilymbender
Great example! Thank you so much for sharing it. 🙏🏻 I learnt a lot, can’t say better than that. 👍
Was your post written by ai slop? Because it's very confusing.
