#Tag · bonfire.cafe

🤖 Our findings suggest strategies for future convention-aware multimodal agents that: (1) learn users’ chunked conventions as they emerge, (2) shift to abstract-first instructions over time, (3) adapt modality to evolving user preferences, and (4) use redundancy to highlight changes from prior interactions.
3/4

Parastoo Abtahi

@parastoo@hci.social · last week

If you saw @jefan present our poster at #CogSci2025, the full paper will appear at #CHI2026:

“Gesturing Toward Abstraction: Multimodal Convention Formation in Collaborative Physical Tasks”
🔗 https://multimodal-conventions.github.io
📄 https://arxiv.org/pdf/2602.08914

@hci 4/4

Screenshot of the paper. Teaser figure: five-panel teaser showing a shift from block-by-block to abstract tower descriptions. Panel 1 shows the first L-shaped tower made from three LEGO blocks (blue base, two red blocks stacked). A speech bubble says Put a blue block on the front side of the grid, with a hand precisely placing an imaginary block on a two-by-two grid. Panel 2 shows a speech bubble saying a red block on top of the blue, on the left side, with a hand holding an imaginary block vertically above the previous position. Panel 3 shows a speech bubble saying then another red block on top of that, with the right hand stacking another imaginary block. Panel 4 shows a speech bubble saying like an L shape. Two hands depict an L-shape gesture representing tower shape without position or orientation. The final panel shows the same tower in a different position and orientation, with a speech bubble reading Put a backward L-shape tower on the back of the grid and a hand indicating the back row of the grid.

https://arxiv.org/pdf/2602.08914

Ulrike Hahn boosted

Parastoo Abtahi

@parastoo@hci.social · 7 months ago

📢 Find Judy Fan ( @jefan) at #CogSci2025 during Poster Session 1 (⏰Tomorrow, 1–2:15 PM | 📍Salon 😄 to learn about our work on understanding multimodal communication and how people form linguistic and gestural abstractions in collaborative physical tasks.

Poster for the Cognitive Tools Lab at CogSci 2025, scheduled for Thursday, July 31. The poster is titled “Using gesture and language to establish multimodal conventions in collaborative physical tasks.” It features an image of a hand pointing to a 2×2 grid, with an arrow indicating movement from the bottom-left square to the top-left square. A quote reads, “... the green block pointing this way,” and the gesture is labeled “Complementary position & orientation.” Headshots of the four authors, Maeda, Tsai, Fan, and Abtahi, appear at the bottom. The session is listed as Poster Session 1 at 1:00 pm.

Parastoo Abtahi

@parastoo@hci.social · 7 months ago

Ulrike Hahn

@UlrikeHahn@fediscience.org · 8 months ago

only two more weeks until the 47th Annual Meeting of the Cognitive Science Society #cogsci2025 -

this year’s meeting is hybrid (one every three years is..), so it’s still very much worth thinking about attending

https://cognitivesciencesociety.org/cogsci-2025/

Sylvia Wenmackers 🦉🍀 boosted

Ulrike Hahn

@UlrikeHahn@fediscience.org · 8 months ago

in the context of writing a talk for an upcoming pre-conference workshop at #cogsci2025 I’m looking for examples of researchers who explicitly maintain that #LLMs do not or cannot “reason”….

all suggestions welcome!

Ulrike Hahn

@UlrikeHahn@fediscience.org · 8 months ago

in the context of writing a talk for an upcoming pre-conference workshop at #cogsci2025 I’m looking for examples of researchers who explicitly maintain that #LLMs do not or cannot “reason”….

all suggestions welcome!