In #AR, using real-time on-device 3D Gaussian splatting, we create the illusion that physical changes occur instantaneously, while a hidden robot fulfills the “reality promise” moments later, updating the physical world to match what users already perceive visually. 🤖

4/5

A user wearing a headset looks at a mobile robot in a room. From the user’s eyes, a viewing cone spans the robot from top to bottom. Point-based “splats” inside the cone are colored red, showing what is visible, and those outside are gray, for discard. As the headset moves or the robot moves, the cone adapts to always cover the robot. A second cone is used for the arm, and it grows and shrinks to cover the arm as it expands. Feathering is used to blend the cone with the background, acting like an invisibility cloak.
A user wearing a headset looks at a mobile robot in a room. From the user’s eyes, a viewing cone spans the robot from top to bottom. Point-based “splats” inside the cone are colored red, showing what is visible, and those outside are gray, for discard. As the headset moves or the robot moves, the cone adapts to always cover the robot. A second cone is used for the arm, and it grows and shrinks to cover the arm as it expands. Feathering is used to blend the cone with the background, acting like an invisibility cloak.

“Reality Promises: Virtual-Physical Decoupling Illusions in Mixed Reality via Invisible Mobile Robots”

Paper: https://hci.princeton.edu/wp-content/uploads/sites/459/2025/08/kari2025-reality-promises.pdf
Full Video: https://youtu.be/SdDXvIB79j0
Project Page: https://mkari.de/reality-promises/

See you in Busan! 🇰🇷

#HCI#HRI

Best description of our lab:
"feels like a fast-fowarding in time, a super high tech wood-shop mixed with an Apple store".
Beautiful piece by the
@npr Points North podcast (https://www.npr.org/podcasts/993547741/points-north)
on
@xjasminelu 's work on a living smartwatch that you need to care for! #science#hci

Spotify link: https://open.spotify.com/episode/1TNcwnV2r02CE5nn7lIYaE?si=Q0M9dyR3Qe-kPfs1H8YXEg&nd=1&dlsi=38497ea6041348df

#HCI researcher under attack? Get help (or give help) at the IDE+A Network! 🌐 https://the-idea.network

Prospective matches are alerted individually with an anonymous profile and support options. If matched parties agree, an email meeting is arranged.

We’re searching for both people in need and supporters 🤝

#science #research#hci #igniteus #theideanetwork