Discussion
Loading...
🧩 AR programming in the real world
Children drag & drop code blocks in AR to build visual programs, also to make characters interact with the physical world using object recognition.
🧵2/6
🎨 Customization using GenAI
Kids can customize characters and accessories with speech-to-3D GenAI, integrated into the programming blocks.
🧵3/6
🕺 Body-driven animation
Capybara auto-rigs 3D characters and lets kids bring them to life with their own body movements.
🧵4/6
👧👦 What novel experiences have children created?
In studies with 20 kids (US + Argentina), we found they created:
1️⃣ realistic avatars for self representation
2️⃣ everyday stories (e.g., workouts, showers)
3️⃣ interactions with the real world (e.g., typing, dancing)
🧵5/6
This is a first step toward our vision of fostering AI literacy and 3D computational thinking among the younger generation. The research was conducted during my postdoc at Princeton University with @andresmh and many amazing co-authors.
📝Paper Preprint: https://arxiv.org/pdf/2508.08467v1
🎥Full Video: https://youtu.be/paJP8B8btVk?si=LGnS_K3YMkModXMV
📱App Beta: https://capybara.cs.princeton.edu/
See you in Busan 🇰🇷 for #UIST2025!