New Platform Lets Kids Build AI-Powered AR Experiences Instead of Just Consuming Them

Children typically experience augmented reality as passive viewers, but a new research project aims to flip that dynamic by turning them into creators. Researchers have developed Capybara, an AR platform that combines visual programming with generative AI to let kids design, animate, and program their own 3D characters in augmented reality.

How Capybara Works#

The system leverages several AI capabilities to unlock creative possibilities:

• Character generation: Kids describe what they want using text prompts, and the system uses text-to-3D generative AI to produce custom virtual characters and accessories
• Animation: The platform automatically rigs and animates characters using body tracking technology
• Interactivity: Computer vision models identify objects in the physical world, letting children program their virtual characters to react and interact with real-world elements

This combination enables children to craft immersive experiences that seamlessly merge digital and physical environments.

Testing the Concept#

The research team conducted user studies with 20 children across the United States and Argentina. The trials demonstrated that Capybara empowers young users to move beyond consumption and instead author their own personalized AR experiences using AI as a creative tool.

Why This Matters#

By shifting children from consumers to creators, the work challenges how emerging technologies like AR and AI are typically deployed in educational settings. Rather than building systems that deliver content to young people, Capybara encourages them to harness these technologies for their own storytelling and creative expression.