Storycaster: An AI System for Immersive Room-based Storytelling (CHI 2026)

Storycaster transforms physical rooms into responsive storytelling environments using generative AI techniques. It uses live camera feeds to augment the walls with cylindrical projections, allowing users to create worlds that blend with their physical surroundings. Unlike headset-based virtual reality (VR) systems, Storycaster preserves spatial awareness. This paper, presented orally at CHI 2026, describes how Storycaster's narrator agent guides participants, enabling them to co-create stories that evolve in response to voice commands, with each scene enhanced by generated ambient audio, dialogue, and imagery.

Learn more at https://www.microsoft.com/en-us/research/video/storycaster-an-ai-system-for-immersive-room-based-storytelling-chi-2026/