Back

Multisensory Perception in XR: Insights from Neuroscience and User Research

May 29

09:00 AM - 09:20 AM

Description

Computers are rapidly evolving to better perceive the world through technologies like computer vision and voice interfaces. Simultaneously, users increasingly expect multisensory user experiences in lieu of traditional, two-dimensional audiovisual interfaces. How does this new technology affect our perception, and what can we learn from our perceptual systems to inform this multisensory design?

This talk will cover how the human brain perceives the world, how the brain perceives in immersive experiences, and how we can leverage this understanding to build a more empathetic future of spatial computing. Presenters Stefanie and Laura will draw from their expertise as both cognitive neuroscientists and user experience researchers in industry, sharing their observations from rigorous user research studies at the forefront of AR/VR content creation, and synthesis from previous neuropsychological studies on AR/VR interaction models.

Speakers

Founder & Head of Design Research , Sendfull
Senior Experience Researcher , Adobe
UX Researcher , Adobe

Related Sessions

May 26

08:20 AM - 08:40 AM

Description

In this session, Benny will showcase how a 130-year-old brand has found ways to innovate its physical experience by integrating digital experiences.

Speakers

Global Manager of Experiential Design , Coca-Cola
May 26

08:40 AM - 09:20 AM

Description

In this session, leading experts will discuss the state of the volumetric capture ecosystem. What are some of the challenges of volumetric capture, from talent sourcing/scheduling to output/post-processing? Non-standard formats have been a big challenge from playback to the distribution of content on viewing hardware. What would 5G help with, in terms of distribution?

Speakers

Sr. Director, XR Content & Services , Samsung
CEO , Metastage
Head of Production , VRAccelerator
Partner, General Manager : Mixed Reality Capture Studios , Microsoft
CEO, Co-Founder , Scandy
May 26

09:20 AM - 09:40 AM

Description

The new medium of immersive computing offers so much opportunities for expression, and at the same time puts creatives in a tricky spot when they have to consider all the parameters that is beyond their control. When every users have different ergonomic and environmental preferences, it's important for us to design and build dynamic experiences that fits into the audience's context. We will explore why proceduralism and machine learning play a crucial role in growing content and experiences in the new spatial medium. Followed up with examples and case studies, we will review the insights and lesson learnt on how to use technology to augment new forms of hardware input and creative directions.

Speakers

Senior Design Manager: 3D & Mixed Reality , Adobe
May 26

09:40 AM - 10:00 AM

Description

In theatre and film, the 'mise en scène' refers to the 'placing on stage', or arrangement of design and scenic elements. Often this takes places within a frame of a stage or screen, but in XR, the literal frame of storytelling is removed. This session will go through the elements of mise en scène as seen in theatre, and best practices for XR.

Speakers

Lecturer in Design , Yale University
May 26

10:00 AM - 10:10 AM