Chinese CHI Concurrent Workshops | Exploring Biosensory Information as Embodied Social Cues for Enhancing Metaverse Copresent Experience

The Chinese CHI 2024 conference, organized by the International Chinese Association of Computer Human Interaction (ICACHI), will be held from November 22 to 25, 2024, at the Southern University of Science and Technology (SUSTech) in Shenzhen, China.

On the first day of the conference (November 22), the SUSTech School of Design will host seven parallel workshops.

 

Workshop Theme

 

Workshop:Exploring Biosensory Information as Embodied Social Cues for Enhancing Metaverse Copresent Experience

 

Ruowei Xiao, Ming Wu, Lin Lin, Xinyi Wu, Hengbin Zhang

 

Metaphor Lab, SUSTech School of Design

 

Participants

Due to limited VR headsets, only up to 3 participants can experience our case study demonstration at the same time. If all the devices are in use simultaneously, new participants will have to wait for the previous participants to finish their experience. The case study demonstration segment is expected to last 10 minutes.

Workshop Duration

Nov 22, 09:00 - 12:00

Workshop location

Room1107 (Semi-open space), Building C1, iPark, Nanshan

Workshop Language

Chinese/English

Equipment needed

The equipment needed for this workshop, such as computers and VR headsets, will be provided by our group.

 

Workshop Description

This study aims at leveraging people's psychophysiological information as metaverse social embodied cues to enhance large-scale copresent experiences. To this end, we intend to explore and reveal people's cognitive preferences for various types of biosensory signals and their corresponding expressions. We will guide each participant to experience a DJ performance in a VR environment that incorporates five biosensory signals: power of electromyography (pEMG), galvanic skin response (GSR), heart rate (HR), respiration effort (RE), oxyhemoglobin saturation by pulse oximetry (SpO2), captured from a real baseline user (see above figure). After experiencing this technology prototype, we will invite users to watch the representative scenes of the three metaverse copresent experience and co-create them through the AIGC tool. Using Playful Probing combined with User Elicitation methods, we will learn users' feedback and preferences on dimensions such as granularity and multimodal representation of physiological data to support our subsequent research and design decisions.

In addition, participants who complete the feedback collection part of the workshop will receive a delicate gift.

 

Objectives

• Demonstrate a preliminary technical demo that integrates biosensory information with a virtual environment for multi-user metaverse copresent events.
• Based on Playful Probing and User Elicitation methods, we can obtain users' preference feedback on physiological data expression of different granularity and expression forms, so as to further explore embodied interaction cues in the future.

 

Target Participants

People interested in human-computer interaction, VR devices, metaverse socialization, physiological signal expression, and VR gaming

 

Expected Outcomes

Participants will be introduced to different biosensory cues and their respective impacts on physiological synchrony and user-perceived copresence. They can go through a metaverse co-presence virtual experience that incorporates biosensory information. Participants' feedback will contribute to our future research and design.

 

Workshop Host

XIAO Ruowei

 

XIAO Ruowei is Assistant Professor at the School of Design, Southern University of Science and Technology. Her research has been focused on the interdisciplinary domain of design and human computer interaction (HCI), specifically, IoT-based embodied interaction, extended reality and gamification. She has a growing record of first-authored papers published in top HCI and gamification journals and conferences, such as IJHCI and CHI Play.

Previously, she obtained a B.E of Information Security Engineering and a B.A of Animation Production from Shanghai Jiao Tong University. After that, she acquired a MEXT scholarship from the Japanese government and continued her graduate study at Keio University, Japan, where she obtained her M.S and Ph.D of Media Design. Prior to joining SUSTech, she worked as a post-doctoral researcher at the Gamification Group of Tampere University, Finland. In addition, she is also an Indie Game developer and has worked for one of the major Japanese game manufacturers, KOEI TECMO Games.

 

Schedule

This workshop is a flow type of participation. Each participant is expected to take 40 minutes to experience the whole process. Please refer to the following arrangement for the content and duration:

• Basic introduction——10min
• Physiological signal enhancement VR technology prototype experience——5min
• Metaverse copresent scene experience——5min
• AIGC co-creation and online research——20min