"UnDIRECTED? investigates the complexities of human emotion within virtual reality, using biometric and gesture recognition technologies to construct non-linear narratives. In the context of the metaverse, it seeks to redefine interactive cinema by integrating heart rate recognition (ECG) into storytelling. Beyond interaction, the project provokes audiences to reflect on their emotional states, vulnerabilities and the intimate connection between their physiological responses and the unfolding narrative.

(project summary)

(project details)

"UnDIRECTED?" re-examines the relationship between humans and virtual structures, exploring the audience's emotional reactions to virtual reality, biometric and hand gesture recognition technologies in non-linear narratives. Soon, we will inevitably be immersed in a virtual world with full sensory and biometric recognition capabilities. Since 2021, international companies have claimed to be investing significant resources in developing the metaverse, recognising it as the next stage of the internet. A virtual reality device with biometric interaction technology, including facial expression and heart rate recognition, was also introduced. Since then, extended cinema will gradually become part of our everyday lives, no longer confined to venues such as cinemas, world expos or museums.

‍

"UnDIRECTED?" is an extension of "LIFE", a project that combines heart rate recognition technology (ECG) in expanded cinema. Previous research has focused on finding significant differences between video games and interactive cinema. In addition, Chan pointed out that previous interactivity relied too much on the audience's intense physical movements when considering the development of interactive cinema. Previous discussions raised new questions for this study, such as how to enrich narrative diversity and utilise the variety to create uniquely personal experiences and whether there are behavioural patterns that can be exploited.

Exhibition Record

Inner Shore, HKBU AVA MAVA Graduation Exhibition 2022, Hong Kong Baptist University, Hong Kong (Y:2022)

BACKGROUND

‍

The idea for UnDIRECTED? began with my fascination with digital spaces and interactive cinema. However, it shifted when biometric devices, such as the HP Reverb G2 Omnicept with built-in heart rate sensing, made these ideas a reality. This led me to question how the cinematic experience of my previous work, "Life," would change in a panopticon-like VR space, and whether emotion should or could be quantified.

1. Panopticon

The panopticon is a conceptual prison design introduced by the philosopher Jeremy Bentham in the late 18th century. It features a central tower from which a single guard can monitor all prisoners without them knowing when they are being watched. This creates a sense of constant surveillance, which influences behaviour through self-regulation. French philosopher Michel Foucault later extended the concept as a metaphor for modern power structures, where surveillance is used to control and discipline society. In digital contexts, the panopticon symbolises systems such as social media, biometric devices or VR spaces where users are monitored and their actions shaped under the gaze of unseen observers.

2. Conversations

Two conversations, totalling 3,990 words, entitled "Practices and Challenges of Biofeedback and Virtual Reality Interaction - A Conversation between Creators and Participants", explore the complexities of integrating biofeedback into VR experiences.

Achievement

WMA Photography Award, WMA HK (Y:2022)