2nd Jun 2023
How might we...
...utilize AR capabilities to help people enjoy a music festival without distractions?
[XR] Using Body-Based Data to Support People’s Wellbeing
This pattern was a co-created output of a Design Jam which took place in Seoul National University on the subject of body-based data in XR. During the Jam, four design teams created simple prototypes which helped deliver better transparency and control over data use in imagined XR services.
The speculative scenario of Team Entertainment centered on the experience of a high-school graduate wearing AR glasses to a music festival. He is not very knowledgeable about data privacy and wants to enjoy the experience without distractions.
Participating in the Body-Based Data Privacy in XR Design Jam in South Korea, Team Entertainment was made up of students and academics from Seoul National University together with external privacy experts.
Problem & Opportunity
During the Design Jam, Team Entertainment identified an opportunity to use AR capabilities to reduce their persona’s possible negative experiences and help him control his body-based data easily, so that he can enjoy a festival without distractions.
Data being used
- Facial Detection
- Facial Landmarks / Mapping
- Motion Tracking
- Vitals
- Voice
Key Features of Prototype
Team Entertainment’s solutions explored how to make body-based data usage easy to understand and control while also looking out for people’s wellbeing.
Body-Based Data Tutorial
Before the experience begins, the person can participate in a tutorial related to the activity they are about to engage in. For example, in a festival scenario they can learn how their voice and motion data is collected and used by engaging in activities where they sing and dance.
Distraction-Minimizing Controls
Easy to access controls that have a simple menu that the person can access at any time. The controls can be opened and used with a simple hand or head movement to minimize distractions.
AR-Assisted Socializing and Navigation
The person can use AR capabilities and body-based data to find and communicate with friends in close proximity or locate desired places and things in their surroundings.
Wellbeing Monitoring through Body-Based Data
Body-based data is used to monitor the person’s wellbeing and give recommendations to prevent negative situations.
Design Pattern: Safety Mode
Team Entertainment used XR prototyping techniques to realize their solution, making use of props and sketches to demonstrate the spatial and physical dimensions of their prototype. The prototypes that were developed by Team Entertainment and the other participating teams were then used to synthesize learnings and insights which were distilled into UX design patterns for privacy interactions.
Team Entertainment’s solution was used as the basis for the Safety Mode design pattern.
The Safety Mode pattern is designed for situations in which people may not be aware that their wellbeing is being impacted. Using Safety Mode, a person can see what the system is reading and decide if they want to follow the recommendation to stay safe.
In this future-facing example, Safety Mode uses a person’s neural data to determine when they are doing something that might affect their wellbeing, like drinking alcohol once they’re already inebriated or exhausted. Upon registering a risk, the system gives them a warning and a recommendation to help them stay safe. The person can decide if they want to take the recommendation — in this case to take a break from alcohol.