AVEVA

Blended XR experience in Digital twins









Overview
“Bring XR experience to factory digital twins”
Role
UX XR Designer, R&D

Duration
2022 Apr. - now  ( 1.5 year )

Category
UX design
XR
Interaction Design







Special Thanks:

Jordan Connor
Conference:

2023 AWE Vienna

BEYOND HEARING

Unleash Deaf people’s Hearing Superpower











Overview
“Unleashing Deaf people’s hearing superpower”

Beyond Hearing is an augmented reality interface, localising sound with a multi-sense feedback system to improve Deaf people’s safety, communication and daily sound engagement.

Deaf people lacks the ability of sound localisation which might lead to dangerous accidents. Besides, car flashing by without having any sound cue increases mental pressure when Deaf people go out. Beyond Hearing assists them with visual and haptic signals to solve this problem.
Role
Solo project

Duration
2022 Jan. - 2023. Jan. (1 year)

Category
Interaction Design
Inclusive Design
AR







Special Thanks:

Dr. Lorenzo Picinali
Audio Experience Design Lab Lead
Imperial College London

Audrey Gaulard
Innovation Design Engineering 2nd year Lead
Imperial College London

Dr. Elena Dieckmann
Innovation Design Engineering 2nd year Lead
Imperial College London

Iulia Ionescu
Visiting tutor
Royal College of Art

Matt Johnson
Visiting tutor
Royal College of Art
Exhibition:

2022 RCA show (Jun. 26th-30th 2022)
2022 Imperial College London Summer show (July 1st-7th 2022)

Press:
RCA2022 featured project
Nike waffle shoes featured project

Award:
D&AD side hustle pencil 2023
Core77 design award student winner 2023 
IDA Official Selection 2022
IDA Honorable Mention 2022
IDA Awards (2022)

Global Student Project Competition
Winner of the year
RS grass root  (2022)

Global Design Graduate Show in collaboration with GUCCI Shortlisted
ARTS THREAD (2022)




SHAPE OF SOUND

- Duration January 2022 (1 week)
- Solo project

What’s the “shape of sound” in Deaf people’s mind ?

#Generative Design
#Grasshopper
#p5.Js
#Tangible



ETHO


This is an exploration of how do we create accessibility for hearing loss people to engage sound events. How might we provide the tactile feedback soundscape for hard of hearing people to experience sound?




PROCESS


Going to London different place to collect different kinds of environmental sounds. For example: sound from underground, crowded area like picadilly circus and also hyde park. To see and analyses different soundscape and then transfer them into tangible forms.
TECHNOLOGY:

This Etho used p5.js & FFT transfer sound into various shape. And with Rhino / Grasshopper to make it into 3D modeling to create the soundscape sculpture.







OUTCOMES:


The 3D-print mini sculpture was presented the different soundscape in London in a tangible way and also imagine about in the hard of hearing people’s world, what the sound looks like.



Special Thanks


Professor Dale Russell
Visiting professor
Royal College of Art

Yukun Ge 
for 3D print
Design Engineering PhD Student
Imperil College London

Jack Liu
for grasshopper coding’s help

SOULmate

Your soul in a tiny robot






Overview

How to bond and synchronize people when they are in a long distance relationship ?

SOULMate, your soul in a tiny robot. You can remote control your robot and the perspective you see by face tracking technique. This gives you the autonomy to see what you would like to see and not limit by the other one.

Role:
User Researcher
Design Prototyper

Duration:
Jan. 2021 (1 month)

Catagory:
#Robotic
#Interaction design
#Motiontracking
#OpenCV



PROBLEM

During the covid situation, people can not meet face to face, which increases the isolation, loneliness, and other mental health issue occurring possibility. Then I start to think that how might I make a tiny robot to assist people to break physical boundaries and make people feel linkage and synchronised with significant others even when they are apart?



User reseach - Workshop



RESEARCH

During the long distant relationship workshops with 14 people (age from 22 to 45), I summarised top three insights are Sharing experience is the key to build the connection, which is important than the simulate physical feedback, video chat is lack of quality eye contact and easily distracted by the environment and physical objects can bring emotional attachment. 







PRIOR ARTS


There are many products create tangible feedbacks to make long distant people feel each other. While it provids short period interaction. Is there any better way to bond long distant people?







IDEATION


In ideation process, I explore the possibility of communication in long distant. Including instant printing machine, app game to link people’s life, tiny robot which you can put your soul in...etc

After iteration, my research question is


HOW MIGHT I put my soul in a robot and accompany to bond and synchronize with partner/ family in the real world ? 






INTERACTION SYSTEM

Soulmate interaction mode include the mobile/laptop camera capture user’s image and detect people’s movement. Then transfer these information to the remote tiny robot to do the corresponding movement and show the remote video chatting.


PROTOTYPE I:

To make more comprehensive and emotional attachment, the demonstration of tiny robot can express the emotion which present by the remote one through the computer vision motion tracking.


PROTOTYPE II

The demonstration of the computer vision motion tracking. User can see the scene in the other side and by the head movement, which create have the autonomy for user to control the angle and place of camera movement.



SUMMARY

"Soulmate" is a project provide new communication experience and companionship in a remote situation with a tiny robot that provides you the autonomy to express yourself, communicate with your loved ones and aim to help user to build a stronger bonding between them and feel each other even they can not really meet each other.



REFELCTION

Due to the time limitation, this proejct did not extend to build the outlook of the robot and make the real distant test with people. In the future, it can build with the finish and test more rounds with people.







Special Thanks to

Bjorn Sommer
1st year Module Lead
Royal College of Art

Assa Ashuach
Visiting Tutor
Royal College of Art


AWARDS

Student Project Award
Winner
RS Grassroot

HackStarter Program Fund
Cohort
Imperial College London






FEELINK



- Duration: 2019 October(6 months)
- Solo project
- International Research Student
- DLX Design Lab, University of Tokyo, Japan


What if we can feel other people’s heartbeats?

Feelink is a gadget for people to exchange their hearbeats and feel what other’s feel, which can use in the remote communication, meditation and even synchronise the heartbeat with the character in the video game.







Prototyping


With different heartbeat frequency to the LED rings can  indicate coresponding colour and vibration to represent the hearbeat status of users






OUTCOMES:


A garment with detecting and transfering heartbeat fuction is produced. This has the potential using on linking with nature, connecting wih game character and link with objects.




Speical Thanks to

Prof. Miles Pentington
DLX Lead
University of Tokyo

All DLX members!


2022 © CHUN-TE HO