AVEVA

Blended XR experience in Digital twins









Overview
“Bring XR experience to factory digital twins”

Created XR user experiences and user interface designs, including conducting user interviews, prototyping, and usability testing.

Developed an XR platform design system and established interface behavior guidelines to maintain cross-platform consistency.

Collaborated with software engineers to develop a 3D/XR visualization digital twins platform specifically tailored for the manufacturing industry, increasing production efficiency.

Built 3D printed models to create both digital twins and physical prototypes, allowing users to visualize and interact with real-time data in the physical world via an AR platform.

Conducted user research and analysis to gather insights and feedback, iterating on designs to meet user needs and enhance the overall experience.
Role
UX XR Designer, R&D

Duration
2023 Apr. - 2024 Oct.  ( 1 year 7 months )

Category
UX design
XR
Interaction Design







Special Thanks:

Jordan Connor
Conference:

2023 AWE Vienna

BEYOND HEARING

Unleash Deaf people’s Hearing Superpower











Overview
“Unleashing Deaf people’s hearing superpower”

Beyond Hearing is an augmented reality interface, localising sound with a multi-sense feedback system to improve Deaf people’s safety, communication and daily sound engagement.

Deaf people lacks the ability of sound localisation which might lead to dangerous accidents. Besides, car flashing by without having any sound cue increases mental pressure when Deaf people go out. Beyond Hearing assists them with visual and haptic signals to solve this problem.
Role
Solo project

Duration
2022 Jan. - 2023. Jan. (1 year)

Category
Interaction Design
Inclusive Design
AR







Special Thanks:

Dr. Lorenzo Picinali
Audio Experience Design Lab Lead
Imperial College London

Audrey Gaulard
Innovation Design Engineering 2nd year Lead
Imperial College London

Dr. Elena Dieckmann
Innovation Design Engineering 2nd year Lead
Imperial College London

Iulia Ionescu
Visiting tutor
Royal College of Art

Matt Johnson
 Visiting tutor
Royal College of Art
Exhibition:

2022 RCA show (Jun. 26th-30th 2022)
2022 Imperial College London Summer show (July 1st-7th 2022)

Press:
RCA2022 featured project
Nike waffle shoes featured project

Award:
D&AD side hustle pencil 2023
Core77 design award student winner 2023 
Red dot design concept shortlist 2023
IDA Official Selection 2022
IDA Honorable Mention 2022
 IDA Awards (2022)

Global Student Project Competition
Winner of the year
RS grass root  (2022)

Global Design Graduate Show in collaboration with GUCCI Shortlisted
ARTS THREAD (2022)

NUO

A healthy, happy brain and active life
for older adults








Overview
Nuo is an app and a device for improving older adults’ nutrition status via physical and psychological method.

Currently, population structure becomes older and older, and mulnutrition is a big issue now happening around the world. In this project, we invesitage the reason of mulnutrition and design an application to improve older adults eating habit and social connection to alleviate this problem.


Role
User Research
UI/UX design

Teammates
Max Drake
Liu Liuziyi
Fiona Wei

Duration
Sep. 2020 - Jan. 2021 (5 month)

Category
UI/UX design
Human-centred design





Problem

There are over 20% of UK people over 60 years old and according to the report from Institute of Economic Affairs, 40% of them have clinical depression and 1 in 10 people have mulnutrition problem.

How do we tackle the malnutrition and loneliness problem for elderly people while our society structure become older?

Our reseach quesition is that “How might we improve the health eating and social activity for elderly people in UK?”





User Journey Map

Wer start from user interview and draw the journey map to understand the touch we can intervene.
After that, we found Recipe is a place we can experiment and improve.




Interview with various background experts

In order to gain insight from professional background, we found expert from various areas.

We found that loneliness and malnutrition are not two seperate issues. They will effect each other. If we want to improve the situation, we need to tackle not just one of them.





Brainstorming


the relationship among social, food and ability





Ideation process

At this stage, we use quick generate groups of ideas and filter out some to do further experiment and low-fiedility prototype.

What we choose is an app and device to increase social interaction and healthy food eating for older adults.


Low-fidelity Prototyping

App wireframe and low-fiedility prototype



User validation


After building the app and devices, we also do user validation. We recipe several feedbacks. For example, older adults love the idea of reading recipe but it needs to be clean. And other adults mention that the step by step receip will really help them while cook a new dish and will affect their choice about meal.



Final Concept:


An app to provide meal plan, recipe library and build community for older adults to encourage them eating health.
We also build an device to assist older adults to tangiblised nutrition for them easy to see the amount of nutrition they take.




Recipe working System map





User Flow






Conclusion:


Nuo with an app and a device to help older adults improve their eating habit and enhacne social connetcion.
To achieve “ Happier, Healther, and Brain active Life”





2022 Imperial College Spring Show





Special Thanks

Audrey Gaulard
Innovation Design Engineering 2nd year Lead
Imperial College London

Dr. Elena Dieckmann
Innovation Design Engineering 2nd year Lead
Imperial College London

Iulia Ionescu
Visiting tutor
Royal College of Art

Prof. Claudia Cooper
Faculty of Brain Sciences
University College London

Prof.Paul Higgs
Sociology of Ageing
University College London

David Chen
Nutritionist

Seth Drake
Bartender
Exhibition:

2022 Imperial College London Spring Show




SHAPE OF SOUND

- Duration January 2022 (1 week)
- Solo project

What’s the “shape of sound” in Deaf people’s mind ?

#Generative Design
#Grasshopper
#p5.Js
#Tangible



ETHO


This is an exploration of how do we create accessibility for hearing loss people to engage sound events. How might we provide the tactile feedback soundscape for hard of hearing people to experience sound?




PROCESS


Going to London different place to collect different kinds of environmental sounds. For example: sound from underground, crowded area like picadilly circus and also hyde park. To see and analyses different soundscape and then transfer them into tangible forms.
TECHNOLOGY:

This Etho used p5.js & FFT transfer sound into various shape. And with Rhino / Grasshopper to make it into 3D modeling to create the soundscape sculpture.







OUTCOMES:


The 3D-print mini sculpture was presented the different soundscape in London in a tangible way and also imagine about in the hard of hearing people’s world, what the sound looks like.



Special Thanks


Professor Dale Russell
 Visiting professor
Royal College of Art

Yukun Ge 
 for 3D print
Design Engineering PhD Student
Imperil College London

Jack Liu
 for grasshopper coding’s help

SOULmate

Your soul in a tiny robot






Overview

How to bond and synchronize people when they are in a long distance relationship ?

SOULMate, your soul in a tiny robot. You can remote control your robot and the perspective you see by face tracking technique. This gives you the autonomy to see what you would like to see and not limit by the other one.

Role:
User Researcher
Design Prototyper

Duration:
Jan. 2021 (1 month)

Catagory:
#Robotic
#Interaction design
#Motiontracking
#OpenCV



PROBLEM

During the covid situation, people can not meet face to face, which increases the isolation, loneliness, and other mental health issue occurring possibility. Then I start to think that how might I make a tiny robot to assist people to break physical boundaries and make people feel linkage and synchronised with significant others even when they are apart?



User reseach - Workshop



RESEARCH

During the long distant relationship workshops with 14 people (age from 22 to 45), I summarised top three insights are Sharing experience is the key to build the connection, which is important than the simulate physical feedback, video chat is lack of quality eye contact and easily distracted by the environment and physical objects can bring emotional attachment. 







PRIOR ARTS


There are many products create tangible feedbacks to make long distant people feel each other. While it provids short period interaction. Is there any better way to bond long distant people?







IDEATION


In ideation process, I explore the possibility of communication in long distant. Including instant printing machine, app game to link people’s life, tiny robot which you can put your soul in...etc

After iteration, my research question is


HOW MIGHT I put my soul in a robot and accompany to bond and synchronize with partner/ family in the real world ? 






INTERACTION SYSTEM

Soulmate interaction mode include the mobile/laptop camera capture user’s image and detect people’s movement. Then transfer these information to the remote tiny robot to do the corresponding movement and show the remote video chatting.


PROTOTYPE I:

To make more comprehensive and emotional attachment, the demonstration of tiny robot can express the emotion which present by the remote one through the computer vision motion tracking.


PROTOTYPE II

The demonstration of the computer vision motion tracking. User can see the scene in the other side and by the head movement, which create have the autonomy for user to control the angle and place of camera movement.



SUMMARY

"Soulmate" is a project provide new communication experience and companionship in a remote situation with a tiny robot that provides you the autonomy to express yourself, communicate with your loved ones and aim to help user to build a stronger bonding between them and feel each other even they can not really meet each other.



REFELCTION

Due to the time limitation, this proejct did not extend to build the outlook of the robot and make the real distant test with people. In the future, it can build with the finish and test more rounds with people.







Special Thanks to

Bjorn Sommer
1st year Module Lead
Royal College of Art

Assa Ashuach
Visiting Tutor
Royal College of Art


AWARDS

Student Project Award
Winner
RS Grassroot

HackStarter Program Fund
Cohort
Imperial College London
2022 © CHUN-TE HO