🕳️  SKYE XINYI GAO

Hallo! Nǐ Hǎo!   


I am Skye, a Creative technologist, Experience designer, and interdisciplinary Artist. 

I explore the possibility of Interaction Design and Natural Intelligence in the context of Emerging technology. 



Selected Work  
2024AlgaMatrixBio Design    
2024OS 1.1 (Page WIP)Public Installation
2024Wired Wild(der)nessWildlife Speculation
2023Wiggly Wally
Bio-inspired Robotic
2022Oblique ObstructionInteractive Installation
2022BITS OF ASHESComputational Design
2022THE CARESS OF THORNComputational Design
2021EmotionWareWearable System
2022(Int) CocoonOpenCV
2021Sentient ComplexInteractive Installation
2021Media ArchitectureMedia Design
2021The OutsideImmersive Media
2020Remember Me DigitallyMulti-media Exhibition
2019Re-shapingKinetic Installation
2018KaleidoShareInteraction Design
  
 

Instagram
Linkedin
Email: skyegao@gsd.harvard.edu


© 2024 Skye Xinyi Gao

(Int) Cocoon: Your Vision Controls Your Horizon



Type:
Human-nature Interaction, Open CV, 
Virtual Environment

Team:
Domo Zheng, Rosanna Zhou

Affiliation: 
NYU Shanghi X Guangzhou Academy of Fine Art - “Singularity” Workshop

Year: 2022
The "cocoon" is a greenhouse constructed by natural insect growth, But in the context of modern society, "cocoon" has become an adjective for an atomized information greenhouse.The seemingly comfortable cocoon is actually constructed artificially, which binds people's multidimensional natural thoughts and natural sources of first-hand information.

“Int Cocoon”, a warm bedroom environment to metaphorize the comfortable feeling that the information cocoon brings us. Every time the participant closes their eyes, the computer will recognize the information through a camera, and then present the truth behind the artificial control of the cocoon

About Theme: Singularity across Artificial and Natural

Project Development 

 
Content
Two very different scenes were created where by shifting the perspective, the audience can experience the tension and truth between a seemly settling environment and an artificial information cocoon.

Choice of Technology


Eye tracking is chosen as main interaction technology because vision is a very primary way for humans to acquire information, representing a natural way for human to explore their environment. At the same time, the use of vision is also very instinctive. When people use vision to receive information, people sometimes do not actively realize such action. By using the technology of eye tracking, the audience can think about their relationship with an artificial formation information through the interaction.

Interaction DesignBlink: When the audience blinks, the scene will shift quickly between natural & artificial



Directional Eye Movement : Eye movement of the audience is designed to control the perspectives change of camera to allow for embodied experience


Scene Construction & Shader (Blender & Unity)
Network Protocol (MQTT & Unity)

Future Improvement At the moment, we created the shader of our second scene (artificial) with reference to the Matrix effect. The visual effect is too straight-forward. If given more time, we will optimize this part by creating our own visual style/effect in terms of our concept.

As all group members were working remotely, we use MQTT communication to transfer the data, which sometimes has the issue of delaying. In the next step when we built the installation, we will improve the data transmission part by implementing socket to communicate between devices locally.

Next Project

Top