Proposal

Integration of Virtual Reality and Biosignals

Daniel Mark

Hawaii Preparatory Academy

Class of 2019

Abstract:

In this independent project, my main goal will be to integrate biosignals with virtual reality so that objects and data can be manipulated manually. Once this goal has been achieved, I hope to move on to more complex applications.

Background:

Currently, one can view scenarios through virtual reality, which simulates a real-world experience and allows users to interact with the environment. To do so, however, requires manual controls that must be pressed. What I want to achieve during my project is the ability to manipulate one’s surroundings in VR simulations via biosignals such as electroencephalography (EEG) and electrocardiography (ECG). EEG is a method of recording the electrical activity of the brain and ECG is the process of recording the electrical activity of the heart. For my project, I will first experiment with the Oculus Rift to experience present day VR capabilities. Once my understanding is complete, I will turn my attention to studying different biosignal outputs. As of now, I feel that ECG signals should be fairly straightforward, EEG signals, however, may be more difficult as the results may vary. Currently, I am thinking of monitoring the EEG signals of test subjects to establish an idea as to what neurosignals correspond to a particular action. Following this stage of my project, I will design a prototype to integrate the Oculus Rift with the Emotiv headset.

Purpose:

The purpose of this project is to create an even more immersive experience to this intriguing new frontier called VR.

What will you measure?

I will measure the signals emitted by cranial activity and electrical activity of the heart and their ability to alter the performance of VR manipulation depending on their applications .I will measure these signals by having test subject perform a variety of actions and record the corresponding brainwaves. As for the ECG measurements, I will submit subjects to an ECG to determine what emotions affects heart activity and to what extent.

Tools/resources needed:

Oculus Rift

Emotiv headset

computing resources

Impact:

The impact of my project will be the provision of a more realistic experience in VR simulations and to further my understanding of everything that composes this blossoming technology.

Legacy:

As I am starting this project as a freshman, I plan to continue my research as I progress here at HPA. I hope that by starting this project as a freshman will encourage others to see the energy lab as an opportunity to advance themselves and not as a daunting building atop the hill.