The First Brain-Computer Interface for Mainstream Consumers [Neural Interface]
Have you ever wanted to control your computer with your mind? I have. And come next December maybe we will. Itâ€™s been almost a year since I first talked about Emotiv Systems and the companyâ€™s EPOC headset. Theyâ€™ve stayed somewhat secretive since then (crypticness and stealth that also extended to my email correspondence with them). But last February 19th they came out of the cave at the GDCâ€™08 conference with a brand new bone, the latest version of their consumer based brain-computer interface that is quite frankly geeking me out. The headset will be marketed for the game industry and is expected to go for $299. Read on for what to expect. The features are, well, pretty unbelievable.
Iâ€™ll start off by noting that there was not one, but two companies demoing brain-computer interfaces at GDC this year. Emotiv Systems & the EPOC neuroheadset, which weâ€™ll be focusing on here, and NeuroSky. The latter is planning on selling their sensors and technologies to partners and will not be developing a specific headset on their own (they had a demo unit at GDC just to show the functionality of their systems).
What Are Brain-Computer Interfaces and the EPOC Neuroheadset?
If youâ€™ve read Think Artificial before, youâ€™re probably somewhat familiar with BCIs. Brain-computer interfaces. Devices that allow us to control machines using only our minds.
The key technology is called electroencephalography (EEG). A device monitors your brainâ€™s electrical activity via sensors on your scalp. Itâ€™s been used for medical purposes for years â€” and the futuristic image on the side here depicts setup for a musical brainwave performance at the Deconism Gallery in 2003, for example. The audience of a concert hooked up to the EEG devices to affect music and lighting.
However, monitoring the waves is different from detecting their patterns and using them reliable â€œtriggersâ€, like Emotiv Systemsâ€™ EPOC device and software does. For this to work, two things are essentially required: The user has to practice producing a repeating, recognizable pattern. But thereâ€™s always noise (because it takes practice to be able to visualize the same image, or sequence), so the second thing is that the software deciphering the electrical activity must learn to recognize trigger waves.
Naturally, EPOC is not an invasive kind of BCIs â€” you wonâ€™t need a drill and pliers to use it.
But youâ€™ll still have to shave your head (just kidding).
The Emotiv EPOC Neuroheadset uses a set of sensors to tune into electric signals naturally produced by the brain to detect player thoughts, feelings and expression. It connects wirelessly with all game platforms from consoles to PCs. The Emotiv neuroheadset now makes it possible for games to be controlled and influenced by the playerâ€™s mind. [link]
Emotiv Systems have been working 4 years on R&D, and have come up with their commercially viable BCI â€” and at a remarkably low price considering its capabilities and that this is the first time such technology hits the market for general consumers. Which brings us to its features.
What Emotivâ€™s Epoc Neuroheadset Can Do
Letâ€™s start off with an easy-digest list of features expected to be bundled in the first release of EPOC:
- Wireless headset – 12 hour battery-life (playing time)
- Demo Game – Makes use of- and demonstrates the headsetâ€™s features
- Emortal – Access to an online hub that allows users to interact with photos and music using Epoc
The EPOC system is comprised of three main software components, each of which detects different kinds of brainwave activity.
The Affectiv suite can reportedly measure the emotional states of the user. Anger, fear, frustration. Emotiv puts forth the example that this could be used to have games increase or decrease the difficulty level depending on the playerâ€™s state of mind. The Cognitiv Suite is the control mechanism that allows players to control objects, and the Expressiv suite which measures and interpretes facial expressions of the user. The descriptions and demos are vivid, for example: You smile and thus your avatar smiles.
One of my earliest questions regarding EPOC was: can the system discern many patterns at the same time with any knowledge beforehand on what youâ€™re trying to accomplish?
Most of what Iâ€™ve seen from their demos is task-and-turn based, where the player is moved between â€œphasesâ€, each of which requires him to use one and only one specific action at a time. The Stonehenge Demo, for example, moves the player from stone to stone â€”Â but the player only applies one action to each stone (e.g. â€œrotateâ€ or â€œliftâ€; not both).
Letâ€™s elaborate. A user is inside Second Life and has created a plain box. My question is: Can the system handle rotating the box while the user is smiling/making the avatar smile? Or rotating the box, moving it a bit forward, then up â€”Â perhaps even rotating and lifting the box at the same time? Is all of this possible? Because if this were possible Iâ€™d be geeked out.
Keymap Your Brainwaves
I got mail yesterday. And I geeked out. The letterÂ was from Emotiv reporting, amongst other things, more information on EmoKey â€” their software for mapping mental intention to keyboards (yes, meaning the Epoc headset will be connectable to virtually any application).
The descriptions almost sound surreal:
EmoKey Software – Use the Emotiv EPOC with your existing software
In our efforts to enabled our users, Emotiv has developed the EmoKey software application in conjunction with the Emotiv EPOC. EmoKey allows you to associate any of the Emotiv EPOC detections with keystrokes on your PC. EmoKey enables all of your existing PC software to be Emotiv EPOC compatible right out of the box! In practice, this means that you can link a â€œsmileâ€ detection to type the â€œsmiley emoticonâ€ in your chat application or link a thought, such as â€œrotate clockwiseâ€ to a series of keystrokes such as â€œa-w-d-s-a-w-d-sâ€ to rotate your magic wand!
This appears to indicate that you can basically do any action, at any time, anywhere. Right? Well, almost. Itâ€™s not clear whether you can only â€œpressâ€ one button at a time (â€a then w then d then sâ€¦.â€), or if you can press many buttons at the same time. It could even be a third case where you can press 3 buttons at a time â€” one from each detection suite (unlikely).
However, I can venture the guess that a feature of the EmoKey is to define a â€œvirtual buttonâ€ (if not, please spread the idea to Emotiv!). This could allow you to compose a series of virtual buttons. A specific thought could then be assigned to a series of them â€œctrl+a, ctrl+w, â€¦â€ instead of single physical buttons, thereby enabling you to press two buttons at the same time. Like enabling rotation of a something while smiling. This brings up the question of how many mappings there can be?
Now We Know How Santa Will Control His Robotic Reindeer Next Christmas
Regardless of questions and concerns, this is an incredible device that I would love to get my hands on. Granted, it is the first commercial edition, and we can expect that things may not run as smoothly as we hope. This video of someone trying the beta demo is actually the worst example I could find. I say actually because I donâ€™t think thatâ€™s bad at all. The upload date & specific demo indicates this was at GDCâ€™08, which means itâ€™s probably a first time user.
Looking forward to seeing and hearing more about Epoc. In a recently featured article I talked about what great virtual reality gear could be; an important part being a non-invasive EEG device like Epoc for movement control.
Imagine making your avatar smile. Not via keystrokes. Simply by smiling yourself, walking towards that interesting monolith in the distance by seeing it happen in your mind.
Links & References
- REGEN3 – Image Â©Regenerative Brainwave Music (DECONism Gallery)
- Emotiv EPOC Neuroheadset Images Â©Emotiv Systems
- Another Epoc demo video at GDCâ€™08
- A third company developing a BCI: OCZ Technologyâ€™s press release.