This time we investigate a concrete use case and how the technology can be used to interact with computers without actually touching them ! For a short period of time, we are going to put ourselves in the shoes of a surgeon.
Introducing the Myo Armband
The Myo armband is a wearable gesture control and motion control device that lets you take control of your phone, computer, and so much more, touch-free. source: Myo.com
The main concept at work here is Electromyography, in other words the armband uses 8 surface EMG electrodes to listen to the electrical activity of your forearm's muscles and is able (with the help of artificial intelligence) to detect a predefined set of gestures.
Myo armband for surgery you said ?
We really like to demystifie how things work and inspire people to dream big and think about how they can impact the world. In this experiment we have been inspired by TedCas, a healthcare technology company producing natural and intuitive human-computer interfaces for healthcare.
With this proptotype, we want to experiment (and share) how natural it could be to interact with a computer while performing in an operating room. This prototype does not necessarily target the surgeon him/herself but also the staff.
So far, you have probably guessed, we need at least two hardware components, the computer and the Myo. Those two components talk together through Bluetooh 4.1, this communication is bi-directional, the armband tells the computer which gesture is performed while the computer can decide to alert the user through an haptic feedback, in this case a vibration.
There is still one missing part, the software layer. We decided to mimmic a system that allows the user to view medical imagery of the patient. In order to prototype this layer quickly, we just need a bunch of open source software and some web-development skills.
The building blocks
Let's pilot the Browser's interface with the Myo !
One extremely cool thing about this prototype is that we can be a bit creative thanks to very smart UI components that make the life easier, we have a vision for the user experience and we first sketch it.
Two specific elements helped us to lay out the foundation for the interaction with the user.
- "Slick - the last carousel you'll ever need" is used in the left pane, reacts to LEFT or RIGHT to move the next "slide" of the carousel accordingly.
Let's google it !
Find some animated gif of medical images that look professional and also demonstrate the potential of the digital imagery produced by today's medical equipment applied to innovation in the field of human machine interaction.
Let's code and pitch
We have learned a lot during this experiment, the entire prototype has been created quickly in only a few hours.
The haptic feedback given by the application work well and it is very intuitive. However, we are not convince that this technology in its existing form will make its way into the operating room where everything need to be properly sanitized.