Monday, April 5, 2010

Neckband turns sounds into computer clicks


Corvin Cioata (above right) is many things: An explorer, a skier, a Scooby Doo fan. Like his mother – a software developer – he’s nuts about computers. But until last year, the nine-year-old couldn’t use one.

Corvin has involuntary movements related to cerebral palsy that make using a mouse impossible. He tried finger and eyebrow switches but couldn’t control them consistently. An off-the-shelf, microphone-based sound switch misfired in noisy environments and exhausted him because it only responded to loud vocalizations.

Then Corvin tried the Hummer – a novel switch developed at Bloorview that detects vocal-chord vibrations when a child makes a sound or hums a tune and turns them into computer functions. “It was the first switch he could easily access,” says his mom Varinia.

Wearing a lightweight neckband, Corvin demonstrated the switch while using a story-making software. The program scanned different storylines related to a princess on an adventure. Corvin clicked his choices by making a sound such as “uh” or “oh” when they appeared on the screen – and showed his pleasure with an awesome smile.

“Certain sounds we make and hums cause the vocal chords to vibrate in a pattern that recurs at regular intervals,” says Tiago Falk, a postdoctoral researcher in biomedical engineering at Bloorview and the primary inventor (in photo above).

A sensor the size of a nickel embedded in the neckband sends signals to a microcontroller that detects the pattern and activates a mouse function – such as turning a page in an online book, clicking an icon on the screen, or moving the mouse left or right.

The Hummer is perfect for children who don’t speak and have physical disabilities that make conventional switches challenging.

A big advantage is that the sensor doesn’t respond to background noises, coughs or other user-generated noises – which can cause false responses in microphone sound switches like the one Corvin initially tried.

Vibrations are produced naturally during voiced speech or hums – no matter how loudly or softly the child vocalizes – so even quiet sounds or silent hums activate the Hummer. In contrast, microphone switches can fatigue users because they require speech of a certain volume.

The current Hummer is a single switch operating one computer function.

A new version is in the works that will allow users to activate a variety of functions based on differences in the pitch and duration of what they say and hum. For example, a quick, low hum might move the cursor right, whereas a slow, high-pitched word would translate into a click.

In future, the system could be used to control voice technology and electronic devices like a TV and lights and to drive a power wheelchair.

“In the short term, it allows Corvin to do school activities like reading and journal writing,” Varinia says. “And in the long-term, it opens the door to a communication device and to accessing environmental controls so he can be more independent.”

5 comments:

Wow. This is really awesome. I have never seen anything like it and wonder if it's being used in the United States at all?

Technology can be so great! Hopefully, it will take off in leaps and bounds in the future! The possibilities are endless! (My son who is blind said he always wanted to invent a car that drives itself. I just saw that General Motors will have a small electric car that drives itself with lasers and an advanced GPS! AMAZING!)
Lindsey Petersen

I would love to get my 13 yr old DD involved in such a study. She has been left without the ability to communicate for 12 years now and she has had very little success with anything but occasional eye gazing and vocalizations.

Hi "Anonymous",

Do you currently reside in the Ontario,Canada region? If so, we could schedule a visit to Bloorview to try out the Hummer on your daughter. Regards, Tiago Falk

Words cannot describe how I felt as I read about this new development, it was truly overwhelming. My own son has cerebral palsy and when I think what this technology could mean for him, how they are hoping one day to make it possible for communication, it almost brings me to tears. To actually be able to know what my child's thoughts are... again words cannot describe how that makes me feel.
We just had a visit to Bloorview last week to reconnect, and I asked to be connected with writing and communication aids, I'm hoping that perhaps we'll be able to get a chance at this also.