| 1 |
The Vocal Joystick: A voice-based humancomputer interface for individuals with motor impairments
|
|
|
|
In: https://www.ee.washington.edu/techsite/papers/documents/UWEETR-2005-0007.pdf (2005)
|
|
Abstract:
We have developed a novel device we call the Vocal Joystick (VJ) whose goal is to enable individuals with motor impairments to make use of vocal parameters to control objects on a computer screen (buttons, sliders, etc.) and ultimately electro-mechanical instruments (e.g., robotic arms, wireless home automation devices). Standard spoken language can be quite inefficient for such continuous control. Existing assistive devices, such as sip-and-puff switches, can have low communication bandwidth. The Vocal Joystick, by contrast, allows users to exploit a large and varied set of vocalizations whose selection is optimized with respect to automatic recognizability, communication bandwidth, learnability, suitability, and ease of use. While this includes regular speech sounds (phones and syllables), the primary focus of the VJ project is on the variation of individual acoustic-phonetic parameters like pitch, loudness, vowel quality, voice quality, and variations thereof. In a VJ system, vocal characteristics (vowel quality, pitch, and loudness) are in real time processed using accurate parameter extraction methods (the VJ engine), transformed via adaptation and acceleration, and are converted into continuous control signals. We have also begun a data collection effort to
|
|
URL: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.399.1684
|
|
BASE
|
|
Hide details
|
|
|
| 2 |
The Vocal Joystick Demo at UIST05: A Voice-Based Human-Computer Interface
|
|
|
|
In: http://ssli.ee.washington.edu/vj/files/UIST-demo-abstract.pdf (2005)
|
|
BASE
|
|
Show details
|
|
|
| 3 |
The Vocal Joystick: A Voice-Based Human-Computer Interface for Individuals with Motor Impairments
|
|
|
|
In: http://ssli.ee.washington.edu/people/bilmes/mypapers/uist05.pdf (2005)
|
|
BASE
|
|
Show details
|
|
|
|
|
