Name
Abstract | ||
|---|---|---|
This paper presents a novel multimodal interaction system that provides three modalities of human interaction to manage the supervision and control of a home automation system for people with limited physical mobility. The first one is based on a brain-control interface (BCI, Brain Computer Interface) by means of surface electroencephalographic electrodes (EEG) using a noninvasive Neurosky wearable. In this case, the control of the BCI is managed by the blinking of human eyes. The second one is based on a voice recognition system using spoken commands on a dialogue system. Finally, the third one is based on a configurable touch screen of a mobile device. All three-interaction modalities can be interchangeable according to user needs.
The multimodal interaction system allows the control of home devices and appliances through a home gateway implemented on a resource-limited embedded system, which it is responsible to apply the user commands detected by the multimodal interface to the corresponding home devices. The set of commands can be configurable and extensible adapted to the needs and abilities of different users. For this research, a prototype of the system was developed to verify the interaction modalities. The system provided an adequate and comprehensible operation for users with different user profiles. Our initial tests show that multimodal control is valid for users who have limited physical mobility.
|
Year | DOI | Venue |
|---|---|---|
2019 | 10.1145/3335595.3335636 | Proceedings of the XX International Conference on Human Computer Interaction |
Keywords | Field | DocType |
Multimodal interaction, brain control interaction, eye blink, touch interface, voice assistant | Modalities,Multimodal interaction,Computer science,Wearable computer,Brain–computer interface,Home automation,Mobile device,Human–computer interaction,Residential gateway,Multimedia,Extensibility | Conference |
ISBN | Citations | PageRank |
978-1-4503-7176-6 | 0 | 0.34 |
References | Authors | |
0 | 5 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Miguel Angel Contreras-Castañeda | 1 | 0 | 0.34 |
| Juan Antonio Holgado-Terriza | 2 | 0 | 0.34 |
| Gonzalo Pomboza-Junez | 3 | 0 | 0.34 |
| Patricia Paderewski-Rodríguez | 4 | 23 | 5.03 |
| Francisco Luis Gutiérrez Vela | 5 | 86 | 22.18 |