Name
Abstract | ||
|---|---|---|
ABSTRACT People frequently,and,effectively integrate,deictic and,graphic,gestures,with,their natural language,(NL) when,conducting,human-to-human,dialogue. Similar multi-modal,commu- nication,can facilitate human,interaction,with,modern,sophisticated,information,processing and decision-aiding computer systems. As part of the CUBRICON project, we are develop- ing NL processing,technology,that incorporates,deictic and graphic,gestures,with simultane- ous coordinated,NL for both,user inputs,and,system-generated outputs.,Such multi-modal language should be natural and efficient for human-computer dialogue, particularly for pre- senting or requesting information about objects that are visible, or can be presented visibly, on,a graphics,display. This paper,discusses,unique,interface,capabilities that,the CUBRI- CON system,provides,including,the ability to: (1) accept,and understand,multi-media,input such,that references,to entities in (spoken or typed) natural,language,sentences,can include coordinated,simultaneous,pointing,to the respective,entities on,a graphics,display; use si- multaneous,pointing,and NL references to disambiguate,one another,when,appropriate; infer the intended,referent of a point gesture,which,is inconsistent,with,the accompanying,NL; (2) dynamically,compose,and,generate,multi-modal,language,that combines,NL with,deictic gestures,and,graphic,expressions; synchronously,present,the spoken,natural,language,and coordinated,pointing,gestures,and,graphic,expressions; discriminate,between,spoken,and written,NL. |
Year | DOI | Venue |
|---|---|---|
1989 | 10.3115/1075434.1075499 | Intelligent User Interfaces |
Keywords | DocType | ISBN |
natural language sentence,nl reference,graphics display,accompanying nl,integrated deictic,graphic gesture,nl processing technology,graphic expression,natural language,deictic gesture,multi-modal language,human interaction,information processing | Conference | 1-55860-444-8 |
Citations | PageRank | References |
33 | 4.76 | 6 |
Authors | ||
5 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| J. G. Neal | 1 | 33 | 5.10 |
| C. Y. Thielman | 2 | 33 | 4.76 |
| Z. Dobes | 3 | 33 | 4.76 |
| susan m haller | 4 | 34 | 5.25 |
| S. C. Shapiro | 5 | 161 | 19.55 |