Name
Abstract | ||
|---|---|---|
An assistive tool (InterpreterGlove) for hearing- and speech impaired people is created, enabling them to easily communicate with the non-disabled using hand gestures and sign language. An integrated hardware and software solution is built to improve their standard of living, consisting of sensor network based motion-capture gloves, a low-level signal processing unit and a mobile application for high-level natural language processing. This paper introduces the overall system architecture and describes our automatic sign language interpreter software solution that processes the gesture descriptor stream of the motion-capture gloves, produces understandable text and reads it out as audible speech. The main logic of our automatic sign language interpreter consists of two algorithms: sign descriptor stream segmentation and text auto-correction. The software architecture of this time-sensitive complex application and the semantics of the developed hand gesture descriptor are described. We also present how the beta tester's feedback from the deaf community influenced our work and achievements. |
Year | DOI | Venue |
|---|---|---|
2014 | 10.1109/IHTC.2014.7147529 | 2014 IEEE Canada International Humanitarian Technology Conference - (IHTC) |
Keywords | Field | DocType |
assistive technology,hearing impaired,social integration,gesture recognition,gesture descriptor,interpreter gloves,sign language,natural language processing,signal processing,Dactyl,fingerspelling | Gesture,Computer science,Gesture recognition,Speech recognition,Sign language,Software,Interpreter,Software architecture,Systems architecture,Semantics | Conference |
Citations | PageRank | References |
0 | 0.34 | 11 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Péter Mátételki | 1 | 2 | 1.06 |
| Máté Pataki | 2 | 24 | 4.15 |
| Sándor Turbucz | 3 | 4 | 1.75 |
| László Kovács | 4 | 170 | 27.82 |