Paper Info
Title
Sahaaya: Gesture Recognising System to Provide Effective Communication for Specially-Abled People
Abstract
This paper presents a solution to problems faced by specially abled people while using computer. The proposed solution makes it easier for them to use computer as medium of communication with input by head gestures. The system detects head gestures of specially-abled person infront of the camera and accordingly moves the cursor on computer screen with customised messages on it. This helps Sahaaya ("helper" in hindi) to know latter's requirement. It also includes analysing the gestures of the person infront of camera and performs predefined functions, eg: raising alarm on nodding, speaking of customised message,etc. People with special ability face many problems while using computers depending on their type of impairment (sight, vocal, hearing and dexterity). Visually challenged persons face problem in viewing on screen , deaf users face problem in getting training from the instructor, person with dexterity impairment faces problem in using input devices. Presence of multiple impairments make the task more challenging for the person. This solution focuses to benefit those who have problem in moving their limbs as well as speech impairment. The proposed work uses OpenCV library to detect face of specially-abled person present in front of the camera. The head movement will be mapped to mouse movement on the screen. All movement infront of the camera will be used to sense the gestures of the person. Gesture recognising works with pre-defined gestures by implementing finite state machine. The system has scope to add more pre-defined gestures and to help people with other impairments as well.
Year
DOI
Venue
2012
10.1109/GHTC.2012.65
GHTC
Keywords
Field
DocType
face,gesture recognition,automata
ALARM,Gesture,Computer science,Automaton,Gesture recognition,Speech recognition,Finite-state machine,Sight,Input device,Cursor (user interface)
Conference
Citations 
PageRank 
References 
0
0.34
1
Authors
2
Name
Order
Citations
PageRank
Arvinder Kaur137026.99
Piyush Madan201.35