Abstract | ||
---|---|---|
A real-time fingertip-gesture-based interface is still challenging for human-computer interactions, due to sensor noise, changing light levels, and the complexity of tracking a fingertip across a variety of subjects. Using fingertip tracking as a virtual mouse is a popular method of interacting with computers without a mouse device. In this work, we propose a novel virtual-mouse method using RGB-D images and fingertip detection. The hand region of interest and the center of the palm are first extracted using in-depth skeleton-joint information images from a Microsoft Kinect Sensor version 2, and then converted into a binary image. Then, the contours of the hands are extracted and described by a border-tracing algorithm. The K-cosine algorithm is used to detect the fingertip location, based on the hand-contour coordinates. Finally, the fingertip location is mapped to RGB images to control the mouse cursor based on a virtual screen. The system tracks fingertips in real-time at 30 FPS on a desktop computer using a single CPU and Kinect V2. The experimental results showed a high accuracy level; the system can work well in real-world environments with a single CPU. This fingertip-gesture-based interface allows humans to easily interact with computers by hand. |
Year | DOI | Venue |
---|---|---|
2021 | 10.1007/s11042-020-10156-5 | MULTIMEDIA TOOLS AND APPLICATIONS |
Keywords | DocType | Volume |
Virtual mouse, RGB-D images, Fingertip detection and tracking, Fingertip-gesture-based interface, Kinect, Human–, computer interaction (HCI) | Journal | 80 |
Issue | ISSN | Citations |
7 | 1380-7501 | 0 |
PageRank | References | Authors |
0.34 | 0 | 5 |
Name | Order | Citations | PageRank |
---|---|---|---|
Dinh-Son Tran | 1 | 0 | 0.34 |
Ngoc-Huynh Ho | 2 | 10 | 3.51 |
Hyungjeong Yang | 3 | 455 | 47.05 |
Soo-Hyung Kim | 4 | 191 | 49.03 |
Gueesang Lee | 5 | 208 | 52.71 |