Paper Info
Title
Towards Real-Time Eyeblink Detection In The Wild: Dataset, Theory And Practices
Abstract
Effective and real-time eyeblink detection is of wide-range applications, such as deception detection, drive fatigue detection, face anti-spoofing. Despite previous efforts, most of existing focus on addressing the eyeblink detection problem under constrained indoor conditions with relative consistent subject and environment setup. Nevertheless, towards practical applications, eyeblink detection in the wild is highly preferred, and of greater challenges. In this paper, we shed the light to this research topic. A labelled eyeblink in the wild dataset (i.e., HUST-LEBW) of 673 eyeblink video samples (i.e., 381 positives, and 292 negatives) is first established. These samples are captured from the unconstrained movies, with the dramatic variation on face attribute, head pose, illumination condition, imaging configuration, etc. Then, we formulate eyeblink detection task as a binary spatial-temporal pattern recognition problem. After locating and tracking human eyes using SeetaFace engine and KCF (Kernelized Correlation Filters) tracker respectively, a modified LSTM model able to capture the multi-scale temporal information is proposed to verify eyeblink. A feature extraction approach that reveals the appearance and motion characteristics simultaneously is also proposed. The experiments on HUST-LEBW reveal the superiority and efficiency of our approach. The comparisons with the existing state-of-the-art methods validate the advantages of our manner for eyeblink detection in the wild.
Year
DOI
Venue
2020
10.1109/TIFS.2019.2959978
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY
Keywords
DocType
Volume
Eyeblink detection, eyeblink in the wild, spatial-temporal pattern recognition, LSTM, appearance and motion
Journal
15
ISSN
Citations 
PageRank 
1556-6013
0
0.34
References 
Authors
0
7
Name
Order
Citations
PageRank
Guilei Hu100.34
Yang Xiao223726.58
Zhiguo Cao331444.17
Lubin Meng400.34
Zhiwen Fang5142.25
Joey Tianyi Zhou635438.60
Junsong Yuan73703187.68