Title
Understanding mobile document capture and correcting orientation errors.
Abstract
Smartphone cameras are increasingly used for document capture in daily life. To understand user behaviors, we performed two studies: (1) an online survey (n=106) to understand general smartphone camera usage behaviors related to information capture, as well as participants' experiences of orientation errors, and (2) a controlled lab study (n=16) to understand detailed document capture behaviors and to identify patterns in orientation errors. According to our online survey, 79.30% of the respondents reported experiencing orientation errors during document capture. In addition, our lab study showed that more than 90% of landscape capture tasks result in incorrect orientation. To solve this problem, we systematically analyzed the user behavior during document capture (e.g., video sequences and photographs taken or hand grip used) and propose a novel solution called ScanShot, which detects document capture time to help users correct orientation errors. ScanShot tracks the direction of gravity during document capture and monitors the users rotational or tilting movements of to update changes in orientation automatically. Our results confirm that document capture with 93.44% accuracy; in addition, our orientation update mechanism can reduce orientation errors by 92.85% using a gyroscope (for rotation) and 81.60% using an accelerometer (for micro-tilts). HighlightsWe study user behavior of document capturing using mobile camera by online study (n=106) and in-lab experiment (n=16).We analyze the erroneous orientation problem during document photo capturing.We propose a technique devised for inferring the user's document capture intention.We device two methods for correcting orientation errors while document capturing.The proposed methods show that more than 80% of error are be corrected.
Year
DOI
Venue
2017
10.1016/j.ijhcs.2017.03.004
Int. J. Hum.-Comput. Stud.
Keywords
Field
DocType
Device orientation,Automatic rotation,Document capture,Smartphone camera.
Computer vision,Gyroscope,Mobile camera,Accelerometer,Computer science,Human–computer interaction,Artificial intelligence,Information capture,Document capture
Journal
Volume
Issue
ISSN
104
C
1071-5819
Citations 
PageRank 
References 
0
0.34
20
Authors
6
Name
Order
Citations
PageRank
Jeungmin Oh1455.22
Joohyun Kim229222.75
Myungjoon Kim300.34
Woohyeok Choi4264.43
SangJeong Lee510.70
Uichin Lee611.02