Title
AR-mentor: Augmented reality based mentoring system
Abstract
AR-Mentor is a wearable real time Augmented Reality (AR) mentoring system that is configured to assist in maintenance and repair tasks of complex machinery, such as vehicles, appliances, and industrial machinery. The system combines a wearable Optical-See-Through (OST) display device with high precision 6-Degree-Of-Freedom (DOF) pose tracking and a virtual personal assistant (VPA) with natural language, verbal conversational interaction, providing guidance to the user in the form of visual, audio and locational cues. The system is designed to be heads-up and hands-free allowing the user to freely move about the maintenance or training environment and receive globally aligned and context aware visual and audio instructions (animations, symbolic icons, text, multimedia content, speech). The user can interact with the system, ask questions and get clarifications and specific guidance for the task at hand. A pilot application with AR-Mentor was successfully built to instruct a novice to perform an advanced 33-step maintenance task on a training vehicle. The initial live training tests demonstrate that AR-Mentor is able to help and serve as an assistant to an instructor, freeing him/her to cover more students and to focus on higher-order teaching.
Year
DOI
Venue
2014
10.1109/ISMAR.2014.6948404
ISMAR
Keywords
Field
DocType
pose tracking,wearable technology,virtual personal assistant,locational cue,wearable realtime augmented reality,ar-mentor system,natural language,machinery repair task,augmented reality based mentoring system,computer displays,visual cue,machinery maintenance task,higher-order teaching,ost display device,augmented reality,optical see through glasses,user interaction,verbal conversational interaction,user guidance,vpa,wearable optical-see-through display device,computer aided instruction,mentoring system,audio cue
Computer vision,Ask price,Pose tracking,Computer science,Wearable computer,Display device,Augmented reality,Human–computer interaction,Natural language,Computer-mediated reality,Artificial intelligence,Multimedia
Conference
ISSN
Citations 
PageRank 
1554-7868
4
0.53
References 
Authors
8
9
Name
Order
Citations
PageRank
Zhiwei Zhu169455.60
Vlad Branzoi240.87
Michael Wolverton340.53
Glen Murray440.53
Nicholas Vitovitch540.53
louise yarnall6286.52
Girish Acharya740.87
Supun Samarasekera879285.72
Rakesh Kumar 00019162.52