Name
Abstract | ||
|---|---|---|
As epitomized in DARPA's 'Augmented Cognition' program, next generation avionics suites are envisioned as sensing, inferring, responding to and ultimately enhancing the cognitive state and capabilities of the pilot. Inferring such complex behavioural states from imagery of the face is a challenging task and multimodal approaches have been favoured for robustness. We have developed and evaluated the feasibility of a system for estimation of cognitive workload levels based on analysis of facial skin temperature. The system is based on thermal infrared imaging of the face, head pose estimation, measurement of the temperature variation across regions of the face and an artificial neural network classifier. The technique was evaluated in a controlled laboratory experiment using subjective measures of workload across tasks as a standard. The system was capable of accurately classifying mental workload into high, medium and low workload levels 81% of the time. The suitability of facial thermography for integration into a multimodal augmented cognition sensor suite is discussed. |
Year | DOI | Venue |
|---|---|---|
2010 | 10.1109/CRV.2010.37 | Computer and Robot Vision |
Keywords | Field | DocType |
cognitive state,low workload level,cognitive workload level,augmented cognition,multimodal augmented cognition sensor,facial thermography,mental workload,facial skin temperature,classify cognitive workload,temperature variation,multimodal approach,thermal imaging,face recognition,neural nets,real time,temperature measurement,sensors,robustness,face,pose estimation,avionics,artificial neural network,biometrics | Computer vision,Facial recognition system,Computer science,Workload,Avionics,Augmented cognition,Pose,Robustness (computer science),Artificial intelligence,Artificial neural network,Cognition | Conference |
ISBN | Citations | PageRank |
978-1-4244-6963-5 | 4 | 0.42 |
References | Authors | |
1 | 3 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| John Stemberger | 1 | 4 | 0.42 |
| robert s allison | 2 | 217 | 29.68 |
| Thomas Schnell | 3 | 7 | 1.65 |