Title
Measuring the Response Bias Induced by an Experience and Application Research Center
Abstract
In recent years we have observed the rise of Experience and Application Research centers (EARC). These EARCs simulate realistic environments and are used for the empirical evaluation of interactive systems in a controlled setting. Such laboratory environments are intended to facilitate data collection without influencing the data itself. Accumulated experience in the use of EARCs has raised concerns that test participants could be impressed by the environments and have raised expectations for advanced systems they expect to encounter; this brings about the danger of systematic bias in subjective report data collected with EARCs. To evaluate the impact of an EARC as an instrument, a controlled experiment with 40 test participants was conducted. This experiment involved the replication of a traditional usability test in both the EARC and a traditional laboratory environment. The results of this study provide evidence regarding the validity and reliability of EARCs as instruments for evaluating interactive systems.
Year
DOI
Venue
2009
10.1007/978-3-642-05408-2_28
AMI
Keywords
Field
DocType
usability testing,response bias,data collection
Data collection,Research center,Response bias,Validity,Computer science,Simulation,Usability,Human–computer interaction,Controlled experiment,Subjective report,Consumer satisfaction
Conference
Volume
ISSN
Citations 
5859
0302-9743
0
PageRank 
References 
Authors
0.34
3
3
Name
Order
Citations
PageRank
Boris de Ruyter173072.12
Rick van Geel200.34
Panos Markopoulos31709181.22