Title
Test case design for context-aware applications
Abstract
ContextCurrent software systems have increasingly implemented context-aware adaptations to handle the diversity of conditions of their surrounding environment. Therefore, people are becoming used to a variety of context-aware software systems (CASS). This context-awareness brings challenges to the software construction and testing because the context is unpredictable and may change at any time. Therefore, software engineers need to consider the dynamic context changes while testing CASS. Different test case design techniques (TCDT) have been proposed to support the testing of CASS. However, to the best of our knowledge, there is no analysis of these proposals on the advantages, limitations and their effective support to context variation during testing. ObjectiveTo gather empirical evidence on TCDT concerned with CASS by identifying, evaluating and synthesizing knowledge available in the literature. MethodTo undertake a secondary study (quasi-Systematic Literature Review) on TCDT for CASS regarding their assessed quality characteristics, used coverage criteria, test type, and test technique. ResultsFrom 833 primary studies published between 2004 and 2014, just 17 studies regard the design of test cases for CASS. Most of them focus on functional suitability. Furthermore, some of them take into account the changes in the context by providing specific test cases for each context configuration (static perspective) during the test execution. These 17 studies revealed five challenges affecting the design of test cases and 20 challenges regarding the testing of CASS. Besides, seven TCDT are not empirically evaluated. ConclusionA few TCDT partially support the testing of CASS. However, it has not been observed evidence on any TCDT supporting the truly context-aware testing, which that can adapt the expected output based on the context variation (dynamic perspective) during the test execution. It is an open issue deserving greater attention from researchers to increase the testing coverage and ensure users confidence in CASS.
Year
DOI
Venue
2017
10.1016/j.infsof.2017.03.008
Information and Software Technology
Keywords
Field
DocType
Context aware application,Systematic review,Software testing
Test Management Approach,Systems engineering,Empirical evidence,Computer science,Simulation,Software system,Risk analysis (engineering),Software,Test case,Empirical process (process control model),Software construction,Test strategy
Journal
Volume
Issue
ISSN
88
C
0950-5849
Citations 
PageRank 
References 
3
0.41
0
Authors
6