Paper Info
Title
Structural conformance checking with design tests: An evaluation of usability and calability
Abstract
Verifying whether a software meets its functional requirements plays an important role in software development. However, this activity is necessary, but not sufficient to assure software quality. It is also important to check whether the code meets its design specification. Although there exists substantial tool support to assure that a software does what it is supposed to do, verifying whether it conforms to its design remains as an almost completely manual activity. In a previous work, we proposed design tests--test-like programs that automatically check implementations against design rules. Design test is an application of the concept of test to design conformance checking. To support design tests for Java projects, we developed DesignWizard, an API that allows developers to write and execute design tests using the popular JUnit testing framework. In this work, we present a study on the usability and scalability of DesignWizard to support structural conformance checking through design tests. We conducted a qualitative usability evaluation of DesignWizard using the Think Aloud Protocol for APIs. In the experiment, we challenged eleven developers to compose design tests for an open-source software project. We observed that the API meets most developers' expectations and that they had no difficulties to code design rules as design tests. To assess its scalability, we evaluated DesignWizard's use of CPU time and memory consumption. The study indicates that both are linear functions of the size of software under verification.
Year
DOI
Venue
2011
10.1109/ICSM.2011.6080781
ICSM
Keywords
Field
DocType
important role,structural conformance checking,substantial tool support,software development,open-source software project,design specification,manual activity,design test,conformance checking,software quality,design rule,protocols,public domain software,testing,formal specification,java,usability,scalability,conformance testing
Software design,Programming language,Software engineering,Computer science,Usability,Conformance testing,Conformance checking,Software construction,Software quality,Design specification,Software development
Conference
Citations 
PageRank 
References 
8
0.56
11
Authors
3
Name
Order
Citations
PageRank
Joao Brunet1151.03
Dalton Serey Guerrero2575.15
Jorge Figueiredo3363.68