Title
On the Effectiveness of Contracts as Test Oracles in the Detection and Diagnosis of Functional Faults in Concurrent Object-Oriented Software
Abstract
Design by contract (DbC) is a software development methodology that focuses on clearly defining the interfaces between components to produce better quality object-oriented software. Though there exists ample support for DbC for sequential programs, applying DbC to concurrent programs presents several challenges. Using Java as the target programming language, we tackle such challenges by augmenting the Java Modelling Language (JML) and modifying the JML compiler (jmlc) to generate runtime assertion checking code to support DbC in concurrent programs. We applied our solution in a carefully designed case study on a highly concurrent industrial software system from the telecommunications domain to assess the effectiveness of contracts as test oracles in detecting and diagnosing functional faults in concurrent software. Based on these results, clear and objective requirements are defined for contracts to be effective test oracles for concurrent programs whilst balancing the effort to design them. Effort is measured indirectly through the contract complexity measure (CCM), a measure we define. Main results include that contracts of a realistic level of completeness and complexity can detect around 76 percent of faults and reduce the diagnosis effort for such faults tenfold. We, therefore, show that DbC can be applied to concurrent software and can be a valuable tool to improve the economics of software engineering.
Year
DOI
Venue
2014
10.1109/TSE.2014.2339829
Software Engineering, IEEE Transactions
Keywords
Field
DocType
Java,concurrency control,contracts,fault diagnosis,object-oriented methods,parallel programming,program compilers,program testing,software quality,software reliability,CCM,DbC,JML compiler,JMLC,Java modelling language,concurrent industrial software system,concurrent programs,concurrent software,contract complexity measure,design by contract,functional fault detection,functional fault diagnosing,object-oriented software quality,runtime assertion checking code,sequential programs,software development methodology,software engineering,target programming language,telecommunication domain,test oracles,Concurrent programming,Software Quality/SQA??Measurement applied to SQA and V&V,Software/Program Verification??Programming by contract,object-oriented programming
Programming language,Software engineering,Computer science,Design by contract,Software system,Real-time computing,Component-based software engineering,Software metric,Software construction,Software framework,Software development,Software sizing
Journal
Volume
Issue
ISSN
40
10
0098-5589
Citations 
PageRank 
References 
4
0.39
28
Authors
3
Name
Order
Citations
PageRank
Wladimir Araujo1150.95
Lionel C. Briand28795481.98
Yvan Labiche32874143.30