Paper Info
Title
Establishing a baseline for measuring advancement in the science of security: an analysis of the 2015 IEEE security & privacy proceedings.
Abstract
To help establish a more scientific basis for security science, which will enable the development of fundamental theories and move the field from being primarily reactive to primarily proactive, it is important for research results to be reported in a scientifically rigorous manner. Such reporting will allow for the standard pillars of science, namely replication, meta-analysis, and theory building. In this paper we aim to establish a baseline of the state of scientific work in security through the analysis of indicators of scientific research as reported in the papers from the 2015 IEEE Symposium on Security and Privacy. To conduct this analysis, we developed a series of rubrics to determine the completeness of the papers relative to the type of evaluation used (e.g. case study, experiment, proof). Our findings showed that while papers are generally easy to read, they often do not explicitly document some key information like the research objectives, the process for choosing the cases to include in the studies, and the threats to validity. We hope that this initial analysis will serve as a baseline against which we can measure the advancement of the science of security.
Year
DOI
Venue
2016
10.1145/2898375.2898380
HotSoS
Keywords
Field
DocType
Science of Security,Literature Review
Data science,Theory building,Rubric,Computer science,Critical security studies,Completeness (statistics),Management science,Scientific method
Conference
Citations 
PageRank 
References 
4
0.50
4
Authors
11
Name
Order
Citations
PageRank
Jeffrey C. Carver1122994.65
Morgan Burcham240.50
Sedef Akinli Koçak3434.04
Ayse Bener4173.05
Michael Felderer553878.87
Matthias Gander6233.15
Jason Tyler King7495.30
Jouni Markkula825025.91
Markku Oivo965081.11
Clemens Sauerwein10134.66
Laurie Williams114033473.64