Paper Info
Title
One pass preprocessing for token-based source code clone detection
Abstract
Token-based source code clones detection provides a promising way to detect the source code duplication and re-dundancy. While preprocessing of clone detection plays an important role in KDD for further processing as the old saying goes: well begun is half done. However, processing unstructured source code files of large software systems is really challenging and time or space consuming. This paper introduces a novel way to clean, tokenize and transform the source code into the appropriate form for mining. A tool called OPP (One Pass Preprocessor) has been developed to preprocess the source code files efficiently and flexibly. The paper experimented on three large open source projects like Wildfly1.02 Linux core-3.6, VTK of different host languages, and the result showed that our tool has great power and flexibility to preprocess the source code files and products high quality output.
Year
DOI
Venue
2014
10.1109/ICAwST.2014.6981824
Awareness Science and Technology
Keywords
Field
DocType
public domain software,redundancy,software reliability,source code (software),KDD,OPP,large software systems,one pass preprocessing,one pass preprocessor,open source projects,products high quality output,redundancy,source code duplication,space consuming,time consuming,token-based source code clone detection,tokenize,transform,unstructured source code files,KDD,clone detection,code clone,configuration table,tokenization
Unreachable code,Codebase,Pattern recognition,Source code,Computer science,Real-time computing,Redundant code,Code generation,Preprocessor,Artificial intelligence,Security token,Dead code
Conference
Citations 
PageRank 
References 
0
0.34
0
Authors
4
Name
Order
Citations
PageRank
Dingkun Li113.07
Minghao Piao2376.30
Ho Sun Shon3388.00
Keun Ho Ryu488385.61