Name
Abstract | ||
|---|---|---|
Data preprocessing is a main step in data mining because real data can be corrupted for different causes and high performance data mining systems require high quality data. When a database is used for training a neural network, a fuzzy system or a neuro-fuzzy system, a suitable data selection and pre-processing stage can be very useful in order to obtain a reliable result. For instance, when the final aim of a system trained through a supervised learning procedure is to approximate an existing functional relationship between input and output variables, the database that is exploited in the system training phase should not contain input-output patterns for which the same input or similar input sets are associated to very different values of the output variable. In this paper a procedure is proposed for detecting non-coherent associations between input and output patterns: by comparing two distance matrices associated to the input and output patterns, the elements of the available dataset, where similar values of input variables are associated to quite different output values can be pointed out. The efficiency of the proposed algorithm when pre-processing data coming from an industrial database is presented and discussed together with a statistical assessment of the obtained results. |
Year | DOI | Venue |
|---|---|---|
2013 | 10.3233/IDA-130604 | Intell. Data Anal. |
Keywords | Field | DocType |
data mining,output pattern,suitable data selection,high quality data,high performance data mining,anomalous input-output pattern,input variable,output variable,pre-processing data,data preprocessing | Data mining,Pattern recognition,Distance matrices in phylogeny,Data selection,Computer science,Data pre-processing,Supervised learning,Input/output,Artificial intelligence,Fuzzy control system,Artificial neural network,Machine learning | Journal |
Volume | Issue | ISSN |
17 | 5 | 1088-467X |
Citations | PageRank | References |
0 | 0.34 | 9 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Nicola Matarese | 1 | 18 | 4.12 |
| Valentina Colla | 2 | 159 | 29.50 |
| Marco Vannucci | 3 | 94 | 15.60 |
| Leonardo M. Reyneri | 4 | 52 | 9.12 |