Name
Abstract | ||
|---|---|---|
Locality Sensitive Hashing is a known technique applied for finding similar texts and it has been applied to plagiarism detection, mirror pages identification or to identify the original source of a news article. In this paper we will show how can Locality Sensitive Hashing be applied to identify misspelled people names (name, middle name and last name) or near duplicates. In our case, and due to the short length of the texts, using two similarity functions (the Jaccard Similarity and the Full Damerau-Levenshtein Distance) for measuring the similarity of the names allowed us to obtain better results than using a single one. All the experimental work was made using the statistical software R and the libraries: textreuse and stringdist. |
Year | DOI | Venue |
|---|---|---|
2019 | 10.1007/s11042-018-6375-9 | Multimedia Tools and Applications |
Keywords | Field | DocType |
Information retrieval, Locality sensitive hashing, Entity deduplication, Textual similarity | Graph theory,Locality-sensitive hashing,Statistical software,Plagiarism detection,Pattern recognition,Information retrieval,Computer science,Jaccard index,Artificial intelligence | Journal |
Volume | Issue | ISSN |
78.0 | 21 | 1573-7721 |
Citations | PageRank | References |
0 | 0.34 | 14 |
Authors | ||
6 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Fernando Turrado García | 1 | 7 | 1.13 |
| Luis Javier Garcí-a Villalba | 2 | 190 | 28.39 |
| Ana Lucila Sandoval Orozco | 3 | 174 | 26.45 |
| Francisco A. Ruiz | 4 | 0 | 0.34 |
| Andrés Aguirre Juárez | 5 | 0 | 0.34 |
| Tai-Hoon Kim | 6 | 790 | 132.45 |