Title
The WDC Training Dataset and Gold Standard for Large-Scale Product Matching
Abstract
A current research question in the area of entity resolution (also called link discovery or duplicate detection) is whether and in which cases embeddings and deep neural network based matching methods outperform traditional symbolic matching methods. The problem with answering this question is that deep learning based matchers need large amounts of training data. The entity resolution benchmark datasets that are currently available to the public are too small to properly evaluate this new family of matching methods. The WDC Training Dataset for Large-Scale Product Matching fills this gap. The English language subset of the training dataset consists of 20 million pairs of offers referring to the same products. The offers were extracted from 43 thousand e-shops which provide schema.org annotations including some form of product ID such as a GTIN or MPN. We also created a gold standard by manually verifying 2200 pairs of offers belonging to four product categories. Using a subset of our training dataset together with this gold standard, we are able to publicly replicate the recent result of Mudgal et al. that embeddings and deep neural network based matching methods outperform traditional symbolic matching methods on less structured data.
Year
DOI
Venue
2019
10.1145/3308560.3316609
Companion Proceedings of The 2019 World Wide Web Conference
Keywords
Field
DocType
deep matching, embeddings, entity resolution, evaluation data, product matching, schema.org annotations
Data mining,Name resolution,Research question,Computer science,Artificial intelligence,Natural language processing,Deep learning,Gold standard,Artificial neural network,Data model,Product (category theory),Replicate
Conference
ISBN
Citations 
PageRank 
978-1-4503-6675-5
0
0.34
References 
Authors
0
3
Name
Order
Citations
PageRank
Anna Primpeli134.11
Ralph Peeters213.06
Christian Bizer38448524.93