Name
Abstract | ||
|---|---|---|
We present work in progress aiming to build tools for the normalization of User-Generated Content (UGC). As we will see, the task requires the revisiting of the initial steps of NLP processing, since UGC (micro-blog, blog, and, generally, Web 2.0 user texts) presents a number of non-standard communicative and linguistic characteristics, and is in fact much closer to oral and colloquial language than to edited text. We present and characterize a corpus of UGC text in Spanish from three different sources: Twitter, consumer reviews and blogs. We motivate the need for UGC text normalization by analyzing the problems found when processing this type of text through a conventional language processing pipeline, particularly in the tasks of lemmatization and morphosyntactic tagging, and finally we propose a strategy for automatically normalizing UGC using a selector of correct forms on top of a pre-existing spell-checker. |
Year | Venue | Keywords |
|---|---|---|
2012 | LREC 2012 - EIGHTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION | UGC,Social Media,text normalization,selection of correction proposals,language model combination |
DocType | Citations | PageRank |
Conference | 1 | 0.35 |
References | Authors | |
10 | 5 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Maite Melero | 1 | 22 | 9.29 |
| Marta R. Costa-Jussà | 2 | 310 | 38.67 |
| Judith Domingo | 3 | 12 | 2.73 |
| Montse Marquina | 4 | 3 | 0.82 |
| Martí Quixal | 5 | 16 | 4.53 |