SoMeWeTa: A Part-of-Speech Tagger for German Social Media and Web Texts
Proisl T (2018)
Publication Language: English
Publication Type: Conference contribution, Original article
Publication year: 2018
Publisher: European Language Resources Association
City/Town: Miyazaki
Pages Range: 665–670
Conference Proceedings Title: Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)
Event location: Miyazaki
ISBN: 979-10-95546-00-9
URI: http://www.lrec-conf.org/proceedings/lrec2018/pdf/49.pdf
Open Access Link: http://www.lrec-conf.org/proceedings/lrec2018/pdf/49.pdf
Abstract
Off-the-shelf part-of-speech taggers typically perform relatively poorly on web and social media texts since those domains are quite different from the newspaper articles on which most tagger models are trained. In this paper, we describe SoMeWeTa, a part-of-speech tagger based on the averaged structured perceptron that is capable of domain adaptation and that can use various external resources. We train the tagger on the German web and social media data of the EmpiriST 2015 shared task. Using the TIGER corpus as background data and adding external information about word classes and Brown clusters, we substantially improve on the state of the art for both the web and the social media data sets. The tagger is available as free software.
Authors with CRIS profile
How to cite
APA:
Proisl, T. (2018). SoMeWeTa: A Part-of-Speech Tagger for German Social Media and Web Texts. In Calzolari N, Choukri K, Cieri C, Declerck T, Goggi S, Hasida K, Isahara H, Maegaard B, Mariani J, Mazo H, Moreno A, Odijk J, Piperidis S, Tokunaga T (Eds.), Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018) (pp. 665–670). Miyazaki, JP: Miyazaki: European Language Resources Association.
MLA:
Proisl, Thomas. "SoMeWeTa: A Part-of-Speech Tagger for German Social Media and Web Texts." Proceedings of the 11th Language Resources and Evaluation Conference, Miyazaki Ed. Calzolari N, Choukri K, Cieri C, Declerck T, Goggi S, Hasida K, Isahara H, Maegaard B, Mariani J, Mazo H, Moreno A, Odijk J, Piperidis S, Tokunaga T, Miyazaki: European Language Resources Association, 2018. 665–670.
BibTeX: Download