Using Small Random Samples for the Manual Evaluation of Statistical Association Measures

Journal article
(Original article)


Publication Details

Author(s): Evert S, Krenn B
Journal: Computer Speech and Language
Publication year: 2005
Volume: 19
Journal issue: 4
Pages range: 450-466
ISSN: 0885-2308
Language: English


Abstract


In this paper, we describe the empirical evaluation of statistical association measures for the extraction of lexical collocations from text corpora. We argue that the results of an evaluation experiment cannot easily be generalized to a different setting. Consequently, such experiments have to be carried out under conditions that are as similar as possible to the intended use of the measures. Finally, we show how an evaluation strategy based on random samples can reduce the amount of manual annotation work significantly, making it possible to perform many more evaluation experiments under specific conditions.



FAU Authors / FAU Editors

Evert, Stefan Prof. Dr.
Lehrstuhl für Korpus- und Computerlinguistik


How to cite

APA:
Evert, S., & Krenn, B. (2005). Using Small Random Samples for the Manual Evaluation of Statistical Association Measures. Computer Speech and Language, 19(4), 450-466.

MLA:
Evert, Stefan, and Brigitte Krenn. "Using Small Random Samples for the Manual Evaluation of Statistical Association Measures." Computer Speech and Language 19.4 (2005): 450-466.

BibTeX: 

Last updated on 2018-11-08 at 00:09