Technical Reports


Click here for full text: PDF

Monte Carlo Study of Taxonomy Evaluation

Ulanov, Alexander; Shevlyakov, Georgy; Lyubomishchenko, Nikolay; Mehra, Pankaj; Polutin, Vladimir
HP Laboratories


Keyword(s): Taxonomy evaluation, taxonomy benchmarks

Abstract: The problems of taxonomy evaluation criteria comparison and corresponding benchmark creation are considered. The classes of Primitive Ideal Taxonomies (PITs), their WordNet and disrupted versions are proposed as the sets of benchmark taxonomies for the comparison of taxonomy evaluation methods. For WordNet PITs and their perturbations, the performances of the structure-based PageRank, FloorRank, and the corpusbased Information Content criteria are studied in Monte Carlo experiment. It is shown that the proposed approach can be used for the ranking of taxonomy evaluation criteria.

5 Pages

Additional Publication Information: To be published and presented at WeBS 2010, Bilbao, Spain.

External Posting Date: October 6, 2010 [Fulltext]. Approved for External Publication
Internal Posting Date: October 6, 2010 [Fulltext]

Back to Index