Stanford InfoLab Publication Server

Feature-Rich Part-of-Speech Tagging with a Cyclic Dependency Network

Toutanova, Kristina and Klein, Dan and Manning, Christopher and Singer, Yoram (2003) Feature-Rich Part-of-Speech Tagging with a Cyclic Dependency Network. In: Human Language Technology Conference (HLT-NAACL 2003), May 27 - June 1, 2003, Edmonton, Canada.




We present a new part-of-speech tagger that demonstrates the following ideas: (i)explicit use of both preceding and following tag contexts via a dependency network representation, (ii) broad use of lexical features, including jointly conditioning on multiple consecutive words, (iii) effective use of priors in conditional loglinear models, and (iv) fine-grained modeling of unknown word features. Using these ideas together, the resulting tagger gives a 97.24% accuracy on the Penn Treebank WSJ, an error reduction of 4.4% on the best previous single automatically learned tagging result.

Item Type:Conference or Workshop Item (Paper)
Uncontrolled Keywords:part-of-speech tagging, dependency networks, sequence models
Subjects:Computer Science
Related URLs:Project Homepage
ID Code:603
Deposited By:Import Account
Deposited On:08 Jul 2003 17:00
Last Modified:24 Dec 2008 11:16

Download statistics

Repository Staff Only: item control page