Stanford InfoLab Publication Server

Optimizing Local Probability Models for Statistical Parsing

Toutanova, Kristina and Mitchell, Mark and Manning, Christopher (2003) Optimizing Local Probability Models for Statistical Parsing. In: 14th European Conference on Machine Learning, (ECML 2003), September 22-26, 2003, Dubrovnik, Croatia.




This paper studies the properties and performance of models for estimating local probability distributions which are used as components of larger probabilistic systems --- history-based generative parsing models. We report experimental results showing that memory-based learning outperforms many commonly used methods for this task (Witten-Bell, Jelinek-Mercer with fixed weights, decision trees, and log-linear models). However, we can connect these results with the commonly used general class of deleted interpolation models by showing that certain types of memory-based learning, including the kind that performed so well in our experiments, are instances of this class. In addition, we illustrate the divergences between joint and conditional data likelihood and accuracy performance achieved by such models, suggesting that smoothing based on optimizing accuracy directly might greatly improve performance.

Item Type:Conference or Workshop Item (Paper)
Uncontrolled Keywords:probabilistic parsing models, memory based learning, deleted interpolation
Subjects:Computer Science
Related URLs:Project Homepage
ID Code:602
Deposited By:Import Account
Deposited On:08 Jul 2003 17:00
Last Modified:24 Dec 2008 11:19

Download statistics

Repository Staff Only: item control page