2007 RobustIEWithPerceptrons
- (Surdeanu and Ciaramita, 2007) ⇒ Mihai Surdeanu, and Massimiliano Ciaramita. (2007). “Robust Information Extraction with Perceptrons.” In: Proceedings of NIST 2007 Automatic Content Extraction Workshop.
Subject Headings: Relation Detection from Text Algorithm, ACE Benchmark Task, ACE-2007, Perceptron Algorithm
Notes
Cited By
Quotes
Abstract
We present a system for the extraction of entity and relation mentions. Our work focused on robustness and simplicity: all system components are modeled using variants of the Perceptron algorithm (Rosemblatt, 1958) and only partial syntactic information is used for feature extraction. Our approach has two novel ideas. First, we define a new large-margin Perceptron algorithm tailored for class-unbalanced data which dynamically adjusts its margins, according to the generalization performance of the model. Second, we propose a novel architecture that lets classification ambiguities flow through the system and solves them only at the end. The system achieves competitive accuracy on the ACE English EMD and RMD tasks.
References
- Y. Altun, T. Hofmann, and M. Johnson. (2003). Discriminative learning for label sequence. In: Proceedings of NIPS 2003.
- Christopher M. Bishop. (1995). Neural Networks for Pattern Recognition. Oxford University Press.
- T. Brants. (2002). A statistical part-of-speech tagger. In: Proceedings of ANLP 2002.
- Massimiliano Ciaramita and Y. Altun. (2006). Broad coverage sense disambiguation and information extraction with a supersense sequence tagger. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP).
- G. Claudio, A. Lavelli, and L. Romano. (2006). Exploiting shallow linguistic information for relation extraction from biomedical literature. In: Proceedings of the European Chapter of the Association for Computational Linguistics (EACL).
- Michael Collins. (2002). Discriminative training methods for hidden markov models: Theory and experiments with the perceptron algorithms. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP).
- M. Cristianini and John Shawe Taylor. (2000). An Introduction to Support Vector Machines. Cambridge University Press.
- C. Fellbaum. (1998). WordNet: An Electronic Lexical Database. MIT Press, Cambridge, MA.
- Yoav Freund and Robert E. Schapire. (1999). Large margin classification using the perceptron algorithm. Machine Learning, 37.
- W. Krauth and M. Mezard. (1987). Learning algorithm with optimal stability in neural networks. Journal of Physics, 20.
- John D. Lafferty, Andrew McCallum, and Fernando Pereira. (2001). Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In: Proceedings of ICML 2001.
- Y. Li, H. Zaragoza, R. Herbrich, John Shawe Taylor, and J. Kandola. (2002). The perceptron algorithm with uneven margins. In: Proceedings of the 19th International Conference on Machine Learning.
- Andrew McCallum, Dayne Freitag, and Fernando Pereira. (2000). Maximum entropy markov models for information extraction and segmentation. In: Proceedings of ICML 2000.
- F. Rosemblatt. 1858. The perceptron: A probabilistic model for information storage and organization in the brain. Psych. Rev., 68:386–407.
- Dan Roth andW. Yih. (2004). A linear programming formulation for global inference in natural language tasks. In: Proceedings of the Annual Conference on Computational Natural Language Learning (CoNLL).
- F. Sha and F. Pereira. (2003). Shallow parsing with conditional random fields. In: Proceedings of HLT-NAACL 2003.
- G. Zhou, J. Su, J. Zhang, andM. Zhang. (2005). Exploring various knowledge for relation extraction. In: Proceedings of the 43rd Annual Meeting of the Association for Computational Linguistics (ACL).
,