2006 EfficientBatchTopKSearchforDictNER
- (Chandel et al., 2006) ⇒ Amit Chandel, P. C. Nagesh, Sunita Sarawagi. (2006). “Efficient Batch Top-k Search for Dictionary-based Entity Recognition.” In: Proceedings of the 22nd IEEE International Conference on Data Engineering (ICDE 2006). doi:10.1109/ICDE.2006.55
Subject Headings: Named Entity Recognition Algorithm.
Cited By
Quotes
Abstract
We consider the problem of speeding up Entity Recognition systems that exploit existing large databases of structured entities to improve extraction accuracy. These systems require the computation of the maximum similarity scores of several overlapping segments of the input text with the entity database. We formulate a batch Top-K problem with the goal of sharing computations across overlapping segments. Our proposed algorithm performs a factor of three faster than independent top-K queries and only a factor of two slower than an unachievable lower bound on total cost. We then propose a novel modification of the popular Viterbi algorithm for recognizing entities so as to work with easily computable bounds on match scores, thereby reducing the total inference time by a factor of eight compared to state-of-the-art methods.
,
| Author | volume | Date Value | title | type | journal | titleUrl | doi | note | year | |
|---|---|---|---|---|---|---|---|---|---|---|
| 2006 EfficientBatchTopKSearchforDictNER | Amit Chandel P. C. Nagesh Sunita Sarawagi | Efficient Batch Top-k Search for Dictionary-based Entity Recognition | Proceedings of the 22nd IEEE International Conference on Data Engineering | http://www.it.iitb.ac.in/~sunita/papers/icde06b.pdf | 10.1109/ICDE.2006.55 | 2006 |