Semantic Relation Mention Recognition Benchmark Task

A Semantic_Relation_Mention_Recognition_Benchmark_Task is a Benchmark Task to test the Performance of a Semantic_Relation_Mention_Recognition_System.

• Example(s):
  • SemEval-1 Task 4 (Benchmark Task))
  • ACE Relation Mention Detection Task.
    • http://www.nist.gov/speech/tests/ace/index.htm
    • http://verbs.colorado.edu/~mpalmer/projects/ace.html
  • OrganizationHeadquarterLocation.
    • Snowball.
  • Message Understanding Conference (MUC)
    • 1996_MUC6ABriefHistory.
  • ?? LEILA.
  • BioMedicine:
    • PPLRE / PPLRE Task / PPLRE Benchmark Task.
    • BioCreAtIvE Task.
  • Protein interacts with Protein from PubMed.
    • [Craven & Kumlien, 99]
    • [Bunescu, Ge, et al., 2005]
    • BioCreAtIvE Task

State of the Art Performance===

• Unrestricted Text.
  • Recall: 60-70% Ref??
  • Procession: 65-75% Ref??
• Semi-structured Text.
  • Recall: 90% Ref??
  • Precision: 90% Ref??

---