Message Understanding Conference (MUC) Task

A Message Understanding Conference (MUC) Task is a natural language processing benchmark tasks that were focused on shallow Semantic Analysis of small text documents.

• Context:
  • In can include Named Entity Recognition, Coreference Resolution, Relation Detection and Information Extraction.
  • It can be associated with MUC workshops (from 1987 through 1995).
  • It can be sponsored by DARPA.
    • for a set of predefined fields in a template corresponding to some desired information relationship from a set of documents.
  • Its Template Filling Task involved Complex Semantic Relations.
  • It can include an ACE Performance Metric definition.
  • It is associated with a MUC Benchmark Task: MUC-7 Task, MUC-6 Task, MUC-5 Task, MUC-4 Task.
• Example(s):
  • MUC-7, topic: Joint Ventures.
  • MUC-6, topic: Management Succession.
  • MUC-5, topic: Joint Ventures.
  • MUC-4, topic: Terrorism.
  • …
• Counter-Example(s):
  • Conference on Computer Vision and Pattern Recognition (CVPR),
  • International Conference on Learning Representations (ICLR),
• See: ACE Program, SemEval, TIPSTER, Information Extraction Task, Named Entity Recognition, MUC-Style Annotation.

---

---

References

1999

• (Appelt and Israel, 1999) ⇒ Douglas E. Appelt and D. J. Israel. (1999). “Introduction to Information Extraction Technology." A Tutorial Prepared for IJCAI-99.

1998a

• (Chinchor, 1998) ⇒ N. A. Chinchor. (1998). “Overview of MUC-7/MET-2.” In: Proceedings of the Seventh Message Understanding Conference (MUC-7).

1998b

• (Marsh and Perzanowski, 1998) ⇒ E. Marsh and D. Perzanowski. (1998). “MUC-7 Evaluation of IE Technology:Overview of Results." Presentation at the MUC-7 Conference.

1996

• (Grishman and Sundheim, 1996) ⇒ R. Grishman and B. Sundheim. (1996). “Message Understanding Conference - 6: A Brief History.” In: Proceedings of COLING-1996.

1995

• Sundheim, B. (Ed.), (1995). Proceedings of the Sixth Message Understanding Conference (MUC-6). ARPA, Morgan Kaufmann, Columbia, MD.

1993

• (Riloff, 1993) ⇒ Ellen Riloff (1993). “Automatically Constructing a Dictionary for Information Extraction Tasks.” In: Proceedings of AAAI-93.

---