TAC KBP 2017 : Event Detection, Coreference and Sequencing
Overview
Following the successful event detection and coreference tasks in the past two years, we are organizing Event Nugget tasks in NIST TAC KBP 2017. In addition to the tranditional Event nugget and Coreference tasks of year 2015 and 2016, we introduce Event Sequence task, which aim to identify the chronological order of events within a particular script.
The Event Detection and Coreference tasks: these tasks aim to identify the explicit mentioning of Events in English, Chinese, and Spanish documents. Every instance of a mention of the relevant Event types must be identified. The Event Detection task is required to detect the selected Event Types and Subtypes taken from the Rich ERE Annotation Guidelines: Events (current version is v2.9.). Also, the task is to identify three REALIS {ACTUAL, GENERIC, OTHER}, which are described in the Rich ERE guidelines.
Event Sequencing tasks: the sequencing task will be conducted on the detected Event Mentions: the main task involve "After" and "Subevent" relations.
The event detection and coreference task will be conducted on a trilingual setting: English, Chinese and Spanish, there will be about 500 annotated documents in total. The Event Sequencing task is only conducted on English. The training set for the Event Sequencing task is constructed by annotating the training and testing data of TAC KBP 2015 Event track data.
Schedule
Preliminary TAC KBP 2017 Schedule |
February 20 | Track registration opens |
June 15 | Deadline for registration for track participation |
September 25 - October 2 | Event Nugget Detection and Coreference Evaluation Window |
October 3-10 | Event Sequencing Evaluation Window |
By mid October | Release of individual evaluated results to participants (most tracks) |
October 15 | Deadline for short system descriptions |
October 15 | Deadline for workshop presentation proposals |
October 20 | Notification of acceptance of presentation proposals |
November 1 | Deadline for system reports (workshop notebook version) |
November 13-14 | TAC 2017 workshop in Gaithersburg, Maryland, USA |
February 2018 | Deadline for system reports (final proceedings version) |
Updates
- Jan 21st 2017: The website online.
|