Abstract:With growing interest in automated event extraction, there is an increasing need to overcome the labor costs of hand-written event templates, entity lists, and annotated corpora. In the last few years, more inductive approaches have emerged, seeking to discover unknown event types and roles in raw text. The main recent efforts use probabilistic generative models, as in topic modeling, which are formally concise but do not always yield stable or easily interpretable results. We argue that event schema induction… Show more
“…Schemas Matching. We follow previous work and use precision, recall and F1-score as the metrics for schema matching (Chambers and Jurafsky, 2011;Chambers, 2013;Cheung et al, 2013;Nguyen et al, 2015;Sha et al, 2016;Ahn, 2017). The matching between model answers and references is based on the head word.…”
Section: Evaluation Metricsmentioning
confidence: 99%
“…Event Schema Induction seminal work studies patterns (Shinyama and Sekine, 2006;Filatova et al, 2006;Qiu et al, 2008) and event chains (Chambers and Jurafsky, 2011) for template induction. For MUC 4, the current dominant methods include probabilistic generative methods (Chambers, 2013;Cheung et al, 2013;Nguyen et al, 2015) that jointly model predicate and ar-gument assignment, and ad-hoc clustering algorithms for inducing slots (Sha et al, 2016;Ahn, 2017;Yuan et al, 2018). These methods all rely on hand-crafted discrete features without fully model the textual redundancy.…”
Section: Related Workmentioning
confidence: 99%
“…In addition, we also perform slot mapping, between slots that our model learns and slots in the annotation. Following previous work on MUC 4 (Chambers, 2013;Cheung et al, 2013;Nguyen et al, 2015;Sha et al, 2016;Ahn, 2017), we implement automatic greedy slot mapping. Each reference slot is mapped to a learned slot that ranks the best according to the F1-score metric on GNBusiness-Dev.…”
Section: Evaluation Metricsmentioning
confidence: 99%
“…Extracting events from news text has received much research attention. The task typically consists of two subtasks, namely schema induction, which is to extract event templates that specify argument slots for given event types (Chambers, 2013;Cheung et al, 2013;Nguyen et al, 2015;Sha et al, 2016;Ahn, 2017;Yuan et al, 2018), and event extraction, which is to identify events with filled slots from a piece of news (Nguyen et al, 2016b;Sha et al, 2018;Liu et al, 2018a;Chen et al, 2018Chen et al, , 2015Nguyen and Grishman, 2016;Liu et al, 2018b). Previous work focuses on extracting events from single news documents according to a set of pre-specified event types, such as arson, attack or earthquakes.…”
We consider open domain event extraction, the task of extracting unconstraint types of events from news clusters. A novel latent variable neural model is constructed, which is scalable to very large corpus. A dataset is collected and manually annotated, with task-specific evaluation metrics being designed. Results show that the proposed unsupervised model gives better performance compared to the state-of-the-art method for event schema induction.
“…Schemas Matching. We follow previous work and use precision, recall and F1-score as the metrics for schema matching (Chambers and Jurafsky, 2011;Chambers, 2013;Cheung et al, 2013;Nguyen et al, 2015;Sha et al, 2016;Ahn, 2017). The matching between model answers and references is based on the head word.…”
Section: Evaluation Metricsmentioning
confidence: 99%
“…Event Schema Induction seminal work studies patterns (Shinyama and Sekine, 2006;Filatova et al, 2006;Qiu et al, 2008) and event chains (Chambers and Jurafsky, 2011) for template induction. For MUC 4, the current dominant methods include probabilistic generative methods (Chambers, 2013;Cheung et al, 2013;Nguyen et al, 2015) that jointly model predicate and ar-gument assignment, and ad-hoc clustering algorithms for inducing slots (Sha et al, 2016;Ahn, 2017;Yuan et al, 2018). These methods all rely on hand-crafted discrete features without fully model the textual redundancy.…”
Section: Related Workmentioning
confidence: 99%
“…In addition, we also perform slot mapping, between slots that our model learns and slots in the annotation. Following previous work on MUC 4 (Chambers, 2013;Cheung et al, 2013;Nguyen et al, 2015;Sha et al, 2016;Ahn, 2017), we implement automatic greedy slot mapping. Each reference slot is mapped to a learned slot that ranks the best according to the F1-score metric on GNBusiness-Dev.…”
Section: Evaluation Metricsmentioning
confidence: 99%
“…Extracting events from news text has received much research attention. The task typically consists of two subtasks, namely schema induction, which is to extract event templates that specify argument slots for given event types (Chambers, 2013;Cheung et al, 2013;Nguyen et al, 2015;Sha et al, 2016;Ahn, 2017;Yuan et al, 2018), and event extraction, which is to identify events with filled slots from a piece of news (Nguyen et al, 2016b;Sha et al, 2018;Liu et al, 2018a;Chen et al, 2018Chen et al, , 2015Nguyen and Grishman, 2016;Liu et al, 2018b). Previous work focuses on extracting events from single news documents according to a set of pre-specified event types, such as arson, attack or earthquakes.…”
We consider open domain event extraction, the task of extracting unconstraint types of events from news clusters. A novel latent variable neural model is constructed, which is scalable to very large corpus. A dataset is collected and manually annotated, with task-specific evaluation metrics being designed. Results show that the proposed unsupervised model gives better performance compared to the state-of-the-art method for event schema induction.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.