U-Compare: share and compare text mining tools with UIMA

Abstract

Summary: Due to the increasing number of text mining resources (tools and corpora) available to biologists, interoperability issues between these resources are becoming significant obstacles to using them effectively. UIMA, the Unstructured Information Management Architecture, is an open framework designed to aid in the construction of more interoperable tools. U-Compare is built on top of the UIMA framework, and provides both a concrete framework for out-of-the-box text mining and a sophisticated evaluation platform allowing users to run specific tools on any target text, generating both detailed statistics and instance-based visualizations of outputs. U-Compare is a joint project, providing the world's largest, and still growing, collection of UIMA-compatible resources. These resources, originally developed by different groups for a variety of domains, include many famous tools and corpora. U-Compare can be launched straight from the web, without needing to be manually installed. All U-Compare components are provided ready-to-use and can be combined easily via a drag-and-drop interface without any programming. External UIMA components can also simply be mixed with U-Compare components, without distinguishing between locally and remotely deployed resources.Availability: http://u-compare.org/Contact: kano@is.s.u-tokyo.ac.jp

Replicability and reproducibility of research results for human language technology: introducing an LRE special section

“…In fact, several recent articles have reported on reproducibility and/or replication problems in the HLT field (e.g., Johnson et al 2007;Poprat et al 2008;Gao and Vogel 2008;Caporaso et al 2008;Kano et al 2009;Fokkens et al 2013;Hagen et al 2015), and two recent workshops 1 have addressed the need for replication and reproduction of HLT results. However, there is no established venue for publications on the topic, and perhaps more problematically, research that investigates existing methods rather than introducing new ones is often implicitly discouraged in the process of peer review.…”

Proceedings of the Workshop on Open Infrastructures and Analysis Frameworks for HLT

“…The U-Compare system (Kano et al, 2009;Kano, Dorado, McCrohon, Ananiadou, & Tsujii, 2010) also supports evaluation and performance comparison of UIMA-based automated annotation tools. It was designed with UIMA in mind from the ground up, enabling UIMA workflow creation and execution through a GUI.…”

Survey of Text Mining Techniques, Challenges and their Applications

“…Text mining techniques become more complex as compared to data mining due to unstructured and fuzzy nature of natural language text [19]. The techniquespresented in [13,16,21] comprises of multidisciplinary fields, such as information retrieval, text analysis, natural language processing [15], and information classification based on logical and non-trivial patterns from large data sets.…”