Automatically Mapping and Integrating Multiple Data Entry Forms into a Database

Abstract

Abstract. Forms are a standard way of gathering data into a database. Many applications need to support multiple users with evolving data gathering requirements. It is desirable to automatically link dynamic forms to the back-end database. We have developed the FormMapper system, a fully automatic solution that accepts user-created data entry forms, and maps and integrates them into an existing database in the same domain. The solution comprises of two components: tree extraction and form integration. The tree extraction component leverages a probabilistic process, Hidden Markov Model (HMM), for automatically extracting a semantic tree structure of a form. In the form integration component, we develop a merging procedure that maps and integrates a tree into an existing database and extends the database with desired properties. We conducted experiments evaluating the performance of the system on several large databases designed from a number of complex forms. Our experimental results show that the FormMapper system is promising: It generated databases that are highly similar (87% overlapped) to those generated by the human experts, given the same set of forms.

Learning to discover complex mappings from web forms to ontologies

“…Form tree extraction is the process of clustering the elements on a form into semantically related groups, and organizing the groups into parent-child hierarchical relationships. In the previous work [17,3], we developed a machine learning technique that leverages Hidden Markov Models (HMM) for automatically extracting a form tree from a form. In this paper, we will assume that a form has been converted to a form tree through the existing solution.…”

Bridging encounter forms and electronic medical record databases: Annotation, mapping, and integration

“…In this work, we focus on integrating forms to a single EHR database. The integration task needs to merge both schema and data elements [2]. We also incorporate a semiautomated approach for discovering correspondences [7].…”

“…We have partially addressed some of the challenges in our previous work [1], [2], [3]. In this paper, we describe an integrated framework, fEHR-plus (fEHR stands for flexible Electronic Health Record), that extends the previous work.…”

“…(1) Determine the SNOMED CT semantic category of a given form term using a structure-based model. (2) Map the term to a linguistically matching concept within the determined semantic category. Mapping Discovery and Validation.…”

“…THE FEHR-PLUS FRAMEWORK A user can design a form through a graphical user interface in the fEHR-plus system. The system automatically converts a form to a tree structure call form tree [2]. Form Term Annotation Using SNOMED CT.…”