Table-processing paradigms: a research survey

Embley, David W.; Hurst, Matthew; Lopresti, Daniel; Nagy, George

doi:10.1007/s10032-006-0017-x

Cited by 129 publications

(81 citation statements)

References 45 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…5 TISP correctly discarded all uses of tables for layout and successfully paired all sibling tables. There were no nested tables in this domain.…”

Section: Resultsmentioning

confidence: 99%

“…We use a conceptual-modeling language to model both the input tables and the output interpretations as suggested in [5]. When we do, the Figure 1 as an example, Table 4 has three Row s, starting with Identification, Location, and Function.…”

Section: Introductionmentioning

confidence: 99%

“…By way of comparison with related work, we note that recent surveys [5,17] describe the vast amount of research that has been done in table processing and illustrate the challenges of the table interpretation problem. We focus in this paper, however, only HTML tables.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Automatic Hidden-Web Table Interpretation by Sibling Page Comparison

Tao¹,

Embley²

2007

Conceptual Modeling - ER 2007

Self Cite

View full text Add to dashboard Cite

Abstract. The longstanding problem of automatic table interpretation still illudes us. Its solution would not only be an aid to table processing applications such as large volume table conversion, but would also be an aid in solving related problems such as information extraction and semi-structured data management. In this paper, we offer a conceptual modeling solution for the common special case in which so-called sibling pages are available. The sibling pages we consider are pages on the hidden web, commonly generated from underlying databases. We compare them to identify and connect nonvarying components (category labels) and varying components (data values). We tested our solution using more than 2,000 tables in source pages from three different domains-car advertisements, molecular biology, and geopolitical information. Experimental results show that the system can successfully identify sibling tables, generate structure patterns, interpret tables using the generated patterns, and automatically adjust the structure patterns, if necessary, as it processes a sequence of hidden-web pages. For these activities, the system was able to achieve an overall F-measure of 94.5%.

show abstract

“…5 TISP correctly discarded all uses of tables for layout and successfully paired all sibling tables. There were no nested tables in this domain.…”

Section: Resultsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Automatic Hidden-Web Table Interpretation by Sibling Page Comparison

Tao¹,

Embley²

2007

Conceptual Modeling - ER 2007

Self Cite

View full text Add to dashboard Cite

show abstract

“…An issue that keeps recurring in our on-going surveys of table recognition [1,3,4] is what should be the output of a table interpretation program. Specific output formats differ widely, but many are equivalent to a spreadsheet where cell contents can be addressed by coordinates.…”

Section: Commercial Softwarementioning

confidence: 99%

“…After describing our view of low-level table processing, we will suggest that this step can now be circumvented by judicious us of common "office" software. 1 The inter-conversion between tables in HTML, PDF, XLM, XLS and DOC files is demonstrated. We then discuss possible table representations for bridging the semantic gap that has so far kept table recognition from being incorporated into routine information retrieval and data extraction applications.…”

Section: Introductionmentioning

confidence: 99%

Notes on Contemporary Table Recognition

Embley

Lopresti

Nagy

2006

Document Analysis Systems VII

Self Cite

View full text Add to dashboard Cite

Abstract. The shift of interest to web tables in HTML and PDF files, coupled with the incorporation of table analysis and conversion routines in commercial desktop document processing software, are likely to turn table recognition into more of a systems than an algorithmic issue. We illustrate the transition by some actual examples of web table conversion. We then suggest that the appropriate target format for table analysis, whether performed by conventional customized programs or by off-theshelf software, is a representation based on the abstract table introduced by X. Wang in 1996. We show that the Wang model is adequate for some useful tasks that prove elusive for less explicit representations, and outline our plans to develop a semi-automated table processing system to demonstrate this approach. Screen-snaphots of a prototype tool to allow table mark-up in the style of Wang are also presented.

show abstract

Automated heuristic based context dependent ETL process to generate multi‐dimensional model for tabular data

Hira¹,

Deshpande

2022

Concurrency and Computation

View full text Add to dashboard Cite

Over the past decade, enterprises have broadly adopted data warehousing in various activities. Today, abundant information is available on websites in the form of tables or spreadsheets. This huge amount of data cannot be processed directly because of its complexity, heterogeneity, and gap between user requirements. In this work, an automatic approach is proposed to build the multi-dimensional structure (MDS) of heterogeneous tabular data format for intelligent decision-making. The proposed MDS is generated by identifying components such as dimensions and hierarchies. It automatically extracts measures based on the spatial characteristics of data dimensions like region, time as well as their hierarchies. This proposed approach automatically generates a multi-dimensional model for BI tools without complicated ETL (Extraction, Transformation and Loading) process and helps to solve several business queries, like "Top 5 states in India based on Irrigated area in 2009". Moreover, the proposed method reduces the time and cost of building multi-dimensional models to a very large extent. The correctness of proposed method is tested with the synthetic and economic datasets of Government websites where information is stored in tabular formats and various heterogeneous setups where the proposed method saved approximately 4000 to 5000 computing hours of the ETL process.

show abstract

Table-processing paradigms: a research survey

Cited by 129 publications

References 45 publications

Automatic Hidden-Web Table Interpretation by Sibling Page Comparison

Automatic Hidden-Web Table Interpretation by Sibling Page Comparison

Notes on Contemporary Table Recognition

Automated heuristic based context dependent ETL process to generate multi‐dimensional model for tabular data

Contact Info

Product

Resources

About