Paper-Based Augmented Reality

Abstract

A new method for augmenting paper documents with electronic information is described that does not modify the format of the paper document in any way. Applicable to both commercially printed documents as well as documents that are output from PC's, the technique we call Paper-Based Augmented Reality substantially improves the utility of paper. We describe the recognition technology that makes this possible as well as several applications. An implementation on a camera phone is discussed that lets users retrieve data and access links from paper documents to electronic data. Recognition is performed at 4 frames per second on a Treo 700w and support is provided for several user applications, including "clickable paper" -printed web pages whose appearance is unchanged but that can be navigated with a camera phone.

Clickable augmented documents

“…As a consequence, these descriptors cannot be applied to text documents because the local regions of the text documents are similar and not discriminative. To overcome this issue, other types of the descriptors for texts have been proposed by using local geometrical relationship of feature points [5], [6].…”

“…Generally, this technology is known as a paper-based AR. These days, some researches focus on text documents because the documents can be widely distributed such as newspapers and magazines [5], [6], [7].…”

Who’s That Girl? Handheld Augmented Reality for Printed Photo Books

“…QRcodes) cannot be used. Text-based document recognition [6,14] is also not possible because photo books contain mostly images. Another widely used techniques to implemented AR systems are recognition algorithms such as SIFT [17].…”

“…It extends the concept of using discrete photos by providing immediate feedback using an augmentation. Prototypes that augment different types of physical objects, such as text-heavy conference proceedings [14], real estate guides [6], and sights [1] have been developed. Different groups (e.g.…”

“…Augmented Reality (AR) looks as a natural option to fuse digital media with paper documents [14]. As traditional AR has severe technical limitation, such as the need for AR goggles, handheld AR recently received a great share of attention in the AR domain [26].…”