We present Newton's Pen, a statics tutor implemented on a "pentop computer," a writing instrument with an integrated digitizer and embedded processor. The tutor, intended for undergraduate education, scaffolds students in the construction of free body diagrams and equilibrium equations. This project entailed the development of sketch understanding techniques and user interface principles for creating pedagogically-sound instructional tools for pentop computers. Development on the pentop platform presented novel challenges because of limited computational resources and a visually static, ink-on-paper display (the only dynamic output device is an audio speaker).We show that a system architecture based on a finite state machine reduces the computational complexity, and serves as a convenient means for providing context-sensitive tutorial help. Our pilot study suggests that Newton's Pen has potential as an effective teaching tool.
Kirchhoff's Pen is a pen-based tutoring system that teaches students to apply Kirchhoff's voltage law (KVL) and current law (KCL). To use the system, the student sketches a circuit schematic and annotates it to indicate component labels, mesh currents, and nodal voltages. The student then selects either mesh (KVL) or nodal (KCL) analysis, and writes the appropriate equations. The system interprets the equations, compares them to the correct equations (which are automatically derived from the circuit), and provides tutorial feedback about errors. Unlike traditional tutoring systems that work from input provided with a keyboard and mouse, our system works from ambiguous, hand-drawn input. The goal of our work is to create computational techniques to enable natural, pen-based tutoring systems that scaffold students in solving problems in the same way they would ordinarily solve them with paper and pencil. Kirchhoff's Pen is an important first step toward this goal.
Smartphones have become indispensable computational tools. However, some tasks can be difficult to perform on a smartphone because these devices have small displays. Here, we explore methods for augmenting the display of a smartphone, or other PDA, using interactive paper. Specifically, we present a prototype interface that enables a user to interactively interrogate technical drawings using an Anoto-based smartpen and a PDA. Our software system, called PaperCAD, enables users to query geometric information from CAD drawings printed on Anoto dot-patterned paper. For example, the user can measure a distance by drawing a dimension arrow. The system provides output to the user via a smartpen’s audio speaker and the dynamic video display of a PDA. The user can select either verbose or concise audio feedback, and the PDA displays a video image of the portion of the drawing near the pen tip. The project entails advances in the interpretation of pen input, such as a method that uses contextual information to interpret ambiguous dimensions and a technique that uses a hidden Markov model to correct interpretation errors in handwritten equations. Results of a user study suggest that our user interface design and interpretation techniques are effective and that users are highly satisfied with the system.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.