A Survey of Visual Language Specification and Recognition

Marriott, Kim; Meyer, Bernd; Wittenburg, Kent

doi:10.1007/978-1-4612-1676-6_2

Cited by 74 publications

(55 citation statements)

References 65 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Visual language parsing has been studied [60], but most previous approaches assume diagrammatic input free from low-level recognition errors and cannot handle realistic, messy, stroke-based input. Mahoney and Fromherz use mathematical constraints to cope with the complexities of parsing sketches of curvilinear configurations such as stick figures [58].…”

Section: Approach Overviewmentioning

confidence: 99%

“…A variety of general two-dimensional parsing techniques have been developed for diagram recognition [39,59,60]. Given a set of two-dimensional, hierarchical shape descriptions, these systems combine low-level shapes in a diagram according to the constraints given in the shape descriptions to produce higher-level descriptions for the diagram.…”

Section: Diagram Recognitionmentioning

confidence: 99%

See 1 more Smart Citation

Multi-domain sketch understanding

Alvarado

2007

ACM SIGGRAPH 2007 Courses

View full text Add to dashboard Cite

People use sketches to express and record their ideas in many domains, including mechanical engineering, software design, and information architecture. In recent years there has been an increasing interest in sketch-based user interfaces, but the problem of robust free-sketch recognition remains largely unsolved. Current computer sketch recognition systems are difficult to construct, and either are fragile or accomplish robustness by severely limiting the designer's drawing freedom.This work explores the challenges of multi-domain sketch recognition. We present a general framework and implemented system, called SketchREAD, for diagrammatic sketch recognition. Our system can be applied to a variety of domains by providing structural descriptions of the shapes in the domain. Robustness to the ambiguity and uncertainty inherent in complex, freelydrawn sketches is achieved through the use of context. Our approach uses context to guide the search for possible interpretations and uses a novel form of dynamically constructed Bayesian networks to evaluate these interpretations. This process allows the system to recover from low-level recognition errors (e.g., a line misclassified as an arc) that would otherwise result in domain level recognition errors. We evaluated SketchREAD on real sketches in two domains-family trees and circuit diagrams-and found that in both domains the use of context to reclassify low-level shapes significantly reduced recognition error over a baseline system that did not reinterpret low-level classifications. We discuss remaining challenges for multi-domain sketch recognition revealed by our evaluation. Finally, we explore the system's potential role in sketch-based user interfaces from a human computer interaction perspective. AcknowledgmentsI did not go to graduate school to work by myself, and I do not believe any that any work of this magnitude can be accomplished by an individual alone. It would be wrong for me to claim sole credit for the work in this dissertation, because the truth is that I could not have done it, nor would I have wanted to do it, without the help and support of many people.First, I would like to thank my advisor, Randy Davis, for giving this work direction and for helping me maintain its direction over the course of six years. Six years ago, he asked me to work on a project that involved hooking a sketch recognition system into a mechanical simulator. I argued that linking two pieces of software was not research, and he replied that perhaps I was right, but that it would make "a hell of a cool demo." Not only was it an incredibly cool demo, but it also opened a door to years of new and exciting research. I owe the direction of this work to Randy's ability to see fascinating problems years before anyone else does.The efforts of many people went into the creation of the software system that underlies work

show abstract

Section: Approach Overviewmentioning

confidence: 99%

Section: Diagram Recognitionmentioning

confidence: 99%

Multi-domain sketch understanding

Alvarado

2007

ACM SIGGRAPH 2007 Courses

View full text Add to dashboard Cite

show abstract

“…In general, a visual language specification aims to capture the syntax and semantics of the relevant language [22]. Moreover a syntax specification of a visual language can focus on two different aspects; the abstract syntax and the concrete syntax, where the concrete syntax deals with the visual representation of the concepts in the abstract syntax [1,23].…”

Section: Introductionmentioning

confidence: 99%

“…The final publication is available at Springer via http:// dx.doi.org/10.1007/978-3-319-42333-3_15 the concrete syntax or the syntax and the semantics is not applicable to all visual languages [22], in general, a visual language specification deals with one or more of these three aspects; abstract syntax, concrete syntax and semantics.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

An Investigation into OWL for Concrete Syntax Specification Using UML Notations

Thomas

Gerber

Merwe

2016

Diagrammatic Representation and Inference

View full text Add to dashboard Cite

Abstract. The Web Ontology Language OWL is a prominent ontology language for specifying ontologies. Although OWL ontologies are wellused for representing and reasoning about knowledge in various domains, they are sparsely studied for visual language specification. The work in this paper, therefore, explores OWL for visual language specification by specifying the concrete syntax of selected UML class diagram notations in an ontology. The selected diagram notations are specified as spatial configurations of primitive elements and qualitative base spatial relationships of Region Connection Calculus-8 (RCC-8). Furthermore, the automated reasoning features of ontology reasoners are investigated to verify the completeness and the correctness of the specification. The verification results indicate that the given specification needs to be revised to support applications to draw the selected notations. The value of such a specification in supporting a semantic diagram interpretation application is demonstrated using the automated instance classification feature of ontology reasoners.

show abstract

Abstract Syntax and Semantics of Visual Languages

Erwig

1998

Journal of Visual Languages & Computing

View full text Add to dashboard Cite

show abstract

A Survey of Visual Language Specification and Recognition

Cited by 74 publications

References 65 publications

Multi-domain sketch understanding

Multi-domain sketch understanding

An Investigation into OWL for Concrete Syntax Specification Using UML Notations

Abstract Syntax and Semantics of Visual Languages

Contact Info

Product

Resources

About