Sketch Grammars: a formalism for describing and recognizing diagrammatic sketch languages

Costagliola, Gennaro; Deufemia, Vincenzo; Risi, Michele

doi:10.1109/icdar.2005.218

Cited by 30 publications

(25 citation statements)

References 7 publications

(4 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…They are just software modules managed by SRAs. Many approaches have been proposed for recognizing free-hand drawings [25][26][27][28][29][30]. Each of these proposals has the potential of being integrated into our system in spite of the fact that they differ one from another under several aspects, ranging from the identification of the shape of the symbols to the approach used to construct them.…”

Section: G Casella Et Al / Journal Of Visual Languages and Computinmentioning

confidence: 99%

“…In this section, we describe the main features of three HDSRs that can be exploited by SRAs to identify the symbols of a given domain: LADDER [25], Sketch Grammars [27], and CALI [28].…”

Section: Hand-drawn Symbol Recognizersmentioning

confidence: 99%

“…Sketch Grammars: Sketch Grammars (SkGs) represent a direct extension of string grammars, where more general relations other than concatenation are allowed [27]. The symbol recognizers automatically generated from SkGs try to cluster stroke interpretations into symbols of the domain language.…”

Section: Article In Press G Casella Et Al / Journal Of Visual Langumentioning

confidence: 99%

See 2 more Smart Citations

An agent-based framework for sketched symbol interpretation

Casella

Deufemia

Mascardi

et al. 2008

Journal of Visual Languages & Computing

View full text Add to dashboard Cite

Recognizing hand-sketched symbols is a definitely complex problem. The input drawings are often intrinsically ambiguous, and require context to be interpreted in a correct way. Many existing sketch recognition systems avoid this problem by recognizing single segments or simple geometric shapes in a stroke. However, for a recognition system to be effective and precise, context must be exploited, and both the simplifications on the sketch features, and the constraints under which recognition may take place, must be reduced to the minimum.In this paper, we present an agent-based framework for sketched symbol interpretation that heavily exploits contextual information for ambiguity resolution. Agents manage the activity of lowlevel hand-drawn symbol recognizers, that may be heterogeneous for better adapting to the characteristics of each symbol to be recognized, and coordinate themselves in order to exchange contextual information, thus leading to an efficient and precise interpretation of sketches. We also present AgentSketch, a multi-domain sketch recognition system implemented according to the proposed framework. A first experimental evaluation has been performed on the domain of UML Use Case Diagrams to verify the effectiveness of the proposed approach. r

show abstract

Section: G Casella Et Al / Journal Of Visual Languages and Computinmentioning

confidence: 99%

“…In this section, we describe the main features of three HDSRs that can be exploited by SRAs to identify the symbols of a given domain: LADDER [25], Sketch Grammars [27], and CALI [28].…”

Section: Hand-drawn Symbol Recognizersmentioning

confidence: 99%

See 1 more Smart Citation

An agent-based framework for sketched symbol interpretation

Casella

Deufemia

Mascardi

et al. 2008

Journal of Visual Languages & Computing

View full text Add to dashboard Cite

show abstract

“…Also closely related to our work is the approach by Costagliola et al [7,8]. Domain-specific recognizers are generated from grammars in the SkG-formalism.…”

Section: Related Workmentioning

confidence: 99%

“…If found, the component can be assembled and passed on to the analysis step (see previous section). Decomposition of a component into primitives is also done by other approaches like SkG [7], and Ladder [13] (cf. Sec.…”

Section: The Model-based Recognizermentioning

confidence: 99%

A model-based recognition engine for sketched diagrams

Brieler

Minas

2010

Journal of Visual Languages & Computing

View full text Add to dashboard Cite

Many of today's recognition approaches for hand-drawn sketches are feature-based, which is conceptually similar to the recognition of hand-written text. While very suitable for the latter (and more tasks, e.g., for entering commands), such approaches do not easily allow for clustering and segmentation of strokes, which is crucial to their recognition. This results in applications which do not feel natural but impose artificial restrictions on the user regarding how diagrams and single components are to be drawn.In this paper we propose a recognition approach based on models, which is designed for the mentioned issue of clustering and segmentation. All strokes are fed into different models, where each model is responsible for a certain type of primitive, e.g., a line or an arc. The recognition of a component in the drawing is then decomposed into the recognition of its primitives, which can be directly searched for in the models. Finally, the identified primitives are assembled to the complete component.In several case studies we also show the applicability and generality of our approach, as very different types of components can be recognized. Furthermore, the proposed approach is part of a complete system to sketch understanding which can not only recognize single components, but can also reason about diagrams as a whole, consisting of a set of these components.

show abstract

A visual language-based system for extraction-transformation-loading development

Deufemia

Giordano

Polese

et al. 2013

Softw. Pract. Exper.

View full text Add to dashboard Cite

SUMMARYData warehouse loading and refreshment is typically performed by means of complex software processes called extraction-transformation-loading (ETL). In this paper, we propose a system based on a suite of visual languages for mastering several aspects of the ETL development process, turning it into a visual programming task. The approach can be easily generalized and applied to other data integration contexts beyond data warehouses. It introduces two new visual languages that are used to specify the ETL process, which can also be represented by means of UML activity diagrams. In particular, the first visual language supports data manipulation activities, whereas the second one provides traceability information of attributes to highlight the impact of potential transformations on integrated schemas depending on them. Once the whole ETL process has been visually specified, the designer might invoke the automatic generation of an activity diagram representing a possible orchestration of it based on its dependencies. The designer can edit such a diagram to modify the proposed orchestration provided that changes do not alter data dependencies. The final specification can be translated into code that is executable on the data sources. Finally, the effectiveness of the proposed approach has been validated through a user study in which we have compared the effort needed to design an ETL process in our approach with respect to the one required with main visual approaches described in the literature.

show abstract

Sketch Grammars: a formalism for describing and recognizing diagrammatic sketch languages

Cited by 30 publications

References 7 publications

An agent-based framework for sketched symbol interpretation

An agent-based framework for sketched symbol interpretation

A model-based recognition engine for sketched diagrams

A visual language-based system for extraction-transformation-loading development

Contact Info

Product

Resources

About