A knowledge-based user interface management system

Foley, James D.; Gibbs, Christina A.; Kovacevic, Srdjan

doi:10.1145/57167.57178

Cited by 60 publications

(18 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Some systems use a knowledge base describing the rules and the criteria that guide the interface building process. A first significant example is UIDE, presented in [35]. This system has a complex knowledge base describing manny different aspects, as the interface components, the actions of the interface, the parameters, the pre-and post-conditions of the different steps of the task managed by the interface.…”

Section: State Of the Artmentioning

confidence: 99%

GAIML: A New Language for Verbal and Graphical Interaction in Chatbots

Pirrone

Russo

Cannella

et al. 2008

Mobile Information Systems

View full text Add to dashboard Cite

Abstract. Natural and intuitive interaction between users and complex systems is a crucial research topic in human-computer interaction. A major direction is the definition and implementation of systems with natural language understanding capabilities. The interaction in natural language is often performed by means of systems called chatbots. A chatbot is a conversational agent with a proper knowledge base able to interact with users. Chatbots appearance can be very sophisticated with 3D avatars and speech processing modules. However the interaction between the system and the user is only performed through textual areas for inputs and replies. An interaction able to add to natural language also graphical widgets could be more effective. On the other side, a graphical interaction involving also the natural language can increase the comfort of the user instead of using only graphical widgets. In many applications multi-modal communication must be preferred when the user and the system have a tight and complex interaction. Typical examples are cultural heritages applications (intelligent museum guides, picture browsing) or systems providing the user with integrated information taken from different and heterogenous sources as in the case of the iGoogle TM interface. We propose to mix the two modalities (verbal and graphical) to build systems with a reconfigurable interface, which is able to change with respect to the particular application context. The result of this proposal is the Graphical Artificial Intelligence Markup Language (GAIML) an extension of AIML allowing merging both interaction modalities. In this context a suitable chatbot system called Graphbot is presented to support this language. With this language is possible to define personalized interface patterns that are the most suitable ones in relation to the data types exchanged between the user and the system according to the context of the dialogue.

show abstract

Section: State Of the Artmentioning

confidence: 99%

GAIML: A New Language for Verbal and Graphical Interaction in Chatbots

Pirrone

Russo

Cannella

et al. 2008

Mobile Information Systems

View full text Add to dashboard Cite

show abstract

“…Semantic modeling languages allow the definition of the main system functions that are to be interactively delivered to the user, resembling typical API specifications, while the generation of a user interface is automatically performed, based on heuristic transformation rules (e.g., every function becomes a button, while every argument, depending on its type, becomes an input field). Examples of such systems are IDL (Foley et al, 1988), which provides also pre-conditions and post-conditions for function availability, and Mickey (Olsen, 1989), which offers a Pascal-like language for defining application functions and engaged data types. Languages such as Slang of the Serpent UIMS (Bass and Coutaz, 1990, pp.…”

Section: Languages For User Interface Developmentmentioning

confidence: 99%

Automated user interface engineering with a pattern reflecting programming language

Savidis

Stephanidis

2006

Autom Software Eng

View full text Add to dashboard Cite

The development of the user interface concerns all aspects of a software system that are targeted to the interactive delivery of its functionality and data. Today, user interface development accounts for a large proportion of the overall software implementation, while the programming process involves various recurring software patterns. Based on the identification of key commonly occurring user interface programming patterns, we have designed and implemented a user interface programming language with built-in constructs to directly support those software patterns, offering declarative programming features such as: precondition-based actions, unidirectional constraints and data-content monitors. Initially, we introduce the deployment syntax and semantics of the novel programming elements, relying upon subject interaction scenarios. Then we reveal the most demanding implementation aspects of the code generator and the respective run-time library.

show abstract

“…The UIDE system also relies on preconditions and postconditions for dialogue control [5] [8], using them to determine when to enable application actions, and to support interface transformations. However, UIDE does not use planning to automatically sequence visual presentations.…”

Section: Related Workmentioning

confidence: 99%

Planning-based control of interface animation

Kurlander

Ling

1995

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '95

View full text Add to dashboard Cite

Animations express a sense of process and continuity that is difficult to convey through other techniques. Although interfaces can often benefit from animation, User Interface Management Systems (UIMSs) rarely provide the tools necessary to easily support complex, state-dependent application output, such as animations. Here we describe Player, an interface component that facilitates sequencing these animations. One difficulty of integrating animations into interactive systems is that animation scripts typically only work in very specific contexts. Care must be taken to establish the required context prior to executing an animation. Player employs a precondition and postcondition-based specification language, and automatically computes which animation scripts should be invoked to establish the necessary state. Player's specification language has been designed to make it easy to express the desired behavior of animation controllers. Since planning can be a timeconsuming process inappropriate for interactive systems, Player precompiles the plan-based specification into a state machine that executes far more quickly. Serving as an animation controller, Player hides animation script dependencies from the application. Player has been incorporated into the Persona UIMS, and is currently used in the Peedy application.

show abstract

A knowledge-based user interface management system

Cited by 60 publications

References 11 publications

GAIML: A New Language for Verbal and Graphical Interaction in Chatbots

GAIML: A New Language for Verbal and Graphical Interaction in Chatbots

Automated user interface engineering with a pattern reflecting programming language

Planning-based control of interface animation

Contact Info

Product

Resources

About