Starting to cook a tutoring dialogue system

Abstract

This paper presents a system that helps you cook a recipe through a spoken dialogue tutoring session. We report our experience while creating the first version of a tutoring dialogue system that helps the user cook a selected dish. Having a working framework to support us with the creation of the cooking assistant, the main challenge we faced was the change of paradigm: instead of the system being driven by the user, the user is instructed by the system. The result is a system capable of dictating generic contents to the user. On top of it, the system can be used in several domains where the goal is not the replacement of the user but providing some assistance while (s)he performs some procedural task.

Recipe sub-goals and graphs

“…The content presented in the multimedia has also varied including: interim goal states of ingredients and mixtures [4], demonstrations of techniques [3,4], enhanced textual descriptions of ingredients and techniques [1,7].…”

Towards a Pervasive Kitchen Infrastructure for Measuring Cooking Competence

“…points towards the cupboard with the sugar). Related systems include Ju et al's [17] rich multimedia experience guides to support users preparing new dishes, and Martins et al's [18] cooking guide based on a spoken dialog system which predicts the next activity based on a cooking ontology. Being inexperienced or disorganized can also result in inefficient behavior during meal preparation.…”