Multimodal Interactive Pattern Recognition and Applications

Toselli, Alejandro H.; Vidal, Enrique; Casacuberta, Francisco

doi:10.1007/978-0-85729-479-1

Cited by 54 publications

(50 citation statements)

References 85 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Corrections are therefore only required in time frames t ≥ t int . This assumption of left-to-right correction is commonly considered in works involving data of sequential nature such as in interactive machine translation (IMT) or interactive speech transcription (IST) [30,31] The two policies proposed for propagating the effects of an interaction are described next.…”

Section: Interaction Methodologiesmentioning

confidence: 99%

Interactive user correction of automatically detected onsets: approach and evaluation

Valero-Mas

Iñesta

2017

J AUDIO SPEECH MUSIC PROC.

View full text Add to dashboard Cite

Onset detection still has room for improvement, especially when dealing with polyphonic music signals. For certain purposes in which the correctness of the result is a must, user intervention is hence required to correct the mistakes performed by the detection algorithm. In such interactive paradigm, the exactitude of the detection can be guaranteed at the expense of user's work, being the effort required to accomplish the task, the value that has to be both quantified and reduced. The present work studies the idea of interactive onset detection and proposes a methodology for assessing the user's workload, as well as a set of interactive schemes for reducing such workload when carrying out this detection task. Results show that the evaluation strategy proposed is able to quantitatively assess the invested user effort. Also, the presented interactive schemes significantly facilitate the correction task compared with the manual annotation. Keywords: User interaction, Onset detection, Information retrieval, Audio analysisMusic signals may be decomposed into sound objects by means of signal processing techniques. Note events constitute an example of musical signal segmentation, and can be defined by both the moment the note startsthe onset-and its end-the offset [ [8,9]. To check the performance of current stateof-the-art onset detection methods, the reader is referred to the results obtained in the annual Music Information Retrieval Evaluation eXchange (MIREX) contest.The results obtained by current state of the art may be considered sufficiently accurate for applications such as audio structure analysis or digital audio effects, in which onset information simply constitutes a support information for the task rather than its main description. Nevertheless, for specific cases as note tracking in automatic music transcription, the preciseness of onset events remarkably influences the overall success of the task.Note that, while onset estimation is generally used as an intermediate process within more complex MIR systems, this task may be also considered as a goal by itself. As an example, the work in [10] contemplates the use of onset information for identifying music pieces by comparing timing deviations between estimated onsets from interpretations of the pieces and its reference annotations from the scores.The aforementioned cases constitute particular examples in which very precise onset times are required. Generally, research in such cases implies the manual annotation of corpora since no single onset estimation Audio, Speech, and Music Processing (2017) 2017:15 Page 2 of 14 algorithm guarantees a perfect retrieval. Whereas this performance limitation is inherent to any research topic, some authors in the MIR community suggest that a glass ceiling is being reached, at least in the case of some commonly addressed tasks [11,12]. It thus appears interesting to explore alternative research paradigms that are capable of dealing with these limitations. Valero-Mas and Iñesta EURASIP Journal onThe so-called...

show abstract

Section: Interaction Methodologiesmentioning

confidence: 99%

Interactive user correction of automatically detected onsets: approach and evaluation

Valero-Mas

Iñesta

2017

J AUDIO SPEECH MUSIC PROC.

View full text Add to dashboard Cite

show abstract

“…But the chosen protocols must also allow an efficient implementation, because interactive processing is generally highly demanding in terms of response times [Toselli et al, 2011]. Eventually, the design of an efficient interaction protocol and an adequate UI are the most sensible design tasks for an IPR application.…”

Section: Interaction Protocolmentioning

confidence: 99%

“…Within the two general types of interaction protocols identified in IPR [Toselli et al, 2011], we will focus in the passive protocol, that is, where the system requires human feedback to emit a hypothesis. This focus is motivated by the fact that it is a suitable scenario in which the system can take advantage of implicit interactions to a great extent.…”

Section: Interaction Protocolmentioning

confidence: 99%

“…The reader may consult [Toselli et al, 2011] for a brief description of each query, together with their respective images.…”

Section: Evaluation Of Multimodal Fusionmentioning

confidence: 99%

“…It should be noted that multimodal interaction may support two types of multimodality [Toselli et al, 2011]. One corresponds to the input signal itself, which can be a complex mixture of different data types, ranging, e.g., from conventional keystrokes to audio and video data streams.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Diverse Contributions to Implicit Human-Computer Interaction

Torres¹,

Alberto²

View full text Add to dashboard Cite

/ Resumen / ResumWhile interacting with computer applications, we submit an important amount of information unconsciously. By studying these implicit interactions we can better understand what characteristics of user interfaces add benefit (or not), thus deriving design implications for future systems.The main advantage of processing implicit input data from the user is that every interaction with the system can contribute to enhance its utility. Additionally, such an input removes the cost of having to interrupt the user to submit explicit information that can be little related to the purpose of using the system. On the contrary, sometimes implicit interactions do not provide clear and concrete data. As such, how this source of information is managed deserves a special attention.This research is two-fold: 1) to apply new perspectives both to the design and the development of tools that can take advantage from user's implicit interactions, and 2) provide researchers with a series of evaluation methodologies of interactive systems that are ruled by such implicit input methods. Five scenarios are discussed to illustrate the feasibility and suitability of this thesis framework. Empirical results with real users show that tapping implicit interactions is a useful asset to enhance computer systems in a variety of ways.Al interactuar con aplicaciones informáticas, proporcionamos inconscientemente una cantidad importante de información. Mediante el estudio de estas interacciones implícitas es posible entender qué características de la interfaz de usuario son beneficiosas (o no), derivando así en implicaciones para el diseño de futuros sistemas interactivos. La principal ventaja de procesar datos de entrada implícitos del usuario es que cualquier interacción con el sistema puede contribuir a mejorar su utilidad. Además, dichos datos eliminan el coste de tener que interrumpir al usuario para que envíe información explícitamente sobre un tema que en principio no tiene por qué guardar relación con la propia intención de utilizar el sistema. Por el contrario, en ocasiones las interacciones implícitas no proporcionan datos claros y concretos. Por ello, hay que prestar especial atención a la manera de gestionar esta fuente de información.El propósito de esta investigación es doble: 1) aplicar una nueva visión tanto al diseño como al desarrollo de aplicaciones que puedan aprovechar consecuentemente a las interacciones implícitas del usuario, y 2) proporcionar una serie de metodologías para la evaluación de dichos sistemas interactivos. Cinco escenarios sirven para ilustrar la viabilidad y la adecuación del marco de trabajo de la tesis. Resultados empíricos con usuarios reales demuestran que aprovechar la interacción implícita es un medio tanto adecuado como conveniente para mejorar de múltiples maneras los sistemas interactivos.Quan interactuem amb aplicacions informàtiques, proporcionem inconscientment una quantitat important d'informació. Mitjançant l'estudi d'aquestes interaccions implícitesés possible entendre qui...

show abstract

References

2016

Dictionary of Computer Vision and Image Processing

View full text Add to dashboard Cite

Multimodal Interactive Pattern Recognition and Applications

Cited by 54 publications

References 85 publications

Interactive user correction of automatically detected onsets: approach and evaluation

Interactive user correction of automatically detected onsets: approach and evaluation

Diverse Contributions to Implicit Human-Computer Interaction

References

Contact Info

Product

Resources

About