Duration-Aware Alignment of Process Traces

Yang, Sen; Zhou, Moliang; Webman, Rachel; Yang, JaeWon; Sarcevic, Aleksandra; Marsic, Ivan; Burd, Randall S.

doi:10.1007/978-3-319-41561-1_28

Cited by 7 publications

(10 citation statements)

References 19 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the context of this research, the time is a critical factor. For this reason, Needleman-Wunsch [11] [12]- [14] was applied in order to avoid delays in the computational time.…”

Section: ) Variation Of the Nw Algorithmmentioning

confidence: 99%

See 1 more Smart Citation

Sub-Sync: Automatic Synchronization of Subtitles in the Broadcasting of True Live programs in Spanish

González‐Carrasco

Puente²,

Ruíz‐Mezcua

et al. 2019

IEEE Access

View full text Add to dashboard Cite

Individuals with sensory impairment (hearing or visual) encounter serious communication barriers within society and the world around them. These barriers hinder the communication process and make access to information an obstacle they must overcome on a daily basis. In this context, one of the most common complaints made by the Television (TV) users with sensory impairment is the lack of synchronism between audio and subtitles in some types of programs. In addition, synchronization remains one of the most significant factors in audience perception of quality in live-originated TV subtitles for the deaf and hard of hearing. This paper introduces the Sub-Sync framework intended for use in automatic synchronization of audiovisual contents and subtitles, taking advantage of current well-known techniques used in symbol sequences alignment. In this particular case, these symbol sequences are the subtitles produced by the broadcaster subtitling system and the word flow generated by an automatic speech recognizing the procedure. The goal of Sub-Sync is to address the lack of synchronism that occurs in the subtitles when produced during the broadcast of live TV programs or other programs that have some improvised parts. Furthermore, it also aims to resolve the problematic interphase of synchronized and unsynchronized parts of mixed type programs. In addition, the framework is able to synchronize the subtitles even when they do not correspond literally to the original audio and/or the audio cannot be completely transcribed by an automatic process. Sub-Sync has been successfully tested in different live broadcasts, including mixed programs, in which the synchronized parts (recorded, scripted) are interspersed with desynchronized (improvised) ones. INDEX TERMS Accessibility, TV broadcasting, algorithm design and analysis, automatic speech recognition.

show abstract

“…In the context of this research, the time is a critical factor. For this reason, Needleman-Wunsch [11] [12]- [14] was applied in order to avoid delays in the computational time.…”

Section: ) Variation Of the Nw Algorithmmentioning

confidence: 99%

“…In the second stage, these similarities are processed to establish the best alignment between the words of the subtitle and transcription storage. For this alignment the algorithm proposed by Needleman-Wunsch [11]- [14] is used, which is useful because of its effectiveness in the alignment of symbol sequences.…”

Section: Introductionmentioning

confidence: 99%

Sub-Sync: Automatic Synchronization of Subtitles in the Broadcasting of True Live programs in Spanish

González‐Carrasco

Puente²,

Ruíz‐Mezcua

et al. 2019

IEEE Access

View full text Add to dashboard Cite

show abstract

“…Forestier et al [11,12] proposed dynamic time warping (DTW) as a similarity metric for process traces. The DTW, however, cannot handle concurrent activities, does not consider idle time intervals, and has other issues when used for process traces [13]. In addition, Forestier et al considered processes that are mostly sequential (non-concurrent), with no activities for which the order of performance is irrelevant.…”

Section: Related Workmentioning

confidence: 99%

“…The medoid, however, may not be adequate when no “suitable” representative exists in the cluster. Another kind of prototype is the consensus sequence, a sequence of commonly observed activities found by aligning many process traces [2,13]. The consensus sequence, however, represents only the order of performance without temporal information.…”

Section: Related Workmentioning

confidence: 99%

A Data-driven Process Recommender Framework

Yang

Dong

Sun

et al. 2017

Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Self Cite

View full text Add to dashboard Cite

We present an approach for improving the performance of complex knowledge-based processes by providing data-driven step-by-step recommendations. Our framework uses the associations between similar historic process performances and contextual information to determine the prototypical way of enacting the process. We introduce a novel similarity metric for grouping traces into clusters that incorporates temporal information about activity performance and handles concurrent activities. Our data-driven recommender system selects the appropriate prototype performance of the process based on user-provided context attributes. Our approach for determining the prototypes discovers the commonly performed activities and their temporal relationships. We tested our system on data from three real-world medical processes and achieved recommendation accuracy up to an F1 score of 0.77 (compared to an F1 score of 0.37 using ZeroR) with 63.2% of recommended enactments being within the first five neighbors of the actual historic enactments in a set of 87 cases. Our framework works as an interactive visual analytic tool for process mining. This work shows the feasibility of data-driven decision support system for complex knowledge-based processes.

show abstract

“…The alignment result is a matrix where the rows represent traces, and the same type activities are aligned in the same columns (Fig.1). The activities most commonly executed in a similar chronological order form a "consensus sequenc" [4][5] [6]. The trace alignment algorithm originates from bioinformatics, where it is used to align protein and gene sequences to identify common structures and mutations.…”

Section: A Motivationmentioning

confidence: 99%

Evaluation of trace alignment quality and its application in medical process mining

Zhou

Yang

et al. 2017

2017 IEEE International Conference on Healthcare Informatics (ICHI)

Self Cite

View full text Add to dashboard Cite

Trace alignment algorithms have been used in process mining for discovering the consensus treatment procedures and process deviations. Different alignment algorithms, however, may produce very different results. No widely-adopted method exists for evaluating the results of trace alignment. Existing reference-free evaluation methods cannot adequately and comprehensively assess the alignment quality. We analyzed and compared the existing evaluation methods, identifying their limitations, and introduced improvements in two reference-free evaluation methods. Our approach assesses the alignment result globally instead of locally, and therefore helps the algorithm to optimize overall alignment quality. We also introduced a novel metric to measure the alignment complexity, which can be used as a constraint on alignment algorithm optimization. We tested our evaluation methods on a trauma resuscitation dataset and provided the medical explanation of the activities and patterns identified as deviations using our proposed evaluation methods.

show abstract

Duration-Aware Alignment of Process Traces

Cited by 7 publications

References 19 publications

Sub-Sync: Automatic Synchronization of Subtitles in the Broadcasting of True Live programs in Spanish

Sub-Sync: Automatic Synchronization of Subtitles in the Broadcasting of True Live programs in Spanish

A Data-driven Process Recommender Framework

Evaluation of trace alignment quality and its application in medical process mining

Contact Info

Product

Resources

About