Abstract:An increasing number of applications require to recognize the class of an incoming time series as quickly as possible without unduly compromising the accuracy of the prediction. In this paper, we put forward a new optimization criterion which takes into account both the cost of misclassification and the cost of delaying the decision. Based on this optimization criterion, we derived a family of non-myopic algorithms which try to anticipate the expected future gain in information in balance with the cost of wait… Show more
“…In [11], the authors put forward the idea of a multi-objective criterion with an associated Pareto front with multiple dominating trade-offs. However, whereas these methods are myopic in nature, the Economy approach described in [1,4] goes one step further by (i) directly optimizing the combined cost defined in equation 1 and (ii) giving a way to estimate the combined cost for future time steps, thus leading to a non-myopic approach that outperforms the best methods known to date.…”
Section: Related Work On Trigger Systemsmentioning
confidence: 99%
“…In the following, we demonstrate how the triggering strategy used in ECTS can be adapted to deal with ECOTS. For this, we consider one of the best performing myopic strategies known to date, described in [9] and the best non-myopic approach in the literature: the Economy-γ strategy described in [1]. The first one relies ultimately on confidence criteria, while the second one explicitly optimizes the accuracy versus delay cost trade-off.…”
Section: Application To State-of-the Art Ects Approachesmentioning
confidence: 99%
“…Our goal is to use the ECOTS approaches to make this horizon adaptive to the observable part of the time series at hand. Evaluation criterion: Ultimately, the value of using an early classification method is defined by the average cost incurred using it, as in [1]. Given an open time series S (e.g.…”
Section: Data Descriptionmentioning
confidence: 99%
“…Data split and extraction: We splitted the set of time series into four parts: 50% for training classifiers, 20% for testing ECOTS algorithms, 15% for validating ECOTS algorithms and 15% for estimating confusion matrices. This split is inspired from the original paper of economy [1]. Subsequences of size w were extracted from the training open time series by doing the following steps: (i) time stamps t p , aka targets, were set within the time series, spaced with w + η M time units in order to avoid overlaps between samples; (ii) η M −η m subsequences were extracted around each target, each one dedicated to the training of the classifier h η (see Figure 4).…”
Section: Training the Collection Of Classifiers And Ecots Algorithmsmentioning
confidence: 99%
“…In Section 2, we formally draw a parallel between the ECTS problem and the ECOTS one. We then review the main approaches to ECTS, and outline two competitive methods: one described in [10] and the other, the Economy method presented in [1]. We then show, in Section 4, how to adapt these methods to the ECOTS problem, before comparing their performances on experiments in Section 5.…”
Learning to predict ahead of time events in open time series is challenging. While Early Classification of Time Series (ECTS) tackles the problem of balancing online the accuracy of the prediction with the cost of delaying the decision when the individuals are time series of finite length with a unique label for the whole time series. Surprisingly, this trade-off has never been investigated for open time series with undetermined length and with different classes for each subsequence of the same time series. In this paper, we propose a principled method to adapt any technique for ECTS to the Early Classification in Open Time Series (ECOTS). We show how the classifiers must be constructed and what the decision triggering system becomes in this new scenario. We address the challenge of decision making in the predictive maintenance field. We illustrate our methodology by transforming two state-of-the-art ECTS algorithms for the ECOTS scenario and report numerical experiments on a real dataset for predictive maintenance that demonstrate the practicality of the novel approach.
“…In [11], the authors put forward the idea of a multi-objective criterion with an associated Pareto front with multiple dominating trade-offs. However, whereas these methods are myopic in nature, the Economy approach described in [1,4] goes one step further by (i) directly optimizing the combined cost defined in equation 1 and (ii) giving a way to estimate the combined cost for future time steps, thus leading to a non-myopic approach that outperforms the best methods known to date.…”
Section: Related Work On Trigger Systemsmentioning
confidence: 99%
“…In the following, we demonstrate how the triggering strategy used in ECTS can be adapted to deal with ECOTS. For this, we consider one of the best performing myopic strategies known to date, described in [9] and the best non-myopic approach in the literature: the Economy-γ strategy described in [1]. The first one relies ultimately on confidence criteria, while the second one explicitly optimizes the accuracy versus delay cost trade-off.…”
Section: Application To State-of-the Art Ects Approachesmentioning
confidence: 99%
“…Our goal is to use the ECOTS approaches to make this horizon adaptive to the observable part of the time series at hand. Evaluation criterion: Ultimately, the value of using an early classification method is defined by the average cost incurred using it, as in [1]. Given an open time series S (e.g.…”
Section: Data Descriptionmentioning
confidence: 99%
“…Data split and extraction: We splitted the set of time series into four parts: 50% for training classifiers, 20% for testing ECOTS algorithms, 15% for validating ECOTS algorithms and 15% for estimating confusion matrices. This split is inspired from the original paper of economy [1]. Subsequences of size w were extracted from the training open time series by doing the following steps: (i) time stamps t p , aka targets, were set within the time series, spaced with w + η M time units in order to avoid overlaps between samples; (ii) η M −η m subsequences were extracted around each target, each one dedicated to the training of the classifier h η (see Figure 4).…”
Section: Training the Collection Of Classifiers And Ecots Algorithmsmentioning
confidence: 99%
“…In Section 2, we formally draw a parallel between the ECTS problem and the ECOTS one. We then review the main approaches to ECTS, and outline two competitive methods: one described in [10] and the other, the Economy method presented in [1]. We then show, in Section 4, how to adapt these methods to the ECOTS problem, before comparing their performances on experiments in Section 5.…”
Learning to predict ahead of time events in open time series is challenging. While Early Classification of Time Series (ECTS) tackles the problem of balancing online the accuracy of the prediction with the cost of delaying the decision when the individuals are time series of finite length with a unique label for the whole time series. Surprisingly, this trade-off has never been investigated for open time series with undetermined length and with different classes for each subsequence of the same time series. In this paper, we propose a principled method to adapt any technique for ECTS to the Early Classification in Open Time Series (ECOTS). We show how the classifiers must be constructed and what the decision triggering system becomes in this new scenario. We address the challenge of decision making in the predictive maintenance field. We illustrate our methodology by transforming two state-of-the-art ECTS algorithms for the ECOTS scenario and report numerical experiments on a real dataset for predictive maintenance that demonstrate the practicality of the novel approach.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.