Two-Stage Variable Selection Using the Wavelet Transform of Batch Trajectories for Data Interpretation and Construction of Parsimonious Quality-Estimation Models

Chu, Young-Hwan; Kim, Daeyoun; Han, Chonghun; Yoon, En Sup

doi:10.1021/ie0614475

Cited by 4 publications

(1 citation statement)

References 29 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This has led to a large research literature to enhance PLS for batch process data and near infrared spectral data that often contain many predictors (e.g. Nørgaard et al (2000), Reiss and Ogden (2007), Chu et al (2007), Cramer et al (2008) and Andersen and Runger (2011a)). Further, ordinary PLS does not consider the order of the successive measurements of a variable directly.…”

Section: Background On Extracting Features Of Profilesmentioning

confidence: 99%

Automated Feature Extraction from Profiles with Application to a Batch Fermentation Process

Andersen

Runger

2012

Journal of the Royal Statistical Society Series C: Applied Statistics

View full text Add to dashboard Cite

Summary. An automated approach to extract interpretable features of univariate or multivariate profiles (functional data) is proposed. A landmark alignment algorithm is modified and the alignment is combined with piecewise linear approximations. Least absolute shrinkage and selection operator (lasso) regression is used for selecting the most important intercepts and slopes and yields an alternative to partial least squares to model a response associated with the profiles. Latent variables can be difficult to interpret but our extracted features simply correspond to slopes and intercepts of particular parts of the profiles. Also, features that relate to the degree of warping between a given profile and a reference can be extracted as predictors. Selection criteria for the number of knots and common knot locations between profiles are developed. We apply our proposed method to batch fermentation data where the profiles consist of on‐line measurements of process variables and the corresponding yield of the process. The extracted features have good interpretability (with large dimensional reduction) and in combination with the lasso have prediction accuracy which is comparable with that of partial least squares applied to the original profiles. Also our proposed feature extraction method is applied to publicly available data where near infrared spectra define the profiles and the prediction accuracy of our feature lasso method is comparable with those of more complicated alternatives.

show abstract

Section: Background On Extracting Features Of Profilesmentioning

confidence: 99%

Automated Feature Extraction from Profiles with Application to a Batch Fermentation Process

Andersen

Runger

2012

Journal of the Royal Statistical Society Series C: Applied Statistics

View full text Add to dashboard Cite

show abstract

Partitioned partial least squares regression with application to a batch fermentation process

Andersen

Runger

2011

Journal of Chemometrics

View full text Add to dashboard Cite

The performance of Partial Least Squares regression (PLS) in predicting the output with multivariate cross-and autocorrelated data is studied. With many correlated predictors of varying importance PLS does not always predict well and we propose a modified algorithm, Partitioned Partial Least Squares (PPLS). In PPLS the predictors are partitioned into smaller subgroups and the important subgroups with high prediction power are identified. Finally, regular PLS analysis using only those subgroups is performed. The proposed Partitioned PLS (PPLS) algorithm is used in the analysis of data from a real pharmaceutical batch fermentation process for which the process variables follow certain profiles during a specific fermentation period. We observed that PPLS leads to a more accurate prediction of the yield of the fermentation process and an easier interpretation, since fewer predictors are used in the final PLS prediction. In the application important issues such as alignment of the profiles from one batch to another and standardization of the predictors are also addressed. For instance, in PPLS noise magnification due to standardization does not seem to create problems as it might in regular PLS. Finally, PPLS is compared to several recently proposed functional PLS and PCR methods and a genetic algorithm for variable selection. More specifically for a couple of publicly available data sets with near infrared spectra it is shown that overall PPLS has lower cross-validated error than PLS, PCR and the functional modifications hereof, and is similar in performance to a more complex genetic algorithm.

show abstract

Ensemble wavelet modelling for determination of wheat and gasoline properties by near and middle infrared spectroscopy

Pinto

Galvão

Araújo

2010

Analytica Chimica Acta

View full text Add to dashboard Cite

Two-Stage Variable Selection Using the Wavelet Transform of Batch Trajectories for Data Interpretation and Construction of Parsimonious Quality-Estimation Models

Cited by 4 publications

References 29 publications

Automated Feature Extraction from Profiles with Application to a Batch Fermentation Process

Automated Feature Extraction from Profiles with Application to a Batch Fermentation Process

Partitioned partial least squares regression with application to a batch fermentation process

Ensemble wavelet modelling for determination of wheat and gasoline properties by near and middle infrared spectroscopy

Contact Info

Product

Resources

About