The parameters optimization selection of Savitzky-Golay filter and its application in smoothing pretreatment for FTIR spectra

An-xin, Zhao; Tang, Xinde; Zhang, Zhonghua; Liu, Junhua

doi:10.1109/iciea.2014.6931218

Cited by 38 publications

(35 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…differentiation of the original data at the midpoint is obtained by performing the fitness polynomial. Finally, the convolution of the entire input data with a digital filter of length 2m + 1 is performed by running least squares polynomial fitting [35,36].…”

Section: Data Preprocessing Methodsmentioning

confidence: 99%

Application of Terahertz Technology in Biomolecular Analysis and Medical Diagnosis

Zhang¹,

Zhang²

2017

Terahertz Spectroscopy - A Cutting Edge Technology

View full text Add to dashboard Cite

Terahertz technology is a nondestructive technique, which has progressed significantly in the scientific research and gains highly attention in the analysis of biological molecular, cellular, tissues and organs. In this decade, some studies were reported on the application of terahertz technology in medical testing and diagnosis. Here, we summarize the terahertz characters, terahertz spectroscopy, and terahertz imaging technology combined with chemometrics. This chapter focuses on introducing the research progress on analyzing the tissues of cancers using terahertz spectroscopy and terahertz imaging technology. Furthermore, the problems should be solved, and development directions of terahertz spectroscopy and terahertz imaging technology are discussed.

show abstract

Section: Data Preprocessing Methodsmentioning

confidence: 99%

Application of Terahertz Technology in Biomolecular Analysis and Medical Diagnosis

Zhang¹,

Zhang²

2017

Terahertz Spectroscopy - A Cutting Edge Technology

View full text Add to dashboard Cite

show abstract

“…However, the systematic and artificial errors resulting from signal noise should be taken into account. In the smoothing pretreatment for spectral analysis of SBS content by FTIR, the Savitzky-Golay filter is frequently used to reduce the noise interference [31]. Herein, the moving window method based on least squares theory is employed to filter out the noise and reduce the effect of smoothing preprocessing on the information.…”

Section: Generation Database For Dnnmentioning

confidence: 99%

SBS Content Detection for Modified Asphalt Using Deep Neural Network

Wang¹,

Zhang

et al. 2020

Advances in Materials Science and Engineering

View full text Add to dashboard Cite

This study proposes a prediction model for accurately detecting styrene-butadiene-styrene (SBS) content in modified asphalt using the deep neural network (DNN). Traditional methods used for evaluating the SBS content are inaccurate and complicated because they are prone to produce errors by manual computation. Feature data of SBS content are derived from the spectra, which are obtained by the Fourier-transform infrared spectroscopy test. After designing DNN, preprocessed feature data are utilized as training and testing data and are fed into the DNN via a feature matrix. Furthermore, comparative studies are conducted to verify the accuracy of the proposed model. Results show that the mean square error value decreased by 68% for DNN with noise and dimension reduction. The DNN-based prediction model showed that the correlation coefficient between the target value and the mean predicted value is 0.9978 and 0.9992 for training and testing samples, respectively, indicating its remarkable accuracy and applicability after training. In comparison with the standard curve method and the random forest method, the precision of DNN is greater than 98% for the same test conditions, achieving the best predicting performance.

show abstract

“…It was necessary to preprocess the collected spectral data in order to ensure the high availability of the later modeling data, so as to improve the accuracy of the model. S-G (Savitzky-Golay, S-G) filter is a filtering method based on local polynomial least square fitting in the time domain (Zhao, Tang, Zhang, & Liu, 2016). The most important feature of this filter is that it can filter noise, while ensuring the shape and width of the signal remain unchanged.…”

Section: Spectral Pretreatmentmentioning

confidence: 99%

Fluorescence hyperspectral image technique coupled with HSI method to predict solanine content of potatoes

Sun

Yang

et al. 2019

J Food Process Preserv

View full text Add to dashboard Cite

In order to ensure the edibility of potatoes, fluorescence hyperspectral images of potato samples were obtained to predict the solanine content in potatoes. For the best ROI (region of interest), the S‐component of saturation was extracted by the HSI colorimetric technology to characterize the bud eye of potatoes in three‐dimensional geometric space. The effective bud eye was located as the geometric center of ROI and the average spectral information was obtained. After pretreatment and selection of feature wavelengths, the predicting mode of SVR was established and was optimized by adjusting the penalty coefficient c and the core coefficient g of radial basis function (RBF). Finally, the determinant coefficient of the model was 0.9143 and the root mean square error was 0.0296, which could basically meet the application requirements. It was concluded that the method based on hyperspectral fluorescence image and HSI colorimetry could predict the solanine content in potatoes accurately through the optimized SVR model. Practical applications The solanine content in potatoes is an important indicator for judging the edibility of potatoes. The traditional manual observation method has a high misidentification rate and is prone to waste. The chemical detection processes are also tedious and time‐consuming. Compared with traditional methods and chemical methods, hyperspectral imaging technology can detect the solanine content in potatoes rapidly, accurately, and nondestructively. In this study, we generated the best prediction model by SVR, which was established a base on characteristic wavelengths through best ROI selection. After comparing, it was found that the bud eye region is the best ROI and the spectral data obtained here has the best predictive ability. All these results provided a theoretical basis for the portable detection of solanine content in potatoes.

show abstract

The parameters optimization selection of Savitzky-Golay filter and its application in smoothing pretreatment for FTIR spectra

Cited by 38 publications

References 15 publications

Application of Terahertz Technology in Biomolecular Analysis and Medical Diagnosis

Application of Terahertz Technology in Biomolecular Analysis and Medical Diagnosis

SBS Content Detection for Modified Asphalt Using Deep Neural Network

Fluorescence hyperspectral image technique coupled with HSI method to predict solanine content of potatoes

Contact Info

Product

Resources

About