Comparison of Linear Interpolation Method and Mean Method to Replace the Missing Values in Environmental Data Set

Abstract

Data collected in air pollution monitoring such as PM10, sulphur dioxide, ozone and carbon monoxide are obtained from automated monitoring stations. These data usually contained missing values due to machine failure, routine maintenance, changes in the siting of monitors and human error. Incomplete datasets can cause bias due to systematic differences between observed and unobserved data. Therefore, it is important to find the best way to estimate these missing values to ensure the quality of data analysed are of high quality. Incomplete data matrices are problematic: incomplete datasets may lead to results that are different from those that would have been obtained from a complete dataset (Hawthorne and Elliott, 2004). There are three major problems that may arise when dealing with incomplete data. First, there is a loss of information and, as a consequence, a loss of efficiency. Second, there are several complications related to data handling, computation and analysis, due to the irregulaties in data structure and the impossibility of using standard software. Third, and more important, there maybe bias due to systematic differences between observed and unobserved data. One approach to solve incomplete data problems is the adoption of imputation techniques (Junninen et al., 2004). Thus, this study compared the performance between linear interpolation method (imputation technique) and substitution of mean value for replacement of missing values in environmental data set.

Effect of Adjuvant Homeopathy with Usual Care in Management of Thrombocytopenia Due to Dengue: A Comparative Cohort Study

“…Missing values of platelet count were handled with imputation by the linear interpolation method. 22 Standard error of the mean (SEM) 23 was used for statistical inference based on the sampling distribution. Difference of platelet count from baseline to each follow-up was analyzed by independent t-test.…”

Desain Eksperimen Karakterisasi Perilaku Udara Sekitar dalam Tinjauan Sebagai Gas Ideal atau Gas Nyata

“…Dengan pencocokan kurva, informasi yang hilang sebagai akibat dari keterbatasan data eksperimen dapat diatasi (Noor et al, 2015). Metode pencocokan kurva banyak dipergunakan untuk memodelkan perilaku dari serangkaian data guna memperoleh informasi yang lebih mendalam dari suatu hasil eksperimen yang terbatas (Lukšič et al, 2014;Metsämäki et al, 2002;Saaban et al, 2015;Said and Al-ameeri, 1987;Shao et al, 2014).…”

Dynamic time warping-based imputation for univariate time series data

“…But it is easy to imagine that this drastic solution may lead to serious problems, especially for time series data (the considered values would depend on the past values). The first potential consequence of this method is information loss which could lose efficiency (Noor et al (2014)). The second consequence is about systematic differences between observed and unobserved data that leads to biased and unreliable results (Hawthorne and Elliott (2005)).…”