Water quality data collected in periodic monitoring programs are often difficult to evaluate, especially if the number of parameters is large, the sampling schedule varies, and values are of different orders of magnitude. The Scatterscore Water Quality Evaluation was developed to yield a quantitative score, based on all measured variables in periodic water quality reports, indicating positive, negative or random change. This new methodology calculates a reconnaissance score based on the differences between up-gradient (control) versus down-gradient (treatment) water quality data sets. All parameters measured over a period of time at two or more sampling points are compared. The relationship between the ranges of measured values and the ratio of the medians for each parameter produces a data point that falls into one of four sections on a scattergram. The number and average values of positive, negative and random change points is used to calculate a Scatterscore that indicates the magnitude and direction of overall change in water quality. The Scatterscore Water Quality Evaluation, a reconnaissance method to track general changes, has been applied to 20 sites at which coal utilization by-products (CUB) were used to control acid mine drainage (AMD).