A multimethod validation of the Inpatient Multidimensional Psychiatric Scale with chronically institutionalized patients.

Abstract

The convergent and discriminant validity of the Inpatient Multidimensional Psychiatric Scale (IMPS) for chronically institutionalized patients was assessed over three modes of assessment (interview ratings, ward ratings, and observed frequency of behavior), two settings (interview and ward), and two points in time. Sequential performance of raw-score intercorrelations, principal-components analyses, and multimethod factor analysis indicated that the IMPS possessed excellent concurrent validity. However, it failed to demonstrate the same utility as a measure of change. Caution should therefore be exercised in any usage of the IMPS where absolute level differences are required for evaluative assessment. 1 This article was presented in part at the 45th annual meeting of the Midwestern Psychological Association, Chicago, May 1973. Appreciation is expressed to Steven L. Golding for comments on an earlier draft of this manuscript and to Lloyd G.

The Time-Sample Behavioral Checklist: Observational assessment of patient functioning

“…Mariotto and Paul (1974) found TSBC higher-order scores to correlate in the expected direction in the O.40's and 0.50's with scores obtained from standardized psychiatric interviews. TSBC higher-order scores were also found to correlate on absolute levels in the 0.60's and 0.70's with standardized ward rating scales, with TSBC and rating scale residual change scores correlating in the 0.50's and 0.60's (Mariotto & Paul, 1974;Paul & Lentz, 1977).…”

“…Mariotto and Paul (1974) found TSBC higher-order scores to correlate in the expected direction in the O.40's and 0.50's with scores obtained from standardized psychiatric interviews. TSBC higher-order scores were also found to correlate on absolute levels in the 0.60's and 0.70's with standardized ward rating scales, with TSBC and rating scale residual change scores correlating in the 0.50's and 0.60's (Mariotto & Paul, 1974;Paul & Lentz, 1977). In addition, TSBC higher-order scores were found to correlate from the 0.40's to the 0.80's with scores obtained from an objective, event recording system used by clinical staff that reflects the outcome of having engaged in various classes of behavior (Redfield , 1979).…”

THE BEHAVIOR OBSERVATION INSTRUMENT: A METHOD OF DIRECT OBSERVATION FOR PROGRAM EVALUATION1

“…Optimally, self-report and rating scales should be empirically combined with direct observations to provide a multidimensional assessment of a service delivery system (see Johnson and Bolstad, 1973;Lentz, Paul, and Calhoun, 1971;Paul, McInnis, and Mariotto, 1973). Methodologically rigorous observation systems like the BOI can be useful in evaluating the validity of these other "indirect" measures of client behavior (e.g., Mariotto and Paul, 1974). Observation instruments like the BOI, which focus on the measurement of categories of behaviors, have other specific limitations.…”

Observational assessment systems use for basic and applied research

“…Studies either directly aimed at comparing the resident assessment systems to other forms of assessment (Mariotto & Paul, 1974) or primarily designed for other questions (e.g., Paul & Lentz, 1977;Montgomery et al, 1974) have provided data on the concurrent and predictive validity of the summary indexes from the instruments. Summary scores on the TSBC and CFRS have been corn-pared to several commonly employed ward-and interview-based rating scales (Power, 1979;Redfield, 1979) while the SRIC has likewise been the focus of criterion validity analyses (e.g., Mariotto & Paul, 1975;Paul & Lentz, 1977).…”