Sensitivity analysis in ranking and selection for multiple performance measures

Abstract

In this paper, we conduct sensitivity analysis on a ranking and selection procedure for making multiple comparisons of systems that have multiple performance measures. The procedure combines multiple attribute utility theory with ranking and selection to select the best configuration from a set of K configurations using the indifference zone approach. Specifically, we consider sensitivity analysis on the weights generated by the multiple attribute utility assessment procedure. We demonstrate our analysis on a simulation model of a large project that has six performance measures.

Appointment scheduling of outpatient surgical services in a multistage operating room department

“…Gray and Goldsman [73] presented an application of indifferencezone R&S to select the best airspace configuration in European airports. Hsiao-Chang et al [74], [75] provided a discussion about optimal computing budget allocation in discrete-event simulation by applying indifference-zone R&S. Morrice et al [76] addressed an indifferencezone R&S for optimizing multiple performance measures.…”

A survey of recent advances in discrete input parameter discrete-event simulation optimization

“…Chen et al (1996), Chen et al (1997), Chen et al (1998), andLin et al (1999) address the problem of optimal computing budget allocation for discrete-event simulation through an extension of indifference-zone R&S. Hyden and Schruben (1999) introduce the idea of an optimal allocation path, a series of budget allocations that yield the optimal probabilities of choosing the best system at all budget levels in a simultaneous simulation environment. Morrice et al (1998) and Morrice et al (1999) propose an indifference zone R&S procedure that allows multiple performance measures through the use of a multiple attribute utility function. A second type of R&S procedure, known as subset selection, aims to produce a subset of random size that contains the best system with probability P * without specification of an indifference zone (i.e., δ = 0).…”