A large class of problems of sequential decision-making can be modeled as Markov or Semi-Markov Decision Problems, which can be solved by classical methods of dynamic programming. However, the computational complexity of the classical MDP algorithms, such as value iteration and policy iteration, is prohibitive and will grow intractably with the size of problems. Furthermore, they require for each action the one step transition probability and reward matrices, which is often unrealistic to obtain for large and complex systems. Here, we provide the decision-maker a sequential decision-making enviroment by establishing a virtual reality simulation system, where the uncertainty property of system can also be shown. In order to obtain the optimal or near optimal policy of sequential decision problem, simulation optimization algorithms as infinitesimal perturbation analysis are applied to complex queuing systems. We present a detailed study of this method on the sequential decision-making problem in Boeing-737 assembling process.
This paper presents the development of an environment to simpli~the creation of simulation models for highvolume electronics manufacturing systems. The simulation environment consists of a problem definer, a static analyzer and a code generator, Included in this paper is an overview of the environment, an application of the system at Chrysler Electronics, and a discussion of system advantages.
This paper addresses a fundamental, easy but powerful mechanism of Virtual Reality Simulation system on World Wide Web. The basic idea is to use Virtual Reality Modeling Language (VRML) to build the virtual world, and design a specific simulator to complete the common simulation work and drive the VR animation. According to the achievable mathematics and animation function, two types of this VR Simulation system are founded. The first one is to use VRMLScript or JavaScript to code the specific simulator. This mechanism really can be realized, however, the mathematical operations and the simulation model scale are limited. The other is to apply Java for coding the simulator, then use HTML to combine the VR scene and the simulator in the same WebPage, which can harmonize the VR animation running according to the simulation logic. Because Java is fully mathematics functioned and the Java code modules are entirely reusable, this VR simulation system, which is mainly recommended, can be easily realized on desktop PC and meet the basic interactive requirements of VR Technology without any extra hardware. A VR M/M/l/k Queuing simulation system is given to explain the mechanism. Finally, the overall Integrated Development Environment for this VR simulation system is also discussed.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.