There is a great need for creating schedules that are optimized. Yet, some individuals have had less than desirable experiences with “optimal” scheduling. This could have been due to prioritization of the wrong criteria, leading to schedules that did not make practical sense, or that were math-intensive and were not able to be easily interpreted. Also, there are many types of optimization problem formulations and solution methods. Here, we divide the formulations into two major types: batched and online scheduling classes are discussed. A different technique has been created that allows schedules to be made that are not only optimal, based on the formulations or framing, but that are actually useful. Here, we discuss two types of methods, one batched called Genetic Algorithms with an Earliest Due Date encoding Method (GAGEDD) and the other online called Markov Decision Processes and Reinforcement Learning extensions. These methods are already being employed to create practical and optimal schedules that can include many different constraints and are able to instantly take into account new scheduling requests and take optimal actions regardless of what state the system is currently in. Especially with current world events (COVID-19), it is important to intelligently schedule patients.
In cybersecurity, incomplete inspection, resulting mainly from computers being turned off during the scan, leads to a challenge for scheduling maintenance actions. This article proposes the application of partially observable decision processes to derive cost‐effective cyber maintenance actions that minimize total costs. We consider several types of hosts having vulnerabilities at various levels of severity. The maintenance cost structure in our proposed model consists of the direct costs of maintenance actions in addition to potential incident costs associated with different security states. To assess the benefits of optimal policies obtained from partially observable Markov decision processes, we use real‐world data from a major university. Compared with alternative policies using simulations, the optimal control policies can significantly reduce expected maintenance expenditures per host and relatively quickly mitigate the most important vulnerabilities.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.