Designing near-optimal policies for energy management in a stochastic environment

Abstract

With the rapid growth in renewable energy and battery storage technologies, there exists significant opportunity to improve energy efficiency and reduce costs through optimization. However, optimization algorithms must take into account the underlying dynamics and uncertainties of the various interconnected subsystems in order to fully realize this potential. To this end, we formulate and solve an energy management optimization problem as a Markov Decision Process (MDP) consisting of battery storage dynamics, a stochastic demand model, a stochastic solar generation model, and an electricity pricing scheme. The stochastic model for predicting solar generation is constructed based on weather forecast data from the National Oceanic and Atmospheric Administration. A near-optimal policy design is proposed via stochastic dynamic programming.Simulation results are presented in the context of storage and solar-integrated residential and commercial building environments. Results indicate that the near-optimal policy significantly reduces the operating costs compared to several heuristic alternatives. The proposed framework facilitates the design and evaluation of energy management policies with configurable demand-supply-storage parameters in the presence of weather-induced uncertainties.

Towards Sustainable Energy-Efficient Communities Based on a Scheduling Algorithm

“…Each user, then, optimises its own schedule and reports it back to the supplier, which, in turn, updates its energy price parameters before pulling the next consumers. Also centralised but considering renewable energy technologies to improve energy efficiency and reduce costs through optimisation algorithms, approaches in the work by the authors of [20] focus on the context of microgrids and storage at residential and commercial building environments. In addition, heuristics based on genetics algorithms [21] and neural networks [22] work on the scheduling of the consumer consumption to save the peak formation.…”

Optimal day ahead energy consumption management in grid‐connected microgrids

“…The nonlinear models in combined heat power plants are linearized into mixed‐integer linear programming to enhance the dispatch flexibility under grid‐connected and islanded modes. In Reference 9, the authors integrated weather‐forecast data related to solar PV into the Markov decision framework and formulated the stochastic EMS problem. Naïve heuristic policies are proposed to quantify the “feasible decision state‐space to handle the supply‐demand uncertainties using stochastic dynamic programming.” A scenario‐based stochastic model is presented in Reference 10 to investigate the MG's economic and security constraints.…”