Every year a large number of wildfires all over the world burn forested lands causing adverse ecological, economic and social impacts. Beyond taking precautionary measures, early warning and immediate response are the only ways to avoid great losses. To this end, in this paper we propose a computer vision approach for fire-flame detection to be used by an early-warning fire monitoring system. Initially, candidate fire regions in a frame are defined using background subtraction and color analysis based on a non-parametric model. Subsequently, the fire behavior is modeled by employing various spatio-temporal features such as color probability, flickering, spatial and spatiotemporal energy, while dynamic texture analysis is applied in each candidate region using linear dynamical systems and a bag of systems approach. To increase the robustness of the algorithm, the spatio-temporal consistency energy of each candidate fire region is estimated by exploiting prior knowledge about the possible existence of fire in neighboring blocks from the current and previous video frames. As a last step, a two-class SVM classifier is used to classify the candidate regions. Experimental results have shown that the proposed method outperforms existing state of the art algorithms.Index Terms-Bag of systems, dynamic textures analysis, fire detection, linear dynamic systems, spatio-temporal modeling 1051-8215 (c)