<p>In this review paper, we address on the state-of-art process with visual object tracking in video surveillance, medical and military applications. In the present scenario number of algorithms and methods are used to track the object in the different scene, a robust visual object tracking remains a critical challenge. The challenges arise due to object motion from frame to frame with a change in appearance, structures, illumination, and occlusion. In this paper, at last, we outline the different algorithms, dataset, strength, and weakness of the different object tracker.</p>