In this paper, we develop face and hand tracking for sign language recognition system. The system is divided into two stages; the initial and tracking stages. In initial stage, we use the skin feature to localize face and hands of signer. The ellipse model on CbCr space is constructed and used to detect skin color. After the skin regions have been segmented, face and hand blobs are defined by using size and facial feature with the assumption that the movement of face is less than that of hands in this signing scenario. In tracking stage, the motion estimation is applied only hand blobs, in which first and second derivative are used to compute the position of prediction of hands. We observed that there are errors in the value of tracking position between two consecutive frames in which velocity has changed abruptly. To improve the tracking performance, our proposed algorithm compensates the error of tracking position by using adaptive search area to re-compute the hand blobs. Simulation results indicate our proposed algorithm can track face and hand with greater precision with negligible computational complexity increase.
ABSTRACT:In this paper, a novel method for the fish-eye lens calibration is presented. The method required only a 2D calibration plane containing straight lines i.e., checker board pattern without a priori knowing the poses of camera with respect to the calibration plane. The image of a line obtained from fish-eye lenses is a conic section. The proposed calibration method uses raw edges, which are pixels of the image line segments, in stead of using curves obtained from fitting conic to image edges. Using raw edges is more flexible and reliable than using conic section because the result from conic fitting can be unstable. The camera model used in this work is radially symmetric model i.e., bivariate non-linear function. However, this approach can use other single view point camera models. The geometric constraint used for calibrating the camera is based on the coincidence between point and line on calibration plane. The performance of the proposed calibration algorithm was assessed using simulated and real data.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.