Biometric recognition can be used to improve gesture-based 3 interfaces by automatically identifying operators. Traditional palm biomet-4 ric recognition techniques depend on palm appearance features, but these 5 features are not available in an operating theater where gloves are worn. 6 We propose a depth-based solution for palm biometric recognition. Based 7 on the depth image, our system automatically segments the user's palm 8 and extracts finger dimensions. The finger dimensions are further scaled 9 according to the sensed depth to obtain the true finger dimensions, which 10 are then used as features to characterize the palm. Finally, a modified k-11 nearest neighbors algorithm that assigns class labels based on the centroid 12 displacement of each class in the neighboring points is applied to recog-13 nize the palm based on the geometric features. An accuracy of 96.24% 14 was achieved for the biometric recognition of 4057 gloved palm samples 15 captured at different angles and depths from 27 users. This accuracy is 16 comparable with those of other state-of-the-art classification algorithms 17 and demonstrates that biometric recognition may be viable for settings 18 with gloved hands such as surgery.
19Index Terms-Human-computer interaction, palm biometric recogni-20 tion, shape-based hand recognition, sterile interface, touch-free interface. 21 42 limit the gesture set to the simplest and most consistently recog-
Traditional surgical planning is challenged by limited spatial information of 2-D medical images or separated planning phases between 3-D model based virtual planning and its in situ registration. This paper presents an augmented surgical planning method with model-section views of an actual patient body and direct augmented interaction to realize spatially interactive planning in situ. A projector-Kinect system is proposed to construct a spatially augmented reality surgical environment directly on the patient body through surgical models' projection, correction and registration. Hand gesture based direct augmented interaction is developed to provide surgeons with interactive guidance during planning. The physical patient's body is augmented by the integration of medical information like 3-D anatomic and pathologic models as well as the 2-D medical images. Compared to conventional planning methods, this augmented planning enables surgical planning in 3-D space on the actual patient, and allows the planning to be integrated into an in situ robot-assisted surgical environment. Experimental results demonstrate that the method can facilitate spatial information perception and convey virtual planning on the physical patient in situ.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.