Human skeleton tracking from depth data using geodesic distances and optical flow

Abstract

Abstract-We present a vision based multisensor that is designed for robot interaction with small, soft, and possibly fragile objects. The sensor consists of a rubber membrane, a rectangular frame on which the membrane is mounted and a CCD camera. The entire system is airtight. Based on the observed deformations of the membrane, we determine the contact area, the integral force acting on the membrane, the 3D force distribution over the membrane, and derive properties of the target object by monitoring the evolution of its deformation. We can distinguish between different types of materials, i.e., solid, soft, amorphous, and determine the speed and nature of their deformation. The sensitivity of the sensor can be adjusted by changing the volume of air within the rectangular frame. We achieved a small noise to signal ratio, which allows us to observe small integral forces in the range of 0.5 N to 2.5 N, with an average error of 0.04 N.

Correction of Joint Angles From Kinect for Balance Exercising and Assessment

“…To obtain those properties with inverse kinematics, the analysis should be complicated with nonlinear optimization techniques. 28 A limitation of this study is that it was conducted with just one subject in a laboratory. The intended application of this technology involves measuring many people in various home environments, such that the dispersions of   counteract that problem, such as Unscented Kalman Filters.…”

Fast Obstacle Detection for Monocular Autonomous Mobile Robots

“…Geodesic distance is used in various vision communities such as image segmentation or human pose estimation [27], [28]. Let S = {s i } represent the superpixels.…”

Time Consistent Estimation of End-Effectors from RGB-D Data

“…Schwarz el al. [11] propose to use optical flow to handle the topology change problem. Similar to [2], a graph is constructed to represent the topology of the point cloud.…”