Central to many problems in scene understanding based on using a network of tens, hundreds 1. An Overview of the System
MotivationWith the recent development of cheap and powerful visual sensors, wireless chips and embedded systems, cameras have enough computing power to do some on-board "smart" processing. These "smart cameras" can form a network to collaboratively monitor, track and analyze the scenes of interest. This area have drawn a lot of attention in both academia and industry over the past years (see [1] [11] and [13] for an overview). However compared with the maturity and availability of the camera network hardware, the software capable of fully utilizing the huge amount of visual information is greatly under-developed. This has become the bottleneck for the wide deployment of the smart camera network (also called visual sensor network, VSN). There is an obvious demand to synchronize the recent development of vision algorithms with the development of the visual sensor network hardware. Our paper presents a completely new and natural approach to 3D reconstruction within a smart camera network.