To address privacy concerns regarding digital video surveillance cameras, we propose a practical, real-time approach that preserves the ability to observe actions while obscuring individual identities. In the Respectful Cameras system, people who wish to remain anonymous wear colored markers such as hats or vests. The system automatically tracks these markers using statistical learning and classification to infer the location and size of each face. It obscures faces with solid ellipsoidal overlays, while minimizing the overlay area to maximize the remaining observable region of the scene. Our approach uses a visual color-tracker based on a nine dimensional color-space using a Probabilistic Adaptive Boosting (AdaBoost) classifier with axis-aligned hyperplanes as weak hypotheses. We then use Sampling Importance Resampling (SIR) Particle Filtering to incorporate interframe temporal information. Because our system explicitly tracks markers, our system is well-suited for applications with dynamic backgrounds or where the camera can move (e.g. under remote control). We present experiments illustrating the performance of our system in both indoor and outdoor settings, with occlusions, multiple crossing targets, lighting changes, and observation by a moving robotic camera. Results suggest that our implementation can track markers and keep false negative rates below 2%. Fig. 1 A sample video frame is on left. The system has been trained to track green vests such as the one worn by the man with the outstretched arm. The system output is shown in the frame on the right, where an elliptical overlay hides the face of this man. The remainder of the scene including faces of workers not wearing green vests, remain visible. Note how the system successfully covers the face even when the vest is subjected to a shadow and a partial occlusion. Please visit "http://goldberg.berkeley.edu/RespectfulCameras" for more examples including video sequences.