The assessment of the quality of the colonoscopic interventions arises as a most relevant issue once the number and the availability of these clinical procedures are increased day by day. The use of the latest computer visionbased techniques can provide the physician with both qualitative and, most important, objectively verifiable quantitative indicators of performance. In this paper we present a study in which we propose the automatic analysis of colonoscopy video for the quality assessment of the intervention from different points of view: 1) We propose the characterization of the different parts of the colon in order to obtain metrics of the time used for navigation, portion of gut analyzed, etc. 2) We analyze the image contents in order to automatically characterize the presence of polyps. 3) We use the information obtained by and eye-tracker in order to assess the physician's skills.