This paper describes an evaluation of a consumer application for soccer highlights detection, which combines advanced user interaction with an underlying automatic highlights detection algorithm. The application was developed for a home entertainment setting, i.e., for non-professional use, and was implemented on a Media Center PC with a remote control. The evaluation uses a qualitative assessment to measure the participants' satisfaction with the application, and investigates their satisfaction regarding several important factors, such as the participants' expectations and their satisfaction with the highlights. In the evaluation, we found that the participants' expectations regarding a soccer highlights detection application vary widely, and there is a gap between what participants expect and what any automatic detection application can provide. Despite this gap, the results from the qualitative assessment indicate that the application is very positively perceived by the participants. The results indicate that the participants showed positive satisfaction with the application, especially in its ease-of-learning, ease-of-use, and the feeling of being in control. Moreover, the results suggest new and further tuned user requirements that help improve satisfaction with the application.