The purpose of the study presented in this paper is to analyze the usefulness of various types of pop-up questions used in algorithm animations.Preliminary analysis indicates that providing feedback to pop-up questions increases the participant's ability to correctly answer both pop-up questions and regular test questions while the form of interaction required of the user via pop-up questions lessens the overall performance, though not significantly.