With the emergence and rapid acceptance of online news come new and varied opportunities for user engagement with content, along with alternative metrics for capturing those behaviors. This study focuses on interactive engagement with online news videos. We propose a theoretical framework for conceptualizing user engagement on a continuum from exposure to interactivity. Furthermore, we make a distinction between user-content (e.g. commenting) and user-user (e.g. replying to another user's comment) modes of interaction. We then explore publicly available measures of these concepts and test a series of hypotheses to explore commenting and conversational behaviors in response to YouTube news videos. We conclude by discussing the theoretical and practical implications for advancing our understanding of user engagement with online news.