From the time that computer technology became affordable and powerful enough for use in the classroom, teachers and researchers began searching for ways to make language assessment faster through automation and more effective through innovation. Testing companies have been leading the way with computer‐based standardized language testing. Many scholars agree that new technologies have changed the way language is assessed but few have considered what these new tasks are actually measuring. As new media and classroom materials drive technology use, language assessments must also adapt to measure language in the way that it is being used both in the classroom and in real life.