Many calls to improve science education in college and university settings have focused on improving instructor pedagogy. Meanwhile, science education at the K-12 level is undergoing significant changes as a result of the emphasis on scientific and engineering practices, crosscutting concepts, and disciplinary core ideas. This framework of “three-dimensional learning” is based on the literature about how people learn science and how we can help students put their knowledge to use. Recently, similar changes are underway in higher education by incorporating three-dimensional learning into college science courses. As these transformations move forward, it will become important to assess three-dimensional learning both to align assessments with the learning environment, and to assess the extent of the transformations. In this paper we introduce the Three-Dimensional Learning Assessment Protocol (3D-LAP), which is designed to characterize and support the development of assessment tasks in biology, chemistry, and physics that align with transformation efforts. We describe the development process used by our interdisciplinary team, discuss the validity and reliability of the protocol, and provide evidence that the protocol can distinguish between assessments that have the potential to elicit evidence of three-dimensional learning and those that do not.

As chemists, we understand that science is more than a set of disconnected facts. It is a way of investigating and understanding our natural world that involves things like asking questions, analyzing data, identifying patterns, constructing explanations, developing and using models, and applying core concepts to other situations. This paper uses the concept of threedimensional (3D) learning, presented in A Framework for K-12 Science Education, to reconceptualize and develop assessment items that require students to integrate chemistry core ideas with scientific practices and crosscutting concepts. Developing 3D assessments from scratch is time-consuming and beyond the scope of most faculty work. Here we present an alternate approach: We provide a detailed description of ways in which instructors can take current assessment questions and modify them to align with three-dimensional learning by focusing on the evidence that is sought about what students know and can do with their knowledge.

An institutional effort to transform gateway science courses is evaluated using a novel approach based on course assessments.

Over the past 20 years research on reform efforts aimed at the chemistry laboratory has focused on different aspects of students’ experiences including increasing content knowledge, improving student attitudes toward chemistry, incorporating inquiry activities, and providing students a hands-on experience related to the chemistry concepts learned in lecture. While many of these efforts have been designed to incorporate inquiry activities, because this term is somewhat nebulous, it can be difficult to identify which aspects of the laboratory support inquiry. The Scientific and Engineering Practices outlined in the Framework for K–12 Science Education provide a new way to identify and characterize laboratory activities more precisely. This work compares two laboratory curricula in terms of the extent to which the curricula as a whole provide opportunities for students to engage in scientific practices and characterizes in which sections of a laboratory activity (prelab/procedure, data manipulation/analysis, conclusions/report out) students most frequently engage specific scientific practices. Further, this study demonstrates how a modified version of a published protocol for evaluating incorporation of science practices into assessment items (the 3-Dimensional Learning Assessment Protocol) can be used to evaluate laboratory activities in a systematic way. Ways in which such an analysis can inform and support the revision of laboratory curricula are also discussed.

This investigation of undergraduates’ heterogeneous science identity trajectories within a gateway chemistry course identified three latent classes (High and Stable, Moderate and Slightly Increasing, Moderate and Declining) using growth mixture modeling. Underrepresented minorities were more likely to exhibit Moderate-and-Slightly-Increasing science identities versus High-and-Stable patterns. Students with higher perceived competence were more likely classified into the High-and-Stable class compared to the other classes. Students classified into the High-and-Stable class scored significantly higher on the final exam and appeared to be more likely to remain in a STEM major across fall and spring semesters compared to the other two classes. Results suggest that some students’ identities shift within a single semester and supporting science perceived competence before college may support students’ science identity development.

The development of proficiency in the practices used by scientists and engineers is considered an important student outcome of laboratory instruction. We developed tasks to assess students' use and development of selected scientific and engineering practices in the general chemistry laboratory using an adapted evidence-centered design approach. In this paper, we provide a detailed description of the process of development and validation of these assessment tasks, using one of our tasks to illustrate the process. The tasks show strong evidence of validity and reliability for revealing students' understanding of scientific and engineering practices within the research context.

The importance of improving STEM education is of perennial interest, and to this end, the education community needs ways to characterize transformation efforts. Three-dimensional learning (3DL) is one such approach to transformation, in which core ideas of the discipline, scientific practices, and crosscutting concepts are combined to support student development of disciplinary expertise. We have previously reported on an approach to the characterization of assessments, the Three-Dimensional Learning Assessment Protocol (3D-LAP), that can be used to identify whether assessments have the potential to engage students in 3DL. Here we present the development of a companion, the Three-Dimensional Learning Observation Protocol (3D-LOP), an observation protocol that can reliably distinguish between instruction that has potential for engagement with 3DL and instruction that does not. The 3D-LOP goes beyond other observation protocols, because it is intended not only to characterize the pedagogical approaches being used in the instructional environment, but also to identify whether students are being asked to engage with scientific practices, core ideas, and crosscutting concepts. We demonstrate herein that the 3D-LOP can be used reliably to code for the presence of 3DL; further, we present data that show the utility of the 3D-LOP in differentiating between instruction that has the potential to promote 3DL

One of the most mystifying products on the market for people at any age is the glow stick: a plastic tube that, when snapped, creates a flood of bright, brilliantly colored light without the use of electricity or significant production of heat. In this case, the chemiluminescence reaction also provides an exciting phenomenon through which we can engage students in the Scientific and Engineering Practices. This laboratory project has been developed both to pique students’ interest about the task at hand and to have them practice science in a more authentic way than a traditional “cookbook” experiment. In completing this project, students will not only gain an understanding of the factors affecting the rate of the chemiluminescence reaction but also be able to create their own procedures, analyze and interpret their data, and construct an evidence-based argument from their results.