The transfer of matter and energy from one organism to another and between organisms and their physical setting is a fundamental concept in life science. Not surprisingly, this concept is common to the Benchmarks for Science Literacy (American Association for the Advancement of Science, 1993), the National Science Education Standards (National Research Council, 1996), and most state frameworks and likely to appear in any middle‐school science curriculum material. Nonetheless, while topics such as photosynthesis and cellular respiration have been taught for many years, research on student learning indicates that students have difficulties learning these ideas. In this study, nine middle‐school curriculum materials—both widely used and newly developed—were examined in detail for their support of student learning ideas concerning matter and energy transformations in ecosystems specified in the national standards documents. The analysis procedure used in this study was previously developed and field tested by Project 2061 of the AAAS on a variety of curriculum materials. According to our findings, currently available curriculum materials provide little support for the attainment of the key ideas chosen for this study. In general, these materials do not take into account students' prior knowledge, lack representations to clarify abstract ideas, and are deficient in phenomena that can be explained by the key ideas and hence can make them plausible. This article concludes with a discussion of the implications of this study to curriculum development, teaching, and science education research based on shortcomings in today's curricula. © 2004 Wiley Periodicals, Inc. J Res Sci Teach 41: 538–568, 2004

Because textbooks have the potential to be powerful catalysts for improving science teaching and learning, having reliable methods for analyzing important textbook features, such as their coherence, is essential. This study reports on the development of a method in which trained reviewers, following a set of guidelines defining the ideas to be learned and connections among those ideas drawn from relevant maps published by the American Association for the Advancement of Science in the Atlas of Science Literacy (2001), were able to analyze the degree to which four widely used high school biology textbooks provided students and teachers with a coherent account of the important topic of matter and energy transformations in living systems. The study method was found to produce consistent results across reviewers and textbooks and can serve those who evaluate, design, and use science curriculum materials. This work represents an important first step in meeting the need for methods to measure, characterize, and, ultimately, to improve textbook coherence. ß

No abstract

Assessment influences every level of the education system and is one of the most crucial catalysts for reform in science curriculum and instruction. Teachers, administrators, and others who choose, assemble, or develop assessments face the difficulty of judging whether tasks are truly aligned with national or state standards and whether they are effective in revealing what students actually know. Project 2061 of the American Association for the Advancement of Science has developed and field-tested a procedure for analyzing curriculum materials, including their assessments, in terms of how well they are likely to contribute to the attainment of benchmarks and standards. With respect to assessment in curriculum materials, this procedure evaluates whether this assessment has the potential to reveal whether students have attained specific ideas in benchmarks and standards and whether information gained from students' responses can be used to inform subsequent instruction. Using this procedure, Project 2061 had produced a database of analytical reports on nine widely used science middle school curriculum materials. The analysis of assessments included in these materials shows that whereas currently available materials devote significant sections in their instruction to ideas included in national standards documents, students are typically not assessed on these ideas. The analysis results described in the report point to strengths and limitations of these widely used assessments and identify a range of good and poor assessment tasks that can shed light on important characteristics of good assessment. ß 2002 John Wiley & Sons, Inc. J Res Sci Teach 39: 889-910, 2002 Assessment of student performance exerts extraordinary influence on the lives of children and their families and on every level of the education system. If used properly, good assessment can be a powerful catalyst for improving both curriculum and instruction. Poor assessment practices, on the other hand, can impoverish our expectations for learning science, focusing teachers' and students' efforts on less important concepts and skills or on test taking as an end in itself.

No abstract