The Development of Authentic Assessments to Investigate Ninth Graders’ Scientific Literacy: In the Case of Scientific Cognition Concerning the Concepts of Chemistry and Physics

Abstract

ABSTRACT. Scientific literacy and authenticity have gained a lot of attention in the past few decades worldwide. The goal of the study was to develop various authentic assessments to investigate students' scientific literacy for corresponding to the new curriculum reform of Taiwan in 1997. In the process, whether ninth graders were able to apply school knowledge in real-life problems was also investigated. Over the course of our two-year study, we developed authentic assessments to investigate a stratified random sampling of 1,503 ninth graders' levels of scientific literacy, including scientific cognition, process skills, application of science, habits of mind, nature of science, and attitude towards science. The purpose of this article is to discuss three different formats of authentic assessments: multiple-choice, open-ended, and hands-on test items, which we developed to investigate scientific cognition. To validate the three formats of authentic assessments, students' performance on these three assessments were compared with the science section of Taiwan's Academic Attainment Testing (STAAT), and the values of Pearson correlation coefficient were all at the significant level, ranging from 0.205 to 0.660 (p < 0.01). We found that our three authentic assessments were better in evaluating students' authentic abilities in science than standardized tests (such as STAAT). Further authentic assessments, particularly the hands-on activity, benefited low-achieving students. Concerning the common themes tested in the authentic assessments, students performed better in a multiple-choice test than an open-ended test on electricity and heat and temperature. In addition, two themes of chemical reactions and reactions of acid and base with indicators were performed best in a hands-on test than in the other two tests. In this article, we provide evidence that authentic assessments could be developed in different formats to investigate students' scientific cognition as part of the national test. Of these formats, the multiple-choice, open-ended, and hands-on test items are all shown to be sensitive in their evaluation of students' cognition in science.KEY WORDS: scientific literacy, scientific cognition and authentic assessmentIn this new century, many countries not only focus on research in science and technology, but also dedicate time and resources to the improvement of science education. In fact, education reform has become a continuous movement in many countries (Bell, Abd-El-Khalick, Lederman, McComas

Chemical Literacy: Performance of First Year Chemistry Students on Chemical Kinetics

“…Thummathong and Thathong [11] have developed multiple-choice and written forms of test instruments on basic chemistry contents to examine undergraduate engineering students' chemical literacy. The test was developed based on the components of chemical literacy contained in several assessment frameworks [4,[12][13]. Cigdemoglu et al [9] have developed an open-ended form of test instruments on acid-base concepts to examine first year university students' chemical literacy.…”

The Economy of Education and its Role in National Development

“…Indeed, reform and improvement of education is a continuous action in many countries. (Chang and Chiu, 2005) 12 . Education of science considers as o 2 ne of the elements of policies of scientific development in many countries and it is the important part of educational systems goals, too.…”

In Pursuit of Authenticity in Science Education

“…From Wiggins' perspective, authenticity in science education would potentially relate to the practices of professional scientists working in as well as outside universities and science-related citizen practices. Often, a more authentic approach to teaching is motivated from a theoretical perspective of knowledge as situated in social practices (Chang & Chiu, 2005).…”