The semantic priming project

Hutchison, Keith A.; Balota, David A.; Neely, James H.; Cortese, Michael J.; Cohen-Shikora, Emily R.; Tse, Chi‐Shing; Yap, Melvin J.; Bengson, Jesse J.; Niemeyer, Dale; Buchanan, Erin Michelle

doi:10.3758/s13428-012-0304-z

Cited by 127 publications

(172 citation statements)

References 58 publications

Supporting

Mentioning

167

Contrasting

Order By: Relevance

“…15 In another line of future work, we will experiment with other "cognitively plausible" evaluation data such as N400 (Kutas and Federmeier, 2011;, and will analyse the similarities and differences between WA and other such "cognitive" evaluation protocols, as the one relying on semantic priming (SPP) (Hutchison et al, 2013;Ettinger and Linzen, 2016).…”

Section: Discussionmentioning

confidence: 99%

Evaluation by Association: A Systematic Study of Quantitative Word Association Evaluation

Vulić

Korhonen

2017

Proceedings of the 15th Conference of the European Chapter of The Association for Computational Linguistics: Volume 1

View full text Add to dashboard Cite

Recent work on evaluating representation learning architectures in NLP has established a need for evaluation protocols based on subconscious cognitive measures rather than manually tailored intrinsic similarity and relatedness tasks. In this work, we propose a novel evaluation framework that enables large-scale evaluation of such architectures in the free word association (WA) task, which is firmly grounded in cognitive theories of human semantic representation. This evaluation is facilitated by the existence of large manually constructed repositories of word association data. In this paper, we (1) present a detailed analysis of the new quantitative WA evaluation protocol, (2) suggest new evaluation metrics for the WA task inspired by its direct analogy with information retrieval problems, (3) evaluate various state-of-the-art representation models on this task, and (4) discuss the relationship between WA and prior evaluations of semantic representation with well-known similarity and relatedness evaluation sets. We have made the WA evaluation toolkit publicly available.

show abstract

Section: Discussionmentioning

confidence: 99%

Evaluation by Association: A Systematic Study of Quantitative Word Association Evaluation

Vulić

Korhonen

2017

Proceedings of the 15th Conference of the European Chapter of The Association for Computational Linguistics: Volume 1

View full text Add to dashboard Cite

show abstract

“…To answer the questions raised in the introduction, we analyzed the data from the Semantic Priming Project (see Hutchison et al, 2013, for a complete description). This database contains priming data for 1,661 targets, all of which were the primary associate to one cue (e.g., below-above) and another associate to a different cue (e.g., upstairs-above).…”

Section: Methodsmentioning

confidence: 99%

“…

Abstract The current study examines the underlying processes of semantic priming using the largest priming database available (i.e., Semantic Priming Project, Hutchison et al Behavior Research Methods, 45(4), 1099-1114, 2013. Specifically, it compares priming effects in two tasks: lexical decision and pronunciation.

…”

mentioning

confidence: 99%

Uncovering underlying processes of semantic priming by correlating item-level effects

2015

Self Cite

View full text Add to dashboard Cite

The current study examines the underlying processes of semantic priming using the largest priming database available (i.e., Semantic Priming Project, Hutchison et al. Behavior Research Methods, 45(4), 1099-1114, 2013. Specifically, it compares priming effects in two tasks: lexical decision and pronunciation. Task similarities were assessed at two different stimulus onset asynchronies (SOAs) (i.e., 200 and 1,200 ms) and for both primary and other associates. To evaluate how consistent priming is across these two tasks, item-level priming effects obtained in each task were correlated for each condition separately. The results revealed significant correlations at the short SOA for both primary and other associates. The correlations at the long SOA were significantly smaller and only reached significance when z-transformed response times were used. Furthermore, this pattern remained essentially the same when only asymmetric forward associates (e.g., panda-bear) were considered, suggesting that the cross-task stability at the short SOA was not merely caused by retrospective processes such as semantic matching. Instead, these findings provide evidence for a rapidly operating, item-based, relational characteristic such as spreading activation.

show abstract

“…Lexicon projects collecting behavioral data for thousands of words have been conducted in English (Balota et al, 2007), French (Ferrand et al, 2010), Dutch (Keuleers, Diependaele, & Brysbaert, 2010), Malay (Yap et al, 2010), British English , and Chinese (Sze, Rickard Liow, & Yap, 2014). The approach has also been used for research on second language processing (Lemhöfer et al, 2008) and priming (Hutchinson et al, 2013;Adelman, Johnson, et al, 2014). Yet, despite providing a vast supply of data, this approach leaves a lack of information on the impact of non-item characteristics on language processing.…”

Section: Background and Motivationmentioning

confidence: 99%

The Developmental Lexicon Project: A behavioral database to investigate visual word recognition across the lifespan

Schröter

Schroeder

2017

Behav Res

View full text Add to dashboard Cite

With the Developmental Lexicon Project (DeveL), we present a large-scale study that was conducted to collect data on visual word recognition in German across the lifespan. A total of 800 children from Grades 1 to 6, as well as two groups of younger and older adults, participated in the study and completed a lexical decision and a naming task. We provide a database for 1,152 German words, comprising behavioral data from seven different stages of reading development, along with sublexical and lexical characteristics for all stimuli. The present article describes our motivation for this project, explains the methods we used to collect the data, and reports analyses on the reliability of our results. In addition, we explored developmental changes in three marker effects in psycholinguistic research: word length, word frequency, and orthographic similarity. The database is available online.Keywords Visual word recognition . Development . Mega studies . Lexical decision . NamingThere is an extensive body of research on the visual word recognition processes in skilled adults (e.g., Balota et al., 2007). On the basis of this research, several computational models have been developed that account for many of the benchmark effects observed in word processing tasks such as lexical decision (LD) or naming (e.g., Coltheart, Rastle, Perry, Langdon, & Ziegler, 2001;Harm & Seidenberg, 2004;Perry, Ziegler, & Zorzi, 2007). Most of these models, however, only aim at explaining the reading behavior of proficient adults who have already acquired the ability to read. In recent years, some efforts have been made to bring interindividual differences into the picture (Andrews & Lo, 2012; Adelman, Sabatos-DeVito, Marquis, & Estes, 2014;Kuperman & van Dyke, 2013;Yap, Balota, Sibley, & Ratcliff, 2012). Arguably, however, the most pronounced differences between readers are intra-individual in nature: Children are not born with the ability to read but need years of extensive practice in order to learn it. And even during adulthood, profound changes take place in lexical and sublexical processing (Balota, Cortese, Sergent-Marshall, Spieler, & Yap, 2004;Ratcliff, Perea, Colangelo, & Buchanan, 2004). Yet, developmental models of the visual word recognition process are still rather scarce (but see Pritchard, Coltheart, Marinus, & Castles, 2016;Ziegler, Bertrand, Lété, & Grainger, 2014). One of the main reasons for this is that very few studies have been conducted that investigate visual word recognition across the lifespan within a coherent framework. Thus, at present, the empirical data that are necessary to feed any computational modeling efforts are missing.The present article describes the Developmental Lexicon Project (DeveL), which provides a linguistic database for 1,152 German words including behavioral measures of how they are processed at different age groups across the lifespan. Extending the logic and methodology of existing mega studies on visual word recognition (Balota et al., 2007;Balota, Yap, Hutchison, & Cortese, 2012;...

show abstract

The semantic priming project

Cited by 127 publications

References 58 publications

Evaluation by Association: A Systematic Study of Quantitative Word Association Evaluation

Evaluation by Association: A Systematic Study of Quantitative Word Association Evaluation

Uncovering underlying processes of semantic priming by correlating item-level effects

The Developmental Lexicon Project: A behavioral database to investigate visual word recognition across the lifespan

Contact Info

Product

Resources

About