Web-based language production experiments: Semantic interference assessment is robust for spoken and typed response modalities

Stark, Kirsten; Scherpenberg, Cornelia van; Obrig, Hellmuth; Rahman, Rasha Abdel

doi:10.3758/s13428-021-01768-2

Cited by 9 publications

(7 citation statements)

References 85 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Data quality was good, where 99% of the audios were transcribable (99% of produced words being transcribed), and only about 12% of participants were replaced due to incomplete or missing recordings. In addition, web-based language production paradigms (e.g., picture-naming tasks) have reproduced lab-based findings across studies (Fairs & Strijkers, 2021;Vogt et al, 2021;Stark et al, 2022). Therefore, the quality of auditory data collected online does not seem to be compromised by technical issues and human factors.…”

Section: Introductionmentioning

confidence: 83%

Collecting musical creativity data online: a tutorial

Liu¹,

Basdeo²,

Chung³

et al. 2022

Preprint

View full text Add to dashboard Cite

The COVID-19 pandemic and associated restrictions on in-person collection created a need for researchers to familiarise themselves with online data collection methods, often through platforms that allow for participation in the absence of a researcher. The development of online methods could prove advantageous by enhancing access to musical populations. Recent psycholinguistic studies employing web-based audiovisual tasks have reproduced lab-based findings with good data quality. However, the online collection of musical data has not been widely explored. Here we offer a tutorial to introduce the first use of the Gorilla Experiment Builder to collect musical improvisations played in response to prompt and recorded on participants own instruments at home in their own time. We aim to support other researchers in developing similar tasks. To test the method, we recruited 76 experienced pianists through Prolific who completed an improvisation task that allowed for participants to test their own recording quality, included written and video instructions, allowed them to hear a musical prompt and metronome, and view the associated musical score on the same screen. Technical issues faced included incomplete improvisations and poor sound quality, but included participants produced high quality data, particularly after the inclusion of an explanatory video. We propose that data collection using online and self-paced task could prove a fruitful vehicle for certain types of musical research and potentially greatly reduce the resources required to collect data.

show abstract

Section: Introductionmentioning

confidence: 83%

Collecting musical creativity data online: a tutorial

Liu¹,

Basdeo²,

Chung³

et al. 2022

Preprint

View full text Add to dashboard Cite

show abstract

“…Several studies have demonstrated the feasibility and accuracy of web-based language production studies. Although overall latencies are longer in web-based than in lab-based experiments (Fairs & Strijkers, 2021), frequently-observed psycholinguistic effects that rely on precise and accurate measurement of naming latencies are replicated (Stark et al, 2022;Vogt et al, 2021).…”

Section: Research Questionsmentioning

confidence: 99%

Voluntary and cued language switching in late bilingual speakers

Mooijman,

Schoonen,

Ruiter

et al. 2023

Bilingualism

View full text Add to dashboard Cite

Previous research examining the factors that determine language choice and voluntary switching mainly involved early bilinguals. Here, using picture naming, we investigated language choice and switching in late Dutch–English bilinguals. We found that naming was overall slower in cued than in voluntary switching, but switch costs occurred in both types of switching. The magnitude of switch costs differed depending on the task and language, and was moderated by L2 proficiency. Self-rated rather than objectively assessed proficiency predicted voluntary switching and ease of lexical access was associated with language choice. Between-language and within-language switch costs were not correlated. These results highlight self-rated proficiency as a reliable predictor of voluntary switching, with language modulating switch costs. As in early bilinguals, ease of lexical access was related to word-level language choice of late bilinguals.

show abstract

“…Raletedness aids, and interferes with, lexical (and conceptual) selection in different ways. Semantic interference, which also is being used as a research paradigm (i.e., Bürki, Elbuy, Madec, & Vasishth, 2020;Stark, van Scherpenberg, Obrig, & Rahman, 2021), is the effect of different related or unrelated distractor words (or images) that can lead to further exploration of the semantic space or to cognitive fixedness.…”

Section: Perspective From a Cognitive Basismentioning

confidence: 99%

Where Divergent Ideas Converge: Answers to AUT Found on Short List of Word Co-Occurrences Terms

Klein

Badía

2022

Creativity Research Journal

View full text Add to dashboard Cite

Divergent thinking (DT) is a fundamental part of creative ideation. Understanding its role in cognition and its attainment through language technology can provide the scaffolding to enhance creative endeavors. This study is a proof of concept on the automatic generation of keyword responses as found on the AUT (Alternative Uses Task), a test commonly used to measure DT. Within a psychometric perspective, we propose a frequency-based simple word co-occurrence method called Co-OBM (co-occurrence-based method). Drawing from Natural Language Processing (NLP) we choose the adequate parameter settings for this task, including part-of-speech tagging (POS), word form, association measure, minimum occurrence in corpus and window size. Through our experiments, we show how most of the popular responses to AUT can be identified in a short word co-occurrence list, together with some of the least frequent, and usually more creative, responses, how this outcome is not random but based on linguistic patterns (Experiment 1); and how Co-OBM output can enhance the performance of subjects' AUT responses (Experiment 2). This is relevant since word co-occurrence is at the core of current language models. Our work aims to reflect and provide technical and empirical foundations for the development of distributional language models for creative purposes.

show abstract

Web-based language production experiments: Semantic interference assessment is robust for spoken and typed response modalities

Cited by 9 publications

References 85 publications

Collecting musical creativity data online: a tutorial

Collecting musical creativity data online: a tutorial

Voluntary and cued language switching in late bilingual speakers

Where Divergent Ideas Converge: Answers to AUT Found on Short List of Word Co-Occurrences Terms

Contact Info

Product

Resources

About