Document recommendation systems for locating relevant literature have mostly relied on methods developed a decade ago. This is largely due to the lack of a large offline gold-standard benchmark of relevant documents that cover a variety of research fields such that newly developed literature search techniques can be compared, improved and translated into practice. To overcome this bottleneck, we have established the RElevant LIterature SearcH consortium consisting of more than 1500 scientists from 84 countries, who have collectively annotated the relevance of over 180 000 PubMed-listed articles with regard to their respective seed (input) article/s. The majority of annotations were contributed by highly experienced, original authors of the seed articles. The collected data cover 76% of all unique PubMed Medical Subject Headings descriptors. No systematic biases were observed across different experience levels, research fields or time spent on annotations. More importantly, annotations of the same document pairs contributed by different scientists were highly concordant. We further show that the three representative baseline methods used to generate recommended articles for evaluation (Okapi Best Matching 25, Term Frequency–Inverse Document Frequency and PubMed Related Articles) had similar overall performances. Additionally, we found that these methods each tend to produce distinct collections of recommended articles, suggesting that a hybrid method may be required to completely capture all relevant articles. The established database server located at https://relishdb.ict.griffith.edu.au is freely available for the downloading of annotation data and the blind testing of new methods. We expect that this benchmark will be useful for stimulating the development of new powerful techniques for title and title/abstract-based search engines for relevant articles in biomedical research.
Graphical AbstractThirty healthy participants received 60 trials of intermittent SO (0.75 Hz) tACS (1 trial = 16 s on + 16 s off) at an intensity of 2 mA. Motor cortical excitability was assessed using TMS-induced MEPs (blue waveforms) acquired across different oscillatory phases during (i.e., online; red arrows) and outlasting (i.e., offline; green arrows) tACS, as well as at the start and end of the stimulation session (blue arrows). Mean MEP amplitude increased by ∼41% from pre- to post-tACS (P = 0.013); however, MEP amplitudes were not modulated with respect to the tACS phase.
Phase synchronization drives connectivity between neural oscillators, providing a flexible mechanism through which information can be effectively and selectively routed between task-relevant cortical areas. The ability to keep track of objects moving between the left and right visual hemifields, for example, requires the integration of information between the two cerebral hemispheres. Both animal and human studies have suggested that coherent (or phase-locked) gamma oscillations (30–80 Hz) might underlie this ability. While most human evidence has been strictly correlational, high-density transcranial alternating current stimulation (HD-tACS) has been used to manipulate ongoing interhemispheric gamma phase relationships. Previous research showed that 40 Hz tACS delivered bilaterally over human motion complex could bias the perception of a bistable ambiguous motion stimulus (Helfrich et al., 2014). Specifically, this work showed that in-phase (0° offset) stimulation boosted endogenous interhemispheric gamma coherence and biased perception toward the horizontal (whereby visual tokens moved between visual hemifields—requiring interhemispheric integration). By contrast, anti-phase (180° offset) stimulation decreased interhemispheric gamma coherence and biased perception toward the vertical (whereby tokens moved within separate visual hemifields). Here we devised a multiple object tracking arena comprised of four quadrants whereby discrete objects moved either entirely within the left and right visual hemifields, or could cross freely between visual hemifields, thus requiring interhemispheric integration. Using the same HD-tACS montages as Helfrich et al. (2014), we found no phase-specific effect of 40 Hz stimulation on overall tracking performance. While tracking performance was generally lower during between-hemifield trials (presumably reflecting a cost of integration), this difference was unchanged by in- vs. anti-phase stimulation. Our null results could be due to a failure to reliably modulate coherence in our study, or that our task does not rely as heavily on this network of coherent gamma oscillations as other visual integration paradigms.
Recent history influences subsequent perception, decision‐making and motor behaviours. In this article, we address a discrepancy in the effects of recent sensory history on the perceived timing of auditory and visual stimuli. In the synchrony judgement (SJ) task, similar timing relationships in consecutive trials seem more synchronous (i.e. less like the repeated temporal order). This effect is known as rapid recalibration and is consistent with a negative perceptual aftereffect. Interestingly, the opposite is found in the temporal order judgement (TOJ) task (positive rapid recalibration). We aimed to determine whether a simple bias to repeat judgements on consecutive trials (choice‐repetition bias) could account for the discrepant results in these tasks. Preliminary simulations and analyses indicated that a choice‐repetition bias could produce apparently positive rapid recalibration in the TOJ and not the SJ task. Our first experiment revealed no evidence of rapid recalibration of TOJs, but negative rapid recalibration of associated confidence. This suggests that timing perception was rapidly recalibrated, but that the negative recalibration effect was obfuscated by a positive bias effect. In our second experiment, we experimentally mitigated the choice‐repetition bias effect and found negative rapid recalibration of TOJs. We therefore conclude that timing perception is negatively rapidly recalibrated, and this is observed consistently across timing tasks. These results contribute to a growing body of evidence that indicates multisensory perception is constantly undergoing recalibration, such that perceptual synchrony is maintained. This work also demonstrates that participants’ task responses reflect judgements that are contaminated by independent biases of perception and decision‐making.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.