This paper presents the theory, design principles, implementation and performance results of PicHunter, a prototype content-based image retrieval (CBIR) system. In addition, this document presents the rationale, design and results of psychophysical experiments that were conducted to address some key issues that arose during PicHunter's development. The PicHunter project makes four primary contributions to research on CBIR. First, PicHunter represents a simple instance of a general Bayesian framework which we describe for using relevance feedback to direct a search. With an explicit model of what users would do, given the target image they want, PicHunter uses Bayes's rule to predict the target they want, given their actions. This is done via a probability distribution over possible image targets, rather than by refining a query. Second, an entropy-minimizing display algorithm is described that attempts to maximize the information obtained from a user at each iteration of the search. Third, PicHunter makes use of hidden annotation rather than a possibly inaccurate/inconsistent annotation structure that the user must learn and make queries in. Finally, PicHunter introduces two experimental paradigms to quantitatively evaluate the performance of the system, and psychophysical experiments are presented that support the theoretical claims.

The prevalent view of binocular rivalry holds that it is a competition between the two eyes mediated by reciprocal inhibition among monocular neurons. This view is largely due to the nature of conventional rivalry-inducing stimuli, which are pairs of dissimilar images with coherent patterns within each eye's image. Is it the eye of origin or the coherency of patterns that determines perceptual alternations between coherent percepts in binocular rivalry? We break the coherency of conventional stimuli and replace them by complementary patchworks of intermingled rivalrous images. Can the brain unscramble the pieces of the patchwork arriving from different eyes to obtain coherent percepts? We find that pattern coherency in itself can drive perceptual alternations, and the patchworks are reassembled into coherent forms by most observers. This result is in agreement with recent neurophysiological and psychophysical evidence demonstrating that there is more to binocular rivalry than mere eye competition.

Purpose Schizophrenia patients are less susceptible to depth inversion illusions (DIIs) in which concave faces appear as convex but what stimulus attributes generate this effect and how does it vary with clinical state? Method To address these issues, we had 30 schizophrenia patients and 25 well-matched healthy controls make convexity judgments on physically concave faces and scenes. Patients were selectively sampled from three levels of care to ensure symptom heterogeneity. Half of the concave objects were painted with realistic texture to enhance the convexity illusion; the remaining objects were painted uniform beige to reduce the illusion. Subjects viewed the objects with one eye while laterally moving in front of the stimulus (to see depth via motion parallax) or with two eyes while remaining motionless (to see depth stereoscopically). Results For each group, DIIs were stronger with texture than without, and weaker with stereoscopic information than without, indicating that patients responded normally to stimulus alterations. More importantly, patients experienced fewer illusions than controls irrespective of the face/scene category, texture, or viewing condition. (parallax/stereo). Illusions became less frequent as patients experienced more positive symptoms and required more structured treatment. Conclusions People with schizophrenia experience fewer DIIs with a variety of object types and viewing conditions perhaps because of a lessened tendency to construe any type of object as convex. Moreover, positive symptoms and the need for structured treatment are associated with more accurate 3-D perception, suggesting that DII may serve as a state marker for the illness.

There is a critical need for new analytics to personalize behavioral data analysis across different fields, including kinesiology, sports science, and behavioral neuroscience. Specifically, to better translate and integrate basic research into patient care, we need to radically transform the methods by which we describe and interpret movement data. Here, we show that hidden in the “noise,” smoothed out by averaging movement kinematics data, lies a wealth of information that selectively differentiates neurological and mental disorders such as Parkinson’s disease, deafferentation, autism spectrum disorders, and schizophrenia from typically developing and typically aging controls. In this report, we quantify the continuous forward-and-back pointing movements of participants from a large heterogeneous cohort comprising typical and pathological cases. We empirically estimate the statistical parameters of the probability distributions for each individual in the cohort and report the parameter ranges for each clinical group after characterization of healthy developing and aging groups. We coin this newly proposed platform for individualized behavioral analyses “precision phenotyping” to distinguish it from the type of observational–behavioral phenotyping prevalent in clinical studies or from the “one-size-fits-all” model in basic movement science. We further propose the use of this platform as a unifying statistical framework to characterize brain disorders of known etiology in relation to idiopathic neurological disorders with similar phenotypic manifestations.

The English artist Patrick Hughes has created an extraordinary class of painted artpieces, most commonly referred to as 'reverspectives'. They consist of truncated pyramids and prisms with their smaller faces closer to the viewer, in such a way as to allow a realistic scene to be painted on them. The works of art contain rich perspective and other painted cues that conspire to elicit an illusory depth percept that is the reverse of the physical depth arrangement. This reverse depth is obtained under a wide range of viewing conditions, and competes with the veridical depth percept in a classical bistable paradigm that was found to exhibit a high degree of hysteresis. Under the illusory depth percept, reverspectives appear to move vividly as the viewer moves in front of them. This paper reports two experiments that were designed to assess the effectiveness of the painted cues in eliciting the illusory depth percept by using three different measures for the strength of the illusion. As expected, the illusion was favored by monocular viewing and large viewing distances. The results from these two experiments are in close agreement with each other, and they indicate that the painted cues are powerful in influencing the ultimate percept.

Earlier psychophysical and physiological studies, obtained mostly with two-dimensional (2-D) stimuli, provided evidence for the hypothesis that the processing of faces differs from that of scenes. We report on our experiments, employing realistic three-dimensional (3-D) stimuli of a hollow mask and a scene, that offer further evidence for this hypothesis. The stimuli used for both faces and scenes were bistable, namely they could elicit either the veridical or an illusory volumetric percept. Our results indicate that the illusion is weakened when the stimuli are inverted, suggesting the involvement of top down processes. This inversion effect is statistically significant for the facial stimulus, but the trend did not reach statistical significance for the scene stimulus. These results support the hypothesis that configural processing is stronger for the 3-D perception of faces than it is for scenes, and extend the conclusions of earlier studies on 2-D stimuli.

Traditionally, research on visual attention has been focused on the processes involved in conscious, explicit selection of task-relevant sensory input. Recently, however, it has been shown that attending to a specific feature of an object automatically increases neural sensitivity to this feature throughout the visual field. Here we show that directing attention to a specific color of an object results in attentional modulation of the processing of task-irrelevant and not consciously perceived motion signals that are spatiotemporally associated with this color throughout the visual field. Such implicit cross-feature spreading of attention takes place according to the veridical physical associations between the color and motion signals, even under special circumstances when they are perceptually misbound. These results imply that the units of implicit attentional selection are spatiotemporally colocalized feature clusters that are automatically bound throughout the visual field.

Introduction: In the Ebbinghaus illusion, a shape appears larger than its actual size when surrounded by small shapes and smaller than its actual size when surrounded by large shapes. Resistance to this visual illusion has been previously reported in schizophrenia, and linked to disorganized symptoms and poorer prognosis in cross-sectional studies. It is unclear, however, when in the course of illness this resistance first emerges or how it varies longitudinally with illness phase.Method: We addressed these issues by having first-episode psychosis patients, multiple-episode schizophrenia patients and healthy controls complete a psychophysical task at two different time points, corresponding to hospital admission and discharge for patients. The task required judging the relative size of two circular targets centered on either side of the screen. Targets were presented without context (baseline), or were surrounded by shapes that made the size judgment harder or easier (misleading and helpful contexts, respectively). Context sensitivity was operationalized as the amount of improvement relative to baseline in the helpful condition minus the amount of decrement relative to baseline in the misleading condition.Results: At hospital admission, context sensitivity was lower in the multiple-episode group than in the other groups, and was marginally less in the first episode than in the control group. In addition, schizophrenia patients were significantly more and less accurate than the other groups in the misleading and helpful conditions, respectively. At discharge, all groups exhibited similar context sensitivity. In general, poorer context sensitivity was related to higher levels of disorganized symptoms, and lower level of depression, excitement, and positive symptoms.Discussion: Resistance to the Ebbinghaus illusion, as a characteristic of the acute phase of illness in schizophrenia, increases in magnitude after the first episode of psychosis. This suggests that visual context processing is a state-marker in schizophrenia and a biomarker of relapse and recovery.