Assessment of emotional functioning in brain-impaired individuals.

Nelson, Linda D.; Cicchetti, Domenic V.

doi:10.1037/1040-3590.7.3.404

“…In fact, the prevalences of impaired performance obtained in the present study using the ST-LNNB and SILS screening instruments (0.09 and 0.22, respectively) are somewhat lower than the 0.34-0.50 prevalences found in previous studies (e.g. Such refinements should be based upon the current theoretical and methodological advances in the field of neuropsychology (see Nelson & Cicchetti, 1995;Prigatano, Parsons & Bortz, 1995). Secondly, the present study utilized global measures of substance use.…”

Section: Discussioncontrasting

confidence: 50%

Cognitive impairment among the dually-diagnosed: substance use history and depressive symptom correlates

Carpenter¹,

Hittner²

1997

View full text Add to dashboard Cite

The present study examined the effects of substance use history and depressive symptomatology on the cognitive functioning of 149 male and 72 female dually diagnosed inpatients. Logistic regression models examined the effects of life-time alcohol and cocaine use, previous month's alcohol and cocaine use and depression on abstract reasoning as assessed by the Shipley Institute of Living Scale (SILS) and neuropsychological functioning as measured by the Screening Test for the Luria-Nebraska Neuropsychological Battery (ST-LNNB). Results indicated differential effects of substance use across the two cognitive outcome measures. Specifically, a significant relationship was demonstrated for previous month's alcohol use on Shipley classification. However, after adjusting for possible borderline cases, previous month's alcohol use dropped to non-significance and in its stead an association between Shipley classification and life-time use was demonstrated. No significant effects were demonstrated for cocaine use, recent alcohol use, depressive symptoms or any of the interaction terms. The Luria-Nebraska performance classifications were significantly associated with both educational level and life-time cocaine use. No significant relationships were obtained for previous month's cocaine use, the alcohol use variables, depressive symptoms, or any of the interactions terms. The degree of classification agreement between the two outcome measures was slightly better than chance (kappa = 0.24 for ST-LNNB and traditional or full scale SILS; kappa = 0.35 for ST-LNNB and modified SILS). These kappa coefficients suggest that the SILS and ST-LNNB assess partially independent dimensions of cognitive functioning. The findings are discussed in light of previous research and implications for clinical assessment and treatment are outlined.

show abstract

“…Similar patterns have been shown to characterize AUC as well (Cumming 2000a; McPherson, Jetz & Rogers 2004). Instability at extremely low or high levels of prevalence seems to be inherent in any model with low number of cases in one of the cells of the confusion matrix (Nelson & Cicchetti 1995).…”

Section: Discussionmentioning

confidence: 99%

Assessing the accuracy of species distribution models: prevalence, kappa and the true skill statistic (TSS)

Allouche

¹

,

Tsoar

²

,

Kadmon

³

2006

Journal of Applied Ecology

View full text Add to dashboard Cite

Summary 1.In recent years the use of species distribution models by ecologists and conservation managers has increased considerably, along with an awareness of the need to provide accuracy assessment for predictions of such models. The kappa statistic is the most widely used measure for the performance of models generating presence-absence predictions, but several studies have criticized it for being inherently dependent on prevalence, and argued that this dependency introduces statistical artefacts to estimates of predictive accuracy. This criticism has been supported recently by computer simulations showing that kappa responds to the prevalence of the modelled species in a unimodal fashion. 2. In this paper we provide a theoretical explanation for the observed dependence of kappa on prevalence, and introduce into ecology an alternative measure of accuracy, the true skill statistic (TSS), which corrects for this dependence while still keeping all the advantages of kappa. We also compare the responses of kappa and TSS to prevalence using empirical data, by modelling distribution patterns of 128 species of woody plant in Israel.3. The theoretical analysis shows that kappa responds in a unimodal fashion to variation in prevalence and that the level of prevalence that maximizes kappa depends on the ratio between sensitivity (the proportion of correctly predicted presences) and specificity (the proportion of correctly predicted absences). In contrast, TSS is independent of prevalence. 4. When the two measures of accuracy were compared using empirical data, kappa showed a unimodal response to prevalence, in agreement with the theoretical analysis. TSS showed a decreasing linear response to prevalence, a result we interpret as reflecting true ecological phenomena rather than a statistical artefact. This interpretation is supported by the fact that a similar pattern was found for the area under the ROC curve, a measure known to be independent of prevalence. 5. Synthesis and applications . Our results provide theoretical and empirical evidence that kappa, one of the most widely used measures of model performance in ecology, has serious limitations that make it unsuitable for such applications. The alternative we suggest, TSS, compensates for the shortcomings of kappa while keeping all of its advantages. We therefore recommend the TSS as a simple and intuitive measure for the performance of species distribution models when predictions are expressed as presenceabsence maps.

show abstract

“…Further research is needed to ascertain the factors related to the utility of the particular screening instruments employed in this study for similar populations. Such refinements should be based upon the current theoretical and methodological advances in the field of neuropsychology (see Nelson & Cicchetti, 1995;Prigatano, Parsons & Bortz, 1995).…”

Section: Discussionmentioning

confidence: 99%

Cognitive impairment among the dually‐diagnosed: substance use history and depressive symptom correlates

Carpenter

¹

,

Hittner

²

1997

View full text Add to dashboard Cite

The present study examined the effects of substance use history and depressive symptomatology on the cognitive functioning of 149 male and 72 female dually diagnosed inpatients. Logistic regression models examined the effects of life-time alcohol and cocaine use, previous month's alcohol and cocaine use and depression on abstract reasoning as assessed by the Shipley Institute of Living Scale (SILS) and neuropsychological functioning as measured by the Screening Test for the Luria-Nebraska Neuropsychological Battery (ST-LNNB). Results indicated differential effects of substance use across the two cognitive outcome measures. Specifically, a significant relationship was demonstrated for previous month's alcohol use on Shipley classification. However, after adjusting for possible borderline cases, previous month's alcohol use dropped to non-significance and in its stead an association between Shipley classification and life-time use was demonstrated. No significant effects were demonstrated for cocaine use, recent alcohol use, depressive symptoms or any of the interaction terms. The Luria-Nebraska performance classifications were significantly associated with both educational level and life-time cocaine use. No significant relationships were obtained for previous month's cocaine use, the alcohol use variables, depressive symptoms, or any of the interactions terms. The degree of classification agreement between the two outcome measures was slightly better than chance (kappa = 0.24 for ST-LNNB and traditional or full scale SILS; kappa = 0.35 for ST-LNNB and modified SILS). These kappa coefficients suggest that the SILS and ST-LNNB assess partially independent dimensions of cognitive functioning. The findings are discussed in light of previous research and implications for clinical assessment and treatment are outlined.

show abstract

Assessment of emotional functioning in brain-impaired individuals.

Cited by 13 publications

References 60 publications

Cognitive impairment among the dually-diagnosed: substance use history and depressive symptom correlates

Cognitive impairment among the dually-diagnosed: substance use history and depressive symptom correlates

Assessing the accuracy of species distribution models: prevalence, kappa and the true skill statistic (TSS)

Cognitive impairment among the dually‐diagnosed: substance use history and depressive symptom correlates

Contact Info

Product

Resources

About