Continuously Variable Rating: a new, simple and logical procedure to evaluate original scientific publications

Abstract

OBJECTIVE:Impact Factors (IF) are widely used surrogates to evaluate single articles, in spite of known shortcomings imposed by cite distribution skewness. We quantify this asymmetry and propose a simple computer-based procedure for evaluating individual articles.METHOD:(a) Analysis of symmetry. Journals clustered around nine Impact Factor points were selected from the medical “Subject Categories” in Journal Citation Reports 2010. Citable items published in 2008 were retrieved and ranked by granted citations over the Jan/2008 - Jun/2011 period. Frequency distribution of cites, normalized cumulative cites and absolute cites/decile were determined for each journal cluster. (b) Positive Predictive Value. Three arbitrarily established evaluation classes were generated: LOW (1.3≤IF<2.6); MID: (2.6≤IF<3.9); HIGH: (IF≥3.9). Positive Predictive Value for journal clusters within each class range was estimated. (c) Continuously Variable Rating. An alternative evaluation procedure is proposed to allow the rating of individually published articles in comparison to all articles published in the same journal within the same year of publication. The general guiding lines for the construction of a totally dedicated software program are delineated.RESULTS AND CONCLUSIONS:Skewness followed the Pareto Distribution for (1<K<2). Observed Positive Predictive Values ranged from 24 - 43% for over 98% of the selected journals in the ISI database. Continuously Variable Rating is shown to be a simple computer based procedure capable of accurately providing a valid rating for each article within the journal and time frame in which it was published.

[ARTIGO RETRATADO] Exercício e suas interações com vários aspectos da vida do homem e dos animais

“…We have covered the various fields outlined in Table 1 in search ofpapers with higher level of citations, within the levels of citations pertaining to each of the respective journals. To this end we applied the concept of continuously variable rating to correct the observed citations with respect to each of the journals, as described by Rocha e Silva 1 . We believe that it is a better way of grading papers in contrast to the more usual procedure of using the impact factor of the published journal to make this evaluation.…”

“…To this end we applied the concept of continuously variable rating to correct the observed citations with respect to each of the journals, as described by Rocha e Silva. 1 We believe that it is a better way of grading papers in contrast to the more usual procedure of using the impact factor of the published journal to make this evaluation. Subjects discussed in this review fall naturally into the categories in which exercise might be expected to be a significant factor…”

[ARTIGO RETRATADO] Revisão dos artigos sobre ortopedia recentemente publicados na imprensa científica brasileira

“…These articles appeared in the following journals: Brazilian Journal of Medical and Biological Research, Clinics, Jornal de Pediatria, Revista da Escola de Enfermagem da USP, Revista Latinoamericana de Enfermagem and São Paulo Medical Journal. Criteria observed for selecting articles were generally based on the new concept of continuously variable rating where articles are evaluated with respect to citations in comparison to other articles cited in the same journal 3 . An overwhelming majority of articles cover orthopedic problems of the lower and upper limb in this order.…”

“…Criteria observed for selecting articles were generally based on the new concept of continuously variable rating where articles are evaluated with respect to citations in comparison to other articles cited in the same journal. 3 An overwhelming majority of articles cover orthopedic problems of the lower and upper limb in this order.…”

Molecular and genetic aspects of oncology and infectology in Clinics

“…This editorial selects some of the most outstanding contributions in oncology and infectology using continuously variable ratings (1) as the selection tool. …”