A New Tool for Identifying Research Standards and Evaluating Research Performance

Abstract

Much has been written about the evaluation of faculty research productivity in promotion and tenure decisions, including many articles that seek to determine the rank of various marketing journals. Yet how faculty evaluators combine journal quality, quantity, and author contribution to form judgments of a scholar’s performance is unclear. A mathematical model of faculty judgment is presented that estimates a scholar’s research productivity that is surprisingly consistent with actual faculty evaluations. The model does not replace human judgment in evaluating a scholar’s research performance, but the model enhances clarity and objectivity in the evaluation process. The method is demonstrated with marketing faculty at one university.

Faculty Scholarship Has a Profound Positive Association With Student Evaluations of Teaching—Except When It Doesn’t

“…The second indicator of faculty scholarship focuses specifically on the ability to publish in elite or top-tier marketing journals in the past 10 years. Naturally, there is debate about the exact composition of the top five or six journals, but there seems to be a general consensus that the following outlets publish some of the highest quality academic articles in the marketing discipline: the Journal of Marketing, Journal of Marketing Research, Journal of Consumer Research, Marketing Science , and Journal of the Academy of Marketing Science (Bacon, Paul, Stewart, & Mukhopadhyay, 2012; Steward & Lewis, 2010). The capability to publish in elite journals is also binary coded (i.e., a “1” indicates that the researcher was listed as an author, regardless of the order or number of authors, for at least one elite publication; and “0” otherwise).…”

Exploring the Questionable Academic Practice of Conference Paper Double Dipping

“…This provides access to valuable resources that will potentially assist in enhancing research productivity and quality, ultimately improving the potential for journal publications (Lee et al, 2010;Tähtinen et al, 2016). Also, successful conference presentations may count favorably toward tenure requirements, as many schools consider international conference presentations an important achievement for evaluating research productivity (Bacon, Paul, Stewart, & Mukhopadhyay, 2012;McNamara & Kolbe, 1996;Shepherd, Carley, & Stuart, 2009). For example, a study by Shepherd et al (2009) showed that in 47% of U.S.-based AACSBaccredited business schools, chairs of marketing departments considered national or international conference proceedings as the second most important and relevant indicator for evaluating research productivity as part of tenure, promotion, and annual performance reviews.…”

Research Professors’ Self-Assessment of Competencies

“…Transformation of others' professional behaviors implies complex work in which varied competencies are collected, analyzed, and validated by international organizations [1][2][3]. Previously, efforts have been primarily devoted to the evaluation of student competencies, but professors' competencies have recently become very important [4][5][6][7] Thus, various models of researcher development have been produced [4,8] to support evaluation of professors [4,5,[9][10][11].…”

“…However, instruments for assessing scientific research-focused competencies are not available [12], and, in México, we found few development models for research professors [13] and few studies of the competencies of undergraduate researchers' professors [14,15] despite their great importance. Studies from other countries on researcher development models were found, for instance, [4,9,10,16,17], who present complex models explaining professors' defined behaviors and commenting that doing so is not just simple but also very relevant. This study attempts to evaluate research-professor competencies that demonstrate the following: leadership in a discipline, production of quality research, innovation, teaching, ethics, citizenship, use of technology, and linkage, funding, and training of other researchers-all focused on solving society's current and future problems.…”