Decision Support System for Solving Reviewer Assignment Problem

Hoang, Dinh Tuyen; Nguyen, Ngoc Thanh; Collins, Botambu; Hwang, Dosam

doi:10.1080/01969722.2020.1871227

Cited by 9 publications

(8 citation statements)

References 28 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…), others try to solve the assignment problem by optimizing objectives under some constraints (Cook et al, 2005;Li et al, 2008;Tang et al, 2010;Tang et al, 2012;Daş & Gökçen, 2014;Guo et al, 2018;Boehmer et al, 2021, etc.). Also, there are studies dealing with all stages of the RAP and designing it as a reviewer recommendation system or decision support system (e.g., Tian et al, 2005;Janak et al, 2006;Sun et al, 2007;Conry et al, 2009;Xu et al, 2010;Silva et al, 2014;Liu et al, 2016;Hoang et al, 2021).…”

Section: Stages Of Reviewer Assignment Process and Related Methodolog...mentioning

confidence: 99%

“…The system needs to be automatic for more fair, objective, and expedient review assignments. Despite this requirement, the number of empirical studies submitted to the RAP for journal papers (Biswas & Hasan, 2007;Karimzadehgan & Zhai, 2009;Daud et al, 2010;Andrade-Navarro et al, 2012;Wang et al, 2013;Protasiewicz, 2014;Yin et al, 2016;Peng et al, 2017;Jin et al, 2018aJin et al, , 2018bZhao et al, 2018;Duan et al, 2019;Chughtai et al, 2019;Tan et al, 2021;Hoang et al, 2021) is less than that for conference papers.…”

Section: Rap For Journal Papersmentioning

confidence: 99%

“…The model captures the interchangeability of both words and texts with the Dirichlet distribution, allowing for a cohesive test data generation procedure. It is seen that LDA is widely applied to extract topics representation from the reviewer's published studies and the submitted proposals (Mimno & Mccallum, 2007;Tang et al, 2010;Tang et al, 2012;Charlin & Zemel, 2013;Liu et al, 2014;Xu & Zuo, 2016;Peng et al, 2017;Yan et al, 2017;Nguyen et al, 2018;Medakene et al, 2019;Pradhan et al, 2020;Yang et al, 2020;Patil & Mahalle, 2021;Tan et al, 2021;Hoang et al, 2021).…”

Section: Probabilistic Latent Semantic Analysis (Plsa)mentioning

confidence: 99%

“…Unlike currently available pre-trained language models, SPECTER can be used for downstream applications without task-specific fine-tuning. Hoang et al (2021) developed a decision support system to select a group of reviewers for proposals automatically. In this system, the profile of reviewers and proposals are represented as a vector by using Doc2Vec (Le & Mikolov, 2014).…”

Section: Neural Network-based Language Modelsmentioning

confidence: 99%

See 3 more Smart Citations

Reviewer Assignment Problem: A Systematic Review of the Literature

Meltem¹,

Yanık

Amasyalı

2023

jair

View full text Add to dashboard Cite

Appropriate reviewer assignment significantly impacts the quality of proposal evaluation, as accurate and fair reviews are contingent on their assignment to relevant reviewers. The crucial task of assigning reviewers to submitted proposals is the starting point of the review process and is also known as the reviewer assignment problem (RAP). Due to the obvious restrictions of manual assignment, journal editors, conference organizers, and grant managers demand automatic reviewer assignment approaches. Many studies have proposed assignment solutions in response to the demand for automated procedures since 1992. The primary objective of this survey paper is to provide scholars and practitioners with a comprehensive overview of available research on the RAP. To achieve this goal, this article presents an in-depth systematic review of 103 publications in the field of reviewer assignment published in the past three decades and available in the Web of Science, Scopus, ScienceDirect, Google Scholar, and Semantic Scholar databases. This review paper classified and discussed the RAP approaches into two broad categories and numerous subcategories based on their underlying techniques. Furthermore, potential future research directions for each category are presented. This survey shows that the research on the RAP is becoming more significant and that more effort is required to develop new approaches and a framework.

show abstract

Section: Stages Of Reviewer Assignment Process and Related Methodolog...mentioning

confidence: 99%

Section: Rap For Journal Papersmentioning

confidence: 99%

Section: Probabilistic Latent Semantic Analysis (Plsa)mentioning

confidence: 99%

Section: Neural Network-based Language Modelsmentioning

confidence: 99%

See 2 more Smart Citations

Reviewer Assignment Problem: A Systematic Review of the Literature

Meltem¹,

Yanık

Amasyalı

2023

jair

View full text Add to dashboard Cite

show abstract

“…Topic-based representation is the most dominant approach in the reviewed literature (12/26 or 46% of studies). This approach is often based on the Latent Dirichlet Allocation (LDA) [2] topic modelling method, in the context of which CRs and submissions are represented as (weighted or unweighted) topic vectors [34,51,36,37,10] or ordered sequences of the identified topics [44] or vectors of most relevant topics identified with LDA [52]. Other topic modelling methods that have been used in the selected studies include Author Topic Model [42], which was adopted in [13,3]; Author-Subject-Topic model, which was proposed and used in [12]; Reviewer Aspect Model [16] used by Yin et al [53], and Latent Semantic Indexing [20] used in [21].…”

mentioning

confidence: 99%

Reviewer Paper Assignment Problem – A Brief Review

Patil¹,

Mahalle²

2022

Handbook on ICT in Developing Countries

View full text Add to dashboard Cite

The quality of peer review, and consequently the published research, depends to a large extent on the ability to recruit adequate reviewers for submitted papers. However, finding such reviewers is an increasingly difficult task. To alleviate this challenge, numerous solutions have been suggested for automated association of papers with "well matching" reviewers -the task often referred to as reviewer assignment problem (RAP). Yet, to our knowledge, a recent systematic synthesis of the RAP-related literature is missing. To fill this gap and support further RAP-related research, we present a scoping review on computational approaches to RAP. Following the latest methodological guidance for scoping reviews, we have collected and synthesised the literature on RAP published over the last five years (Jan 2016 -Sept 2021). Specifically, the review is focused on the following aspects of RAP research: i) the overall approach to RAP; ii) the criteria used for reviewer selection; iii) the modelling of candidate reviewers and submissions; iv) the computational methods for matching reviewers and submissions; and v) the evaluation methods used for assessing the performance of the proposed solutions. The paper summarises and discusses the findings for each of the aforementioned aspects of RAP research and suggests future research directions.

show abstract

Literature Review

Protasiewicz

2023

Studies in Computational Intelligence

View full text Add to dashboard Cite

Decision Support System for Solving Reviewer Assignment Problem

Cited by 9 publications

References 28 publications

Reviewer Assignment Problem: A Systematic Review of the Literature

Reviewer Assignment Problem: A Systematic Review of the Literature

Reviewer Paper Assignment Problem – A Brief Review

Literature Review

Contact Info

Product

Resources

About