Extracting core questions in community question answering based on particle swarm optimization

Abstract

Purpose A large number of questions are posted on community question answering (CQA) websites every day. Providing a set of core questions will ease the question overload problem. These core questions should cover the main content of the original question set. There should be low redundancy within the core questions and a consistent distribution with the original question set. The paper aims to discuss these issues. Design/methodology/approach In the paper, a method named QueExt method for extracting core questions is proposed. First, questions are modeled using a biterm topic model. Then, these questions are clustered based on particle swarm optimization (PSO). With the clustering results, the number of core questions to be extracted from each cluster can be determined. Afterwards, the multi-objective PSO algorithm is proposed to extract the core questions. Both PSO algorithms are integrated with operators in genetic algorithms to avoid the local optimum. Findings Extensive experiments on real data collected from the famous CQA website Zhihu have been conducted and the experimental results demonstrate the superior performance over other benchmark methods. Research limitations/implications The proposed method provides new insight into and enriches research on information overload in CQA. It performs better than other methods in extracting core short text documents, and thus provides a better way to extract core data. The PSO is a novel method used for selecting core questions. The research on the application of the PSO model is expanded. The study also contributes to research on PSO-based clustering. With the integration of K-means++, the key parameter number of clusters is optimized. Originality/value The novel core question extraction method in CQA is proposed, which provides a novel and efficient way to alleviate the question overload. The PSO model is extended and novelty used in selecting core questions. The PSO model is integrated with K-means++ method to optimize the number of clusters, which is just the key parameter in text clustering based on PSO. It provides a new way to cluster texts.

[Retracted] Evaluation Model of Physical Education Effect: On the Application of Radial Basis Function‐Particle Swarm Optimization Neural Network (RBFNN‐PSO)

“…Because of the lack of global optimization ability in neural network method, it is necessary to optimize. Li et al [ 4 ] put forward a combination of model and k -means++ method to optimize the key parameters of clustering, which provides a new method for text clustering. Shuai et al [ 5 ] proposed a personal credit evaluation method based on RBFNN-PSO.…”

Environmental Cost Control of Manufacturing Enterprises via Machine Learning under Data Warehouse

“…PSO is a random search algorithm based on group collaboration inspired by birds foraging [25]. The algorithm has the characteristics of the clear concept, easy implementation, and fast convergence speed, and is widely adopted in the field of decision-making optimization [26].…”

Teaching and Training Methods of Table Tennis in Colleges and Universities at the time of Big Data (BD)

“…It reveals that our epoch is formed by the supersession of sundry data stream(DS). On account of the arrival of the message age, all people are linking up with others and rapping off through smart facilities through Internet, hence they are huge DS running alternately every day [2]. hence in this epoch, the building of iptables is very indispensable, and is prepreerence thing of fail-safe system.…”