Subgroup Preference Neural Network

Abstract

Subgroup label ranking aims to rank groups of labels using a single ranking model, is a new problem faced in preference learning. This paper introduces the Subgroup Preference Neural Network (SGPNN) that combines multiple networks have different activation function, learning rate, and output layer into one artificial neural network (ANN) to discover the hidden relation between the subgroups’ multi-labels. The SGPNN is a feedforward (FF), partially connected network that has a single middle layer and uses stairstep (SS) multi-valued activation function to enhance the prediction’s probability and accelerate the ranking convergence. The novel structure of the proposed SGPNN consists of a multi-activation function neuron (MAFN) in the middle layer to rank each subgroup independently. The SGPNN uses gradient ascent to maximize the Spearman ranking correlation between the groups of labels. Each label is represented by an output neuron that has a single SS function. The proposed SGPNN using conjoint dataset outperforms the other label ranking methods which uses each dataset individually. The proposed SGPNN achieves an average accuracy of 91.4% using the conjoint dataset compared to supervised clustering, decision tree, multilayer perceptron label ranking and label ranking forests that achieve an average accuracy of 60%, 84.8%, 69.2% and 73%, respectively, using the individual dataset.

Preference Net: Image Recognition using Ranking Reduction to Classification

“…Preference Neuron are a multi-valued neurons uses a PSS, that is the positive part of the SS activation function introduced by subgroup preference neural network [13] as an activation function. PSS function has a single output; however, PN…”

“…The PNN is fully connected to multiple-valued neurons and a single-hidden layer proposed by ELgharabawy [12,13].…”

“…A multi-valued activation function has been proposed by Aizenberg [4] using convex shape to support multi-values and complex numbers neural network. In addition, Moraga [41] Preference neural network (PNN ) was introduced by Elgharabawy [13] as the first ANN for ranking using spearman objective function and new smooth staircase (SS) activation function designed to accelerate the ranking by producing multi preference values [13]. The deep neural network (DNN ) is introduced for object ranking to solve document retrieval problems [50].…”