An Evolutionary Neuron Model with Dendritic Computation for Classification and Prediction

Tang, Cheng; Song, Zhenyu; Tang, Yajiao; Tang, Huimei; Wang, Yuxi; Ji, Junkai

doi:10.1007/978-3-030-84522-3_2

Cited by 1 publication

(1 citation statement)

References 41 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Simultaneously, the risk of dendrites containing synapses that fall into saddle points increases, which makes it difficult for the DNM to solve problems containing too many features [46]. Previous studies have investigated ways to mitigate synapses falling into saddle points; however, the main focus of these studies was learning algorithms [47], [48], [49]. Although the DNM performs well when handling traditional multi-input single-output tasks, it is difficult for a single DNM to handle more complex tasks, e.g., multi-output problems.…”

Section: Dendritic Neuron Model Analysismentioning

confidence: 99%

Dendritic Neural Network: A Novel Extension of Dendritic Neuron Model

Tang,

Ji,

Todo

et al. 2024

IEEE Trans. Emerg. Top. Comput. Intell.

Self Cite

View full text Add to dashboard Cite

The conventional dendritic neuron model (DNM) is a single-neuron model inspired by biological dendritic neurons that has been applied successfully in various fields. However, an increasing number of input features results in inefficient learning and gradient vanishing problems in the DNM. Thus, the DNM struggles to handle more complex tasks, including multiclass classification and multivariate time-series forecasting problems. In this study, we extended the conventional DNM to overcome these limitations. In the proposed dendritic neural network (DNN), the flexibility of both synapses and dendritic branches is considered and formulated, which can improve the model's nonlinear capabilities on high-dimensional problems. Then, multiple output layers are stacked to accommodate the various loss functions of complex tasks, and a dropout mechanism is implemented to realize a better balance between the underfitting and overfitting problems, which enhances the network's generalizability. The performance and computational efficiency of the proposed DNN compared to state-of-theart machine learning algorithms were verified on 10 multiclass classification and 2 high-dimensional binary classification datasets. The experimental results demonstrate that the proposed DNN is a promising and practical neural network architecture.

show abstract