Additive Update Algorithm for Nonnegative Matrix Factorization

Hien, Tran Dang; Tuan, Van Phu; At, Pham Van

doi:10.48550/arxiv.1209.5647

Cited by 1 publication

(1 citation statement)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…where α and β are the step sizes. MU algorithm can also be viewed as the gradient descent algorithm [18] with iteration dependent or adaptive step size α k and β k defined for updating matrices W and H respectively as:…”

Section: Repeatmentioning

confidence: 99%

Novel Algorithms Based on Majorization Minimization for Nonnegative Matrix Factorization

2019

View full text Add to dashboard Cite

Matrix decomposition is ubiquitous and has applications in various fields like speech processing, data mining and image processing to name a few. Under matrix decomposition, nonnegative matrix factorization is used to decompose a nonnegative matrix into a product of two nonnegative matrices which gives some meaningful interpretation of the data. Thus, nonnegative matrix factorization has an edge over the other decomposition techniques. In this paper, we propose two novel iterative algorithms based on Majorization Minimization (MM)-in which we formulate a novel upper bound and minimize it to get a closed form solution at every iteration. Since the algorithms are based on MM, it is ensured that the proposed methods will be monotonic. The proposed algorithms differ in the updating approach of the two nonnegative matrices. The first algorithm-Iterative Nonnegative Matrix Factorization (INOM) sequentially updates the two nonnegative matrices while the second algorithm-Parallel Iterative Nonnegative Matrix Factorization (PARINOM) parallely updates them. We also prove that the proposed algorithms converge to the stationary point of the problem. Simulations were conducted to compare the proposed methods with the existing ones and was found that the proposed algorithms performs better than the existing ones in terms of computational speed and convergence.

show abstract

Section: Repeatmentioning

confidence: 99%