Newton Methods for Convolutional Neural Networks

A literature survey of matrix methods for data science

“…solving with the Hessian matrix in a Newton method. As a result the applicability of Newton-type schemes for the computation of W (j) and b (j) has received more attention with a strong focus on exploiting the structure of the Hessian matrix [32,61,275,47,227,271]. The computational complexity of neural networks is challenging on many levels.…”