NONLINEAR ALGEBRA IN AN ACORN: With Applications to Deep Learning

A simple algorithm for solving a set of nonlinear equations by matrix algebra has been discovered recently — first by transforming them into an equivalent matrix equation and then finding the solution analytically in terms of the inverse matrix of this equation. With this newly developed ACORN (Adaptive Constrained Optimal Robust Nonlinear) algorithm, it is possible to minimize the objective function [constructed from the functions in the nonlinear set of equations] without computing its de...