Neural Networks Are Essentially Polynomial Regression (2018)
You may be interested in my new arXiv paper, joint work with Xi Cheng, an undergraduate at UC Davis (now heading to Cornell for grad school); Bohdan Khomtchouk, a post doc in biology at Stanford; and Pete Mohanty, a Science, Engineering & Education Fellow in statistics at Stanford. The paper is of a provocative nature, and we welcome feedback. A summary of the paper is:
Much work remains to be done (see paper), but our results so far are very encouraging.