Deep Linear Networks: Open Problems

This article is about open problems in deep neural networks. Part 5 of my notes on implicit regularisation in Deep Linear Networks.