On the Number of Linear Regions of Convolutional Neural Networks With Piecewise Linear Activations.

One fundamental problem in deep learning is understanding the excellent performance of deep Neural Networks (NNs) in practice. An explanation for the superiority of NNs is that they can realize a large family of complicated functions, i.e.