Why deeper is great

08 Jun 2020

越深,可以得到越复杂的function;

再浅层网络中,两个neurons产生一种线段;但再深层中

if K is width,H is depth,

we can have at least $K^H$ piesces.

image-20200514084819795

越靠近input的layer越重要

image-20200514085300144

(上图表现各层对noise的敏感度,越往后noise影响越小;