I describe a very deep learning neural network (VDNN) with 250 layers in a recent article. You can check it out at https://machinelearningrecipes.com/blog/post/1730318/very-deep-neural-networks-explained-in-40-seconds