Summary
Residual connections smoothen the loss landscape of neural networks (1).
Figures
Ref (1)
1.
Li H, Xu Z, Taylor G, Studer C, Goldstein T. Visualizing the Loss Landscape of Neural Nets. Advances in Neural Information Processing Systems. 2018;31. Available from: https://proceedings.neurips.cc/paper/2018/hash/a41b3bb3e6b050b6c9067c67f663b915-Abstract.html