TR2018-206

Time-Delay Momentum: A Regularization Perspective on the Convergence and Generalization of Stochastic Momentum for Deep Learning

    •  Zhang, Z., Xu, W., Sullivan, A., "Time-Delay Momentum: A Regularization Perspective on the Convergence and Generalization of Stochastic Momentum for Deep Learning", arXiv, March 2018.
      BibTeX arXiv
      • @article{Zhang2018mar,
      • author = {Zhang, Ziming and Xu, Wenju and Sullivan, Alan},
      • title = {Time-Delay Momentum: A Regularization Perspective on the Convergence and Generalization of Stochastic Momentum for Deep Learning},
      • journal = {arXiv},
      • year = 2018,
      • month = mar,
      • url = {https://arxiv.org/abs/1903.00760}
      • }
  • Research Areas:

    Artificial Intelligence, Machine Learning

Abstract:

In this paper we study the problem of convergence and generalization error bound of stochastic momentum for deep learning from the perspective of regularization.