TR2018-206

Time-Delay Momentum: A Regularization Perspective on the Convergence and Generalization of Stochastic Momentum for Deep Learning


    •  Zhang, Z., Xu, W., Sullivan, A., "Time-Delay Momentum: A Regularization Perspective on the Convergence and Generalization of Stochastic Momentum for Deep Learning", arXiv, March 2019.
      BibTeX Download PDF
      • @techreport{MERL_TR2018-206,
      • author = {Zhang, Z. and Xu, W. and Sullivan, A.},
      • title = {Time-Delay Momentum: A Regularization Perspective on the Convergence and Generalization of Stochastic Momentum for Deep Learning},
      • institution = {MERL - Mitsubishi Electric Research Laboratories},
      • address = {Cambridge, MA 02139},
      • number = {TR2018-206},
      • month = mar,
      • year = 2019,
      • url = {http://www.merl.com/publications/TR2018-206/}
      • }
  • MERL Contacts:
  • Research Areas:

    Artificial Intelligence, Machine Learning


In this paper we study the problem of convergence and generalization error bound of stochastic momentum for deep learning from the perspective of regularization.