TR2018-072

LMKL-Net: A Fast Localized Multiple Kernel Learning Solver via Deep Neural Networks


    •  Zhang, Z., "LMKL-Net: A Fast Localized Multiple Kernel Learning Solver via Deep Neural Networks", arXiv, July 12, 2018.
      BibTeX arXiv
      • @article{Zhang2018jul,
      • author = {Zhang, Ziming},
      • title = {LMKL-Net: A Fast Localized Multiple Kernel Learning Solver via Deep Neural Networks},
      • journal = {arXiv},
      • year = 2018,
      • month = jul,
      • url = {https://arxiv.org/abs/1805.08656}
      • }
  • Research Areas:

    Artificial Intelligence, Computer Vision, Machine Learning

Abstract:

In this paper we propose solving localized multiple kernel learning (LMKL) using LMKL-Net, a feedforward deep neural network. In contrast to previous works, as a learning principle we propose parameterizing both the gating function for learning kernel combination weights and the multiclass classifier in LMKL using an attentional network (AN) and a multilayer perceptron (MLP), respectively. In this way we can learn the (nonlinear) decision function in LMKL (approximately) by sequential applications of AN and MLP. Empirically on benchmark datasets we demonstrate that overall LMKL-Net can not only outperform the state-of-theart MKL solvers in terms of accuracy, but also be trained about two orders of magnitude faster with much smaller memory footprint for large-scale learning.