Institutionen för systemteknik (ISY)

The Application of an Oblique-Projected Landweber Method to a Model of Supervised Learning

Björn Johansson, Tommy Elfving, Vladimir Kozlov, Yair Censor, Per-Erik Forssén, Gösta Granlund
Mathematical and Computer Modelling
Volume 43, Number 7-8, Pages 892-909
April 2006

Abstract

This paper brings together a novel information representation model for use in signal processing and computer vision problems, with a particular algorithmic development of the Landweber iterative algorithm. The information representation model allows a representation of multiple values for a variable as well as expression of confidence. Both properties are important for effective computation using multi-level models, where a choice between models shall be implementable as part of the optimization process. It is shown that in this way the algorithm can deal with a class of high-dimensional, sparse, and constrained least-squares problems, which arise in various computer vision learning tasks, such as object recognition and object pose estimation. While the algorithm has been applied to the solution of such problems, it has so far been used heuristically. In this paper we describe the properties and some of the peculiarities of the channel representation and optimization, and put them on firm mathematical ground. We consider for the optimization a convexly-constrained weighted least-squares problem and propose for its solution a projected Landweber method which employs oblique projections onto the closed convex constraint set. We formulate the problem, present the algorithm and work out its convergence properties, including a rate-of-convergence result. The results are put in perspective of currently available projected Landweber methods. An application to supervised learning is described, and the method is evaluated in an experiment involving function approximation, as well as application to transient signals.

Keywords

Projected Landweber, preconditioner, nonnegative constraint, supervised learning, channel representation

Full Paper

Available on the science direct website.

---

Bibtex entry

@Article{jekcfg06,
  author = 	 {Bj\"orn Johansson and Tommy Elfving and Vladimir Kozlov and Yair Censor and Per-Erik Forss\'en and G\"osta Granlund},
  title = 	 {The Application of an Oblique-Projected Landweber Method to a Model of Supervised Learning},
  journal = 	 {Mathematical and Computer Modelling},
  year = 	 {2006},
  volume = 	 {43},
  number =       {7-8},
  issn =         {0895-7177},
  pages = 	 {892--909},
  month = 	 {April}
}