Institutionen för systemteknik (ISY)

HiperLearn: A High Performance Learning Architecture

Gösta Granlund, Per-Erik Forssén, Björn Johansson
LiTH-ISY-R-2409
January 2002

Abstract

A new architecture for learning systems has been developed. A number of particular design features in combination result in a very high performance and excellent robustness. The architecture uses a monopolar channel information representation. The channel representation implies a partially overlapping mapping of signals into a higher-dimensional space, such that a flexible but continuous restructuring mapping can be made. The high-dimensional mapping introduces locality in the information representation, which is directly available in wavelets or filter outputs. Single level maps using this representation can produce closed decision regions, thereby eliminating the need for costly back-propagation. The monopolar property implies that data only utilizes one polarity, say positive values, in addition to zero, allowing zero to represent no information. This leads to an efficient sparse representation.

The processing mode of the architecture is association where the mapping of feature inputs onto desired state outputs is learned from a representative training set. The sparse monopolar representation together with locality, using individual learning rates, allows a fast optimization, as the system exhibits linear complexity. Mapping into multiple channels gives a strategy to use confidence statements in data, leading to a low sensitivity to noise in features. The result is an architecture allowing systems with a complexity of some hundred thousand features described by some hundred thousand samples to be trained in typically less than an hour. Experiments that demonstrate functionality and noise immunity are presented. The architecture has been applied to the design of hyper complex operations for view centered object recognition in robot vision.

---

Bibtex entry

@TechReport{gfj01,
  author = 	 {G\"osta Granlund and Per-Erik Forss\'en and 
                  Bj\"orn Johansson},
  title = 	 {{H}iper{L}earn: {A} High Performance Learning Architecture},
  institution =  {Dept. EE, Link\"oping University},
  year = 	 {2002},
  number = 	 {LiTH-ISY-R-2409},
  address = 	 {SE-581 83 Link\"oping, Sweden},
  month = 	 {January}
}