Holographic associative memory

Holographic Associative Memory (HAM) Is a form of information storage where two pieces of information are saved and retrieved by associating them with one another in a pattern such that any part of the pattern contains them both and either piece can be used to retrieve the other. It has its roots in the principles of Holography. Holograms are made by using two beams of light, called a "reference beam" and an "object beam". They produce a pattern on the film that contains them both. Afterwards, by reproducing the reference beam, the hologram recreates a visual image of the original object. In theory, one could use the object beam to do the same thing: reproduce the original reference beam. In HAM, the pieces of information act like the two beams. Each can be used to retrieve the other from the pattern.

Holographic Neural Model

The connectionist belief with Artificial Intelligence maintains that associative processing may be accomplished in the construction of multicellular structures, which in some manner mimic the interconnectivity of biological neuron cells. The holographic model of neurological function takes a different viewpoint; maintaining that more powerful cognitive properties may be obtained within simpler structures mimicking the morphology of individual cells, in particular stellate and pyramidal neurons. Furthermore in holographic paradigm a large capacity for learning, memory and attention may be observed from relatively general transforms, realizing properties implicit within manifolds constructed from a more universal scalar (i.e. the complex number).[1] Of particular interest is the complex product operation whereby a coincident phase rotation occurs for any set of complex numbers defining a path from the origin to a point in Argand plane. This commutative aspect is used within the holographic neural model to facilitate enfolding of information.[1]


Definition

HAM is part of the family of associative (stimulus-response) memories, where information is mapped onto the phase orientation of complex numbers. It can be considered as a complex valued artificial neural network. The holographic associative memory exhibits some remarkable characteristics. Holographs have been shown to be effective for associative memory tasks, generalization, and pattern recognition with changeable attention. Ability of dynamic search localization is central to natural memory. For example, in visual perception, humans always tend to focus on some specific objects in a pattern. Humans can effortlessly change the focus from object to object without requiring relearning. HAM provides a computational model which can mimic this ability by creating representation for focus. At the heart of this new memory lies a novel bi-modal representation of pattern and a hologram-like complex spherical weight state-space. Besides the usual advantages of associative computing, this technique also has excellent potential for fast optical realization because the underlying hyper-spherical computations can be naturally implemented on optical computations.

It is based on principle of information storage in the form of stimulus-response patterns where information is presented by phase angle orientations of complex numbers on a Riemann surface.[2] A very large number of stimulus-response patterns may be superimposed or "enfolded" on a single neural element. Stimulus-response associations may be both encoded and decoded in one non-iterative transformation. The mathematical basis requires no optimization of parameters or error backpropagation, unlike connectionist neural networks. The principal requirement is for stimulus patterns to be made symmetric or orthogonal in the complex domain. HAM typically employs sigmoid pre-processing where raw inputs are orthogonalized and converted to Gaussian distributions.

Principles of operation

1) Stimulus-response associations are both learned and expressed in one non-iterative transformation. No backpropagation of error terms or iterative processing required.

2) The method forms a non-connectionist model in which the ability to superimpose a very large set of analog stimulus-response patterns or complex associations exists within the individual neuron cell.

3) The generated phase angle communicates response information, and magnitude communicates a measure of recognition (or confidence in the result).

4) The process permits a capability with neural system to establish dominance profile of stored information, thus exhibiting a memory profile of any range - from short-term to long-term memory.

5) The process follows the non-disturbance rule, that is prior stimulus-response associations are minimally influenced by subsequent learning.

6) The information is presented in abstract form by a complex vector which may be expressed directly by a waveform possessing frequency and magnitude. This waveform is analogous to electrochemical impulses believed to transmit information between biological neuron cells.

gollark: Well, what I actually need is "I want this, I have this, how do I make this?".
gollark: Who are you talking to?
gollark: Aeson makes it really really easy.
gollark: A generalized one would allow me to feed in a generic JSON thing and the ID of something to craft and get it out.
gollark: That's not very extensible. At all.

See also

Bibliography

References
  1. Sutherland J.G. (1994) "The Holographic Cell. A Quantum Perspective". in Plantamura V.L. et al. ed. Frontier Decision Support Concepts. John Wiley & Sons, New York. ISBN 0-471-54772-7.
  2. Sutherland, John G. (1 January 1990). "A holographic model of memory, learning and expression". International Journal of Neural Systems. 01 (3): 259–267. doi:10.1142/S0129065790000163.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.