Visual representation of spatiotemporal structure
by , , , ,
Abstract:
The processing and representation of motion information is addressed from an integrated perspective comprising low- level signal processing properties as well as higher-level cognitive aspects. For the low-level processing of motion information we argue that a fundamental requirement is the existence of a spatio-temporal memory. Its key feature, the provision of an orthogonal relation between external time and its internal representation, is achieved by a mapping of temporal structure into a locally distributed activity distribution accessible in parallel by higher-level processing stages. This leads to a reinterpretation of the classical concept of `iconic memory' and resolves inconsistencies on ultra-short-time processing and visual masking. The spatial-temporal memory is further investigated by experiments on the perception of spatio-temporal patterns. Results on the direction discrimination of motion paths provide evidence that information about direction and location are not processed and represented independent of each other. This suggests a unified representation on an early level, in the sense that motion information is internally available in form of a spatio-temporal compound. For the higher-level representation we have developed a formal framework for the qualitative description of courses of motion that may occur with moving objects.
Reference:
Visual representation of spatiotemporal structure (Kerstin Schill, Christoph Zetzsche, Wilfried Brauer, A. Eisenkolb, A. Musto), In Human Vision and Electronic Imaging III (Bernice E. Rogowitz, Thrasyvoulos N. Pappas, eds.), SPIE-Intl Soc Optical Eng, 1998.
Bibtex Entry:
@InProceedings{Schill1998,
  author    = {Kerstin Schill and Christoph Zetzsche and Wilfried Brauer and A. Eisenkolb and A. Musto},
  title     = {Visual representation of spatiotemporal structure},
  booktitle = {Human Vision and Electronic Imaging {III}},
  year      = {1998},
  editor    = {Bernice E. Rogowitz and Thrasyvoulos N. Pappas},
  month     = {jul},
  publisher = {{SPIE}-Intl Soc Optical Eng},
  abstract  = {The processing and representation of motion information is addressed from an integrated perspective comprising low- level signal processing properties as well as higher-level cognitive aspects. For the low-level processing of motion information we argue that a fundamental requirement is the existence of a spatio-temporal memory. Its key feature, the provision of an orthogonal relation between external time and its internal representation, is achieved by a mapping of temporal structure into a locally distributed activity distribution accessible in parallel by higher-level processing stages. This leads to a reinterpretation of the classical concept of `iconic memory' and resolves inconsistencies on ultra-short-time processing and visual masking. The spatial-temporal memory is further investigated by experiments on the perception of spatio-temporal patterns. Results on the direction discrimination of motion paths provide evidence that information about direction and location are not processed and represented independent of each other. This suggests a unified representation on an early level, in the sense that motion information is internally available in form of a spatio-temporal compound. For the higher-level representation we have developed a formal framework for the qualitative description of courses of motion that may occur with moving objects.},
  doi       = {10.1117/12.320104},
  url       = {10.1117/12.320104">http://dx.doi.org/10.1117/12.320104},
}