-
f Experimental phenomenology in the development of a colocative audio-visual display
- Source: Soundtrack, The, Volume 10, Issue 1, Apr 2017, p. 19 - 42
-
- 01 Apr 2017
Abstract
This article describes the methodological background for perceptual studies conducted on the author’s Pixelphonic display – a system that colocates visuals and their associated sounds in moving image displays. The concept of Pixelphonics is to add a spatial complement to synchronized sound, so that audio can now be in place with its image, in addition to being in time with it. Methods grounded in experimental phenomenology are used to better understand the general perceptual response to the system, which works by attaching a 2D array of audio exciters to the backside of a screen, connected to signal distribution and software. Findings show the general efficacy of the system and adequate perceptual resolution for further development and refinement of the display. One experiment is selected for discussion to illustrate the approach.