Spektrogram assisted Søren Andreasen in creating an acoustic sequencer inside a camping caravan, displayed on the Copenhagen based electronic music festival STRØM 2014. The installation were based mainly on the use of Arduino boards and max/msp which controlled solenoids used as hammers inside the caravans cabinets. Relays where used to control the the water pump for the kitchen faucet and a vacuum cleaner - all elements in acoustical musical transformation of an original piece by danish composer Bjørn Svin.
Binaural sound production / synthesis build upon the idea of being able to recreate the experience of an auditory space, similar to how humans perceive distance and direction of auditory events in a sphere surrounding the listener. It possible to measure how individuals hear, and with this knowledge recreate an auditory scene, with correct placement of sources when listening on headphones. Headphones are mandatory for binaural production, since humans have two ears, and the combination of how one sources is perceived by both ears results in the correct perception of the auditory scene.
The direction and distance of the sources can be created using synthesis using software such as Ircam SPAT for max/msp or FLUX version of the same software as a VST.
The possibility of recreating an auditory scene with synthesis has many possible uses - since many people are using headphones pr. default in combination with their smart-devices, and the sources can be synthesised with the computational power of such devices.
The papaengine is an example of software which allow one to recreate binaural audio scenes on iOS devices.
An important parameter for obtaining the correct sensation of an auditory scene, is the incorporate head tracking in the headphones. The autonomous system will make our head turn back and forth slightly, if the listener becomes unsure of the direction of an audio source. The change of angle to the auditory source changes when the listeners turns his/her head, since the source stay fixed in space, but the listeners head is moving.
Binaural production strives to recreate the natural perception of direction and distance (even if used for artistic purposes), and one can therefore imagine that recreating the natural sensation of a fixed source in space, even though the head is turning, will assist in an improved sensation of space.
Louis Anglionin and I made a short demonstration of a home-build head tracking system, to test if the sensation would improve considerably. The answer is most definitely yes! Hopefully head tracking will be a default feature of consumer headphones.
spektrogram - in the lab