See our new website at research.ict.csiro.au

Audio Display and Interaction

This page reports on work carried out from 2002 - 2004.

Several projects explored the use of audio including spatialised audio display, audio display of information and real-time synthesised audio. Typical demonstrations of this work showed it integrated into a richer scenario such as the one shown in the accompanying images and video. This work uses a digital model of a silver artefact (a nineteenth century silver snuffbox) from the Australian Museum’s collection and tells part of the story of the voyage of an early passenger ship from Britain to Australia in 1854.

Download 102KB large image. Details of silver museum artefact. Real-time interaction with the haptic device generates tapping and scratching sounds appropriate for the shape and material of the artefact and the actual speed or force applied through the haptic stylus.  At the same time the person exploring this virtual object can feel the indentations of the engraving.
Download 141KB large image. Audio display is used as part of a multi-modal user experience to enhance the value of a museum story, the voyage of an early passenger sailing ship from Britain to Australia. When the silver box is opened with the haptic stylus the names of the passengers tumble out.
Download 691KB large image. Haptic audio interaction with a virtual museum artefact.