Sound, alone or in combination with visual imaging techniques, offers a powerful means of transmitting information. It can significantly increase the bandwidth of the human/computer interface. This project is about sound: sound synthesis, rendering complex data sets in sounds, and visualizing sounds in a virtual-reality environment.
The Scientific Sonification project is based on the concept that sounds are dynamic events which evolve in a multidimensional space. Each sound is a superposition of component waves (partials), whose evolution is determined by a set of static and dynamic control parameters. By defining a mapping from the data space to the sound space, we create a formalism for the faithful rendition of data in sounds.
Our research focuses on establishing coordinate systems in sound space that optimize the aural perception of given data sets and their salient features. The data sets are taken from large-scale scientific computations; so far, we have rendered data from computational chemistry, materials science, and computer science.
DIASS currently functions as part of the M4C synthesis language developed at the University of Illinois at Urbana/Champaign. The code, written in C, is designed for a distributed-memory environment; the implementation uses the standard MPI message-passing library. A C++ version is under development.
The figure above shows an image of nine sounds created with DIASS and visualized with M4CAVE on a CAVE simulator. The component waves (partials) in each sound are represented by spheres; the diameter of a sphere is proportional to the amplitude of the partial, and its height is a measure of the frequency. The grid in the background serves to indicate the frequency spectrum; it spans eight octaves, corresponding approximately to the range of a piano. The colors of the spheres reflect the amount of reverberation in each partial.
DIASS and M4CAVE are part of a comprehensive Environment for Music Composition, a software system that includes, besides DIASS and M4CAVE, programs for computer-assisted composition and automatic music notation.
The following recent publications are available on the web:
Hans G. Kaper, MCS Division
Argonne National Laboratory
Argonne, IL 60439
Sever Tipei, School of Music
University of Illinois at Urbana/Champaign
Urbana, IL 61801
[ MCS Division - Applied Mathematics | MCS Division - Research | MCS Division | Hans G. Kaper | Sever Tipei ]
Last update: October 21, 1998 (HGK)