Sonification Data Analysis Tool Using JavaSound by Anton Schertenleib

1
Sonification Data Analysis Tool Using
JavaSoundby Anton Schertenleib Robert Candey
http//spdf.gsfc.nasa.gov/research/sonification
2
Overview

• Introduction
• Definition Soni-/ Audification
• Benefits Of Auditory Display
• Example Of Use
• ICAD
• Sonification Tool xSonify (Prototype)
• Sonification Process
• Technical Background
• Demonstration Of xSonify

3
Definition Sonification

• Three groups for Sonification
• Iconic Sonification
• Direct Conversion Audification
• Musical Sonification
• John M. Keller, 2003, Private Communication

4
Definition Sonification

• Example
• A church bell as the simplest
• form of Sonification.
• The amount of peals conveys
• information about the current
• time.

5
Definition Audification

• Example
• Cassini spacecraft crossed the bow shock of
  Saturn
• Cassinis Radio and Plasma Wave Science (RPWS)
  instrument

http//www-pw.physics.uiowa.edu/space-audio/cassin
i/bow-shock/
6
Benefits Of Auditory Display

• Uncovering Patterns
• Identifying New Phenomena
• Improving data exploration
• Analyzing Complex, Rapidly Or Temporally Changing
  Data
• Monitoring Data While Looking At Something Else
• Improving Visual Perception When Accompanied By
• Audio Cues

7
Example Of Use
Voyager 2 Displayed Micrometeorids As
Hailstorm Sounds When Traversing Saturns
rings.
8
ICAD
ICAD - International Community For Auditory
Display Founded 1992, Santa Fe,
CA http//www.icad.org/
9
Sonification Attributes
10
Sonification Process
Data Pipeline
Sylvain Daude, Laurence Nigay, 2003, Design
Process For Auditory Interfaces
11
Sonification Tool xSonify (Prototype)

• Facts
• Java 1.5
• Java Sound API / MIDI
• WebStart Technology
• Speech Support
• 3 Different Sonification Modes

12
Technical Background
13
Technical Background
14
Demonstration Of xSonify

• Demo I
• Simple Numerical Data
• 40 Values
• Values From 0 To 10 Repeating Four Times
• Demo II
• Data From Cluster Spacecrafts
• 1500 Values
• Values Show Display

15
Demonstration Enhanced Of xSonify
4 Cluster Satellites Over North Pole
16
Cluster 1 B
Cluster 2 B
Cluster 3 B
Cluster 4 B
Cluster SP B
17
Demonstration Of xSonify

• Demo I
• Simple Numerical Data
• 40 Values
• Values From 0 To 10 Repeating Four Times
• Demo II
• Data From Cluster Spacecrafts
• 1500 Values
• Values Show Display

18
Thank You For Your Attention
http//spdf.gsfc.nasa.gov/research/sonification a
nton_at_mail630.gsfc.nasa.gov robert.m.candey_at_nasa.go
v