Audio and Tactile Interface Design Guidelines

1
Audio and Tactile Interface Design
Guidelines Chad Thornton Tad Hirsch Asim
Smailigic Francine Gemperle Anthorny Kolb
Carnegie Mellon - ICES Interaction Design Studio
February 7, 2003
2
CMU - ICES ID PDG
Project Overview
2 of 22
Duration 1 Year, ending February 2003 Foci
Audio and Tactile Interfaces Objective Develop
Design Guidelines for audio and tactile
interfaces
3
CMU - ICES ID PDG
Timeline
3 of 22
Feb 13 Mar 31 Jun 30
Sept 30 Dec 31
Feb 7 - 28
Literature Survey
Aug 15
Feb 2
Cost /Benefit Analysis
Prototype
Iterations
Evaluation
ICAD
Writing
Tactile Audio
Literature Survey
Prototype
Evaluation
Writing
Kickoff Deliver Report Deliver Demo
Deliver Report Deliver
Final Report
4
CMU - ICES ID PDG
Motivation
4 of 22

• Mobile and Wearable Product Space
• Users need eyes/hands free access to information
• Multitasking demands multisensory interfaces
• Non visual interfaces enable smaller products

5
CMU - ICES ID PDG
Approach
5 of 22
1. Distribute cognitive load by splitting
information display across senses 2. Building
Blocks approach
6
Audio Interface Prototypes and Experiments
February 7, 2003
7
CMU - ICES ID PDG
Introduction
7 of 22
Approaching Sound A Building Blocks
Approach Designing the Auditory
Environment Designing the Interactions Findings Su
mmary
8
CMU - ICES ID PDG
Approaching Sound
8 of 22
Research Existing Knowledge Primary - Research
on Auditory Interfaces - Psychoacoustics Second
ary - Sound Design - Music - Visual Design -
Products and Applications
9
CMU - ICES ID PDG
Approaching Sound
9 of 22
10
CMU - ICES ID PDG
A Building Blocks Approach
8 of 22
How to communicate to designers? What we found -
Detailed research on auditory interfaces -
Application-specific examples - Prescriptive
approaches Building Blocks - Identify common
interaction design problems - Design and
evaluate several solutions for each
1. Progress Indicator
2. User Focus
11
CMU - ICES ID PDG
Designing the Auditory Environment
10 of 22

Building Block 1 Progress Indicator - The
Scenario - Three solutions
12
CMU - ICES ID PDG
Designing the Auditory Environment
10 of 22

Creating - Recording - Synthesizing -
Editing - Making it dynamic
13
CMU - ICES ID PDG
Designing the Auditory Environment
11 of 22
Triggering and Spatializing - Using Max/MSP -
Mac-based - Full-featured graphical programming
music media environment - Proven reliable in
research performance - Strong support
community - Lots of patches - Used SPAT to
spatialize sound around a listener - Created
functions to manipulate sounds in interesting
ways - Movement - Filter - Interaction
14
(No Transcript)
15
(No Transcript)
16
(No Transcript)
17
CMU - ICES ID PDG
Designing for Interaction
15 of 22

• Building Block 2 Focus
• - Hardware control of spatialization
• - Indicating Focus Position or Filter
• - Rotation Dynamics Fluid or Discrete

18
CMU - ICES ID PDG
Findings
16 of 22

• Testing the abilities of the HRTF
• - Localization
• - One, several sounds
• - Movement
• - Distance and elevation
• Progress Indicator
• - Movement
• - Sound types
• - Aesthetics
• Focus
• - Position vs. Filter
• - Discrete vs. Fluid

19
CMU - ICES ID PDG
Summary
17 of 22

• Codifying this research
• - Paper submitted to ICAD
• Design Guidelines for Spatial Audio
• - Design Space (context, spatial)
• - Sounds (type, elements, aesthetics)
• - Movement
• - Focus
• - Interaction

20
Tactile Display
February 7, 2003
21
CMU - ICES ID PDG
Summary
19 of 22

• Experimental Prototypes
• Spatial sequencing of tactile vibrations
• Shapes
• Melodies

22
CMU - ICES ID PDG
Tactile Display Guidelines
20 of 22

• Tactile Display Guidelines
• Placement
• Tactors (tactile stimulators)
• Tactor Arrays
• Tactile Icons
• Applications

23
CMU - ICES ID PDG
Final Delivery
21 of 22
Design Guidelines Documents 2/28/03  Spatial
Audio Wearable Tactile Request a copy Bound
report with a CD containing the .pdf file and
sample sounds. On file at PDG, Online Demo
during break
24
Thank you!
February 7, 2003