ProFeel: Low Cost VisualHaptic Perceptualization of Protein StructureStructure Alignments

1
ProFeel Low Cost Visual-Haptic Perceptualization
of Protein Structure-Structure Alignments

• Marc Hansen
• University of California at Santa Cruz

2
Outline

• Background
• Motivation
• Theoretical Justification
• Obstacles
• Previous Research
• ProFeel
• Future Work

3
Background

• Definitions
• Data Perceptualization
• use of more than one of the senses for presenting
  information
• Haptic Rendering
• use of sense of touch (tactile and/or
  kinesthetic) to present information
• Force Feedback
• sensation of weight or resistance in a virtual
  world (Burdea 96)

4
Background (cont.)

• Pros of Haptic Rendering
• useful for those with visual impairments
• used with visualization
• disambiguate variables being visualized
• more engaging
• increase dimensionality

5
Background (cont.)

• Cons of Haptic Rendering
• annoying
• low spatial resolution
• absence of persistence

6
Motivation

• Increased accuracy
• Decreased time
• Sensory impedance mismatch
• Multivariate representation is difficult
• More engaging/fatigue resistant
• Lower cognitive workload
• Facilitate learning
• Increase perceived quality

7
Theoretical Justification

• Decreased reaction times for multisensory versus
  single sensory stimulus (Geilen et al. 1983)
• With more realistic stimulus, use more
  appropriate modality if several are present
  (Welch and Warren 1980)

8
Obstacles (Barriers to Entry)

• Price for haptic equipment
• Multisensory presentation parameters can clash
  rather than complement
• User training may be required
• Difficulty of developing haptic renderings
• No models for automatically mapping data to
  haptics

9
Previous Research

• Physical Object Metaphor in User Interfaces
• Multimodal User Interface System
• (Dufresne et al. 95)
• Automated User Interface Design
• (Blumenthal 90)

10
Previous Research (cont.)

• Multisensory Information Visualization
• Molecular modeling/docking (Brooks et al. 90)
• Fluid dynamics (Ogi et al. 96 )
• Navigation/piloting simulations (Haas 95)
• Bimodal data presentation (Bly 82,
• Hughes et al. 96, Hansen et al. 99)

11
ProFeel
12
ProFeel Development Environment

• Windows 95 (Direct-X)
• RasMol
• Logitech WingMan Force joystick
• Immersion
• I-Force Studio (for creating resource files)
• Feel Foundation Class

13
ProFeel Haptic Mapping

• secondary structure
• strand linear horizontal movement
• helix circular movement
• loop wriggling movement

14
ProFeel Haptic Mapping (cont.)

• polarity / Geiger counter
• low 4 Hz clicks
• medium 6.5 Hz clicks
• high 10 Hz clicks

15
ProFeel Haptic Mapping (cont.)

• exposure / resonance (25 Hz vibration)
• buried small amplitude
• partially buried medium amplitude
• exposed large amplitude

16
ProFeel Haptic Mapping (cont.)

• goodness of fit / temperature
• poor hot 100 Hz vibration
• medium warm 75 Hz vibration
• good cool 50 Hz vibration

17
Future Work

• Combine visualization, sonification, and haptic
  rendering
• Compare the effects of redundancy versus
  complimentarity
• Look for point of diminishing returns (how much
  sensory information can be used?)

18
Future Work (cont.)

• Other applications, e.g. data mining
• What are the effects of multimodal presentation
  on other performance measurements?
• learning and memory
• fatigue
• psychophysiological