A Nose Gesture Interface Device: Extending Virtual Realities

1
A Nose Gesture Interface Device Extending
Virtual Realities
2
Saved the most important for last

• A Nose Gesture Interface Device Extending
  Virtual Realities
• Tyson R. Henry, Scott E. Hudson, Andrey K.
  Yeatts, Brad A. Myers, and Steven Feiner,
  Proceedings of UIST 91, November 11 - 13, 1991,
  Hilton Head, NC, pp. 65-68
• http//www.acm.org/pubs/citations/proceedings/uist
  /120782/p65-henry/

3
Some of the most important VR work ever published

• Had its own special session at UIST 91
• Reprinted in Presence (the main VR journal),
  April 1992.
• Will recreate the presentation here

4
A Nose Gesture Interface Device Extending
Virtual Realities

• Tyson Henry University of New Mexico
• Scott Hudson Carnegie Mellon
• Andrey Yeatts University of Arizona
• Brad Myers Carnegie Mellon
• Steven Feiner Columbia University
• at the University of Arizona in 1991

5
Motivation

• Current virtual reality systems are just too
  limited
• Goal improved sense of presence
• Extensions to other senses
• Full body interaction

6
Rhino-Virtual Realities

• The potential of the nose has been sorely
  neglected in previous systems
• To remedy this we have developed ...

7
The DATANOSE
8
Offers Support for True Multi-Modal Interaction

• Works with conventional graphical interfaces...

9
(No Transcript)
10
A New Suction Based Dragging Technique
Hoovering
11

• Also works with older (text based) interface
  styles...

12
(No Transcript)
13
Hardware Design

• The Early Prototypes

14
First Prototype

• Fully functional
• Exceeded all specs
• But unexpectedly did not gain user acceptance

15
Design iteration

• Next prototypes miniaturized the olfactory output
  system and explored new commercially appealing
  packaging...

16
Rabbit Nose PlatformWorked better, but
whiskers interfered with interaction
17
Next IterationDidnt work very well...
18
Pig Nose PlatformIssues with users squealing
19
Dog Nose PlatformDrooling problems...
20
This one didnt work at allSubjects had an
inexplicable urge to tell bad puns
21
After a few small modifications it worked
betterBut pun problem persisted
22

• The final prototype...

23
Groucho Marx Nose Platform
24
DATANOSE Features

• Full featured miniature olfactory I/O system
• Fully mobile operation

25
Works in the lab...
26
Down the hall...
27
To places mobile computing has never gone
before...
28
Advanced Interaction Techniques

• 3D Rotation Task
• True User-Centered Rotation

29
(No Transcript)
30
(No Transcript)
31
(No Transcript)
32
(No Transcript)
33
(No Transcript)
34
Interacting with Multiple Devices

• The DATANOSE works smoothly with conventional
  I/O devices...

35
Keyboard
36
Mouse
37
Valuators (Knobs)
38

• Also has great potential in computer supported
  cooperative work applications...

39
(No Transcript)
40

• Finally, can support fluid interaction with large
  data sets...

41
(No Transcript)
42
ApplicationsAn Example Virtual World

• Searched for an appropriate application domain...

43
ApplicationsAn Example Virtual World

• Implemented Dogs World
• A users view

44
(No Transcript)
45
(No Transcript)
46
(No Transcript)
47

• CSCW Extensions
• The Collaborative Dogs World...

48
(No Transcript)
49
A New Toolkit

• To avoid the high cost of developing
  rhino-interfaces, a new toolkit was developed
• SYSTEM
• An acronym standing for...

50
A New Toolkit

• To avoid the high cost of developing
  rhino-interfaces, a new toolkit was developed
• SYSTEM
• a System that reallY doeS creaTE user interfaces
  that have really nice featuMs

51
Uses The Seeheim Model

• A major advance in itself

52
More Important ...

• We have been able to answer the most important
  research question about the model...

53
Uses The Seeheim Model

• What is that little box at the bottom!?!

54
Important Discovery

• The Seeheim model works much better if you put
  everything in the little box
• An improved model...

55
Improved Model
56
The Final SMELL-HEIM Model
57
Another Major Advance

• A completely new approach to dialog management
• Did an extensive literature search
• Never been done before
• Will revolutionize UI software work

58
Another Major Advance

• A completely new approach to dialog management
• Did an extensive literature search
• Never been done before
• Will revolutionize UI software work
• Finite State Machine Controllers!

59
SYSTEM supports easy to use graphical editor for
FSM controllers
60
SYSTEM supports easy to use graphical editor for
FSM controllers
61
Usability Testing

• Significant new testing after the paper was
  submitted

62
User Testing Results
63
User Testing Results

• Both users really really liked it!

64
Future Work

• Extending to other body parts
• DATA ARM
• DATA EYEBALLS

65
(No Transcript)
66
Future Work (cont.)

• Extending to other body parts
• DATA FOOT
• DATA MOUTH
• Warning Our research shows that these devices
  should not be used together!

67

• Conclusion
• Overall a dramatic breakthrough in virtual
  research

68
Questions?
69
(No Transcript)