MAGIC Gaze

1
MAGIC Gaze

• Semester Project Summer 2004
• by Luzian Wild

2
Introduction

• What is MAGIC Gaze?
•  Manual And Gaze Input Cascaded 
• What is the use of it?
• Eye as additional input
• Combined with manual input because eye can only
  perform pointing

3
Contents

• Project Goals
• Used Hardware
• Part I Gaze Driver
• Part II Gaze augmented control of a 3D scene
• Implementation
• Functions
• Conclusion

4
Project Goals

• Develop a combined eye and motion tracking
  driver in collaboration with Sébastien Dupré
• Use the gaze to control a 3D virtual environment

5
Used Hardware

• ISCAN VisionTrak eye tracker
• MotionStar magnetic tracker

6
Part I Gaze Driver

• Reads data from the two trackers
• Calculates the gaze/screen incersection
• Advanced calibration tool
• Integrates the gaze data as smart proxy

7
Part II Gaze augmented control of a 3D scene

• Virtual environment VHD on Linux
• Hangar with 2 virtual humans
• Python for control
• Existing control layers, 2 concepts
• Puppet Actions for an object
• Ghost Script that possesses and controls a
  puppet.
• Gaze application is a ghost

8
Part II Implementation

• Python thread to
• Read and parse data from network
• Update values 50-100 times per sec.
• Manual interaction with Gamepad
• 2nd Python thread for Gamepad
• 3rd Python thread for direct gaze interaction
• Pointer Red ball

9
Part II Functions

• Direct gaze interaction
• Look at a human ? he winks
• Look at the door button ? door opens
• Manually controlled interaction
• Possess a human
• Walk to a position
• Combined Keep following the gaze

10
Part II
11
Conclusion

• Project goals achieved
• Gaze tracking driver
• Gaze augmented control of a virtual environment
• Project was very interesting, high gain of new
  knowledge

12
MAGIC Gaze - THE END

• Thank you for your attention
• Luzian Wild, 24 June 2004