Augmented Reality

1
Augmented Reality

• MARE Multi-user Augmented Reality Environment
  on Real Table Setup
• Raphael Grasset
• Jean-Dominique GascueliMAGIS, France

iMAGIS is a joint project between
CNRS,INRIA,INPG and UJF
2
Motivations of our Research

• Purpose real collaborative situation
  (discussion, meeting, project review..).

NEED DIRECT 3D Visualization, Interaction..
Buscher00

• Applications scientific visualization,
  architecture, urban planning, game..

• No satisfactory solutions (Desktop Computer,
  CAVE, Responsive Workbench)

3
Our Multi-user AR Environment
A collaborative environment for multi-user in
augmented reality.
Schmalstieg00, Fjeld02

• Setup Centralized configuration
• Around the table. Not modified environment.
• Augmented user.
• Private/Public area.

shared area
Personal area
4
Goals

• Architecture Hardware/Software.
• Calibration / Registration.
• Intuitive 3D interaction method.
• Visual integration (occlusion, shadow).
• Multi-user management (protection, monitoring).

• Moto
• (simplicity, rapidity) / (viability,
  robustness)

5
Architecture Hardware

• Heterogeneous devices (displays, 3D/2D, two-hand)

6
Architecture Hardware

• Personal display
• Tracking
• Interaction devices

(Onyx 3, 2 Pipes, SGI)
7
Architecture Software

• Modular / Multilayer system
• XML configuration approach (device, interaction,
  object).

Application
Usermanager
Objectmanager
Devicemanager
Interactionmanager
OpenGL Performer, AL, VL, Qt
X
8
Architecture Software

• Support of various object (3D, 2D, text, picture,
  music, video, speech synthesis)

Text Screen-Stabilized
3D Object
Sound Object
Animated Objects
Picture
Text
9
Calibration of devices

• User-based approach plugn calib and play.
  Intuitive and simple method.
• Optotrak / FOB / Wacom calibration select
  points of reference.

Fob emitter

• Pen Calibration orient pen in specific
  direction.

Tuceryan95
10
Head calibration

• Fixed view and register specific object.

video see-through
optical see-through

• Maximum error 1 cm
• ? sufficient for non-critical application

• less jitter that magnetic tracker

11
Goals

• Architecture Hardware/Software.
• Calibration / Registration.
• Intuitive 3D interaction methods.
• Visual integration (occlusion, shadow).
• Multi-user management (protection, monitoring).

• Moto
• (simplicity, rapidity) / (viability,
  robustness)

12
Interaction moto

• Least intrusive device real pen and hand
  interaction TUI.

• Low haptic feedback table contact, respect of
  gravity.
• virtual tools personal menu

13
Tracked pencil

• real fonction and 6D0F manipulation

14
Hand tracked device

• easy wearable/removable
• gesture and interaction

15
Tangible User Interface

• real reality approach.
• natural object cup, paper, box.
• specialized object marker

16
Moving Objects 1/2

• Inspired from real methods

lift-move method
slide method
17
Moving Objects 2/2

• 3D Tangible UI select with a real ghost

18
Adding Objects

• Add Objects Virtual/Real
• Virtual Objects menu, catalogue, gesture.
• Real Objects
• predefined model register virtual and real
  representation.
• generic model fitting with a simple shape

19
Multiuser management
Gutwin00

• Communication/Coordination like real meeting.
• Awareness enhance device, line of sight, visual
  and sound feedthrough.
• Personal view unix access approach personal
  scene graph.

20
Multiuser management
Gutwin00

• Communication/Coordination like real meeting.
• Awareness enhance device, line of sight, visual
  and sound feedthrough.
• Personal view unix access approach personal
  scene graph.

21
Multiuser management
Gutwin00

• Communication/Coordination like real meeting.
• Awareness enhance device, line of sight, visual
  and sound feedthrough.
• Personal view unix access approach personal
  scene graph.

22
Multiuser management
Gutwin00

• Communication/Coordination like real meeting.
• Awareness enhance device, line of sight, visual
  and sound feedthrough.
• Personal view unix access approach personal
  scene graph.

23
Multiuser management

• Protection social technical protocol
• Assistance Multimedia help tool tip
• Monitoring Log Replay

24
Pre/Post session Authoring Tools

• Preparation
• hardware setup
• scene setup
• assistance setup
• scenario setup

• Debriefing
• replay
• save selected information

Meeting

• XML files
• Dedicated Graphical User Interfaces

25

• Contributions
• Collaborative AR framework
• Easy setup, adaptive to object domain.
• New interactive techniques
• Virtual Reality and CHI approach.
• Future Works
• Gesture Recognition.
• TUI Vision tracking.
• Visual Integration shadow, lighting
• Multiuser coupling, planning.
• CHI evaluation

26
Questions ?
27
Calibration Results

• Maximum error 1 cm
• ? sufficient for non-critical application

optical see-through
video see-through

• less jitter that magnetic tracker

28
How to see that what users see ?
29
Navigation

• Goal Visualize the scene from different
  viewpoint. RA (face to face) ??RV(immersion)
  (Kiyokawa99
• Approach dim in the scene (WIM Stoakley95).

t1
t1
t2
t2
Tree
character
Working space
30
Personal View details
31
(No Transcript)
32
Interaction

• time-multiplexed vs space-multiplexed
• Personal menus tools, add objects.

Radio Button
Push Button
Menu
slider
33
S2002 Bookman Old Style, Bold, 37 points

• This subtitle is 31 points
• Bullets are orange text is 26 points
• They have 110 line spacing, 6 points
  before/after
• Longer bullets in the form of a paragraph are
  harder to read if there is insufficient line
  spacing. This is the maximum recommended number
  of lines per slide (seven).
• Sub-bullets look like this.

34
Motivations
Augmented Reality (RA)
Integrate RV
35
Calibration Results

• Maximum error 1 cm
• ? sufficient for non-critical application
• less jitter that magnetic tracker