3D Imaging in an Immersive Virtual Reality Environment

1
3D Imaging in an ImmersiveVirtual Reality
Environment
AIMS Annual Spring Meeting Thursday March 23,
2006 Marvin Landis Research Computing
Support Center for Computing and Information
Technology University of Arizona
2
3D Imaging in an ImmersiveVirtual Reality
Environment

• Immersive Virtual Reality Environments
• AZ-LIVE
• Toolkits and Applications
• Projects and Examples

3
Immersive Virtual Reality Environments

• Displays that fill the entire users
  field-of-view
• Multiple projectors and stereoscopic projections
• 3D tracker and input devices
• Audio system and speakers

4
Immersive Virtual Reality Environments
Power Walls

• Scalable from a single projector to two or more
  projectors
• Edge-matching or edge-blending creates extremely
  high resolution, seamless images in sizes up to
  floor-to-ceiling displays
• Active or passive stereo viewing

5
Immersive Virtual Reality Environments
Dome/Spherical Displays

• Only one main projector is needed per dome
• Projector lens is located at the center of
  curvature of the dome
• Spherical projection software works with both
  OpenGL and Microsoft DirectX
• No stereoscopic capability

6
Immersive Virtual Reality Environments
Curved/Faceted Displays

• Cylindrical display with multiple projectors
  utilizing edge-blending or edge-matching
  technology
• Active or passive stereo viewing
• Typically used to accommodate large groups of
  viewers

7
Immersive Virtual Reality Environments
Multi-sided Environments

• Available with four, five, or six projection
  surfaces
• Small to medium sized groups of viewers are fully
  immersed in the virtual environment
• Active or passive stereo viewing
• Wide variety of tracking systems available

8
AZ-LIVE

• Arizona Laboratory for Immersive Visualization
  Environments
• The University of Arizonas spatially immersive
  virtual reality environment

9
AZ-LIVE Structure

• Fakespace Systems FLEX/CAVE in CCIT 307
• Four 10 ft. x 8 ft. reconfigurable displays
  (three walls and the floor)

10
AZ-LIVE Structure
11
AZ-LIVE Displays

• Four Christie Digital Mirage DLP projectors (2000
  lumens, 1280 x 1024 resolution)
• Sixteen pairs of Stereographics Crystal Eyes LCD
  eyewear
• Three extra long-range IR stereo emitters
• Projectors will also support passive stereo
  viewing

12
AZ-LIVE Displays
13
AZ-LIVE Tracking and Interaction

• InterSense IS-900 acoustic motion tracking system
• MiniTrax 6 DOF wand
• Main viewer head tracking sensor
• Fakespace Interaction Engine (FIE) scripting and
  voice command modules

14
AZ-LIVE Tracking and Interaction
15
AZ-LIVE Audio and Computers

• Crown CTS-4200 four channel, 200 watt-per-channel
  amplifier
• Four JBL Control 28 hi-fidelity speakers
• SGI Onyx4 - 8 processors, 4 graphic pipes, 5GB
  memory

16
Toolkits and Applications
3D Graphics Toolkits

• OpenGL industry standard multi-platform
  graphics API
• OpenGL Performer scenegraph based,
  performance-oriented API
• OpenGL Volumizer interactive visualization of
  volumetric data sets
• OpenGL Multipipe - manage applications across
  multiple graphics pipes
• OpenSceneGraph - scenegraph system for high
  performance applications
• OpenSG - portable scenegraph toolkit to create
  realtime graphics programs
• OpenMask - Modular Animation and Simulation Kit
• Panda3D - rendering engine with Python scripting
  interface
• VTK - 3D graphics, image processing, and
  visualization toolkit

17
Toolkits and Applications
Virtual Reality Toolkits

• CAVElib - API for developing collaborative
  virtual environment applications, multiple
  displays, and 3D tracking (VRCO / Fakespace)
• VR Juggler - suite of APIs that simplify
  tracking, object selection , navigation, and
  graphical user interfaces (Iowa State University)
• DIVERSE - Device Independent Virtual Environment
  - Reconfigurable, Scalable, Extensible (Virginia
  Tech, NIST)
• VESS - Virtual Environment Software Sandbox
  (University of Central Florida)
• FreeVR - virtual reality interface/integration
  library (Bill Sherman)
• CAVERNsoft G2 - toolkit for high performance
  tele-immersive collaborative applications
  (University of Illinois at Chicago)

18
Toolkits and Applications
Other Toolkits and Software

• Ygdrasil (YG) high level scripting layer for
  collaborative environments
• SCAM - simple CAVE Menu library with 2D widgets
  and file access
• OpenAL 3D audio API
• Bergen - audio server and client library
• VSS virtual sound server
• vtk2CAVE - use VTK in a CAVE environment
• vtkActorToPF - translate any vtkActor to an
  OpenGL Performer pfGeode
• dxTopfb - convert OpenDX geometries into an
  OpenGL Performer binary file

19
Toolkits and Applications
Applications

• AmiraVR - extended version of TGS Amira software
  for immersive installations
• Ensight Gold scientific / engineering
  visualization with virtual reality support
• VMD/NAMD molecular graphics viewer and dynamics
  simulator
• Cave5D - virtual reality version of Vis5D
• 3DIVE - interactive display and manipulation of
  volumetric data
• Virvo virtual reality volume rendering
• LIMBO - collaborative program that maintains 3D
  models in a virtual environment
• MetVR - view meteorological data sets in a
  virtual environment
• XMView/CMView - molecular visualization program
• CQ3A - Quake3 renderer for the CAVE

20
Projects and Examples
3D Isosurface Reconstruction
21
Projects and Examples
Volume Rendering
22
Projects and Examples
Molecular Visualization
23
Projects and Examples
Landscape Architecture
24
Projects and Examples
Atmospheric Sciences
25
Projects and Examples
Lunar and Planetary Sciences
26
Projects and Examples
Media Arts
27
Projects and Examples
AmiraVR
28
Projects and Examples
VMD
29
Projects and Examples
Cave5D
30
Projects and Examples
Courtesy of Fakespace Systems
31
Contact Information
http//azlive.arizona.edu Marvin
Landis vislab_at_arizona.edu marvinl_at_arizona.edu 520-
621-8258