Visual AR

1
Visual AR

• An interactive visual programming environment for
  augmented reality user interfaces

Otmar Hilliges
lthilliges_at_in.tum.degt
2
Outline

• Problem
• Idea
• Goals
• Contribution
• Related Work
• New Ideas

3
Problem

• Typical Requirements for AR UIs
• Multimodal Semantic unification of several input
  channels. Also several presentation components
  have to be coordinated.
• Spatial Tracking data linked to objects in 3D
  views.
• Flexible I/O devices can be added/removed at
  runtime.
• Rapid prototyping To start the usability
  lifecycle for finding and evaluating new UI
  metaphors.

4
Problem (2) - UI Architecture
5
Idea

• Petri - Net used as abstraction layer
• Easy but yet powerful formal model.
• Graph structure supports a concise view.
• Tangible Interactions as development paradigm
• Built the application with your own hands.
• Self contained development
• Usage of existing infrastructure
• Development environment is just another
  Application
• Realtime visualisation

6
Goals

• Interactive Development Environment
• Running in the DWARF 3D environment
• Tangible Petri-Net editing
• Realtime editing and visualisation
• Pattern collection of typical interactions for
  reuse (subnets)

7
Idea (2) - UI MockUp
8
Contribution

• Related Work
• Visual programming
• Mindstorms
• Squeak
• Unit
• New Stuff
• Runtime prototyping
• Tangible programming
• Visual debugging and analysis