FYP Project LYU0303:

1
FYP Project LYU0303

• Video Object Tracking and Replacement for Post TV
  Production

1
2
Augmented Reality

• Augmented Reality (AR) is a form of human-machine
  interaction where information is presented in the
  file of view of an individual
• augmenting the real world scene necessitating
  that the user maintains a sense of presence in
  that world.
• the virtual images are merged with the real view
  to create the augmented display.
• technology for merging the real and virtual image
  streams in tight constrain.

3
AR (movie)
4
AR Animation (movie)
5
Key Technologies of AR

• accurate registration of the virtual objects with
  the real world image
• camera position, viewing parameters
• digital composition, scene lighting, object
  texture mapping
• real-time processing constrain
• user viewing method

6
AR Systems

• Monitor Based Augmented Reality
• Video See-through Augmented Reality Display
• Optical See-through Augmented Reality Display

7
AR using Monitor (movie)
8
AR using Head Mount Device (movie)
9
ARCADE Augmented Reality Computing Arena for
Digital Entertainment

• AR provides new ways of digital entertainment
  possibilities when combining with traditional
  entertainment channels.
• Key applications TV and Movie productions
  combining fantasy with reality

10
LYU0303 Video Object Tracking and Replacement
for Post TV production

• Design the special pattern markers for 3D objects
  to be applied on objects during the video
  shooting
• Develop efficient algorithm to calculate the
  objects positions and orientations in the video
• Non real-time algorithm
• MPEG-1 or DV quality video
• The special pattern marks and the detection
  algorithm must survive from the partial occlusion
  of the object.

11
LYU0303 Video Object Tracking and Replacement
for Post TV production

• Develop algorithm to determine the lighting
  condition of the scene in a video
• Generate realistic images to replace the video
  object according to its positions and
  orientations
• non real-time algorithm
• MPEG-1 or DV quality video
• Simple object, soda can or cereal box
• The algorithm must survive from the partial
  occlusion of the object
• Photometric registration problem

12
Popular 2D Markers
13
Illustration of possible Special Pattern Markers
for 3D Object
14
Same Object Two Brand Names
15
References

• International Symposium on Mixed and Augmented
  Reality, ISMAR 1999-2002
• Can be downloaded from IEEE website using Campus
  network (IP address restrictions)
• ieeexplore.ieee.org/xpl/tocresult.jsp?isNumber245
  94
• Augmented Reality Website
• www.augmented-reality.org
• MagicBook
• www.hitl.washington.edu/magicbook/
• Virtual Showcase
• http//virtual-showcase.com/