Computer vision framework for adding CG simulations

1
Computer vision framework for adding CG
simulations

• Sashi Kumar Penta
• Robotics Course Project
• Final Project Progress Presentation

2
Motivation

• Graphics simulations into real scenes has
  interesting applications
• Special affects in movies
• Demonstrations,

Philippos Mordohai
3
Sub Goals

• Imaging
• Calibration
• Stereo correspondence
• Depth-map Computation
• 3D Geometry Construction
• Interactive toolkit

4
Imaging
5
Calibration

• Obtaining both internal and external parameters
  of the camera

6
Stereo correspondence

• Rectification
• Graph-cut method

7
Depth-map Computation

• Triangulation
• X
• x x
• C C

X
8
3D Geometry Construction

• Obtaining Triangle Mesh
• User-assisted prior (plane, blob)
• Object completion
• Foreground
• Background (may occlude foreground)

9
Interactive Toolkit

• Stereo Refinement
• Priors (plane, blob)
• Depth discontinuity, etc
• Placing CG simulations

10
Current Status/ Code developed

• Stereo videos are captured
• Camera calibration has been done
• Stereo correspondence module is ready for
  standard images

11
What needs to be done

• Test the stereo computation on videos recorded
• Get the depth-map computation module ready
• Get the interactive toolkit ready to assist user
  for placing synthetic scenes

12
Long term goals

• Adding CG simulations into the real-scenes
• IBR frame-work
• Photo-consistency of synthetic scenes with the
  real-scenes

13
Questions?
14
Thank you!