Texture Synthesis and Transfer

1
Texture Synthesis and Transfer

• William Wedler
• 15-463 Final Project
• Fall 2007

2
Project Description

• Synthetic texture from a given sample
• Extract blocks and fit them together
• Find blocks that match along their borders
• Piece together with jagged edges
• Justification Markov property
• Current state is (x,y) location
• Output is a block from the given sample

3
Synthesis Results
Markov Model
Current State Overlapping region already
synthesized (Shaded region)
Current Output Selected block from input sample
(Dashed outline)
Input
Output
4
Dependency on Sampling Parameters
20 pixel Window
30 pixel Window
40 pixel Window
Input
1/6 Overlap
1/5 Overlap
1/4 Overlap
5
Texture Transfer Results

• Modify model sates
• Add target correspondence information

Input texture
Input target
6
Extension Into Animation

• Idea Transition from mostly texture to mostly
  target figure
• Vary resemblance to texture/target
• Change window size with
• Blur input target
• Add time dimension to state information
• Consider texture from previous frame
• Modified code borrowed from Proff. Efros

7
Animation Results
Only vary window sizes, no prev. frame
info http//www.youtube.com/watch?vlXxkgA65TO4
Vary window, blur and add prev. frame
info http//www.youtube.com/watch?vIrA6YKrKOPw
Inputs
Outputs