The Visualization Brazilian Network

1
The Visualization Brazilian Network

• Bruno Feijó
• VisionLab/PUC-Rio

2
Some Pioneer Results Brazil

• Computing
• Broadcast Production
• Electronic Systems Banking, Voting
• Software Engineering (LUA, Agents, ...)
• Visualization in early 80s TV Globo
• Computer Graphics in the Broadcast Industry
• Developments with a Spin-off PDI
• First in Television Drama Technology
• First to use 1-inch videotape in outdoor
  shootings
• Partnership with Sony
• First Outdoor Blue Screen (early 90s)

3
The Concept Of Visualization

• It is more than data visualization and Virtual
  Reality applications
• Visualization as visual simulation of processes
  and environments with a technological basis
  shared by several strategic sectors
• Game cinema TV simulator
• Strategic Macrosector
• Digital Content Production, Broadcast, Cinema,
  Oil, Games, Defense,

4
VisualizationFuture scenario

• Computational Holography
• Entertainment, Defense, Communication, Education
• Artificial Intelligence
• Ultra-Definition (4K, 8K, )
• Water
• The Connection Point
• A single point with information, education,
  entertainment, communication, and services
  ...visual

5
Visualization Brazilian NetworkRBV

• Strategic development policy Minister of
  Science and Technology
• A network of intelligence connecting industry and
  academy
• Research, Development and Innovation
• Goals To organize the visualization sector and
  to promote innovation in order to increase
  competitiveness
• Structured by competences

6
RBVCurrent Competences
Strategic Kernel RBV JPessoa Digital
Production Pole of Olinda Pole of Games -
PortoDigital
1
PE 1 Games and Simulation (UFPE)
3
2
2 Broadcast and Digital Content Prodution
(PUC-Rio)
Rio
4
3 Energy, Gas, and Oil (UFRJ)
5
SP 4 Industrial (USP)
RG 5 Security and Defense (PUC-RS)
Rio
VisionLab/PUC-Rio
Lamce/UFRJ
University Lab aligned With RDIBusiness
Pole Rio CineVideo
UFRJ Technological Park (under construction)
7
The Model Of Regional Integrated Axis
Strategic Kernels clusters of intelligence
executing National Strategic Projects National
Strategic Projects Global projects involving
more than one Competence and having economic
feasibility Specific Project Isolated project
belonging to a Competence
International organisms
Government Sectors
National Development Bank
Strategic firms
Mechanism for Economic Feasibility
Sub-network (capilarity)
Incubators
RD Lab (University)
Cluster of Production and Business
Market
PD
RD Training Services New Products
Studios to rent Clusters and Motion
Capture Offices for resource allocation Production
system support Representatives of agencies for
development Infrastructure for technical support
Pilot Axis VisionLab-PoleRio
Digital Production Commission

• Key Concepts
• Local Productive Clusters
• Strategic firms
• - Logistics
• - Resource equalization
• - Management uniformity
• - First organizing, financing later

Conection to other networks and groups of
excellence through inductions or projects in
consortium
8
VisionLab/Pole Rio
VisionLab Pole Rio CineVideo
VisionLab Campus PUC-Rio, Gávea
Studios VisionLab
Firms (? 100)
Business Center
Studios
VisionLab
Expansion Area
9
RD And Innovation In RBV

• Emerging and developing country
• Low- cost high technology
• Simplicity
• Cross-functional development
• Between sectors or companies
• Focus on processes
• Secrecy versus patent
• Secrecy, short life cycle, and steps ahead
• Research papers and product documentation

10
VisionLab RDI
11
Reconstruction and Simulation
12
Reconstruction and Simulation
13
Special Effects
3x cheaper and 2x faster
Realistic Simulation through time
VisionLab for BAND/NBP/RTP (Portugal)
Acident Simulation for TV Drama (3D models
image)
VisionLab for NBP/RTP (Portugal)
3D model
14
Low Cost Touch Screen Interface
camera
Low cost High speed High accuracy No sound sensors
Array of infrared LEDs
projector
acrylic
Platform Windows Media Encoder .Net
plastic film
15
IPTV Experiments
Active Objects Simultaneous Broadcasting -
digital TV - internet
http//www.shoptime.com.br/apollo/internetTV.do
16
Interactive Digital TVPUC-Rio model
Screen Layout for Digital TV
Application (VisionLab)
Text
Status
Middleware (NCL/Telemidia)
Menu
Standard
Traffic
Main Text
Interactivity icon
Watermark
Interactivity icon
Wheather
17
Low-Cost Digital Asset Management
18
HW And SW For HD Stereo Projection
VisionLab Absolute Technologies
The most compact 2K stereo projection system in
Brazil
VLab Stereo Player - 2K (High Definition) -
no flicking - no audio dependence
19
High Definition Stereo Production
20
Image-based Rendering for Games Simulations
Conventional 3D model
Relief impostor (an image in real time)
Shading model
CPU-GPU Parallel Architecture
21
3D Game Engines, Experimental Games, and Mobile
Games
Multiplayer Online Game in Mobile Phones
22
Storytelling for Interactive TV and Defense
The plot has a logical structure. Scenes are
predicates with pre e post-conditions, e.g.
attack(draco, princess_castle). Red scenes should
wait and green scenes are free to connect.
Automatic animation of the attack scene,
corresponding to the predicate attack
Current scene

• There are variations, but the backbone of the
  plot is not destroyed
• There are both global visions and
  local/individual visions of the plot
• The characters are intelligents, but fuzzy and
  emotional this is Affective Computing in
  Participative Games
• Dramatic Gaming vs Action Game

23
Emotional Talking Heads
VisionLab TeleMídia IMPA
Facial animation Emotion Model Virtual Narrator
24
Image-based shading for 2D Animation
Pipeline for the Preprocessing Module
VisionLab IMPA
Shading Example
25
Compression for Irregular Meshes
Two vectors of integers only (V and M)
3D Bunny with 9672 triangles compressed with the
CLERS code (red for C, dark blue for L, green for
E, yellow for R, and light blue for S) C
create L left E end R right S split
Example CCCCcRsLcRCCcRsLEsLRLRE
CHalfEdge Structure
VisionLab Mechanics Dept. Mathematics Dept.
26
Microsoft Research Faculty Summit 2007