High Definition Video: Acquisition and Workflow, CODECs Explained

1
High Definition Video Acquisition and Workflow,
CODECs Explained ResearchChannel 10th Annual
Mtg Internet2 Fall Member Meeting Chicago,
December 2006 Michael Wellings Director,
Engineering
THINK FORWARD. THINK RESEARCHCHANNEL.
2
Topics of Discussion
3
Topics of Discussion

• What is ResearchChannel
• Recent public demonstrations
• Demo System design
• Audio
• Video
• iHDTV Open Source Project
• What it is
• Current state
• Advanced Systems
• HD Video workflow discussion
• Codec Comparison

4
WERE MAKING IT HAPPEN
5
ResearchChannel Programs

• More than 3,200 hours of programming in theVideo
  on Demand library
• 1,100 new programs addedthis year, and this
  number ison the rise

6
Diverse Programming
7
ResearchChannel Participants
Advanced Network Forum AJA Video Systems
Inc. Australia's Academic Research Network
(AARNet) Fujinon Howard Hughes Medical
Institute IBM Corporation Intel
Corporation Internet2 Johnson Johnson Library
of Congress Microsoft Research National
Academies National Academy of Engineering

• Duke University
• George Mason University
• Indiana University, School of Informatics
• Johns Hopkins University
• Massachusetts Institute of Technology
• National University of Singapore
• New York University
• Pennsylvania State University
• Rice University
• Rutgers, The State University of New Jersey
• Stanford University Medical Center
• Texas AM University
• Tulane University, A.B. Freeman School of Business

Universidad de Puerto Rico Universidade de São
Paulo University of Alaska - Fairbanks University
of Chicago University of Hawaii University of
Maryland - College Park University of
Pennsylvania University of Southern
California University of Virginia University of
Washington University of Wisconsin-Madison Virgini
a Tech Yale University
National Academy of Sciences National Institute
of Nursing Research National Institute of
Standards and Technology National Institutes of
Health National Library of Medicine National
Science Foundation Pacific Northwest
Gigapop Poznan Supercomputing and Networking
Center R1edu.org SURFnet Vulcan Northwest,
Inc. Wisconsin Public Television
8
ResearchChannel Participants

• American Meteorological Association
• Arizona State University
• California State University,Monterey Bay
• Indiana University
• Loma Linda University
• Pacific Northwest National Laboratory
• University of Kentucky
• University of Michigan

9
U.S. Television Distribution
DISH Network satellite system 12 million
homes Cable systems 12.9 million homes
10
U.S. Television Distribution New
Retransmission Markets

• 744,000 new subscribers in past 12 months

11
Podcasting and Other New Features
12
Google Video
13
What Viewers Are Saying

• I am very pleased to see a broadcast of such
  intellectual content.
• You are greatly contributing to humanitys
  accumulation of knowledge.
• ResearchChannel is what one hopes to find more
  of on television.

14
Technology Milestones

• August 1999First-Ever Streaming of
  High-Definition Television over the Internet
• November 1999Network Sets Record Speed
• April 2000First Live HDTV Over Internet Newscast
• July 2004First Transmission of Full Bandwidth HD
  Video Between Computers
• September 2005First-Ever Live HD Images from
  Seafloor to Land Available as IP-Based Feed
• November 2005Interactive Multipoint HD
  Videoconference Demonstrated
• November 2006Partner in World-wide teatimng of
  ConferenceXP

15
Microsoft Research Grant
16
Technology Leading the Way
17
Continuous Ocean Observing
18
eScience

• FermiLab
• Osaka University Microscopy Group
• Ohio Super Computing center
• Dr. S. Ramakrishnan
• GRNET
• CERN
• Argonne
• Intel

19
Other New Partnerships CERN and Osaka
20
Consortia Partnerships

• CineGrid
• WACE (Workshop for Advanced Collaborative
  Environments)
• WUN (Worldwide Universities Network)
• PRAGMA
• Telescience
• NTT Labs

21

• Recent Demonstrations

22
Recent Demonstrations

• Sept 2005 - iGrid San Diego
• Enhanced HD interactive - USA118 Global N-Way
  Uncompressed Interactive Conferencing
• Underwater research using HD from SS Thompson
  USA119 20,000 Terabits Under the Sea
• Nov 2005 - SC05 Seattle
• Enhanced HD Interactive Conferencing/HD Storage,
  capture and editing using SRB (Storage Resource
  Broker)

23
iGRID 05 USA118

• Sept 2005 - iGrid San Diego
• Enhanced HD interactive - USA118 Global N-Way
  Uncompressed Interactive Conferencing
• Remote sites
• Pacific Northwest Gigapop - University of
  Washington - Seattle
• The WIDE (Widely Integrated Distributed
  Environment) Project - Tokyo
• University of Wisconsin - Madison
• University of Michigan Ann Arbor
• SURFnet - Amsterdam

24
iGRID 05 USA118

• Sept 2005 - iGrid San Diego
• Remote site equipment
• 2 RX iHD1500 Hosts (multicast from iGRID)
• 1 TX iHD1500 Client (unicast to iGRID)
• Central site equipment
• 6 RX iHD1500 Clients
• 2 TX iHD1500 Hosts (Multicast)
• Evertz VIP-12 HD Video Tile Generator
• Multichannel mix-minus audio system

25
iGRID 05 USA119

• Sept 2005 - iGrid San Diego
• First ever live HD/ip from a ship at sea to
  viewers on shore
• Ku-Band equipment upgrade to SeaTel antenna
• Careful RF engineering to design satellite
  Link-Budget
• Real-time MPEG-2 MP_at_HL encoding
• Ip gateway
• Satellite modem 20mbps

26
Recent Demonstrations

• Nov 2006 SC06 Tampa
• iHD1500 system
• Dec 2006 Internet2 Fall Member Meeting Chicago
• iHD1500 system
• HD CoDecs compared
• HD Camera hands-on

27

• Advanced Delivery Methods
• And systems

28
Advanced Delivery Methods

• The content is important, not the delivery method
• We will use what works best for the application
• Quality will scale to match the receiving device
• Multiple delivery methods will be used
• Wired delivery for stationary receivers
• Non-wired delivery for mobile devices
• As high speed connectivity proliferates,
  over-the-air transmission becomes less important
  for stationary receivers
• The multiple use, highly connected devices in the
  home receive all content over high speed network
  connections using several forms of transport
  media
• Ip over cable, fiber, copper, RF
• CATV operators will migrate to an all-IP delivery
  scheme and broadcasters will be hard-pressed to
  compete
• Traditional Broadcastings last stand will be
  rural areas in advance of expanding IP networks

29
Advanced Delivery Methods

• It took about a year for cable modems downstream
  speeds to increase from 2mbps to 8mbps in the
  Seattle area
• High bandwidth connectivity means non-linear
  viewing of multi-res content which will change
  the face of media delivery
• Global reach
• Old Model
• Broadcast in your own geographic area
• Compete with local broadcasters and print media
• New Model
• X-cast (Podcast, multicast, unicast etc) to
  the world and
• become part of an immense soup of content
• Compete with everyone for a small slice of a
  universal market

30
ResearchChannel Advanced on-line Services

• ResearchChannel satellite feed on the network
• 233.0.73.29 MPEG2_at_ 3.2mbps
• Live 1080i HD video of Mt Rainier
• 233.0.73.26 MPEG2 MP_at_HL _at_ 20mbps
• Live 720p HD video of Mt Rainier
• http//www.researchchannel.org/tech/desktopclient
  s.asp
• HD VOD 720p WMV-HD http//www.researchchannel.org
  /visions05/hdpresentation.asp
• HD VOD 1080i MPEG2 ML_at_HL
• http//www.researchchannel.org/tech/desktophdsamp
  les.asp
• KEXP-FM Audio-on-demand uncompressed audio
  webcasting
• http//www.kexp.org

31
ResearchChannel Advanced on-line Services

• Successful demonstration home delivery of
  WMV-HD_at_720p over CATV Modems
• Developing VOD archive for oceanographic HD video
• KEXP-FM on-line services have a world-wide
  audience that equals Seattle broadcast listener
  numbers

32
ResearchChannel Advanced on-line Services

• Making Television History
• Visions 05 - Emmy Award Nominee
• First-ever live HD 1080i video/IP streamed around
  the world
• SMPTE 292M multicast and unicast _at_ 1.5gbps
• MPEG 2 MP_at_HL multicast
• WMV-HD multicast with Unicast automatic failover

33
ResearchChannel Advanced on-line Services

• Seattle Science Foundation Project testbed for
  new
• Medical technology with HD video archiving
• WWAMI collaborative medical education via
• Advanced video technology

34
High Definition Workflow

• A Report in progress

35
HD a Background
36
Sample Rates

• NTSC 422
• Y, Pb, Pr color matrix
• 4x3.38 (compromise rate from 3.58MHz) 15.5MHz
• Color difference channels _at_ 6.75MHz
• HD 422 (really 22111)
• Y, Pb, Pr color matrix
• 22x3.3874.25MHz
• Color difference channels _at_ 37.125MHz

37
Sample / Bit Rates

• Broadcast
• 420 MPEG-2 TS 19.2mbps
• DVD
• 420 MPEG-2 PS VBR
• HD DVD/Blu-Ray
• 420 VC-1 8mbps
• 420 AVC 8mbps

38
HD Resolutions

• 720p 60Hz
• 1280x720 24p
• 1280x720 30p
• 1280x720 60p
• 1080i/p 60Hz
• 1920x1080 24p
• 1920x1080 30p
• 1920x1080 60i
• 1920x1080 60p

39
HD Bitrates Uncompressed 10- bit 422

• 720p 60Hz - SMPTE 296M
• 1280x720 30p
• 742mbps
• 1280x720 60p
• 1485mbps

40
HD Bitrates Uncompressed 10- bit 422

• 1080i/p 60Hz SMPTE 274M
• 1920x1080 30p
• 1485mbps
• 1920x1080 60i
• 1485mbps
• 1920x1080 60p
• 2970mbps

41
iHD

• 1920x1080 60i 8bit 422
• Sony HDCam source material
• 995mbps active lines, 1188mbps total

42
iHDTV Software Suite

• iHDTV Explained
• iHD1500
• iHD270
• HD to the Desktop
• WindowsXP-based application suite
• Released as Open Source as of April 24th, 2006
• iHD_Trusted_Partners_Group formed to direct
  software development

43
iHDTV Explained

• iHD1500
• Uncompressed SMPTE 292M 422
• Data rate total approx 1.5 gbps
• Requires
• high-end HD capture cards
• PCI Express platforms
• Windows XP
• 2 x gige network connection
• Jumbo frame transport and routing

44
iHDTV Explained

• iHD270 (first introduced aug 99)
• Sony HDCamtm compression
• SDTI data format 270mbps
• AJA Xena I/O
• Requires
• AJA Xena-HD capture cards
• Dual Processor P4
• Windows XP
• Sony HDCam Hardware encoder/decoder
• Gige network connection

45
iHD1500 application

• SMPTE 292M/ip
• 1.5gbps
• 1080-60i HD video with multiplexed audio
• ResearchChannel partner Intel PCE-Express 3.4GHz
  Dual Xeon platforms
• ResearchChannel partner AJA Video Systems
  supplied initial round of Xena-HD capture boards

46
iHD1500 application

• Latency about 4 frames end to end plus network
  delay
• 4 frames133ms or 1/7 sec
• Network delay AustraliagtPhiladelphia 250ms
• Satellite latency about 250ms per hop
• H.323 devices about 220ms plus network delay
• No significant delay in video equipment

47
Software Enhancements

• iHD1500 Enhancements
• tile display generated in software
• Audio mixing in software
• Audio mix-minus in software
• Video switching in software

48
Codec comparison Project

• SMPTE StEM HD Mini-Movie
• Designed for critical evaluation of HD equipment
  as well as encoders and decoders
• Delivered as tga files, uncompressed
• Imported into Final Cut Pro

49
Codec comparison Project

• 7 Uncompressed Quicktime Movies on 7 sequences

50
Codec comparison Project

• 5 movies exported
• DVCPro 100
• HDV
• MPEG-4 Basic
• H.264 Part 10 (AVC)
• HD uncompressed
• All FCP I/O via AJA Kona 2 board

51
Codec comparison Project

• HD sequence played out to HDCam Tape
• recaptured 8bit 422 in FCP
• HD sequenced played out to NTT HD1000 MPEG-2
  encoder
• recaptured from output of NTT HD1000 MPEG-2
  decoder as 8bit 422, and 420

52
Codec comparison Project

• DVCPro 100 sequence re-rendered in FCP to
  uncompressed
• HDV sequence re-rendered in FCP to uncompressed

53
Codec comparison Project

• MPEG-4 Basic re-rendered to uncompressed in FCP
• MPEG-4 h.264 Part 10 re-rendered to uncompressed
  in FCP

54
The edit

• Five scenes of interest selected
• 8 new sequences created for each of the 7
  compressed-decompressed files plus the original
• HDV and DVCPro were scaled 133 and 150
  respectively to match the uncompressed material

55
Difference mask

• Luminance of each compressed file inverted and
  added to the original
• 50 luma field indicated no loss
• Material lost in codec process exhibited visually
  due to the subtraction process

56
The movies

• Several HD movies resulted from this project
• 7 with the edited 5 scenes each an example of a
  particular codec showing the difference mask
  full screen
• 7 with the encoded and decoded video overlayed in
  the center of the frame of the origional for
  direct comparison
• 5 complete sequences of codec representation
• The original uncompressed movie

57
Video CoDec Comparison
CODEC Bit Rate (Mbps) File Size (MB) Compression Ratio Type Size Color
HDCam 144.00 n/a 10.41 Hardware 1920X1080 311
DVCProHD 115.24 5100 131 Software 1280x1080 422
MPEG-2 422_at_HL 30.00 n/a 561 Hardware 1920X1080 422
MPEG-2 MP_at_HL 420 18.00 n/a 931 Hardware 1920X1080 420
HDV MPEG-2 MP_at_H14 24.96 1110 601 Software 1440X1080 311
MPEG-4 H.264 Part 10 7.57 344 1981 Software 1920X1080 420
MPEG-4 Basic 5.94 270 2531 Software 1920X1080 420
VC-1 8.00 320 1881 Hardware 1920X1080 420
58
equipment

• SONY HDW-500 VTR
• Apple Dual 2.7GHz G5
• 4GB RAM
• Mac OS-X 10.4.7
• Final Cut Pro 5.1.1
• AJA Kona 2 I/O
• NTT HD 1000 MPEG Encoder
• NTT HD 1000 MPEG Decoder

59
Further investigation

• VC-1 to be added
• Encoder problems
• No playout to baseband HD
• Portable Uncompressed playback system
• HD multiburst input

60
Screen size/resolution/Viewing Distance

• rule of thumb
• Optimal viewing distance 3 to 4 times diagonal
  screen measurement
• Viewing angles
• SMPTE 30deg
• THX 36deg

61
Screens

• Small screen up close vs large screen further
  away
• Dot pitch most important factor
• Native HD resoultion displays make sense in
  larger (24 to 50 inch) screens due to optimum
  viewing distances
• Low res screens appear sharper from a distance
  this is due to the apparent dot pitch of the
  digital display

62
SMPTE StEM HD Mini-Movie
63
(No Transcript)
64
(No Transcript)
65
(No Transcript)
66
(No Transcript)
67
(No Transcript)
68
(No Transcript)
69
(No Transcript)
70
SC06 Central Services
71
For more information

• www.researchchannel.org
• wellings_at_researchchannel.org