Cover

1
LYU9904 Presentation
Multi-Model Digital Video Library
Supervisor Prof. Michael Lyu
Jacky Ma
Team members
Joan Chung
2
Presentation Outline

• Project Aims
• Introduction of Digital Video Library
• Introduction of Our Work
• Considerations and Approach
• Design and Implementation
• Future Plans

3
Project Aims

• Learn different issues about DVL
• existing such as Informedia(TM) done by CMU
• Implement a small-scale model
• Client interface for playback of media
• Process data source/user queries in Chinese
• Web Integration

4
Introduction of Digital Video Library

• Functions of a DVL
• Why Digital Video Library?
• Issues about DVL
• Techniques Addressing DVL Issues

5
Functions of a DVL

• Storage and play back of video resources
• Online access of video resources
• Search of useful information through the vast
  data collections
• Retrieval of the most relevant selections

6
Why Digital Video Library?

• Digital data
• easy to process in an automated way
• takes advantage of the Internet
• Multimedia content
• more attractive
• for education, training, sports and entertainment
• Library management
• An organized way of retrieval media contents

7
Issues about DVL

• Building Video Databases
• Indexing the Video Contents
• Breaking the Video into Segments
• Retrieving Video

8
Building Video Database

• Extremely large space requirement
• Choosing a video format
• Online access of video resources

9
Indexing the Video Contents

• Inaccessibility of information in video
• Limitation of text-base descriptions
• Tedious manual process
• Cinematic information is complex to describe

10
Breaking the Video into Segments

• Video paragraphing
• Alternate representation of video
• Text tile
• Text abstract
• Full-text transcript
• Representative single image
• Skim video

11
Retrieving Video

• Three principle for searching
• Let user to skim the video object quickly with
  their interest
• Adjust the size of video
• Identify of desired video among multiple returned
  results
• Ways to achieve
• Small size of video returned
• Information visualization

12
(No Transcript)
13
Overview of Digital Video Library System
14
Techniques Addressing DVL Issues

• Speech Analysis
• Speech recognition technology generates
  transcript
• Pauses and silence in audio help paragraphing
• Image Analysis
• Detect significant changes in weighted color
  histogram
• Interpret camera motion
• Natural Language Processing
• Query processing
• Retrieval

15
(No Transcript)
16
Our Work

• Focus and Target
• Programming Environment
• Design and Implementation
• System Consideration
• System Design
• System Implementation
• Future Plans

17
Focus and Target

• Divide the project into modules that can be
  implemented in stages
• digital video preparation
• video playback
• user query
• web-integration

18
Programming Environment

• Platform
• Java as programming language
• JMF API to present time-base media

19
Why use Java?

• Platform independence
• Network ready
• International appeal
• Easy to build GUI
• JMF API for video playback
• Disadvantages?

20
Presenting Time-Base Media with JMF

• What is JMF?
• Java Media Framework Application Programming
  Interface
• Incorporating media data into Java
• The high level architecture
• Similar to traditional VCR
• Data Source
• Pull data-source and Push data-source
• Media Presentation
• Programmed or Interactive controls

21
Design and Implementation

• System Consideration
• System Design
• System Implementation

22
System Consideration

• User Perspective
• User friendly
• Other system component are transparent
• Server Program
• Robust, reliable
• Network Issue
• Video Collections

23
System Design
24
System Implementation

• Library Preparation
• Server Program
• Client Program

25
(No Transcript)
26
Future Plans

• Java-applet Client Program
• Semi-auto Timestamp Editing Tools
• Searching and Indexing Capability
• Other Possible Extensions
• Automatically derived transcripts
• Language processing of queries and transcripts
• Content-based Image Manipulation