Automatic Video Content Retrieval System AViCon

1
Automatic Video Content Retrieval System (AViCon)

• Yohan Chin
• Computer Science Department
• University of Texas Dallas

2
Contents

• Motivation
• MPEG-7
• Functional Requirement
• Non-Functional Requirement
• System Requirement
• Risks
• Conclusions

3
Motivation

• Growth of multimedia content
• Size of multimedia content in a year
• 1.5 billion GB
• Textual document 0.003 of total
• Elaborate solutions for searching and retrieving
  of multimedia gt require

4
MPEG-7

• a multimedia content description standard
• Visual descriptors
• Color
• Shape
• Texture
• motion

5
Mpeg-7 Cont.
6
Functional Requirement
Video file
annotation
Graphic Annotation Tool
Low-level features
Scene dectection
MPEG-7 XM
AUDIO FILE
Text Data
XML DOC.
Video Content Analysis
7
Functional Requirement Cont.
Multimedia Data
Meta Data
Image feature vector
(Video, Audio, Image)
(author,genre,duration)
Multimedia Database
8
Functional Requirement Cont.
Web server
INTERNET
BROKER
Web Browser
Multimedia database
Multimedia Retrieval
9
Functional Requirement Cont.
Video Content Analysis
Multimedia Retrieval
XML Schema
BROKER
Multimedia Database
Overall Architecture
10
Non-functionalRequirement- Constraint

• Customer requirement
• Retrieval time ? in 2 secs.
• Reliability requirement
• 85 accuracy rate
• Rules for interacting with other components
• XML Schema

11
Non-functionalRequirement- Constraint Cont.

• Protocol Requirement
• SOAP Protocol /Http Protocol
• Budget Restriction
• Available for only 6 months
• Memory Requirement
• Very large memory size
• multimedia indexing

12
Non-functionalRequirement- Assumption

• User skills
• Open Source Programs
• MPEG7-XM
• Run in various O/S
• IBM Video Annex Tool
• Decode several video formats (avi,wmv,..etc.)
• User System Condition
• Intel Pentium III and 256 RAM
• IE6.0

13
Non-functionalRequirement- Dependencies

• Pilot Project
• Researchers and Technicians
• Three Researchers (2PhD,1MS)
• One Technician
• Products and Compilers
• GNU C compiler
• Oracle 9i RDBMS
• Apache HTTP Server
• J2EE

14
Non-functionalRequirement- Dependencies Cont.

• Deliverables
• Multimedia Retrieval System
• Multimedia Database
• Algorithms
• Subspace Clustering Algorithm
• Shot Boundary Detection Algorithm
• Vector Modeling

15
System Requirement -Hardware

• Hardware Requirement
• SUN Fire V880 Server
• 900 MHZ, 4GB memory, 10,000 RPM
• SUN Blade 100 workstation
• 436 GB , 2.7GHz, 3GB memory
• PC
• Pentium(R) 4 CPU 2.0GHz

16
System Requirement Software

• Software Requirements
• Programming Languages
• C/C,J2EE,HTML,SQL
• DataBase System
• Oracle9i
• MPEG-7
• MPEG-7 XM software
• Speech Recognition
• Sphinx2
• Annotation
• IBM Annex Tool

17
Risks

• Manual Content Description
• Can make different annotations
• Modularizing each components
• Inconsistent XML document
• Open Source Programs
• No technical support

18
Conclusions

• MPEG-7 is very useful for CBIR
• Summarized Video Content
• User-Interactive Query Environment
• Communicate with XML data

19
Questions?

• Thank you