Batch VIP

1
Batch VIP

• A backend system of video processing

VIEW Technologies The Chinese University of Hong
Kong
2
Outline

• Ideas of BatchVIP
• Design Goals
• Concepts
• Rules
• Structure
• Processing modules

3
Design goals

• Integrate and update different kinds of video
  processing function efficiently
• Coordinate processes
• High stability
• Real-time monitor the progressing status
• Record events in log

4
Module

• A Module is a component which implements a
  certain video processing task.
• Module is independent of Batch VIP by using a
  standalone executable file with a XML
  specification
• Advantages
• Easy to integrate new modules or update existing
  modules without modifying the Batch VIP
• Guarantee the reliability.
• Standard interface

5
Sample of XML Specification
ltModulegt  ltInfo NAME"SpeechRecognition"
SRC"speechrecognition.exe" DESCRIPTION"Speech
Recognition" MULTIPLEINSTANCE"0"
USEENGINE"1" /gt ltRequirementgt  ltEngine
NAMEengine.exe/gt ltFile SRC"DMAPI.dll" /gt  
ltFile SRC"regexp.dll" /gt   ltFile
SRC"smapi.dll" /gt   lt/Requirementgt 
ltInputgtADRemovelt/Inputgt   ltOutputgtSpeech
Scriptlt/Outputgt   lt/Modulegt
6
Rules of the task arrangement

• If one module needs the results of other modules,
  it can not run until all those modules finish.
• Each file only can be processed by one module at
  any time
• Only the module which has the multiple-instance
  feature can process several files at the same
  time
• Each module must apply for the thread quota
  before creating process and must release it after
  finishing.

7
Reliability

• Module mechanism
• Multi-Thread Management
• Critical Section Management
• Monitor Process status
• CPU utilization
• Socket communication

8
Communication

• Socket based
• Duplex
• TCP/IP
• Message
• Control message
• Progress message
• Error message

9
Structure
Module
Ad Detection
Batch Control Center
Module Manager
Scene Detection
Video
Task Manager
Xml interface

Process Manager
Publish
Log
10
Working flow
tasks
Check preprocess
return quota
Add to Task Queue
Destroy Socket
Task Queue
Create Process
Create Socket
Task Manager
Server
Termination message
Update task status
Update task progress
Terminate
11
Processing Layer
12
Scene Detection
Histogram-based difference
Eliminate duplicated results
D(X,Y)
13
VOCD
14
Speech Recognition

• Audio Extraction
• ViaVoice

15
Story Segmentation
16
Publish
17
Thank you for you attention!