WMA

1
WMA A Marking-Based Synchronized
Multimedia Tutoring System for English
Composition Studies By Herng-Yow Chen and Kuo-Yu
Liu Presented by Brett Lilley
2
Evolution of the Web

• Hypertext
• Document with hyperlinks to other documents
• Content-based
• Hypermedia
• Hypertext with graphics, audio, video
• Time-based

3
Problem Statement

• Creation of hypermedia presentations for
• educational use.
• Focus on correcting English Composition

4
Creating Hypermedia

• Authoring
• Media Correlation
• Publishing
• Integration

5
Better Educational Solution Presentation
Recording

• eClass
• Authoring on the Fly

6
Web-Based Multimedia Annotation (WMA) System

• Enable students to submit writing via the Web
• Capture speech instructions
• Capture the navigation events
• Hot Keys
• Mouse Operations
• Ensure synchronized presentation with automatic
  navigation features
• Enable random access throughout the hypermedia
  document

7
Inter-Media Relationships
8
System Architecture
9
(No Transcript)
10
Temporal Correlation

• Discrete Media
• Navigation Events
• Continuous Media
• Speech
• Random Access Between the Two

11
Spatial Correlation
12
Spatial Correlation Free-Form Handwriting
13
Spatial Correlation Free-Form Handwriting Problem
14
Adaptable Handwriting Presentation
15
Spatial Correlation Tele-Pointer

• Discussion Clues
• Capturing/Storing Issues

16
Tele-Pointer Movement Interpolation

• Interpolation Smoothing Algorithm
• Number of Interpolated Pointers
• Distance Interval
• Timestamp and Positions
• Time Interval - Crucial

17
Content Correlation Undo And Random Access
18
Speech-Event Binding
19
Undo Facilitation

• Timestamps of events do not match speech stream
  timestamps
• Recording is contiguous cannot delete
  on-the-fly
• Delete during speech-event binding

20
Experimental ResultsClustering Speech Turns
21
Experimental Results Random Visual Event Access
22
Experimental ResultsUndo Functionality

• Compare Against Manually-Created Speech Segments
• 71 Match Lower than Random Access

23
Experimental ResultsTele-Pointer Interpolation

• Interviewed 20 Students
• gt80 ms Decreased Fluidity and Sickness
• 50 ms Used in WMA

24
Experimental Results User Study

• When Spring 2006
• Where Computer Science and Information
  Engineering at Chi Nan University
• Who 2 instructors, 27 Ph.D. students, 25
  graduate students

25
Survey Results

• Favorable reactions to perceived usefulness of
  WMA
• Integration of emerging technologies for learning
  is attractive to students
• Favorable reaction to design and features.

26
Pre- and Post-Test Results
27
Conclusion

• Overall system evaluation is good for practical
  applications
• Learners get what they put in
• Improvements can be made by customizing the
  Speech-Event Binding process

28
Questions???