Multimodal Slide Shows as Asynchronous Presentation Reviews

1
Multimodal Slide Shows as Asynchronous
Presentation Reviews
Roger J. Chapman
The University of Hawaii, at Hilo Computer
Science Department
2
Slide Shows

• Advantages
• Memory and structuring aid
• Common view for instructors and students
• Easily stored, edited, reused, and shared

• Disadvantages
• Can fly through slides
• Can simply read the slides contents
• Hardwired structure may breakdown during an
  interactive class

3
Deictic Gesturing

• Instructors often talk through a slide making a
  series of linking deictic gestures
• Pointing at something while speaking, to gesture
  this, that or there.
• Increases efficiency and accuracy of the
  communication

4
Multimodal Reviews

• Hardcopies of slide shows
• help students follow the material covered during
  a class
• help students review later in their own time
• Can more natural reviews be simply created when
  it is not necessary to capture a lot of software
  dynamics?
• How useful might that be?

5
Other Systems

• Can add audio to PowerPoint presentations, but
  not pointing
• ScreenCam and HyperCam capture dynamics, but
  video files are large
• Compressed video on the Internet (e.g.
  RealPresenter) is becoming common, but still not
  always practical for dial-up students to stay
  online

6
Research on Multimodal Communications

• Chapanis (1975)
• Bly (1988) Tang (1991)
• Oviatt (1999)
• Faraday and Sutcliffe (1997)
• Neuwirth et al. (1994)
• Daly-Jones et al. (1997)
• Bergeron et al. (1999, 2001)

7
C-SLANT

• C-SLANT (Collaborative Slide Annotation Tool)
• Simple screen capturing
• Slide show structure for asynchronous messages
• Synchronized voice and mouse movement recording
  other annotation tools
• 97 of the participants made deictic gestures
• Combined deictic gestures with other annotations
  markings
• Slide show structure needed overarching messaging
  structure

8
Point n Talk

• Simple Asynchronous Presentation System
• Synchronized Speech and Pointing over an image
• Play only mode for students
• Tested in a Data Structures and Program Design
  Class with 17 students

9
(No Transcript)
10
Point n Talk
11
Authoring Issues

• Sometimes difficult to record in one take
• Trying to be very succinct
• Recording in chunks helped
• Didnt always need to point
• E.g. Talking about the entire slide as one topic
• Sometimes mouse was moved into white space while
  not gesturing

12
Online Survey Results
13
Online Survey Results

• Things liked
• Synchronized speech and pointing (7)
• Ease of use
• Asynchronous presence
• Things disliked
• Download time
• Unnecessary pointer movement (5)
• Fixed size images

14
Point n Talk Enhancements

• A text window to help scripting and annotating a
  slide
• In addition to starting and stopping recording
  with mouse-commands or function keys
• Recording voice only, Record pointing only,
  Record voice and pointing modes
• Actual size and best-fit image display

15
2001 SIGCSE Questionnaire

• Special Interest Group on Computer Science
  Education (SIGCSE)
• 58 instructors responded

• Do you ever use a slide show to structure
  material to be covered in your classes?
• 46(79) yes 12(21) no

16
Slide Show Usage
17
2001 SIGCSE Questionnaire

• Do students have access to the same set of
  slides?
• 44(96) yes 2/46(4) no
• Do you use annotated copies of your slides as
  part of your preparation for teaching your
  classes?
• 20/43(47) yes 23(53) no (3 gave no answer)

18
Conclusions

• A lot of slide show use
• Multimodal slide shows with deictic referencing
  over static images
• Useful to review some material
• Simple for instructors and students
• Popular with students
• Need to record to compact discs and/or use
  streaming technology