Semantics for multimedia presentations on the Web

1
Semantics formultimedia presentationson the Web

• prof. dr. Lynda Hardman
• CWI Amsterdam, TU/e

2
Talk overview

• Problem
• Too many users, too many devices
• Design dependencies
• Example presentation
• Rembrandt and chiaroscuro
• Cuypers transformation engine
• Where are the semantics?
• Explicit and implicit
• How should these be incorporated within a
  presentation-generation system?

3
Too many users, too many devices

• Multimedia presentations should be tailored to
  the
• user
• language, abilities, level of expertise, task,
  ...
• end-users platform capabilities
• PC, PDA, mobile, voice-only, no audio,
• network resources available
• bandwidth and other QoS parameters

4
Problems with current transformation tools

• Current document transformation and style
  languages are insufficiently powerful
• They rely on flexibility of textre-flow,
  scrollbars, pagination, etc.
• They are "template-based and thus cannot cater
  for wide variations in
• dynamic media-centric content
• device characteristics
• user preferences

5
Design dependencies
Presentation structure
Style
abcdefghijk abcdefghijk abcdefghijk ABCDEFGHIJK ab
cdefghijk abcdefghijk
Content
6
Presentation structure depends on content
7
Presentation structure of example
Chiaroscuro Rembrandt Harmensz. Van Rijn
title
description
examples
Clair-obscur (Frans) en chiaroscuro (Italiaans)
betekenen 'licht-donker'. Beide termen worden
gebruikt om sterke licht-donkercontrasten in
schilderijen, tekeningen en prenten aan te
duiden. Hoewel het effect al eerder werd
toegepast, is de term pas sinds het einde van de
16de eeuw in zwang. De oorsprong van het woord
ligt in Italië. De schilder Caravaggio
(1573-1610) maakte het chiaroscuro-effect tot
zijn handelsmerk. Hij was een meester in het
schilderen van donkere taferelen met één felle
lichtbundel.
1631
1628
1638
8
Presentation Structure depends on Style
9
Demo
10
Where are the Semantics?
11
Cuypers Knowledge Sources
User Query
MMDB
MetadataDB
Cuypers Engine
12
Conclusions

• Generating multimedia presentations requires
• powerful transformation tools
• which allow design dependencies to be taken into
  account
• Semantic Web has the potential to
• encode knowledge we use
• reuse knowledge already available
• Cuypers system provides an experimentation
  platform
• demo at stand 3002 at 1600

13
This research is supported by

• NWO I2RPIntelligent Information Retrieval and
  Presentation
• NWO CHIMECultural Heritage in an Interactive
  Multimedia Environment (start date end 2002)
• NWO NASHNetworked Adaptive Structured Hypermedia