Extending UML for Modeling of Multimedia Applications

1
Extending UML for Modeling of Multimedia
Applications
Stefan Sauer, Gregor Engels University of
Paderborn (Germany) Information Systems
Group engels_at_uni-paderborn.de
G. Engels, University of Paderborn
2
Motivation
3
Motivation
4
Example
5
Research Goal

• Modeling Language for Multimedia
  Applications
• Language Requirements
• covers all aspects of a MM application
• graphical / visual
• already familiar to software developers

comprehensive easy to understand easy to learn
6
Aspects of a MM Application

• (1) Logical Structure
• application domain objects
• associated media objects
• (2) Spatial Presentation (Layout)
• (3) Predefined Temporal Behaviour
• (4) Interactive Control

7
Interrelations between Aspects
MVC (Model - View - Controller) -
Pattern
(4) Interactive Control
(1) Logical Structure
Controller
Modelstatic
Model

• (2) Spatial Presentation

• (3) Predefined Temporal
• Behaviour

Modeldynamic
View
8
Research Goal

• Modeling Language for Multimedia
  Applications
• Language Requirements
• covers all aspects of a MM application
• graphical / visual
• already familiar to software developers

comprehensive easy to understand easy to learn
9
UML

• UML (Unified Modeling Language)
• standardized object-oriented modeling language
• accepted as industrial standard by
• OMG (Object Management Group) in
  1997
• current version 1.3
• formally defined abstract and concrete syntax
• informally defined semantics
• comprises 8 different (already known!) diagram
  types

10
UML Diagram Types
(1) Use Case Diagrams (2) Class Diagrams (3)
Statechart Diagrams (4) Activity Diagrams (5)
Sequence Diagrams (6) Collaboration
Diagrams (7) Component Diagrams (8) Deployment
Diagrams
11
UML Diagram Types vs. Multimedia Aspects
(1) Use Case Diagrams (2) Class Diagrams (3)
Statechart Diagrams (4) Activity Diagrams (5)
Sequence Diagrams (6) Collaboration
Diagrams (7) Component Diagrams (8) Deployment
Diagrams

• (1) logical structure
• application domain objects
• associated media objects
• (2) spatial presentation
• (3) predefined temporal behaviour
• (4) interactive control

12
Class Diagram Example
Media
MMApplication
1
1
1..
1..
ContinousMedia
DiscreteMedia
ApplicationUnit
Animation
Text
Image
Graphics
Video
Audio
ComposerEntry
1
1
1
1
1..
1..
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
2..
2..
0..2
0..2
1
1
1..3
1..3


1
1
TextEntry
Portrait
MusicSheet
MusicPiece
Film
0..1
0..1


1
1
1
1
1
1
1
1
1
1
13
UML Diagram Types vs. Multimedia Aspects
(1) Use Case Diagrams (2) Class Diagrams (3)
Statechart Diagrams (4) Activity Diagrams (5)
Sequence Diagrams (6) Collaboration
Diagrams (7) Component Diagrams (8) Deployment
Diagrams

• (1) logical structure
• application domain objects
• associated media objects
• (2) spatial presentation
• (3) predefined temporal behaviour
• (4) interactive control

14
Extended Sequence Diagram
Music int MTitle
KNMn MusicSheet
KNMa MusiPiece
Highlight Marker
T s
0
L
R
MTitel Mozart1
max 0,5
max 0,2
HBox1
035
HBox2
035
210
HBox3
035
HBox4
025
ImageVideoBox
15
UML Diagram Types vs. Multimedia Aspects
(2) Class Diagrams (3) Statechart
Diagrams (5) Sequence Diagrams

• (1) logical structure
• application domain objects
• associated media objects
• (2) spatial presentation
• (3) predefined temporal behaviour
• (4) interactive control

?
16
Extension of UML OMMMA-L
Object-Oriented Modeling of MultiMedia
Applications - the Language

• (1) logical structure
• application domain objects
• associated media objects
• (2) spatial presentation
• (3) predefined temporal behaviour
• (4) interactive control

OMMMA-L Class Diagrams Statechart
Diagrams Presentation Diagrams Extended Sequence
Diagrams
17
Example
18
Spatial Presentation (Layout)
End
Alphabet
ArrowAnimation
ImageVideoBox
HypertextBox
ImageBox
Prev
Rew
Stop
Play
Pause
Ffw
Next
Prev1
Next1
19
OMMMA-L Presentation Diagram
End
Alphabet
ArrowAnimation
L
ImageVideoBox
HypertextBox
ImageBox
R
Prev
Rew
Stop
Play
Pause
Ffw
Next
Prev1
Next1
20
OMMMA-L covers all aspects
MVC (Model - View - Controller) -
Pattern
(4) Interactive Control
(1) Logical Structure
Controller
Modelstatic
Statechart Diagram
Class Diagram
Model

• (2) Spatial Presentation

• (3) Predefined Temporal
• Behaviour

View
Modeldynamic
Ext. Sequence Diagram
Presentation Diag.
21
(No Transcript)
22
Summary

• OMMMA-L
• object-oriented modeling language for
  multimedia applications
• based on UML (Unified Modeling Language)
• new features
• presentation diagram
• extended sequence diagram
• formally defined abstract and concrete syntax
• based on UML meta model
• OMMMA-tools available (extensions of Rational
  Rose)

23
Industrial Application
joint project with DaimlerChrysler goal
development of Automotive UML for requirements
specification of automotive components
example navigation system