Capturing and Visualizing Histories of Multimediabased Casual Interactions

1
Capturing and Visualizing Histories of
Multimedia-based Casual Interactions

• Charlotte Tang
• University of Calgary

2
The Message

• Group members and researchers can benefit from a
  visualization system for multimedia casual
  interactions
• Designers can benefit from a taxonomy of tasks
  and visualization

3
Message

• Multimedia conversations can be captured and
  visualized for review and analysis
• A taxonomy of tasks and visualization can guide
  designing such visualization tool

4
Casual Interaction
5
Casual Interaction
Hi Mary
6
Casual Interaction
Hi guys! Oh, theres Sally! Ask her along.
7
Distance impairs casual interaction
Hey guys, Im at CHI, anything new?
I wonder if Mike is in the lab? I have a question
for him.
8
Technologies for casual interaction
9
Notification Collage (Greenberg Rounding, 2001)
10
Problems

• Uncertain how to effectively capture multimedia
  interactions
• No visualization tool to help people review and
  analyze these histories
• Uncertain what people do with interaction
  histories

11
Previous work

• Text-based systems

Its cool! Go for it!
Smith Fiore, 2001
Viegas Donath, 1999
12
Goals

• Build a conversation capturing tool
• Develop VisStreams
• Identify a taxonomy of tasks and visualizations

13
Capture text conversations

• H
• Ho
• How
• Howd
• Howdy
• Howdy!

• H
• Ho
• Hoa
• Ho
• How
• Howd
• Howdy
• Howdy!

14
Capture text conversations

• H
• Ho
• How
• Howd
• Howdy
• Howdy!

15
Capture video images







16
Capture video images
Boyle Greenberg, 2002
17
Conversation Capture

• Filter out redundant texts
• Filter out similar/identical images
• Capture all data types

18
VisStreams

• To visualize multimedia past conversations
• Timeline overview
• Timeline detailed view
• Timeline filtered view
• Dynamic zooming
• Episode replay

19
A taxonomy of tasks visualizations

• What requirements should a tool for visualizing
  histories of multimedia casual interactions
  support?
• Tasks
• visualizations

20
Methodology Brainstorming

• Tasks to perform
• Questions to ask

21
Methodology Data visualization

• A booklet of interaction data
• PostIt notes white board markers

22
Results Task Categories
Perspective
of Group Member
of Researcher
23
Results Visualization Parameters
24
Detail View
Mike R, Ive brought the tripod back home to use.
Yeah, let me turn the video on.
Ouch!!! When will you bring it back? I want to
tape NCWed.
Carman around?
Hey, Saul, what are you taping?
Harry Potter! Movie tonite?
Nice posture ?
1115
1120
1125
25
Conversation View
Greeting gestures
Hiking in Canmore
VisStreams development
Were going to have a pot luck dinner in Canmore
Hey, Mike What do you think about the overview?
It looks good to me! Can I change their height and
Which trail are we going to hike?
26
Rhythms and Trends View
Begole et al. 2002
27
Community Social Structures View
Joanie
Brandes et al., 2001
(DiMicco, 2003)
28
Contributions

• A taxonomy of tasks and visualization
• Design and critique of VisStreams
• A conversation capturing tool and a set of design
  issues and solutions

29
Future work

• Prototype visualization tools using our taxonomy
• Field study of VisStreams
• Interaction and privacy

30
The Message

• Group members and researchers can benefit from a
  visualization system for multimedia casual
  interactions
• Designers can benefit from a taxonomy of tasks
  and visualization

31
Message

• Multimedia conversations can be captured and
  visualized for review and analysis
• A taxonomy of tasks and visualization can guide
  designing such visualization tool

32
Enhance VisStreams
Future Work

• Detailed View

Timeline Detailed View
Timeline Filtered View
Dynamic Zooming
Episode Replay
33
Enhance detailed view
34
Enhance VisStreams
35
Identify conversation threads
Collabrary
NC
Tabletops
VisStreams
Timeline Detailed View
36
Conversation View
Collabrary
NC
VisStreams
Tabletop
SDG
Xmas Party