Active Capture Design Space

1
Active Capture Design Space

• Ana Ramírez Chang
• BiD Seminar
• 3 November 2005

2
Active Capture
Systems that direct human action
SIMS Faces
3
Active Capture
Direction / Cinematography
Interaction
Capture
Active Capture
Computer Vision / Audition
Human Computer Interaction
Processing
4
Active Capture
Direction / Cinematography
Interaction
Capture
Active Capture
Computer Vision / Audition
Human Computer Interaction
context
Processing
5
Active Capture
Feedback
Goal-Directed Interactive Loop
6
Active Capture
Directs human action. The system and the user
have a common goal, and the system directs the
user to help her reach the common goal.
Feedback loop. The interaction script uses data
from the action recognizer to affect how it
directs the human action.
Action recognizer uses context from interaction
script. The action recognizer uses context from
the interaction with the user, or the interaction
script along with data from the multimedia
parsers to create a more complex recognizer.
System monitors directed action. The system uses
multimedia parsers and sensors to monitor the
directed action.
7
Constraint Space

• Time To Task
• User Satisfaction
• with the process and the product
• Variability In Product
• is product discrete (often binary) or continuous
  in its satisfaction of the common goal
• Cost Of Failure
• for false positives and false negatives

8
Alarm Clock Example

• Desired Action The alarm clock directs the user
  to wake up.
• Multimedia Parsers The alarm on/off button.
• Action Recognizer The awake recognizer would
  describe the user as being awake if she turned
  off the alarm after it rang.

9
Alarm Clock

• Directs human action - The alarm clock directs
  the user to wake up.
• System monitors directed action - The alarm keeps
  ringing until the user is awake enough to turn
  the alarm off.
• Action recognizer uses context from interaction
  script
• If the button is pressed while the alarm is not
  going off, the user may be turning the alarm off
  in her sleep, the alarm may have fallen off the
  counter, causing the button to be hit, or maybe
  even a cat has pressed the button.
• If the button is pressed when the alarm is not
  buzzing, we can not be very sure the person whom
  we are directing to wake up is awake.
• If the button is hit while the alarm is going
  off, there is a very good chance the person is
  awake and pushed the button.
• Feedback loop - If the user does not press the
  button, the alarm keeps buzzing, and if she does
  press the button, the alarm stops buzzing, so the
  interaction script uses data from the action
  recognizer.

10
Alarm Clock

• Time to task How long should it take for the
  alarm clock to wake the person up?
• User satisfaction The alarm clock could wake the
  person up so that she is annoyed at the alarm
  clock, or it could wake her up so she is
  refreshed and not annoyed with the alarm.
• Variability in outcome The system could wake
  everyone up the same way, say abruptly, or
  slowly, or it could wake each person up
  differently, depending on their reaction to the
  alarm.

11
Redesigned Alarm Clock

• Time To Task
• User Satisfaction
• Process
• Product
• Variability in Outcome

12
Redesigned Alarm Clock

• Time To Task 15 minutes
• User Satisfaction
• Process high, so the user is not annoyed at the
  system and will be willing to wake up to it the
  next day.
• Product high success rate of waking the person
  up.
• Variability in Outcome high, allowing each
  person to wake up a different way, maybe in a few
  minutes, or using all 15 minutes, maybe just by
  noticing the brighter light, or maybe with a loud
  buzz.

13
Redesigned Alarm Clock

• Different types of alarms
• Different tones
• Change modality e.g. lights, sounds, water
• Change methods e.g. tell user to wake up, make
  user wake up

Freshness
Method shift
Modality shift
14
Next Steps

• Find existing Active Capture applications
• Place applications in constraint space
• Re-evaluate design strategies with respect to
  constraint space
• Re-design some existing AC applications by moving
  them within design space (constraint space
  design strategies)

15
Redesigned Alarm Clock

• Time To Task
• User Satisfaction
• Process
• Product
• Variability in Outcome

16
Redesigned Alarm Clock

• Time To Task
• User Satisfaction
• Process
• Product
• Variability in Outcome