First thoughts on FLY

1
First thoughts on FLY

• Scott Klemmer08.28.2006

2
High level how I can help

• Bring in ideas from the academic literature
• Help with ideation
• Design review

3
Today

• Some initial thoughts
• Begin fleshing out some scenarios
• Out of the box
• Power User
• Figure out next steps

4
Compass Rose Mode Selection

• Strengths
• Easy to Learn
• Clear, consistent mappings
• Challenges
• Remembering mode
• not sure, only testing will tell
• Have any data on mode errors?
• A bit slow to navigate one at a time
• Teaching simple print content seems successful

5
Pie and Marking Menus

• Pie Menus are a radial menu
• Marking menus extend this with the ability to
  mark ahead (Kurtenbach 1994)
• Much faster than linear menus for muscle control
  memory reasons
• Potential advantages for compass rose
• More fluent interaction for power users
• Marks leave record of mode
• Potential challenge
• How to see mode options

6
Recognition and Learning

• single-character commands seem successful
• multi-character commands seem clunkier
• (SR, SD, )
• How does the Rose relate to these?
• Gestures on the main character?
• In general, a move from characters to gestures
  may be powerful?

7
Feedback on the PC?

• Use Bluetooth to communicate with PC
• Current mode and options given on PC screen
• Provides feedback about current state
• Prevents a non-self-disclosing interface
• gestures on paper control PC screen
• Potential for augmenting experiences like piano
• Bouncing ball to indicate next option
• New games that bridge paper and digital

8
FLY Notes / World / Notes Browser

• On the whole, very slick
• iTunes-like feel comes across well
• Primary challenge too much meta-interface
• The piano is a great intro hook
• And solves the catch-22 of the pen
• Recognition is magical and catchy
• but it doesnt always work

9
The dashboard challenge

• Relevant information and available commands
  should be visible (self-disclosing)
• A Hallmark strength of the GUI over a command
  line interface, which is non-self-disclosing (how
  do I know what I can do?)
• But visibility of extraneous information causes
  clutter

10
An analogy a hammer

• Once weve had some practice, we dont think
  about using a hammer, we think about hammering
  a nail
• Location and action are determined in one gesture
• No mode errors (hammer v. pull up nail are very
  distinct)
• No widgets, buttons, controls

11
Potential Extraneous information

• File/Edit/ menus feel very GUI 1.0
• In Office 2007, replaced by ribbon
• tools could be folded into tasks, rather than
  being a top-level item
• what would you like to do?
• Like iTunes, could go straight to documents
• Check for apps redundant w/store on left
• Install apps redundant w/My pen

12
Potential extraneous information

• pen monitor text implied by the information to
  the right
• Account balance only needed when in purchase
  mode
• 5 applications installed possibly better as a
  tooltip for memory level
• Search My Documents could just say search
  inside the text box
• Likewise, search icon redundant
• level in battery level, and percent/icon
  redundancy

13
My documents

• arent really documents, but notebook pages
• Meta-interface feels a bit heavyweight
• Why not go straight to the notebook pages?
• Are categories and keywords an important
  distinction?
• Rise of the folksonomy
• In general, Flickr is a great browser model
• Add keywords on paper?

14
Text recognition

• conversion is a step in a task, not a task in
  itself
• Possibly best done automatically, in background
  (multivalent documents Phelps Wilensky 2000)

15
(No Transcript)
16
Leveraging the PC browser

• Notes/diary sharing is a killer app
• Social send notes to friends, family,
• School send to teacher, classmate
• Collaborate with Flickr?
• Send notes pages to photo site
• How does scheduler relate to browser?
• Can I see a desktop calendar?

17
(No Transcript)
18
Potential new experiences

• How about something in the creative domain?
• Make a collage with Flickr
• add in photos with gestures
• A different kind of notebook
• Sketchbook
• Larger artist papers