Natural Human-Computer Interaction ??????:????????

1
Natural Human-Computer Interaction?????????????
?

• Jian Wang
• Microsoft Research Asia
• December 27, 2003 Xia Men

2
Outline

• Challenges
• Computing and interaction
• Driving forces of natural user interface
• Case discussion
• Pen computing

3
Random Thoughts

• Analog originals ð Digital originals
• Single Device ð Multiple devices
• Optional ð Essential
• GUI ð Next mainstream UI

4
Challenges

• non-digital way of doing things''
• like paper and pencils
• PCs still create non-digital document
• Such as printed document
• Keyboard/mouse confine people to desktop
• Mobile interaction

5
From Desktop to Anywhere

• Desktop
• Computer on every desktop
• Internet mobility
• A workplace for any time and any where on any
  device

6
Killer Apps Evolution

• PC with KB/Mouse
• Word processing
• Electronic spreadsheet
• Browser
• Today (button, pen, camera)
• Information access, PIM, instant message, e-mail
• Note-taking (help to capture your ideas), reading
  and annotation
• Collaboration / RTC
• Web services

7
Interaction and Devices
Display size
Large
Small
Large
Phone
Instant communication and information access
Mobility
Quick authoring and information access
Tablet PC
High volume authoring and information consumption
Small
Desktop PC
Desktop PC
8
Driving forces

• Computing (GPU)
• Display
• Wireless connection
• Storage
• Sensors

9
Case Discussion

• Tablet PC
• uPen

10
Tablet PC Approach

• Combine the simplicity of paper with power of a
  PC
• The rich features of a notepad with the
  simplicity of a pen
• Wireless
• Display
• Sensor

11
uPen Approach

• New interaction device
• Digital pen
• Digital everything
• Digital printed document
• New data type
• Ink as ink
• Sensor

12
Summary

• Computer (???) goes from desktop to mobile and
  collaborative scenarios(???)
• Is GUI ready for this change?
• Non-digital way of doing things(???)

13
Invention That Changed World

• National Medal of Technology , 2000
• IEEE, John Von Neumann Medal Award , 1999
• ACM, A. M. Turing Award , 1997