Techniques for Observing Users

1
Techniques for Observing Users

• Sharon Parikh
• CS 160 Discussion
• 3/5-6/01

2
Overview

• Discuss the 10 steps of observing users properly
• outlined in Kathleen Gomoll reading
• Use these steps when doing your usability testing
  on your low-fi prototype

3
Step 1a Setup

• Write down the tasks
• slips of paper, note cards
• Recruit the users
• dont ask
• your friends
• your CS160 classmates
• Set up a realistic situation
• quiet room with no distractions

4
Step 1bIntroduction

• Introduce yourself and the team

5
Step 2Explain purpose of test

• Explain to the user about how they fit in our
  design process
  
• providing feedback on your design
• Emphasize the fact that you are testing your
  design and not them
  
• its okay to make mistakes and get stuck

6
Step 3Its OK to quit

• Your user should be told that they can quit the
  test at any time
  
• puts the user at ease
• Standard ethical and professional procedure

7
Step 4Talk Demonstrate

• Talk about demonstrate how the equipment in the
  room will be used
  
• i.e. tape recorder - will be used to take their
  vocal thoughts and observations
  
• Demonstrate any piece of the equipment that they
  will need to use that they have not used before
  
• i.e. a laser pen as a mouse pointer

8
Step 5Explain how to think aloud

• Most users will feel self-conscious about talking
  out loud
  
• re-assure them that it might be awkward at first,
  but its really easy once you get used to it
  
• If they stop talking out loud, remind them
• you need the vocal feedback for your observations

9
Step 6Cannot provide help

• Tell the user that you will not be able to
  provide help or answer questions once the
  experiment starts
  
• By letting users flounder, you can see how
  people really interact with your product

10
Step 6Continued...

• Under certain circumstances, you may need to
  provide help
  
• Think of which circumstances you will do so,
  before your experiment
  
• Let them ask any questions they want as part of
  thinking out loud
  
• Answer them at the end of the experiment

11
Step 7Tasks and UI

• Give instructions for their tasks
• both orally and written down
• Describe the general function of the product
• If you need to demonstrate part of the product,
  dont demonstrate the part you are trying to
  evaluate

12
Step 8Any questions?

• Ask the user if they have any questions before
  you start the observations
  
• Answer any of those that dont affect what you
  are evaluating
  
• task specific questions
• general questions about what you covered already
  is fine
  

13
Step 9After the tasks

• Explain to the user what you were trying to find
  out
  
• Answer any remaining questions
• Discuss interesting behavior you observed
• Ask about overall impressions
• Ask any questions you have about test
• why did they do something

14
Step 10Use the results

• If the users had difficulty with a particular
  feature, dont blame the user
  
• improve your design with their feedback
• during the evaluation, record your observations
  for documentation
  
• critical incident logs
• test again (next assignment)

15
Conclusion

• 1 Setup Introduction
• 2 Explain purpose of test
• 3 Its OK to quit
• 4 Talk Demonstrate
• 5 Explain how to think aloud

16
Conclusion cont.

• 6 Cannot provide help
• 7 Tasks UI
• 8 Any questions?
• 9 After the tasks
• 10 Use the results