Do Not Do a Usability Test Now

1
Do Not Do a Usability Test Now!
Warning
Friends and family usability testing is fast,
easy, and convenient but its a quick and dirty
technique
2
Chapter 2 Observing the User Experience Do a
Usability Test Now!
Friends and family usability testing Discount
usability testing
3
Usability testing of Old
Usability Usefulness Functionality
Developers
Fails to meet functional specifications
Meets Specifications
QA Testing
4
Usability testing of Old
Clients
Usability Usefulness Functionality
Developers
Fails to meet functional specifications
Meets Specifications
QA Testing
5
eCommerce Website Example
I need 1) Product catalog 2) Shopping cart 3)
Receipts
Clients
Usability Usefulness Functionality
Developers
Fails to meet functional specifications
Meets Specifications
QA Testing
6
eCommerce Website Example
Clients
Well use 1) XML AJAX 2) Paypal API 3) SMTP
Usability Usefulness Functionality
Developers
Fails to meet functional specifications
Meets Specifications
QA Testing
7
eCommerce Website Example
Clients
Can we 1) View Items 2) Make Payments 3) Receive
Receipts
Usability Usefulness Functionality
Developers
Fails to meet functional specifications
Meets Specifications
QA Testing
8
eCommerce Website Example
How do I? 1) Save money 2) Choose the best
product 3) Feel good about my purchase?
Clients
Usability Usefulness Functionality
Developers
Fails to meet functional specifications
Meets Specifications
QA Testing
Users
9
eCommerce Website Example
Clients
Developers
Fails to meet functional specifications
Usable
Unusable
QA Testing
Meets Specifications
Usability Testing
Users
10
eCommerce Website Example
My Goals Make Money Attract Customers Meet
Regulations
Clients
Developers
Fails to meet functional specifications
Usable
Unusable
QA Testing
Usability Meets User Goals
Meets Specifications
Usability Testing
My Goals Save Money Get the Best Product Feel
Good
Users
11
Usability Test
My Goals Save Money Get the Best Product Feel
Good
1) Define the Audience and Their Goals
Soccer Mom
12
Quality Assurance Test
Test product function designed by developer to
meet client goals
My Goals XML AJAX Paypal API SMTP
My Goals Attract Customers Make Money Meet
Regulations
Developer
Client
13
Usability Test
My Goals Need it fast Easy to use Feel Smart
My Goals Save Money Get the Best Product Feel
Good
Business Professional
1) Define the Audience and Their Goals
But who is your audience?
Soccer Mom
Tech guru
My Goals Have the coolest product Feel Important
14
Usability Test
My Goals Save Money Get the Best Product Feel
Good

• Define the Audience and Their Goals
• Create Tasks that Address Their Goals

Soccer Mom
Tasks Comparison Shopping with
Competitors Peruse Product Ratings and Customer
Feedback Logon to Secure Website
15
User-less Usability Assessment
Usability Tasks Comparison Shopping with
Competitors Peruse Product Ratings and Customer
Feedback Logon to Secure Website
Product Functionality Searchable Catalog Shopping
Cart Automated Billing and Receipts
16
Discount Usability Test
My Goals Save Money Get the Best Product Feel
Good

• Define the Audience and Their Goals
• Create Tasks that Address Their Goals
• Get The Right People (5-6 people)

Soccer Mom
1) Unfamiliar 2) Unbiased
Friends and Family Test
17
Discount Usability Test

• Define the Audience and Their Goals
• Create Tasks that Address Their Goals
• Get The Right People (5-6 people)
• Watch Them Perform the Tasks

Were not testing you, mom. Were testing the
website.

• In Vitro Testing
• Quite room Computer
• No Distractions
• No Interruptions
• No Help
• Generic Computer
• Think Aloud
• Experimenter taking notes/videotapes

Usability Expert
Thats nice dear. Whos behind the mirror?
Soccer Mom
18
Discount Usability Test
When was the last time you used any website
under these conditions?

• Define the Audience and Their Goals
• Create Tasks that Address Their Goals
• Get The Right People (5-6 people)
• Watch Them Perform the Tasks

Were not testing you, mom. Were testing the
website.

• Quite room Computer
• No Distractions
• No Interruptions
• No Help
• Generic Computer
• Think Aloud
• Experimenter taking notes/videotapes

Usability Expert
Thats nice dear. Whos behind the mirror?
Soccer Mom
19
Discount Usability Test

• Define the Audience and Their Goals
• Create Tasks that Address Their Goals
• Get The Right People (5-6 people)
• Watch Them Perform the Tasks
• What Did You Learn?

What ever was she thinking?

• What worked well?
• Users not understanding?
• Users confused?
• Users frustrated?
• User behaviors different from expectations?
• Did the users understand the purpose of the site?

Usability Expert
20
eCommerce Website Example
Clients
This was such a big LIE!
Developers
Fails to meet functional specifications
Usable
Unusable
QA Testing
Meets Specifications
Usability Testing
Interpreting the results of a usability test is
complicated and never clear cut!
Users
21
eCommerce Website Example
Clients
Developers
Fails to meet functional specifications
Educated Guess Time Constrains Budget Internal
Politics Client Pressures
QA Testing
Its Dirty
Meets Specifications
Usability Testing
The rest of the book will help get a handle on
all of this!
Users