Usability Test Plans

1
Usability Test Plans

• CSSE 376 Software Quality Assurance
• Rose-Hulman Institute of Technology
• April 20, 2007

2
Outline

• Purpose of Test Plans
• Suggested Format

3
Purpose of Test Plans

• Blueprint for test
• Communication with development team
• Describes needed resources
• Milestone for testing

4
Suggested Format

1. Purpose
2. Problem Statement
3. User profile
4. Method
5. Task list
6. Environment/equipment

1. Test monitor role
2. Evaluation measures
3. Report contents

5
Problem Statement

• High-level reason for performing test
• Describe what you expect to achieve from testing
• don't be vague
• make sure that objective can be measured
• Example
• Is help easier to access via a shortcut key or
  the mouse?

6
User Profile

• Describe end users of product
• Cover all important attributes
• Cover important ranges

7
Example User Profile
Attribute Range Distribution
Computer experience none to 10 years 10 none25 1 year65 1 years
Age 18-55 years 50 18-2540 25-5010 over 50
Gender male/female 85 male
8
Cartoon of the Day
9
Method

• Describe major steps of testing
• Participant greeting
• Orientation
• Performance test
• Participant debriefing

10
Task List

• Tasks to be performed by participants
• Describe Successful Completion Criteria (SCC)
• Include Maximum Time to Complete (MTC)

11
Task List Example
Task Description Detail
1 Select region of data SCC Correct values selectedMTC 2.0 sec
2 Choose chart type SCC Correct type selectedMTC 2.0 sec
3 Assign labels SCC Correct labels assignedMTC 10.0 sec
12
Environment/Equipment

• Describe environment that you are attempting to
  simulate
• desk arrangement
• availability of other materials
• lighting, noise level
• Equipment needed to perform testing

13
Test Monitor Role

• Explain how test monitor will interact with
  participants
• Describe tasks that the monitor will perform

14
Evaluation Measures

• Data that will be collected
• performance
• time to complete tasks
• number of errors by type
• preference
• usefulness of product
• ease of learning/use

15
Report Contents

• What you will report at the conclusion of testing
• major sections of report
• schedule for dissemination
• Does not include analysis