Contextual Inquiry

1
Contextual Inquiry
2
Hall of Fame or Hall of Shame?

• Gas pump display

3
Hall of Shame!

• Hard to distinguish cost vs. gallons
• bad labels
• placed inconsistently
• displays too similar

4
Outline

• Finish task analysis
• Using tasks in design
• Administrivia
• Contextual inquiry

5
How Often do Users Perform the Tasks?

• Frequent customers remember more details
• Infrequent customers may need more help
• even for simple operations
• Which function is performed
• most frequently?
• by which customers?
• optimize system for these tasks will improve
  perception of good performance

6
How Often (BART)?

• Varying frequency of customers
• some take BART every day (most)
• some take it only occasionally
• Varying frequency of tasks
• can only do BART Plus every 2 weeks
• not frequent -gt more instructions
• might do add fare or buy new ticket every day
• probably more common
• How to find out for sure?
• observe customers!

7
What are the Time Constraints on the Task?

• What functions will customers be in a hurry for?
• Which can wait?
• Is there a timing relationship between tasks?

8
Time Constraints (BART)?

• Customers will almost always be in a hurry
• Lines form
• Take less than 1 minute/transaction
• Be able to do any task in any order

9
What Happens When Things Go Wrong?

• How do people deal with
• task-related errors?
• practical difficulties?
• catastrophes?
• Is there a backup strategy

10
Things Go Wrong (BART)?

• Confusion on task
• dismiss transaction button
• Practical difficulty
• generated ticket with too much money
• cash-in policy?
• Catastrophe
• machine eats card -gt swipe instead of insert
• Backup strategy
• use cash in regular machines (use ATM)

11
Selecting Tasks

• Real tasks customers have faced
• collect any necessary materials
• Should provide reasonable coverage
• compare check list of functions to tasks
• Mixture of simple complex tasks
• easy task (common or introductory)
• moderate task
• difficult task (infrequent or for power users)

12
What Should Tasks Look Like?

• Say what the customer wants to do, but not how
  the customer would do it
• allows comparing different design alternatives
• They should be very specific
• forces us to fill out description w/ relevant
  details
• example file browser story
• say who the customers are (use personas or
  profiles)
• design can really differ depending on who
• name names (allows getting more info as
  necessary)
• characteristics of the users (job, expertise,
  etc.)
• Some should describe a complete job
• forces us to consider how features work together
• example phone-in bank functions

13
Using Tasks in Design

• Write up a description of tasks
• formally or informally (us)
• run by customers and rest of the design team
• get more information where needed

Manny is in the city at a club and would like to
call his girlfriend, Sherry, to see when she will
be arriving a the club. She called from a
friends house while he was on BART, so he
couldnt answer the phone. He would like to check
his missed calls and find the number so that he
can call her back.
14
Using Tasks in Design

• Write up a description of tasks
• formally or informally (us)
• run by customers and rest of the design team
• get more information where needed
• Rough out an interface design
• discard features that dont support your tasks
• or add a real task that exercises that feature
• major screens functions (not too detailed)
• hand sketched
• Produce scenarios for each task
• what customer has to do what they would see
• step-by-step performance of task

15
Scenarios (cont.)

• Scenarios are design specific, tasks arent
• Scenarios force us to
• show how various features will work together
• settle design arguments by seeing examples
• only examples -gt sometimes need to look beyond
• Show customers storyboards
• sequences of sketches showing screens
• actions customers can take

16
Involve Customers to Answer Task Analysis
Questions

• Customers help designers learn
• what is involved in their jobs
• what tools they use
• i.e., what they do
• Developers reveal technical capabilities
• builds rapport an idea of what is possible
• customers can comment on whether ideas make
  sense
• How do we do this?
• observe interview prospective customers in work
  place!

17
Contextual Inquiry

• Way of understanding customers needs work
  practices
• Design happens in teams
• design team programmer, marketing, quality
  assurance, producer, more..
• user teams the customers are also part of a team
  that does something
• Master apprentice model allows customer to
  teach us what they do!
• master does the work talks about it while
  working
• we interrupt to ask questions as they go
• The Where, How, and What expose the Why

18
Principles

• Context
• go to the workplace see the work as it unfolds
• people summarize, but we want details
• keep it concrete when people start to abstract
• We usually get reports by email, ask Can I see
  one?
• Partnership
• master-apprentice relationship, yes other
  models, no
• avoid interviewer/interviewee (stops work),
  expert/novice (set expectations at the start)
• partnership allows more apprentice interaction
• alternate between watching probing (withdrawal
  return)

19
Principles (cont.)

• Interpretation
• good facts are only the starting point
• designs based on interpretations
• validate rephrase
• run interpretations by the customer to see if you
  are right
• share ideas to check your reasoning (walk the
  chain back)
• people will be uncomfortable until the phrasing
  is right
• need to be committed to hearing what the customer
  is really saying (Huh?, Umm, Yes, but)
• Focus
• interviewer needs data about specific kind of
  work
• steer conversation to stay on useful topics
• respect triggers (flags to change focus
  changing understanding)
• shift attention (some one walks in)
• surprises (you know it is wrong)

20
Customers Unique or One of Many?

• Take the attitude that nothing any person does
  is done for no reason if you think its for no
  reason, you dont yet understand the point of
  view from which it makes sense. Take the
  attitude that nothing any person does is unique
  to them, it always represents an important class
  of customers whose needs will not be met if you
  dont figure out whats going on. (p. 63)

21
Thoughts on Interviews

• Use recording technologies
• notebooks, tape recorders, still video cameras
• Structure
• conventional interview (15 minutes)
• introduce focus deal with ethical issues
• get used to each other by getting summary data
• transition (30 seconds)
• state new rules they work while you watch
  interrupt
• contextual interview (1-2 hours)
• take notes, draw, be nosy! (who was on the
  phone?)
• wrap-up (15 minutes)
• summarize your notes confirm what is important
• Master/apprentice can be hard
• e.g., sometimes need to put down your company
  (the designers)

22
What Customers Might Say

• This system is too difficult
• You dont have the steps in the order we do
  them
• Do not take comments personally
• you shouldnt have a personal stake
• Goal is to make the system easy to use for your
  intended customers

23
Caveats of Customer-Centered Design Techniques

• Politics
• agents of change can cause controversy
• get a sense of the organization bond w/
  interviewee
• important to get buy-in from all those involved
• Customers are not always right
• cannot anticipate new technology accurately
• job is to build system customers will want
• not system customers say they want
• be very careful about this (you are outsider)
• if you cant get users interested in your hot
  idea, youre probably missing something
• Design forever without prototyping
• rapid prototyping, evaluation, iteration is key

24
Summary

• Answer questions before designing
• who, what, where, when, how often?
• users data?, other tools? when things go wrong?
  
• Selecting tasks
• real tasks with reasonable functionality coverage
• complete, specific tasks of what user wants to do
• Contextual inquiry
• way to answer the task analysis questions
• interview observe real users
• use the master-apprentice model to get them to
  teach you