Questionnaires

1
Questionnaires

• Lode Vanacken
• lode.vanacken_at_uhasselt.be

2
References

• Preece et al., Interaction Design, beyond human
  computer interaction
• Walonick, Survival Statistics (excerpts)

3
Introductie
Vragen
Interviews
Questionnaires
4
Waarom?

• Wat doen ze?
• Wat willen ze doen?
• Wat vinden ze tof?
• Wat vinden ze niet tof?

5
Wanneer?

• Niet alleen in HCI
• Marktonderzoeken,
• Usability testing
• Field studies

6
Interviews

• Conversation with a purpose
• Kort
• Simpel
• Niet te veel vragen
• Review en pilot study!

7
Guidelines

• Korte vragen
• Geen samengestelde vragen
• How do you like this cell phone compared with
  previous ones that you have owned?
• ?
• How do you like this cell phone? Have you owned
  other cell phones? If so, did you like it?

8
Guidelines

• Vermijd jargon
• Geen veronderstellingsvragenWhy do you like
  this style of interaction?
• Pas op voor bevooroordeling!

9
Bad or Good?

• What brand of computer do you own? __
• A. IBM PC
• B. Apple

10
Solutions

• Do you own an IBM PC? (circle Yes or No)Do you
  own an Apple computer? (circle Yes or No)
• What brand of computer do you own? (Check
  all that apply)
• __ Do not own a computer
• __ IBM PC
• __ Apple
• __ Other

11
Bad or Good?

• Where did you grow up? __
• A. country
• B. farm
• C. city

12
Bad or Good?

• What do you think about this report? __
• A. It's the worst report I've read
• B. It's somewhere between the worst and
  best
• C. It's the best report I've read

13
Bad or Good?

• Are you in favor of Proposition 13 ?
• ___ Yes
• ___ No
• ___ Undecided
• What was your AGI last year? ___

14
Branching

• 1. Do you currently have a life insurance policy
  ? (Yes or No) If no, go to question 3
• 2. How much is your annual life insurance
  premium ? __
• 1. How much did you spend last year for life
  insurance ? __

15
5 Stappen

• Introductie
• Warmup
• Hoofd sessie
• Cool-off period
• Afsluitende sessie

16
Soorten

• Unstructured interviews
• Structured interviews
• Semi-structured interviews
• Group interviews

17
Unstructured interviews

• Specifiek onderwerp
• Open vragen
• Geen structuur, wel doelen!
• Zeer diepgaand

18
Structured interviews

• Questionnaire
• Maar in interview vorm
• Zeer duidelijke doelen
• Gesloten vragen
• Zelfde vragen voor iedereen

19
Semi-structured interviews

• Combinatie vorige 2
• Basis script
• Probes
• Do you want to tell me something else?

20
Group interviews

• Focus group
• Agenda om discussie te leiden
• Hoge geldigheid

21
Analyse

• Interview opgenomen
• Mits toestemming!
• Verzamel de data

22
Questionnaires

• Interview op papier
• Distribueren naar velen
• Post, Mail, Website

23
Design

• Demografische vragen ? groepen
• Specifieke vragen
• Logische delen
• Doelen van de studie
• Zo kort mogelijk

24
Design Tips

• Verkies gesloten vragen
• Bied keuzes aan
• Overweeg No-opinion optie
• Schaal
• Goed bereik
• Geen overlap
• Consistent
• Duidelijke instructies

25
Schaal

• Likert Scales
• Semantic differential scales

26
Likert Scales

• The use of color is excellent (where 1
  represents strongly agree and 5 represents
  strongly disagree)
• The use of color is excellent

1
2
3
4
5
strongly agree
strongly disagree
agree
disagree
OK
27
Likert Scales

• Statements over product.
• This control panel is easy to use
• Bereik?
• 9 7 5 3
• Even / Oneven

28
Semantic Differential Scales

• Minder gebruikt
• Bipolaire houding over bepaald onderwerp
• Deze les

29
Taxonomie

• Method Class
• Inquiry
• Method Type
• Questionnaires/Survey/Interview/Focus Group
• Automation Type
• Capture/Analysis
• Effort Level
• Formal Use

30
Case Study

• Meten van de workload/presence van een gebruiker
• Workload
• Hoe zwaar is de taak mentaal / fysiek
• Presence
• Being there

31
Workload

• NASA-TLX

32
Presence

• Witmer and Singer, SUS,
• Meestal Likert scales

33
Presence

• How natural did your interactions with the
  environment seem?
• How much did the visual aspects of the
  environment involve you?
• How compelling was your sense of moving around
  inside the virtual environment?

34
Questions?