An Analysis of Survey Research in Augmentative

1
An Analysis of Survey Research in Augmentative
Alternative Communication Marcie L. McNeill and
Janice Light Department of Communication Sciences
and Disorders, The Pennsylvania State University

• Surveys as Valuable Tools
• Systematic and deliberate means of gathering
  qualitative and quantitative information
• Answer specific questions and explore the
  relationships between variables
• Help to define areas of need
• Help to determine where money is spent
• Contribute information towards policy and funding
  decisions
• Things that get counted, get noticed.
• Surveys gather information on
• Opinions, values, beliefs, habits
• Demographic characteristics such as age, health,
  income, and education
• Facts and figures about people, events, or time
• Devaus, 2002 Fink. 2006, Groves, Fowler, COuper,
  Lepkowski, Singer, Tourangeau, 2004

• Components of Good Surveys Recommended
  Strategies to Overcome Challenges and Reduce
  Error
• Sampling Coverage Error
• Employ random or stratified sampling as possible
• Ensure all members of a population have a chance
  of responding
• Use of known groups, multi-step procedures, or
  snowball sampling to help locate members of
  target populations
• Measurement Error
• Focus group discussion of salient issues and
  terminology for questionnaire development
• Feedback on questionnaires from expert panels,
  stakeholders, and target populations
• Pilot study implementation
• Non-response error
• Use of clear and concise questionnaires
  containing issues important to the respondent
• Use of questionnaires that can be completed in a
  timely manner
• Multiple and systematic contact with respondents
• Systematically compare respondents to
  non-respondents to ensure lack of bias in results
• Analyze first wave of respondents against later
  waves for differences
• Increase Reliability
• Systematic questionnaire development
• Systematic training and monitoring of
  interviewers

• Goals of the Project
• Analyze published surveys in the field of AAC
• Identify the populations being surveyed
• Identify purposes of the surveys
• Identify the methodological challenges of
  implementing surveys in AAC
• Identify potential strategies to overcome the
  challenges

• Sampling Recruiting Methods
• Unless dealing with a large group of established
  members, it is very difficult to employ true
  random sampling techniques
• Majority of the studies used Convenience Sampling
  
• Lists of facilities and organizations
• Preassembled groups of individuals
• Support groups, member lists, listservs
• Purposive or judgment sampling
• Individuals used based upon the perception of
  their knowledge and skills set
• Two-step procedures
• Primary contacts pass study information on to
  potential participants (e.g. snowball sampling)

• Methods
• 43 survey research studies from 1985 to 2007 in
  the Augmentative and Alternative Communication
  journal were analyzed for their implementation of
  survey methodology techniques

• Current Response Rates
• 27 of the published studies utilized
  self-administered mailed questionnaires
• Response rates varied between 22 and 88
• 7 studies had response rates of less than 30
• 6 of those 7 were published after the year 2000
• Target population groups included ASHA special
  interest division 12 members, individuals who
  use AAC, teachers, and family members of
  individuals who use AAC
• 5 of the 7 attempted 2 or less contacts
• 13 / 27 studies with response rates of 60 or
  higher
• Employed multiple contact strategies including
  follow up phone calls
• Targeted populations included universities,
  family members, teachers, former patients,
  individuals who use AAC, speech language
  pathologists, agencies

• Results
• Populations Targeted
• Individuals who use AAC
• Speech Language Pathologists
• Family members caregivers
• Regular special education teachers
• Employers co-workers
• Graduate Students in communication disorders
• Universities
• Not included Individuals with cognitive
  disabilities who use AAC

• Methodological Challenges of Survey Research in
  AAC
• Many potential participants may require
  alternative ways of responding due to
  communication, cognitive, or motor impairments
• In AAC, the heterogeneity, small size, and
  difficulties associated with locating the
  targeted populations increase the chance of error
  to occur
• Sampling error
• Occurs when only some of the members of a target
  population group are surveyed
• Always exists on some level
• Measurement Error
• Occurs when respondents answers to questions are
  imprecise and difficult to compare to other
  answers
• Usually as a result of poorly worded questions
• Coverage Error
• Occurs when the list from which the sample is
  drawn is incomplete or does not include all
  elements of a population
• All are not given an equal chance of being
  included in the sample population
• Non-response Error
• Occurs when there is a significant portion of the
  targeted population that do not respond or
  participate in the study
• This group may have characteristics that make
  them different from the members of the population
  group that chose to respond
• Dillman, 2007

• Future Research
• Individuals with cognitive disabilities who use
  AAC currently do not have a voice in survey
  research
• Very little information exists for researchers on
  how to effectively and reliably survey
  individuals with disabilities, especially those
  with complex communication needs.
• Survey researchers in the field of AAC must
  implement survey methodology effectively, while
  attempting to overcome the challenges that occur
  due to the unique characteristics and small size
  of the targeted populations
• Through implementation of these recommendations,
  researchers can ensure that the surveys they
  address yield valuable, reliable, high quality
  data that serves to advance understanding and
  improve outcomes for individuals who use AAC.

• Information Obtained from
• Surveys in AAC
• Demographics of individuals who use AAC
• The experiences of individuals who use AAC
• Literacy
• Employment
• Crime
• SLPs knowledge of AAC
• The status of personnel preparation
• The experiences of family members and caregivers
  of individuals who use AAC
• Funding of AAC devices
• Reasons for the acceptance or abandonment of AAC
  systems

• Improving Response Rates
• Tailored Design Methodology
• Dillman, 2007
• The chance of people participating in a survey is
  greater if they feel that the rewards of
  participating will outweigh any costs
• User-friendly questionnaire with postage paid
  return envelopes
• Up to 5 contacts with questionnaire recipients
• Pre-notice letter, cover letter, thank you
  postcard, repeat mailing of questionnaire,
  telephone contact if possible
• Use of personalized correspondence
• Offer of token financial incentives

Further information and references available by
contacting Marcie McNeill at mlm539_at_psu.edu