Methodological%20Issues%20in%20Survey%20Research

1
Methodological Issues in Survey Research

• Jeremy McMillen,
• James Randy McBroom,
• Barbara Langham,
• Texas AM University-Commerce

2
Survey Research Methods

• Mail Surveys (postal service, campus
  alternatives)
• E-Surveys (e-mail initiated, mail initiated)
• Telephone
• On-Site Variations
• Hybrid and Combination (example, mail survey with
  internet response option)

3
Graduating Student Survey Internet

• Purposes
• Support Strategic Planning
• SACS Accreditation
• Program, Department Review
• Student Services Review
• Customer Satisfaction Report Component
• Retention, Graduation Issues

4
Graduating Student Survey-Internet

• Population All Students Graduating in Spring,
  2001 (N646)
• Initial Contact Letter from University
  President Containing
• Request to Complete Questionnaire
• Web-Site of Questionnaire
• Instructions, Including Password, Implied Consent
  Notice, and Incentive Notice (100 Savings Bond)

5
Graduating Student Survey-Internet

• Questionnaire 52 Item Instrument on Web-Site
  with Direct Data Entry
• Case-Control Minimal
• Follow-Up Letter After 3 Weeks to All
• Cost
• Monetary 200
• Personnel Hours 10
• Response Rate 19.2
• Time Frame 6 weeks

6
Graduate Student Engagement Survey-Mail

• Purposes
• Outgrowth of National Survey of Student
  Engagement
• Large, Diverse Graduate Student Population
  (Masters and Doctoral)
• Lack of Information on Graduate Students
• SACS Accreditation
• Support Strategic Planning

7
Graduate Student Engagement Survey-Mail

• Population All Degree Seeking Graduate Students
  (Masters and Doctoral) Enrolled in Spring, 2001
  (N1,648)
• Sampling Procedure Stratified Random Sampling,
  Doctoral Students Weighted
• Final Sample Size 666 Total (548 Masters, 118
  Doctoral)

8
Graduate Student Engagement Survey-Mail

• Initial Contact Mailed Package from Researcher
  Containing
• Cover Letter with Instructions, Implied Consent
  Notice
• 83 Item Questionnaire
• Stamped, Addressed Return Envelope
• Coded Case-Control Postcard

9
Graduate Student Engagement Survey-Mail

• Questionnaire 83 Item Instrument
• Case-Control Coded Post Card
• Follow-Up Entire Package to Non-Respondents
  After 3 Weeks
• Cost
• Monetary 1,200
• Personnel Hours 120 Hours (Approximately)
• Response Rate 50
• Time Frame 9 Weeks

10
Comparison of Methods

• Internet
• Incentive (100)
• Minimal Case-Control
• Follow-Up 3 Weeks
• Cost
• 200
• 10 Hours
• Time Frame 6 Weeks
• Response Rate 19.2

• Mail-Out
• No Monetary Incentive
• Good Case-Control
• Follow-Up 3 Weeks
• Cost
• 1,200
• 120 Hours
• Time Frame 9 Weeks
• Response Rate 50

11
Conclusion

• Internet
• Advantages and Disadvantages
• Mail-Out
• Advantages and Disadvantages

12
Contacts

• Jeremy McMillen, Director of Institutional
  Research
• jeremy_mcmillen_at_tamu-commerce.edu
• [phone]
• Randy McBroom, Assistant to the President for
  Planning and Institutional Effectiveness
• randy_mcbroom_at_tamu-commerce.edu
• [phone]
• Barbara Langham, Assistant Data Analyst, Office
  of Institutional Research
• barbara_langham_at_tamu-commerce.edu
• [phone]
• Texas AM University-Commerce
• P.O. Box 3011
• Commerce, TX 75429-3011