Kypros-net Web Site: Learn Greek! On-line Course

1
Kypros-net Web SiteLearn Greek! On-line Course

• SI 622
• Evaluation of Systems and Services
• M. Elledge
• P. Zaphiris
• 4/15/00

2
The Project

• Evaluate Learn Greek! language course
• Usability
• Functionality
• Quality
• Client Kypros-net Originator/Administrator

3
The Product

• Kypros-net description
• Formation
• Purpose

4
Kypros-net Web Site
5
Learn Greek! Course

• Course Description
• Independent study course to learn Greek
• 105 audio lessons, transcriptions, vocabulary,
  spell checker, dictionary
• Objectives
• Assist people in learning Greek language
• Develop site using User Participation philosophy
• Minimize expense (tapes from Cyprus Broadcasting
  Corporation (CyBC) radio volunteers MIT server)

6
Learn Greek! Home Page
7
Methods Used

• Interviews with site creator, content
  contributors (2), director and administrator of
  U-M
• Forty-three user surveys, 371 discussion board
  postings
• Literature search of PsychInfo and Wilson
  databases
• Comparative Evaluation with 16 web language sites
• User testing of 8 tasks with 5 subjects
• GTN for first two levels
• Metaphor, Vocabulary analyses
• Checklist/Cognitive walk-through on course
• GOMS on 2 tasks

8
Key Client Questions

• How useful is the course?
• How functional is the course?
• How well does it meet on-line course standards?
• What can be done to improve the course?

9
Question 1

• How useful is the course?
• Does it meet client objectives?
• Does it meet user expectations?
• Findings
• Client objectives exceeded
• User expectations met
• Still, there are complaints

10
Findings

• Client Objectives
• Participatory Design 105 lessons transcribed by
  8 users dictionary, spell checker installed by
  users on-going help provided by users
• Steady increase in site visits over time

11
Findings

• User Expectations
• High user satisfaction

12
Findings

• Positive Comments
• EASY TO UNDERSTAND
• Fun
• It helped refresh my Greek
• Finally after surfing for a long time I found
  that you could learn Greek from the internet
• It is a very progressive course, builds up
  confidence as it goes
• Very good method of learning
• It falls into place after listening a couple of
  times.
• Greek is the most kick-butt language on
  earth!!!!

13
Findings

• Some User Complaints
• Cant download lessons
• No pronunciation guide
• Cant compare text with lessons
• Few instructions or information about course
  content

14
Discussion Board Postings

• Category/Subject Total
• Technical
• Problems with needing/installing keyboard
  fonts 56 15.1
• Problems with/wanting to download
  lessons 49 13.2
• Problems with installing/using RealPlayer 40 10.8
  39.1
• Content
• Postings of on-line notes 73 19.7
• Questions about availability of text, CDs or
• including links to web sites 37 10.0
  29.7
• Comprehension
• Questions about vocabulary 28 7.5
• Questions about grammar/spelling 17 4.6
• Questions about dialect 2 5.4 17.5
• Miscellaneous 69 18.6 18.6

15
Question 2

• How functional is the course?
• Do the operations work?
• Is the architecture successful?
• Findings
• Site is subject to Internet vagaries
• Learn Greek! architecture can be improved

16
Findings

• Operations
• ON the site generally work
• Translations, lessons, etc. function
• Waiting can become tedious
• Web operations less dependable
• Server downtime
• Slow lesson downloads
• Intermittent transmission

17
Findings

• Architecture
• Layout
• Violates requirement for visual integrity
• Inconsistent formatting
• Labeling
• Confusing (Greek to English in Greek?)
• Incorrect (Vocabulary/notes transcripts?)
• Out-of-order (Instructions after the task?)

18
Findings

• Architecture (cont.)
• Content
• Few instructions (RealPlayer, Greek fonts)
• No Help or FAQ
• Multiple translations
• Navigation
• Hard to find things (transcripts)
• Search engine cant target course

19
Question 3

• Does it meet language course standards?
• Is the content appropriate?
• Is the methodology appropriate?
• Findings
• Fairly unusual hybrid of independent study
  web-based learning
• Pedagogy okay, course content can be enhanced

20
Findings

• Lacks some features

21
Findings

• Meets basic teaching methodologies

22
Conclusions

• Yin/Yang Strengths are also weaknesses
• Accessibility vs. dependability
• Participation vs. consistency
• Frugality vs. thoroughness

23
Recommendations

• Technical
• Architecture
• Content

24
Questions?
25
Other Findings

• Findings
• Recommendations

26
Conclusions
27
Next Steps
28
Learn Greek! Site Visits