Kypros-net Web Site: Learn Greek! On-line Course

1
Kypros-net Web SiteLearn Greek! On-line Course

• SI 622
• Evaluation of Systems and Services
• M. Elledge
• P. Zaphiris
• 4/15/00

2
Part I - Introduction
3
The Project

• Evaluate Learn Greek! language course
• Usability
• Functionality
• Quality
• Client Kypros-net Originator/Administrator

4
The Product

• Kypros-net description
• Formation
• By a group of volunteers (grad students) in 1996.
• Composed mainly of Computer Science,
• Information Technology and Human-Computer
• Interaction students.
• Purpose
• to utilize the Internet and particularly the
  World Wide Web (WWW) system for the promotion of
  the world of Cyprus

5
Kypros-net Web Site
6
Learn Greek! Course

• Course Description
• Independent study course to learn Greek
• 105 audio lessons, transcriptions, vocabulary,
  spell checker, dictionary
• Objectives
• Assist people in learning Greek language
• Develop site content using Participatory Design
• Minimize expense (tapes from Cyprus Broadcasting
  Corporation (CyBC) radio volunteers)

7
Learn Greek! Home Page
8
Methods Used

• Interviews with site creator, content
  contributors (2), director and administrator of
  U-M Language Resource Ctr.
• Forty-three user surveys, 371 discussion board
  postings
• Literature search of PsychInfo and Wilson
  databases
• Comparative Evaluation with 16 web language sites
• User testing of 8 tasks with 5 subjects
• GTN for first two levels
• Metaphor, Vocabulary analyses
• Checklist/Cognitive walk-through on course
• GOMS on 2 tasks

9
Key Client Questions

• How useful is the course?
• How functional is the course?
• How well does it meet on-line course standards?
• What can be done to improve the course?

10
Part II - What we did
11
Question 1

• How useful is the course?
• Does it meet client objectives?
• Does it meet user expectations?
• Findings
• Client objectives exceeded
• User expectations met
• Still, there are issues...

12
Findings

• Client Objectives
• Participatory Design 105 lessons transcribed by
  8 users on-going help provided by users
• Steady increase in site visits over time

13
Learn Greek! Site Visits
14
Findings

• Client Objectives
• Participatory Design 105 lessons transcribed by
  8 users on-going help provided by users
• Steady increase in site visits over time
• User Expectations
• High satisfaction

15
User Satisfaction
16
Findings

• Client Objectives
• Participatory Design 105 lessons transcribed by
  8 users on-going help provided by users
• Steady increase in site visits over time
• User Expectations
• High satisfaction
• Positive comments

17
User Comments

• EASY TO UNDERSTAND
• Fun
• It helped refresh my Greek
• Finally after surfing for a long time I found
  that you could learn Greek from the internet
• It is a very progressive course, builds up
  confidence as it goes
• Very good method of learning
• It falls into place after listening a couple of
  times.
• Greek is the most kick-butt language on
  earth!!!!

18
Findings

• Some User Issues
• Cannot download lessons
• No pronunciation guide
• Cannot compare text with lessons
• Few instructions or information about course
  content

19
Discussion Board Postings

• Category/Subject Total
• Technical
• Problems with needing/installing keyboard
  fonts 56 15.1
• Problems with/wanting to download
  lessons 49 13.2
• Problems with installing/using RealPlayer 40 10.8
  39.1
• Content
• Postings of on-line notes 73 19.7
• Questions about availability of text, CDs or
• including links to web sites 37 10.0
  29.7
• Comprehension
• Questions about vocabulary 28 7.5
• Questions about grammar/spelling 17 4.6
• Questions about dialect 2 5.4 17.5
• Miscellaneous 69 18.6 18.6

20
Question 2

• How functional is the course?
• Do the operations work?
• Is the architecture successful?
• Findings
• Site is subject to typical Internet problems
• Learn Greek! architecture can be improved

21
Findings

• Operations
• The site generally works
• Translations, lessons, etc. function
• Web operations less dependable
• Server downtime
• Slow lesson downloads, translations
• Intermittent transmission

22
Findings

• Architecture
• Labeling
• Confusing (Greek to English dictionary in Greek)
• Incorrect (Vocabulary/notes transcripts)
• Out-of-order (Instructions after the task)

23
Site Architecture-Labeling
24
Findings

• Architecture
• Labeling
• Confusing (Greek to English in Greek)
• Incorrect (Vocabulary/notes transcripts)
• Out-of-order (Instructions after the task)
• Layout
• Inconsistent formatting and appearance

25
Site Architecture-Formats
26
Findings

• Architecture (cont.)
• Content
• No directions (RealPlayer, Greek font
  installation)
• No descriptions (Lesson plans course content)
• No Help or FAQ
• Multiple translations
• Navigation
• Hard to find things (transcripts)
• Search engine cannot target course

27
Question 3

• Does it meet language course standards?
• Is the content appropriate?
• Is the methodology appropriate?
• Findings
• Fairly unusual hybrid of independent study
  web-based learning
• Pedagogy okay, course content can be enhanced

28
Attributes of Language Programs
29
Findings

• Meets basic teaching methodologies

30
Conclusions

• Strengths are also weaknesses
• Accessibility vs. dependability
• Participation vs. consistency
• Frugality vs. thoroughness

31
Recommendations

• Technical
• Allow downloading of course audio material
• Architecture
• Implement a consistent look and feel
• Include preview and where am I
• Content
• Instructions and FAQ
• More Visual.

32
Questions ?