Title: Service Oriented Architecture in eTesting Systems
16th Workshop Software Education and Reverse
Engineering
Service Oriented Architecturein eTesting Systems
Goce Armenski, M.Sc(armenski_at_ii.edu.mk)
Institute of Informatics - FNSUniversity Ss.
Ciryl and Methodious Skopje, Macedonia
21.
Content
CONTENT
- ????? SYSTEM FOR ELECTRONIC TESTING
- INTRODUCTION
- ?RCHITECTURE, CONCEPTS AND FUNCTIONALITY OF
??EST
- APPLICATION OF ETEST
- RESULTS
- SERVICE ORIENTED ARCHITECTURE
- SOA IN EASSESSMENT
- COMMON FRAMEWORK
- CONCLUSION
32.
??est concepts and functionality
??est Technology
Web based sollutions VS desktop based sollutions
- Web based application- Active Server Pages
(ASP)- JavaScript- SQL Server 2000- NT Server
and Win 2000 compatible- IIS 4.0 or newer
Web Browser (Netscape 4.x or Internet Explorer
4.x, and above)
JScript
Email (SMTP)
SQL Server Access
IIS 4.0
ASP
Win 2000 Server
43.
??est concepts and functionality
Course organization
- learning objects- three structure
Fig. 3 Course organization
54.
??est concepts and functionality
Types of questions
- Multichoice questions (choose one of many, choose
many of many, yes/no answers) - Short entry answer (text or numerical)
- Essay answer.
- Questions can have pictures or graphs in the text
or offered answers
65.
??est concepts and functionality
Test creation algorithm
Fig. 4 Algorithms for test creation
- dynamic linear tests (fixed number of questions)
Marking and reporting
- results are shown at the end of the test-
negative marking
76.
??est concepts and functionality
Statistical data analyses
- Identification of content which is not well
presented - Personalized feedback to students
- Identification of week questions which need to be
revised before used again - Identifying the individual weaknesses of students.
87.
Application of eTest
4. APPLICATION OF ??EST
- Integration in the process of learning -
Controlled learning
Fig. 5 Way of passing the learning objects
- Successful strategy??
- all questions
- N questions in a row
- N right questions
- 3 right questions in a row
Statistical analyses of the user activities
98.
Results
5. RESULTS
Practical Implementation
- Institute of Informatics , FNS (2001)
- ?.D. Mobimak (2002)
- UNDP (2003-2004)
The use of technology in education is very
dependent of the organization - logistics
- social changes Synchronization with other
systemsTechnical infrastructure
109.
Results
Data gathering
Institute of Informatics, FNS (january 2001)
- 26 courses - 12391 questions - 589
scheduled assessments - 9861 generated tests
Does eTesting provides more effective and more
objective assessment compared to the traditional
forms, and does it help the learning process
1110.
Results
Problems Facing with
- Installed in 4 Faculties from 3 Universities
- - not interoperable
- does not allow searching or using common
question bank - does not allow cross-institutional cooperation
- not fully standards compliant
12Possible Solution
11.
Results
13IT Architecture Requirements
12.
Service Oriented Architecture
6. SERVICE ORIENTED ARCHITECTURE
- Simplicity
- Software that reflects the need of business
- Agility and flexibility
- Reusability
- Technology independent
- Promote integration
Built to Change
14Evolution of the Web
13.
Service Oriented Architecture
1514.
Service Oriented Architecture
SERVICE ORIENTED ARCHITECTURE
An approach for building distributedcomputing
systems based on encapsulating business functions
as services that can be easily accessed in a
loosely coupled fashion.
16SOA Its Not a Thing
15.
Service Oriented Architecture
Its not a
- Product
- A specific technology
- An application
- A specific standard
- A specific set of rules
An Approach for Building Agile and Flexible
Business Applications
177. SOA in eLearning
16.
SOA in eLearning
- JISC Technical Framework to support e-Learning
(ELF). - IMS Abstract Framework (IAF)
- LeAPP Learning Architecture Project
- Carnegie Mellons Learning Services Architecture
1817.
SOA in eLearning
e-Learning (ELF)
198. SOA in eAssessment
18.
SOA in eAssessment
- FREMA.
- TENCompetence Assessment Model
20FREMA Core Services
19.
SOA in eAssessment
- Support Services
- Schedule
- Notify
- Track
- Authorise and Authenticate
- Assessment Services
- Assign
- Author item
- Author assessment
- Validate assessment
- Take assessment
- Mark assessment
- Moderate assessment
- Grade Assessment
- View Feedback
Reference Impl
Service Profiles
Assessment Domain Definition
21TENCompetence - Phases in the assessment process
20.
SOA in eAssessment
Assessment Design
Item Construction
Assessment Construction
AssessmentDelivery
Respons Evaluation
DecisionMaking
22eTest Core Services
21.
SOA in eAssessment
- Support Services
- Schedule
- Notify and Announce
- Track
- Authentication
- User Management
- Assessment Services
- Item Construction
- Test Construction
- Test Delivery
- Results Collecting
- Marking
- Decision Making
- Statistical Analysis
2322.
SOA in eAssessment
SOA Projects in eAssessment
- Research Projects
- TOIA Technologies for Interoperable assessment
- ASSIS Assessment Sequencing
- APIS assessment Provision through
Interoperability - and many others
- Standards Bodies
- In Assessment IMS, OSIDs
- In Web Services - SOAP, WSDL, WSRF, W3C
2423.
Conclusion
6. CONCLUSION and FUTURE FORK
Service Oriented Architecture
- Advantages over monolithic applications for
Testing
Review of existing SOA models for eAssessment
- Design of Common Framework by service
identification - Practical realization
Extend the ASSIS project with different test
delivery models
- Dependent on context
- Game based learning
25Thank you for your time!