Moving%20to%20E%20Assessment

1
Moving to E Assessment
Robert A Bullivant Deputy Director
General Chartered Insurance Institute
2
AGENDA

• 1. Why bother?
• 2. Making the business case.
• 3. Selecting a partner
• 4. Centre issues
• 5. Compiling the test fixed form or random?
• 6. Implementation
• 7. Communication issues

3
Why Bother ?????????

• Why Bother????????

• Better candidate experience
• Competitive issues
• Regulatory encouragement
• A better way to train and test.

4

• Candidates take an exam when they are ready NOT
  when we say they have to be ready.

5
Making The Business Case

• On line is more expensive
• Business case must look at
• Competitive position
• Candidate experience
• Candidate expectation
• Potential to increase entries

6
Making the Business Case

• Look very closely at cost base and aggressively
  identify savings that will be made as a result of
  going on line.

7
Potential Cost Savings

• Printing
• Centre costs
• Invigilation costs
• Couriers and postage
• Less regular moderation meetings
• Staff both in exam and support areas

8
Selecting a Partner

• Note the word partner not supplier
• Experience of running on line exams
• Which system is being used
• Security arrangements
• Support arrangements
• Costs
• Availability of Centres

9
Centre Issues

• How many
• Where
• Corporate centres
• Mobile testing

10
Compiling the Test

• Moderation
• Has to be done in advance
• Essential to take advice
• Two possible routes
• Fixed form
• Random selection

11
Fixed Form

• A number of tests are compiled in their entirety
  and the system allocates a test at random

12
Fixed Form Issues

• System must allocate a different paper at re-sit
  to those who fail.
• Paper needs to be pre moderated
• Everything is done up front
• Accuracy is essential - GRFT

13
Random Selection

• The question bank is held in the system which
  selects at random the questions to be used by
  reference to the test specification

14
Issues with Random Selection

• Size of question bank
• Facility values
• Test specification and syllabus
• Introducing new questions
• Enemies
• Frequency of change of paper

15
Implementation

• Project structure

16
Communication Issues

• Early research with customers
• Keep customers aware of progress
• Give dates you can meet
• Put a trial test on your web site

17
Topical Tips

• Research the cost benefit implication with great
  care
• Select your partner with care
• Understand how your business will change
• Make sure it will change for the better
• Research the issues around random and fixed form
  carefully there is scope for a false start.

18

• You have to get it right first time. Are your
  procedures and controls up to it????????????