BOSR Project Survey

1

BOSR Project Survey 3 Summary of Key
Findings December 13, 2007
2
Introduction (1 of 2)

• This document provides a summary of the third
  BOSR Project Survey findings.
• The survey objective was to help assess
  organizational readiness for the new EMIS
  Go-Live.
• The survey was distributed on November 19th, 2007
  to approximately 500 EMIS stakeholders (current
  system users, other interested parties in TBS,
  and other government departments (OGD)) It
  closed on November 26th with 150 respondents.
• The survey findings have been supplemented by
  information on organizational readiness from 224
  TBS and OGD users who completed feedback forms
  during their attendance at EMIS training between
  October 22nd and December 11th.
• With regards to readiness, the following was the
  main finding
• Overall, OGD respondents indicated a higher level
  of readiness to use EMIS than TBS respondents.
• This may be explained by the fact that
  significantly fewer Expenditure Management Sector
  (EMS) and Program Sector (PS) respondents had
  benefited from EMIS training by the survey close
  date of November 26th.
• Offsetting this finding, the consolidated results
  from EMIS training feedback forms demonstrated
  that, with increasing attendance at training
  between November 26th and December 11th 34 from
  PSs, 21 from OGDs, and 9 from EMS the reported
  readiness levels increased throughout.

3
Introduction (2 of 2)

• This document is organized into the following
  sections
• Participant Profile
• Training
• Business Processes
• Readiness to Use EMIS
• Business Processes and Readiness to use EMIS
• Note All sections from Participant Profile
  forward are based on the BOSR Project Survey with
  the exception of Business Processes and Readiness
  to use EMIS (page 12) which is based on the
  results from the EMIS training feedback forms.
• A subsequent survey is planned for mid to late
  January 2008 with the objective of assessing the
  level of organizational change adoption following
  the implementation of the new EMIS.

4
Participant Profile

• Similar to the second survey, the number of
  respondents who completed the survey decreased
  compared to the second survey nevertheless, over
  150 respondents completed the third survey, which
  is an ample response rate.

• As with the second survey, the majority of
  respondents were from government organizations
  outside of the Treasury Board Secretariat.
• Approximately 40 of respondents were from large
  government organizations (500 or more FTEs or
  Reference Levels 300M or greater), and
  approximately 30 were from small government
  organizations (less than 500 FTEs and Reference
  Levels less than 300M.
• The response rate from the TBS PSs is
  particularly low, with response rates ranging
  from only 1 to 4.

5
Training Overall Results and By User Group

• As of November 26th, approximately 94 of users
  have either completed or registered for training.
• OGDs have a significantly higher training
  completion rate than TBS users.

• Context
• As of November 26th (BOSR Survey close), only 19
  people from EMS and 37 people from the PSs had
  completed in-class training, compared to 208
  people from the non-TBS departments/agencies/crown
  s.

6
Business ProcessesOverall Results and By User
Group

• Overall, 44 of respondents indicated that they
  understand the new business processes
• Generally, EMS and PSs have a lower level of
  understanding than OGDs.

• Context
• As of November 26th (BOSR Survey close), only 19
  people from EMS and 37 people from the PSs had
  completed in-class training, compared to 208
  people from the non-TBS departments/agencies/crown
  s.

7
Business Processes By those who have completed
training within each User Group

• Of those respondents who have completed training,
  approximately 52 understand the new processes.
  However, similar to the results regarding
  readiness to use EMIS, a significant percentage
  (42) of EMS respondents who have completed
  training indicated a lack of understand.

• Context
• As of November 26th (BOSR Survey close), only 19
  people from EMS and 37 people from the PSs had
  completed in-class training, compared to 208
  people from the non-TBS departments/agencies/crown
  s.

8
Readiness to use EMISOverall results and By
User Group

• Overall, the majority of respondents feel that
  they are personally ready to use EMIS. However,
  there remains a fair number of TBS respondents
  who do not feel ready specifically, within the
  EMS.

• Context
• As of November 26th (BOSR Survey close), only 19
  people from EMS and 37 people from the PSs had
  completed in-class training, versus the 208
  people from the non-TBS departments/agencies/crown
  s.

9
Readiness to use EMISOverall Results and By
User Group

• Overall, the majority of respondents feel that
  their immediate organizations are ready to use
  EMIS. However, a large percentage of TBS
  respondents indicated that do not feel that their
  teams are ready.

• Context
• As of November 26th (BOSR Survey close), only 19
  people from EMS and 37 people from the PSs had
  completed in-class training, compared to 208
  people from the non-TBS departments/agencies/crown
  s.

10
Readiness to use EMISBy those who have
completed training within each User Group

• Of those respondents who have completed training,
  overall, approximately 72 are ready to complete
  transactions in EMIS. However, a significant
  percentage of EMS respondents who have completed
  training (60) indicated that they continue to
  feel unprepared.

• Context
• As of November 26th (BOSR Survey close), only 19
  people from EMS and 37 people from the PSs had
  completed in-class training, compared to 208
  people from the non-TBS departments/agencies/crown
  s.

11
Readiness to use EMISBy those who have
completed training within each User Group

• Overall, the majority of respondents who have
  completed training feel that their immediate
  organizations are ready to use EMIS. However, a
  fairly high percentage of respondents from the
  TBS EMS indicated that they do not believe that
  their organization is ready.

• Context
• As of November 26th (BOSR Survey close), only 19
  people from EMS and 37 people from the PSs had
  completed in-class training, versus the 208
  people from the non-TBS departments/agencies/crown
  s.

12
Business Processes and Readiness to use
EMISConsolidated Results from Training Feedback
Forms

• Of those who completed feedback forms given at
  the end of training sessions between October 22
  and Dec 11th, a significant percentage (62)
  indicated that they were ready to work with the
  new EMIS and the related business processes
  very few respondents indicated disagreement (6).
• It is likely that the higher percentage of
  readiness indicated through the EMIS training
  feedback forms compared to the BOSR Survey is due
  to the information learnt during the training
  sessions and the fact that EMS and PS staff
  continued to attend training following the BOSR
  Project Survey close on November 26th.

• Context
• As of November 26th (BOSR Survey close), only 19
  people from EMS and 37 people from the PSs had
  completed in-class training, compared to 208
  people from OGDs.
• Between November 27th and December 11th, EMS
  training completion increased by 9, PSs by 34 and
  OGDs by 21.