Measuring

1
Measuring Demonstrating Learning Value
toNon-Training Business Managers
Presented by Will
Hipwell Jeffrey BerkVice President Vice
President, Products StrategyGeoLearning, Inc.
KnowledgeAdvisors
2
Todays Webinar Agenda

• What is Analytics?
• The 5 Levels of Learning Measurement
• Balanced Scorecard
• Thinking Like a
• CxO
• Line of Business Manager
• Training Manager
• Human Capital Contribution Model
• Best Practices

3
What is Learning Analytics?

• Learning Analytics helps organizations understand
  how to better train develop employees, partners
  and customers.

4
Todays Learning Analytics Thinking

• No longer nice to have but a standard tool
• Automation of data collection, storage,
  processingand reporting
• Leverage predictive indicators to make
  informedbusiness decisions
• Analytics tools that are practical, scaleable,
  replicable
• Analytics that repeatedly measure all 5 levels of
  learning
• Strong linkage to impact, results and ROI
• Beyond ROI Value Optimization

5
Human Capital is the Foundation of Learnings
Value
Shareholder / Market Value The Ultimate Proof
of Value
Linkage to Business Results Especially
Profitability Lead to Future Shareholder Value
Business results that exceed expectations result
in increased future shareholder and market values.
Human Capital Performance Drives Future Business
Results
High performing workplaces create business
results (sales, cycle time, cost control,
customer satisfaction, employee retention,
productivity, etc.)
Leaning directly influences the performance of
people. It creates a high performance workplace.
6
Technology Makes Analytics Scaleable
Data Collection
Data Storage
Data Reporting
Data Processing

• Post-Event Survey
• Follow-Up Survey
• Manager Survey
• Instructor Survey
• Scored Testing
• Needs Assessments
• Actual business result
• input tools
• Paper, web, email
• LMS integration

• Sophisticated queries
• OLAP technology
• Multiple aggregations
• Multiple cuts views

• Web-enabled reports
• Push email alerts
• Push email reporting
• Phillips ROI report
• Custom query
• Custom reports
• Analytical tools
• Actual business result reports

• ASP solution
• SQL Server
• Centralized storage
• Secure environment
• Raw data access

• Because data collection, processing and reporting
  is automated, you have more timeto analyze the
  data and turn it into actionable business
  intelligence to
• Improve your learning programs 2) Demonstrate
  value to your stakeholders 3) Optimize your
  learning investments

7
5 Levels of Learning Measurement
Quality Control (Level 1)
Ensure Effectiveness (Level 2)
Improve Application to Job (Level 3)
Impact the Right Business Results (Level 4)
Create Value (Level 5)
Continually Improve
8
Balanced Scorecard for Learning Measurement
Level 1
Did they like it?
Level 2
Did they learn?
Level 3
Do they use it?
Level 4
What were the results?
Level 5
Whats the ROI?
9
Job Roles Learning Analytics
Bersin Associates
10
The 64,000 Question

• How will the users of this information define
  value?
• This necessitates a broad understanding of all
  stakeholders perceptions of ROI.

11
Human Capital Contribution Model

• A process and toolset enabling learning
  organizations to measure and improve business
  results andbottom-line impact.

12
Benefits of HCCM

• Ensures that business results are aligned with
  business objectives.
• Significantly reduces wasted LD expenses
• Substantially increases productivity
• Simplifies the process of tracking actual
  business results
• Cost-effective approach to measuring ROI
• Enables you to link learning investments to
  bottom-line impact
• Data-driven approach to optimizing the impact of
  your LD programs

13
Business Needs Analysis

• Up front planning process
• Ensure training scope is appropriate for business
  needs
• Conduct an organizational needs assessment
• Conduct an individual needs assessment
• Conduct a competency assessment
• Perform a pre-test

14
Business Needs Analysis Case Study

• Insurance company
• Auto liability development need
• Used scenario-based testing
• Built a more focused program
• Participants attended training based on their
  competency

15
Performance Analysis

• Rigorous tracking ofday-to-day operational
  performance
• Reduce wasted training investments
• Improve organizational performance
• Track key attributes of training (instructor,
  location, delivery)
• Track key attributes of participants (years on
  job, business unit)

16
Performance Analysis Case Study

• Telecommunications company
• Sales training outsourced to 3rd party
• Tracked and benchmarked performance
• Made changes for poor performers
• Optimized impact of training on job

17
Business Results Analysis

• Understand business results important to
  management
• Track actual business resultsover time
• Key results include revenue, profitability and
  productivity
• Additional macro results include cost,
  satisfaction, cycle-time, quality and risk
• Use technology templates and tools to automate
  the tracking of actual business results

18
Business Results Analysis Case Study

• Enterprise software company
• Needed to show link to key business results
• Used automated web tools to gather results
• Proved 19 improvement in productivity
• Proved 20 improvement in quality

19
ROI Analysis

• Utilize financial analysis to validate the
  investment
• Leverage The Phillips ROI Process
• Automated tools to estimate, isolateand adjust
• Identifies ways to deliver learning at lower cost
• Identifies programs to invest more/less inthe
  future

20
ROI Analysis Case Study

• Floral company
• Conducted major technology training
• Needed to determine ROI for management
• Analysis proved a 3.4 to 1 benefit to cost ratio
• 276,000 in cost savings due to training

21
Profit Impact Analysis

• Data driven approach to planning and forecasting
  
• Connect learning to financial statement
  analysis
• Measure human capital contribution margin

22
Profit Impact Analysis Case Study

• Small technology company
• Major change to core technology of product
• Measured profit impact of training
• -0.5 effect on profit in Y1, 3 in Y2

23
Learning Measurement Best Practices

• Plan your metrics before writing survey questions
• Ensure your measurement process is replicable and
  scalable
• Ensure measurements are internally and externally
  comparable
• Use industry-accepted measurement approaches

24
Learning Measurement Best Practicescontinued

• Define value in the eyes of your stakeholders
• Ensure metrics are well balanced (Balanced
  Scorecard)
• Leverage automation and technology
• Crawl, walk, run
• Ensure your metrics are flexible

25
Free Resources from GeoLearning

• E-Learning Strategy Blueprintwww.geolearning.com/
  bp
• Learning Analytics Best Practices white
  paperwww.geolearning.com/research
• Training Analytics Human Capital ROI white
  paperwww.geolearning.com/analytics
• Todays Presentation Slideswww.geolearning.com/va
  lueppt
• The GeoLearning Analytics Toolwww.geolearning.com
  /geoanalytics

26
QA Session