Complex Repertoires and PM Methodologies

1
Complex Repertoires and PM Methodologies

• Manuel A. Rodriguez
• Florida Institute of Technology
• Kelly L. Therrien
• Florida Institute of Technology
• James E. Daniels
• Aubrey Daniels International
• ABA 2004

2
Points of Presentation

• Introduction to Evaluating Complex Repertoires in
  OBM
• The Current Project
• Implications to the field of OBM

3
Introduction

• Much of the behavior in organizations is
  rule-governed behavior (Agnew Redmon, 1992
  Austin, Carr, Agnew, 1999 Malott, 1992)
• Progress should be made toward more reliable
  measures of verbally-mediated maintaining
  variables or better interpreting of data gained
  from questionnaires in light of known mechanisms
  of rule control
• Ericsson and Simon (1993) protocol analysis
  research has contended to understanding further
  verbal problem solving processes (Austin and
  Delaney, 1998)
• Accounting (Bouwman, 1984)
• Job choice (Barber Roeling, 1993 Soelberg,
  1965)
• Supervisor evaluations (Martin Klimoski, 1990)
• Strategic decision making (Schweiger, Andersen,
  Locke, 1985)
• Consumer choice (Bettman Zins, 1977)
• Performance problem solving (Austin, 1996)

4
Introduction

• The Knowledge Worker (Amar, A.D., 2002)
• Cognitive Constructs
• Evaluation of covert behavior as a method of
  constructing a more objective observation form
  (Lattal Perone, 1998 McGuigan, 1978)
• Lattal and Perone (1998) 5 strategy points to
  approach verbal behavior (derived from Skinner,
  1957)
• Treat verbal behavior as behavior
• Pit variables against each other
• Assume that different subjects will follow
  different paths
• Distinguish verbal topographies from verbal
  functions
• Compare verbal behavior with nonverbal behavior

5
The Current Study

• Site
• Nuclear Power Plant, located in the Eastern
  United States
• Participants
• 2 Groups
• Work Control Planners and Schedulers
• Engineering Design and Rapid Response Team
• Human Performance Steering Team
• Goals
• Job observation form
• Analyze and recommend

6
Applying PM

• Pinpointing
• Mind Mapping
• Measuring
• Job Observations
• Evaluation
• Graphing
• Feedback
• Individual

7
Mind Map

• Used for generating outlines for writing, family
  trees, and complex business applications
• Advantages of Mind Maps
• Interpretation of How the brain works
• Associations and links to be recorded and
  reinforced
• Key words and images, not sentences
• Visually stimulating
• Disadvantages of linear models
• Time constraints
• Missing Info.
• Interpretation
• Visual appeal

8
Mind Map Applications

• Notes
• Recall
• Creativity
• Problem Solving
• Planning
• Presentation
• When linear is not applicable

9
Examples of Mind Maps
10
Examples of Mind Maps
11
Mind Maps in Business
12
Current Project Mind Maps
13
Current Project Mind Maps
14
Current Project Mind Maps
15
The Observation Tool

• O.T.I.S.
• Verbal Behavior measured as opposed to overt
  behavior
• Yess and nos over opportunities
• Engineering Department and the Performance
  Appraisal
• Coaching

16
Outcome of Job Observations
17
Outcome of Job Observation
18
Outcome of Job Observation
19
Outcome of Job Observation
20
Outcome of Job Observation
21
Project Notes

• Previous Job Observations Methodology/Post Job
  Observation Methodology
• Buy in on Mind Maps and Covert Behavior
• Feedback System needed
• No Follow-up
• No IOA
• Social Validity High

22
Implications for the Field

• The implications of this study
• Observations of verbal behavior for knowledge
  workers in other organizations
• Application of OBM to all types of employees,
  rather than a reliance on employees whose
  performance is directly observable
• Why do Mind Maps Sell?
• Covert Behavior in Business

23
Future Research

• Research should be conducted on the use of mind
  maps or some other assessment method for
  gathering verbal repertoires of complex
  organizations
• Research should be conducted on verbal behavior
  and verbal reports as variables of interest in
  generating observation tools towards performance
  improvement
• IOA
• Effects of Being Observed
• Cognitive Task Analysis and OBM

24
Questions/Comments?

• Manuel A. Rodriguez
• mrodriguezbs_at_yahoo.com
• Florida Institute of Technology
• Kelly L. Therrien
• ktherrien_at_cfl.rr.com
• Florida Institute of Technology
• James E. Daniels
• Aubrey Daniels International
• ABA 2004

25
References

• Annett, J. (2000). Theoretical and pragmatic
  influences on task analysis methods. In J.M.
  Schraagen, S.F. Chipman, V.L. Shalin, (Eds.),
  Cognitive Task Analysis, (pp. 25-40). Mahwah, NJ
  Lawrence Erlbaum Associates.
• Zachary, W., Ryder, J., and Hicinbothom, J., (in
  press). COGNITIVE TASK ANALYSIS AND MODELING OF
  DECISION MAKING IN COMPLEX ENVIRONMENTS, In J.
  Cannon-Bowers E. Salas (Eds.), Decision making
  under stress Implications for training and
  simulation. Washington, DC American
  Psychological Association.
• Reynolds, R., Brannick, M., (2002) Thinking
  About Work/Thinking at Work Cognitive Task
  Analysis. Symposium presented at the 17th annual
  conference of the Society for Industrial and
  Organizational Psychology, Toronto
• Gordon, S.E., and Gill, R.T. (1997). Cognitive
  Task Analysis. In C. Zsambok and G. Klein (Eds.).
  Naturalistic Decision Making. (pp. 131-140).
  Mahwah, NJ Lawrence Erlbaum Associates.
• Reynolds, R.T., Brannick, M. (2000) Is job
  analysis doing the job Extending job analysis
  with cognitive task analysis, The Industrial
  Psychologist, 39(1), 63 67.
• Reynolds, R.T. Neville, K. (2002). Job
  Analysis versus Cognitive Task Analysis of Air
  Traffic Controllers, Paper presented at the
  Military Psychology Conference, VA.
• Levine, E.L. (1983) Everything you always wanted
  to know about job analysis, and more A primer.
  Tampa, FL Edward L. Levine..
• Ryder, J.M., Gott, S., Neville, K.J., (2000).
  Using Cognitive Task Analysis for Instructional
  Design. Orlando, FL Naval Air Warfare Center
  Training Systems Division. (Technical Report
  000322.9914)

26
References

• Ryder, J.M., Gott, S., Neville, K.J., (2000).
  Using Cognitive Task Analysis for Instructional
  Design. Orlando, FL Naval Air Warfare Center
  Training Systems Division. (Technical Report
  000322.9914)
• Cooke, N.J., (1994). Varieties of knowledge
  elicitation techniques. International Journal of
  Human-Computer Studies, 41, 801-849.
• Amar, A.D. Managing Knowledge Worker Unleashing
  Innovation and Productivity (2002). Quorum
  Books, London.
• Austin, J., Carr, J., and Agnew, J. (1999). The
  Need for Assessment of Maintaining Variables in
  OBM. Journal of Organizational Behavior
  Management, 19, 59-87.
• Austin, J. Delaney, P. (1998). Protocol
  Analysis A useful tool for the behavior analyst.
  The Analysis of Verbal Behavior, 15, 41-56.
• Barber, A., and Roeling, M. (1993). Job posting
  and the decision to interview A verbal protocol
  analysis. Journal of Applied Psychology, 78,
  845-856.
• Bettman, J., and Zins, M. (1977). Constructive
  processes in consumer choice. Journal of
  Consumer Research, 4, 72-85.
• Bouwman, M. (1984). Expert vs. novice decision
  making in accounting A summary. Accounting,
  Organizations, and Society, 9, 325-327.
• Briscoe, R., Hoffman, D., and Bailey, J. (1975).
  Behavioral Community Psychology Training a
  Community Board To Problem Solve. Journal of
  Applied Behavior Analysis, 8, 157-168, Number 2
  (Summer)

27
References

• Soelberg, P. (1965). A Study of decision making
  Job Choice. Unpublished doctoral dissertation,
  Carnegie Institute of Technology, Pittsburg, PA.
• Lattal, K., and Perone, M. (1998). Handbook of
  Research Methods in Human Operant Behavior
  Plenum Press
• Martin, S., and Klimoski, R. (1990). Use of
  Verbal Protocols to trace cognitions associated
  with self-and supervisor evaluations of
  performance. Organizational Behavior and Human
  Decision Processes, 46, 135-154.
• McGuigan, F.J., (1978). Cognitive
  Psychophysiology principles of Covert Behavior
  Prentice-Hall, Inc., Englewood Cliffs, New
  Jersey.
• Ericsson, K., and Simon, H. (1993). Protocol
  Analysis Verbal reports as data. (Revised
  edition) Cambridge, MA The MIT Press.
• Hayes, S., Barnes-Holmes, D., and Roche, B.
  (1994). Relational Frame Theory A Post
  Skinnerian Account Of Human Language and
  Cognition. Kluwer Academic / Plenum Publishers.