Critics

1
Critics

• IE 8541 / HUMF 8001

2
What did you learn from the protocol?

• To which information did the subject attend? How
  often did the subject access information in the
  problem description?
• Did the subject successfully they separate
  relevant from irrelevant information?
• Where did the subject have difficulties?
• Could you develop a model of the
• Does any concepts from the Expertise article
  apply to the subjects behavior?

3
Critics

• A critic is a system the presents a reasoned
  opinion about a product or action (or decision)
  generated by a human.
• An important property of critics is that the
  human does the problem solving in any way they
  see fit.
• This allows the users great flexibility in their
  problem solving approach.

4
A Continuum of Human Control and Automation
Agent assisted by human
Design environment
Autonomous system
Intelligent assistant
Pencil and paper
Critic
Adapted from Fischer et al. Critics, and
Emerging Approach to knowledge-based ,
International Journal of Man-Machine Studies, 35
(5) 695-721, 1991.
5
High Functionality Systems

• Complex systems with many functions. Examples
  CAD systems, information retrieval systems, Word,
  etc.
• Problem users may not understand/remember all
  the functions available to them.
• Critics can be very useful in helping users to
  learn and effectively apply the power of such
  systems.

6
Complex problem solving

• Critics can also be useful in complex problem
  solving helping users to identify possible next
  steps.
• Critics can also help in users in insuring that
  solutions conform to the complex rules (building
  codes, legal requirements) and constraints of a
  domain. Examples architectural design, NASA
  operations planning.

7
Critics vs. Totally Automated Problem Solvers

• Critics
• Users completely control the problem solving
• Does not require encoding all knowledge,
• Easier to maintain
• Robust at producing solutions
• Requires the user to put in work to produce a
  solution,
• Provides direction and support, without cramping
  the users style.

• Automated solvers
• Do no allow users much control over problem
  solving,
• Require encoding all relevant knowledge
• Work intensive to maintain,
• Brittle
• Requires little work from user to produce a
  solution
• May frustrate users, motivating them to abandon
  system.

8
Joint Cognitive Systems

• An important philosophical difference between
  critics and totally automated systems is that
• Critics view the human and computer working
  together to solve problems as parts of a joint
  cognitive system.

9
Parts of Janus

• Janus design environment
• Janus Crack Critic contains rules about good
  and bad designs
• Janus ViewPoints provides explanations and
  pros and cons of a design.

10
(No Transcript)
11
Educational vs. Performance Critics

• Educational Critics (i.e. computer tutors and
  guidebots. Goal is to maximize learning and
  information retention, possibly at the cost of
  performance.
• Performance Critics goal is to maximize
  performance at a task. Much education and review
  may occur during use of a performance critic.

12
Active vs Passive Critics

• Active critics interrupt as soon as an issue
  arises. Criticism is timely, but may interrupt
  users cognitive processes, disrupt STM.
• Passive critics give feedback only when asked.
  Less annoying, but feedback may seem out of
  context or come too late.

13
Future needs for Critics

• Critics need to adapt to the user and context.