What is Operant Conditioning?

1
What is Operant Conditioning?

• Module 16 Operant Conditioning

2
Operant Conditioning

• A type of learning in which the frequency of a
  behavior depends on the consequence that follows
  that behavior
• The frequency will increase if the consequence is
  reinforcing to the subject.

3
Operant Conditioning

• The frequency will decrease if the consequence is
  not reinforcing to the subject.

4
The Law of Effect

• Module 16 Operant Conditioning

5
Edward Thorndike (1874-1949)

• Author of the law of effect
• Behaviors with favorable consequences will occur
  more frequently.
• Behaviors with unfavorable consequences will
  occur less frequently.
• Created puzzle boxes for research on cats

6
Thorndikes Puzzle Box
7
B.F. Skinner (1904-1990)

• Developed the fundamental principles and
  techniques of operant conditioning and devised
  ways to apply them in the real world
• Designed the Skinner Box, or operant chamber

8
Reinforcement/Punishment

• Reinforcement - Any consequence that increases
  the likelihood of the behavior it follows
• Punishment - Any consequence that decreases the
  likelihood of the behavior it follows

9
Reinforcement/Punishment

• The subject determines if a consequence is
  reinforcing or punishing

10
Reinforcement

• Module 16 Operant Conditioning

11
Positive Reinforcement

• Anything that increases the likelihood of a
  behavior by following it with a desirable event
  or state
• The subject receives something they want
• Will strengthen the behavior

12
Positive Reinforcement
13
Negative Reinforcement

• Anything that increases the likelihood of a
  behavior by following it with the removal of an
  undesirable event or state
• Something the subject doesnt like is removed
• Will strengthen the behavior

14
Negative Reinforcement
15
Positive/Negative Reinforcement
16
Reinforcement Immediate Versus Delayed
Reinforcement

• Module 16 Operant Conditioning

17
Immediate/Delayed Reinforcement

• Immediate reinforcement is more effective than
  delayed reinforcement
• Ability to delay gratification predicts higher
  achievement

18
Reinforcement Primary Versus Secondary
Reinforcement

• Module 16 Operant Conditioning

19
Primary Reinforcement

• Something that is naturally reinforcing
• Examples food, warmth, water, etc.
• The item is reinforcing in and of itself

20
(No Transcript)
21
Secondary Reinforcement

• Something that a person has learned to value or
  finds rewarding because it is paired with a
  primary reinforcer
• Money is a good example

22
(No Transcript)
23
PunishmentThe Process of Punishment

• Module 16 Operant Conditioning

24
Types of Punishment

• An undesirable event following a behavior
• A desirable state or event ends following a
  behavior

25
(No Transcript)
26
PunishmentProblems With Punishment

• Module 16 Operant Conditioning

27
Negative Effects of Punishment

• Doesnt prevent the undesirable behavior when
  away from the punisher
• Can lead to fear, anxiety, and lower self-esteem
• Children who are punished physically may learn to
  use aggression as a means to solve problems.

28
Positive Effects of Punishment

• Punishment can effectively control certain
  behaviors.
• Especially useful if teaching a child not to do a
  dangerous behavior
• Most still suggest reinforcing an incompatible
  behavior rather than using punishment

29
Some Reinforcement ProceduresShaping

• Module 16 Operant Conditioning

30
Shaping

• Reinforcement of behaviors that are more and more
  similar to the one you want to occur
• Technique used to establish a new behavior

31
Some Reinforcement Procedures Discrimination and
Extinction

• Module 16 Operant Conditioning

32
Discrimination

• The ability to distinguish between two similar
  stimuli
• Learning to respond to one stimuli but not to a
  similar stimuli

33
Extinction

• In operant conditioning, the loss of a
  conditioned behavior when consequences no longer
  follow it.
• The subject no longer responds since the
  reinforcement or punishment has stopped.

34
Schedules of Reinforcement Continuous
Reinforcement

• Module 16 Operant Conditioning

35
Continuous reinforcement

• A schedule of reinforcement in which a reward
  follows every correct response
• Most useful way to establish a behavior
• The behavior will extinguish quickly once the
  reinforcement stops.

36
Schedules of Reinforcement Partial Reinforcement

• Module 16 Operant Conditioning

37
Partial Reinforcement

• A schedule of reinforcement in which a reward
  follows only some correct responses
• Includes the following types
• Fixed-interval and variable interval
• Fixed-ratio and variable-ratio

38
Fixed-Interval Schedule

• A partial reinforcement schedule that rewards
  only the first correct response after some
  defined period of time
• i.e. weekly quiz in a class

39
Variable-Interval Schedule

• A partial reinforcement that rewards the first
  correct response after an unpredictable amount of
  time
• i.e. pop quiz in a class

40
Fixed-Ratio Schedule

• A partial reinforcement schedule that rewards a
  response only after some defined number of
  correct responses
• The faster the subject responds, the more
  reinforcements they will receive.

41
Variable-Ratio Schedule

• A partial reinforcement schedule that rewards an
  unpredictable number of correct responses
• This schedule is very resistant to extinction.
• Sometimes called the gamblers schedule
  similar to a slot machine

42
Schedules of Reinforcement
43
New Understandings of Operant Conditioning The
Role of Cognition

• Module 16 Operant Conditioning

44
Latent Learning

• Learning that takes place in absence of an
  apparent reward

45
Cognitive Map

• A mental representation of a place
• Experiments showed rats could learn a maze
  without any reinforcements

46
Latent Learning Cognitive Maps

• Play Cognitive Processes in Learning (625)
  Segment 12 from Psychology The Human
  Experience.

47
Overjustification Effect

• The effect of promising a reward for doing what
  someone already likes to do
• The reward may lessen and replace the persons
  original, natural motivation, so that the
  behavior stops if the reward is eliminated

48
New Understandings of Operant ConditioningThe
Role of Biology

• Module 16 Operant Conditioning

49
Biological Predisposition

• Research suggests some species are biologically
  predisposed to learn specific behaviors

50
The End