samedi 6 juin 2009

To experiment with operant conditioning

Basically, classical conditioning is a form of learning where two stimuli become associated so strongly that the presence of only one of the stimuli will elicit the same response as if both were present. (If you need to know more, go read that node).

Operant conditioning is when you do one thing, another thing happens, and you therefore learn to do the first thing in order to cause the second thing to happen. This is stimulus-response connection. (classical conditioning is a stimulus-stimulus connection).

About the time Ivan Pavlov was working with his dogs, Edward L. Thorndike was messing about with cats; he put them into cages ('puzzle boxes') which had some trigger that needed to be pressed or pulled in order to open the door. The cats would struggle to escape, and by chance would hit or pull the right doodad; after a couple times the cats would learn to just hit the button or pull the string straight off. This response would be reinforced by repeated successes, and weakened by failure. This is called Thorndike's Law of Effect.

B.F. Skinner liked the general idea, and because of his work operant conditioning is largely associated with his name today. But Skinner was a Behaviorist, and so dropped all talk of intentions and desires on the part of the animal. He focused on the operant, which he defined as an observable, voluntary behavior that an organism emits to 'operate' (have an effect) on the environment. The Skinner-Box is a common apparatus used to experiment with operant conditioning.

Aucun commentaire: