For one thing, even primary sensory cortex is just one part of a huge,
intricate
system.
Steven-Pinker-The-Blank-Slate 1
" Here we have the problem with connectionism.
Simple connectionist networks can manage impressive displays of memory and generalization in circumscribed problems like reading a list of words or learning stereotypes of animals.
But they are simply too underpowered to duplicate more realistic feats of human intelligence like understanding a sentence or reasoning about living things.
Humans don't just loosely associate things that resemble each other, or things that tend to occur together. They have combinatorial minds that enterrain propositions about what is true of what, and about who did what to {80} whom, when and where and why. And that requires a computational architecture that is more sophisticated than the uniform tangle of neurons used in generic connectionist networks. It requires an architecture equipped with logical apparatus like rules, variables, propositions, goal states, and different kinds of data structures, organized into larger systems. Many cognitive scientists have made this point, including Gary Marcus, Marvin Minsky, Seymour Papert, Jerry Fodor, Zenon Pylyshyn, John Anderson, Tom Bever, and Robert Hadley, and it is acknowledged as well by neural network modelers who are not in the connectionist school, such as John Hummel, Lokendra Shastri, and Paul Smolensky. 13 I have written at length on the limits of connectionism, both in scholarly papers and in popular books; here is a summary of my own case. 14
In a section called "Connectoplasm" in How the Mind Works, I laid out some simple logical relationships that underlie our understanding of a complete thought (such as the meaning of a sentence) but that are difficult to represent in generic networks. 15 One is the distinction between a kind and an individual: between ducks in general and this duck in particular. Both have the same features (swims, quacks, has feathers, and so on), and both are thus represented by the same set of active units in a standard connectionist model. But people know the difference.
A second talent is compositionality: the ability to entertain a new, complex thought that is not just the sum of the simple thoughts composing it but depends on their relationships. The thought that cats chase mice, for example, cannot be captured by activating a unit each for "cats," "mice," and "chase," because that pattern could just as easily stand for mice chasing cats.
A third logical talent is quantification (or the binding of variables): the difference between fooling some of the people all of the time and fooling all of the people some of the time. Without the computational equivalent of x's,y's, parentheses, and statements like "For all x," a model cannot tell the difference.
A fourth is recursion: the ability to embed one thought inside another, so that we can entertain not only the thought that Elvis lives, but the thought that the National Enquirer reported that Elvis lives, that some people believe the National Enquirer report that Elvis lives, that it is amazing that some people believe the National Enquirer report that Elvis lives, and so on. Connectionist networks would superimpose these propositions and thereby confuse their various subjects and predicates.
A final elusive talent is our ability to engage in categorical, as opposed to fuzzy, reasoning: to understand that Bob
? ? ? ? ? Dylan is a grandfather, even though he is not very grandfatherly, or that shrews are not rodents, though they look just like mice. With nothing but a soup of neurons to stand for an object's properties, and no provision for rules, variables, and definitions, the networks fall back on stereotypes and are bamboozled by atypical examples. {81}
In Words and Rules I aimed a microscope on a single phenomenon of language that has served as a test case for the ability of generic associative networks to account for the essence of language: assembling words, or pieces of words, into new combinations. People don't just memorize snatches of language but create new ones. A simple example is the English past tense. Given a neologism like to spam or to snarf, people don't have to run to the dictionary to look up their past-tense forms; they instinctively know that they are spammed and snarfed. The talent for assembling new combinations appears as early as age two, when children overapply the past-tense suffix to irregular verbs, as in We holded the baby rabbits and Horton heared a Who. 16
The obvious way to explain this talent is to appeal to two kinds of computational operations in the mind. Irregular forms like held and heard are stored in and retrieved from memory, just like any other word. Regular forms like walk- walked can be generated by a mental version of the grammatical rule "Add -ed to the verb. " The rule can apply whenever memory fails. It may be used when a word is unfamiliar and no past-tense form had been stored in memory, as in to spam, and it may be used by children when they cannot recall an irregular form like heard and need some way of marking its tense. Combining a suffix with a verb is a small example of an important human talent: combining words and phrases to create new sentences and thereby express new thoughts. It is one of the new ideas of the cognitive revolution introduced in Chapter 3, and one of the logical challenges for connectionism I listed in the preceding discussion.
Connectionists have used the past tense as a proving ground to see if they could duplicate this textbook example of human creativity without using a rule and without dividing the labor between a system for memory and a system for grammatical combination. A series of computer models have tried to generate past-tense forms using simple pattern associator networks. The networks typically connect the sounds in verbs with the sounds in the past-tense form: -am with -ammed, -ing with -ung, and so on. The models can then generate new forms by analogy, just like the generalization from tigers to lions: trained on crammed, a model can guess spammed; trained on folded, it tends to say holded.
But human speakers do far more than associate sounds with sounds, and the models thus fail to do them justice. The failures come from the absence of machinery to handle logical relationships. Most of the models are baffled by new words that sound different from familiar words and hence cannot be generalized by analogy. Given the novel verb to frilg, for example, they come up not with frilged, as people do, but with an odd mishmash like freezled. That is because they lack the device of a variable, like x in algebra or "verb" in grammar, which can apply to any member of a category, regardless of how familiar {82} its properties are. (This is the gadget that allows people to engage in categorical rather than fuzzy reasoning. ) The networks can only associate bits of sound with bits of sound, so when confronted with a new verb that does not sound like anything they were trained on, they assemble a pastiche of the most similar sounds they can find in their network.
The models also cannot properly distinguish among verbs that have the same sounds but different past-tense forms, such as ring the bell-rang the bell and ring the city-ringed the city. That is because the standard models represent
only sound and are blind to the grammatical differences among verbs that call for different conjugations. The key difference here is between simple roots like ring in the sense of "resonate" (past tense rang) and complex verbs derived from nouns like ring in the sense of "form a ring around" (past tense ringed). To register that difference, a language-using system has to be equipped with compositional data structures (such as "a verb made from the noun ring") and not just a beanbag of units.
Yet another problem is that connectionist networks track the statistics of the input closely: how many verbs of each sound pattern they have encountered. That leaves them unable to account for the epiphany in which young children discover the -ed rule and start making errors like holded and heared. Connectionist modelers can induce these errors only by bombarding the network with regular verbs (so as to burn in the -ed) in a way that is unlike anything real children experience. Finally, a mass of evidence from cognitive neuroscience shows that grammatical combination (including regular verbs) and lexical lookup (including irregular verbs) are handled by different systems in the brain rather than by a single associative network.
It's not that neural networks are incapable of handling the meanings of sentences or the task of grammatical conjugation. (They had better not be, since the very idea that thinking is a form of neural computation requires that some kind of neural network duplicate whatever the mind can do. ) The problem lies in the credo that one can do everything with a generic model as long as it is sufficiently trained. Many modelers have beefed up, retrofitted, or combined networks into more complicated and powerful systems. They have dedicated hunks of neural hardware to abstract symbols like "verb phrase" and "proposition" and have implemented additional mechanisms (such as synchronized firing patterns) to bind them together in the equivalent of compositional, recursive symbol structures.
? ? ? ? They have installed banks of neurons for words, or for English suffixes, or for key grammatical distinctions. They have built hybrid systems, with one network that retrieves irregular forms from memory and another that combines a verb with a suffix. 17
A system assembled out of beefed-up subnetworks could escape all the criticisms. But then we would no longer be talking about a generic neural network! We would be talking about a complex system innately tailored to {83} compute a task that people are good at. In the children's story called "Stone Soup," a hobo borrows the use of a woman's kitchen ostensibly to make soup from a stone. But he gradually asks for more and more ingredients to balance the flavor until he has prepared a rich and hearty stew at her expense. Connectionist modelers who claim to build intelligence out of generic neural networks without requiring anything innate are engaged in a similar business. The design choices that make a neural network system smart -- what each of the neurons represents, how they are wired together, what kinds of networks are assembled into a bigger system, in which way -- embody the innate organization of the part of the mind being modeled. They are typically hand-picked by the modeler, like an inventor rummaging through a box of transistors and diodes, but in a real brain they would have evolved by natural selection (indeed, in some networks, the architecture of the model does evolve by a simulation of natural selection). 18 The only alternative is that some previous episode of learning left the networks in a state ready for the current learning, but of course the buck has to stop at some innate specification of the first networks that kick off the learning process.
So the rumor that neural networks can replace mental structure with statistical learning is not true. Simple, generic networks are not up to the demands of ordinary human thinking and speaking; complex, specialized networks are a stone soup in which much of the interesting work has been done in setting up the innate wiring of the network. Once this is recognized, neural network modeling becomes an indispensable complement to the theory of a complex human nature rather than a replacement for it. 19 It bridges the gap between the elementary steps of cognition and the physiological activity of the brain and thus serves as an important link in the long chain of explanation between biology and culture. ~
FOR MOST OF its history, neuroscience was faced with an embarrassment: the brain looked as if it were innately specified in every detail. When it comes to the body, we can see many of the effects of a person's life experience: it may be tanned or pale, callused or soft, scrawny or plump or chiseled. But no such marks could be found in the brain. Now, something has to be wrong with this picture. People learn, and learn massively: they learn their language, their culture, their know-how, their database of facts. Also, the hundred trillion connections in the brain cannot possibly be specified individually by a 750-megabyte genome. The brain somehow must change in response to its input; the only question is how.
We are finally beginning to understand how. The study of neural plasticity is hot. Almost every week sees a discovery about how the brain gets wired in the womb and tuned outside it. After all those decades in which no one could find anything that changed in the brain, it is not surprising that the {84} discovery of plasticity has given the nature-nurture pendulum a push. Some people describe plasticity as a harbinger of an expansion of human potential in which the powers of the brain will be harnessed to revolutionize childrearing, education, therapy, and aging. And several manifestos have proclaimed that plasticity proves that the brain cannot have any significant innate organization. 20 In Rethinking Innateness, Jeffrey Elman and a team of West Pole connectionists write that predispositions to think about different things in different ways (language, people, objects, and so on) may be implemented in the brain only as "attention-grabbers" that ensure that the organism will receive "massive experience of certain inputs prior to subsequent learning. "21 In a "constructivist manifesto," the theoretical neuroscientists Stephen Quartz and Terrence Sejnowski write that "although the cortex is not a tabula rasa . . . it is largely equipotential at early stages," and therefore that innatist theories "appear implausible. "22
Neural development and plasticity unquestionably make up one of the great frontiers of human knowledge. How a linear string of DNA can direct the assembly of an intricate three-dimensional organ that lets us think, feel, and learn is a problem to stagger the imagination, to keep neuroscientists engaged for decades, and to belie any suggestion that we are approaching "the end of science. "
And the discoveries themselves are fascinating and provocative. The cerebral cortex (outer gray matter) of the brain has long been known to be divided into areas with different functions. Some represent particular body parts; others represent the visual field or the world of sound; still others concentrate on aspects of language or thinking. We now know that with learning and practice some of their boundaries can move around. (This does not mean that the brain tissue literally grows or shrinks, only that if the cortex is probed with electrodes or monitored with a scanner, the boundary where one ability leaves off and the next one begins can shift. ) Violinists, for example, have an expanded region of cortex representing the fingers of the left hand. 23 If a person or a monkey is trained on a simple task like recognizing shapes or attending to a location in space, neuroscientists can watch as parts of the cortex, or even
? ? ? ? ? ? ? ? ? individual neurons, take on the job. 24
The reallocation of brain tissue to new tasks is especially dramatic when people lose the use of a sense or body part. Congenitally blind people use their visual cortex to read Braille. 25 Congenitally deaf people use part of their auditory cortex to process sign language. 26 Amputees use the part of the cortex formerly serving the missing limb to represent other parts of their bodies. 27 Young children can grow up relatively normal after traumas to the brain that would turn adults into basket cases -- even removal of the entire left hemisphere, which in adults underlies language and logical reasoning. 28 All this {85} suggests that the allocation of brain tissue to perceptual and cognitive processes is not done permanently and on the basis of the exact location of the tissue in the skull, but depends on how the brain itself processes information.
This dynamic allocation of tissue can also be seen as the brain puts itself together in the womb. Unlike a computer that gets assembled in a factory and is turned on for the first time when complete, the brain is active while it is being assembled, and that activity may take part in the assembly process. Experiments on cats and other mammals have shown that if a brain is chemically silenced during fetal development it may end up with significant abnormalities. 29 And patches of cortex develop differently depending on the kind of input they receive. In an experimental tour de force, the neuroscientist Mriganka Sur literally rewired the brains of ferrets so that signals from their eyes fed into the primary auditory cortex, the part of the brain that ordinarily receives signals from the ears. 30 When he then probed the auditory cortex with electrodes, he found that it acted in many ways like the visual cortex. Locations in the visual field were laid out like a map, and individual neurons responded to lines and stripes at a particular orientation and direction of movement, similar to the neurons in an ordinary visual cortex. The ferrets could even use their rewired brains to move toward objects that were detectable by sight alone. The input to the sensory cortex must help to organize it: visual input makes the auditory cortex work something like the visual cortex.
What do these discoveries mean? Do they show that the brain is "able to be shaped, molded, modeled, or sculpted," as the dictionary definition of plastic would suggest? In the rest of this chapter I will show you that the answer is no. 31 Discoveries of how the brain changes with experience do not show that learning is more powerful than we thought, that the brain can be dramatically reshaped by its input, or that the genes do not shape the brain. Indeed, demonstrations of the plasticity of the brain are less radical than they first appear: the supposedly plastic regions of cortex are doing pretty much the same thing they would have been doing if they had never been altered. And the most recent discoveries on brain development have refuted the idea that the brain is largely plastic. Let me go over these points in turn.
The fact that the brain changes when we learn is not, as some have claimed, a radical discovery with profound implications for nature and nurture or human potential. Dmitri Karamazov could have deduced it in his nineteenth- century prison cell as he mulled over the fact that thinking comes from quivering nerve tails rather than an immaterial soul. If thought and action are products of the physical activity of the brain, and if thought and action can be affected by experience, then experience has to leave a trace in the physical structure of the brain. {86}
So there is. no scientific question as to whether experience, learning, and practice affect the brain; they surely do if we are even vaguely on the right track. It is not surprising that people who can play the violin have different brains from those who cannot, or that masters of sign language or of Braille have different brains from people who speak and read. Your brain changes when you are introduced to a new person, when you hear a bit of gossip, when you watch the Oscars, when you polish your golf stroke -- in short, whenever an experience leaves a trace in the mind. The only question is how learning affects the brain. Are memories stored in protein sequences, in new neurons or synapses, or in changes in the strength of existing synapses? When someone learns a new skill, is it stored only in organs dedicated to learning skills (like the cerebellum and the basal ganglia), or does it also adjust the cortex? Does an increase in dexterity depend on using more square centimeters of cortex or on using a greater concentration of synapses in the same number of square centimeters? These are important scientific problems, but they say nothing about whether people can learn, or how much. We already knew trained violinists play better than beginners or we would never have put their heads in the scanner to begin with. Neural plasticity is just another name for learning and development, described at a different level of analysis.
All this should be obvious, but nowadays any banality about learning can be dressed up in neurospeak and treated like a great revelation of science. According to a New York Times headline, "Talk therapy, a psychiatrist maintains, can alter the structure of the patient's brain. "32 I should hope so, or else the psychiatrist would be defrauding her clients. "Environmental manipulation can change the way [a child's] brain develops," the pediatric neurologist Harry Chugani told the Boston Globe. "A child surrounded by aggression, violence, or inadequate stimulation will reflect these connections in the brain and behavior. "33 Well, yes; if the environment affects the child at all, it would do so by changing connections in the brain. A special issue of the journal Educational Technology and Society was intended "to examine the position that learning takes place in the brain of the learner, and that pedagogies and technologies
? ? ? ? ? ? ? ? ? ? ? ? should be designed and evaluated on the basis of the effect they have on student brains. " The guest editor (a
biologist) did not say whether the alternative was that learning takes place in some other organ of the body like the pancreas or that it takes place in an immaterial soul. Even professors of neuroscience sometimes proclaim "discoveries" that would be news only to believers in a ghost in the machine: "Scientists have found that the brain is capable of altering its connections. . . . . . You have the ability to change the synaptic connections within the brain. "34 Good thing, because otherwise we would be permanent amnesiacs.
This neuroscientist is an executive at a company that "uses brain research {87} and technology to develop products intended to enhance human learning and performance," one of many new companies with that aspiration. "The
human being has unlimited creativity if focused and nurtured properly," says a consultant who teaches clients to draw diagrams that "map their neural patterns. " "The older you get, the more connections and associations your brain should be making," said a satisfied customer; "Therefore you should have more information stored in your brain.
You just need to tap into it. "35 Many people have been convinced by the public pronouncements of neuroscience advocates -- on the basis of no evidence whatsoever -- that varying the route you take when driving home can stave off the effects of aging. 36 And then there is the marketing genius who realized that blocks, balls, and other toys "provide visual and tactile stimulation" and "encourage movement and tracking," part of a larger movement of "brain- based" childrearing and education that we will meet again in the chapter on children. 37
These companies tap into people's belief in a ghost in the machine by implying that any form of learning that affects the brain (as opposed, presumably, to the kinds of learning that don't affect the brain) is unexpectedly real or deep or powerful. But this is mistaken. All learning affects the brain. It is undeniably exciting when scientists make a discovery about how learning affects the brain, but that does not make the learning itself any more pervasive or profound. ~
A second misinterpretation of neural plasticity can be traced to the belief that there is nothing in the mind that was not first in the senses. The most highly publicized discoveries about cortical plasticity concern primary sensory cortex, the patches of gray matter that first receive signals from the senses (via the thalamus and other subcortical organs). Writers who use plasticity to prop up the Blank Slate assume that if primary sensory cortex is plastic, the rest of the brain must be even more plastic, because the mind is built out of sensory experience. For example, one neuroscientist was quoted as saying that Sur's rewiring experiments "challenge the recent emphasis on the power of the genes" and "will push people back toward more consideration of environmental factors in creating normal brain organization. "38 But if the brain is a complex organ with many parts, the moral does not follow. Primary sensory cortex is not the bedrock of the mind but a gadget, one of many in the brain, that happens to be specialized for certain kinds of signal processing in the first stages of sensory analysis. Let's suppose that primary sensory cortex really were formless, getting all its structure from the input. Would that mean that the entire brain is formless and gets all of its structure from the input? Not at all.
For one thing, even primary sensory cortex is just one part of a huge, intricate system. To put things in perspective, here is a recent diagram of the wiring of the primate visual system:39 {88}
? ? ? ? ? ? ? ? ? Primary visual cortex is the box near the bottom labeled "V1. " It is one of at least fifty distinct brain areas devoted to visual processing, and they are interconnected in precise ways. (Despite the spaghetti-like appearance, not everything is connected to everything else. Only about a third of the logically possible connections between components are actually present in the brain. ) Primary visual cortex, by itself, is not enough to see with. Indeed, it is so deeply buried in the visual system that Francis Crick and the neuroscientist Christof Koch have argued that we are not conscious of anything that goes on in it. 40 What we see -- familiar colored objects arranged in a scene or moving in {89} particular ways -- is a product of the entire contraption. So even if the innards of the V1 box were completely specified by its input, we would have to explain the architecture of the rest of the visual system -- the fifty boxes and their connections. I don't mean to imply that the entire block diagram is genetically specified, but much of it almost certainly is. 41
And of course the visual system itself must be put into perspective, because it is just one part of the brain. The visual system dominates some half-dozen of the more than fifty major areas of the cortex that can be distinguished by their anatomy and connections. Many of the others underlie other functions such as language, reasoning, planning, and
? ? ? social skills. Though no one knows to what extent they are genetically prepared for their computational roles, there are hints that the genetic influence is substantial. 42 The divisions are established in the womb, even if the cortex is cut
off from sensory input during development. As development proceeds, different sets of genes are activated in different regions. The brain has a well-stocked toolbox of mechanisms to interconnect neurons, including molecules that attract or repel axons (the output fibers of neurons) to guide them to their targets, and molecules that glue them in place or ward them away. The number, size, and connectivity of cortical areas differ among species of mammals, and they differ between humans and other primates. This diversity is caused by genetic changes in the course of evolution that are beginning to be understood. 43 Geneticists recently discovered, for example, that different sets of genes are activated in the developing brain of humans and the developing brains of chimpanzees. 44
The possibility that cortical areas are specialized for different tasks has been obscured by the fact that different parts of the cortex look similar under a microscope. But because the brain is an information-processing system, that means little. The microscopic pits on a CD look the same regardless of what is recorded on it, and the strings of characters in different books look the same to someone who cannot read them. In an information-carrying medium, the content lies in combinatorial patterns among the elements -- in the case of the brain, the details of the microcircuitry -- and not in their physical appearance.
And the cortex itself is not the entire brain. Tucked beneath the cortex are other brain organs that drive important parts of human nature. They include the hippocampus, which consolidates memory and supports mental maps, the amygdala, which colors experience with certain emotions, and the hypothalamus, which originates sexual desire and other appetites. Many neuroscientists, even when they are impressed by the plasticity of the cortex, acknowledge that subcortical structures are far less plastic. 45 This is not a minor cavil about anatomy. Some commentators have singled out evolutionary psychology as a casualty of neural plasticity, saying that the changeability of the cortex proves that the brain cannot support evolutionary specializations. 46 But most proposals in evolutionary psychology are about drives like fear, sex, love, and {90} aggression, which reside largely in subcortical circuitry. More generally, on anyone's theory an innately shaped human ability would have to be implemented in a network of cortical and subcortical areas, not in a single patch of sensory cortex. ~
Another basic point about the brain has been lost in the recent enthusiasm for plasticity. A discovery that neural activity is crucial for brain development does not show either that learning is crucial in shaping the brain or that genes fail to shape the brain.
The study of neural development is often framed in terms of nature and nurture, but it is more fruitful to think of it as a problem in developmental biology -- how a ball of identical cells differentiates into a functioning organ. Doing so stands the conventional assumptions of associationism on their head. Primary sensory cortex, rather than being the firmest part of the brain on top of which successive stories can only be even more plastic, may be the part of the brain that is most dependent on the input for proper development.
In assembling a brain, a complete genetic blueprint is out of the question for two reasons. One is that a gene cannot anticipate every detail of the environment, including the environment consisting of the other genes in the genome. It has to specify an adaptive developmental program that ensures that the organism as a whole functions properly across variations in nutrition, other genes, growth rates over the lifespan, random perturbations, and the physical and social environment. And that requires feedback from the way the rest of the organism is developing.
Take the development of the body. The genes that build a femur cannot specify the exact shape of the ball on top, because the ball has to articulate with the socket in the pelvis, which is shaped by other genes, nutrition, age, and chance. So the ball and the socket adjust their shapes as they rotate against each other while the baby kicks in the womb. (We know this because experimental animals that are paralyzed while they develop end up with grossly deformed joints. ) Similarly, the genes shaping the lens of the growing eye cannot know how far back the retina is going to be or vice versa. So the brain of the baby is equipped with a feedback loop that uses signals about the sharpness of the image on the retina to slow down or speed up the physical growth of the eyeball. These are good examples of "plasticity," but the metaphor of plastic material is misleading. The mechanisms are not designed to allow variable environments to shape variable organs. They do the opposite: they ensure that despite variable environments, a constant organ develops, one that is capable of doing its job.
Like the body, the brain must use feedback circuits to shape itself into a working system. This is especially true in the sensory areas, which have to cope with growing sense organs. For that reason alone we would expect the activity
{91} of the brain to play a role in its own development, even if its end state, like those of the femur and the eyeball, is in some sense genetically specified. How this happens is still largely a mystery, but we know that patterns of neural stimulation can trigger the expression of a gene and that one gene can trigger many others. 47 Since every brain cell contains a complete genetic program, the machinery exists, in principle, for neural activity to trigger the development
? ? ? ? ? ? ? ? of an innately organized neural circuitry in any of several different regions. If so, brain activity would not be sculpting the brain; it would merely be telling the genome where in the brain a certain neural circuit should go.
So even an extreme innatist need not believe that the brain differentiates itself by the equivalent of GPS coordinates in the skull, following rules like "If you are between the left temple and the left ear, become a language circuit" (or a fear circuit, or a circuit for recognizing faces). A developmental program may be triggered in a part of the developing brain by some combination of the source of the stimulation, the firing pattern, the chemical environment, and other signals. The end result may be a faculty that is seated in different parts of the brain in different people. After all, the brain is the organ of computation, and the same computation can happen in different places as long as the pattern of information flow is the same. In your computer, a file or program may sit in different parts of memory or be fragmented across different sectors of the disk and work the same way in every case. It would not be surprising if the growing brain were at least that dynamic in allocating neural resources to computational demands.
The other reason that brains can't rely on a complete genetic blueprint is that the genome is a limited resource. Genes are constantly mutating over evolutionary time, and natural selection can weed out the bad ones only slowly. Most evolutionary biologists believe that natural selection can support a genome that is only so big. That means that the genetic plans for a complex brain have to be compressed to the minimum size that is consistent with the brain's developing and working properly. Though more than half the genome is put to work primarily or exclusively in the brain, that is not nearly enough to specify the brain's connection diagram.
The development program for the brain has to be resourceful. Take the problem of getting every axon (output fiber) from the eyes to connect to the brain in an orderly way. Neighboring points in the eye must connect to neighboring points in the brain (an arrangement called topographic mapping), and corresponding locations in the two eyes should end up near each other in the brain but not get mixed up with each other.
Rather than give each axon a genetically specified address, the mammalian brain may organize the connections in a cleverer way. In her studies of brain development in cats, the neuroscientist Carla Shatz has discovered that waves of activity flow across each retina, first in one direction, then in some other {92} direction. 48 That means that neurons that are next to each other in a single eye will tend to fire at around the same time, because they are often hit by the same wavefront. But axons from different eyes, or from distant locations in the same eye, will be uncorrelated in their activity, because a wave passing over one will miss the other. Just as you could reconstruct the seating diagram of a stadium if the fans were doing "the wave" along various directions and you knew only who stood up at which time (since people who stood up at the same time had to be seated near each other), the brain could reconstruct the spatial layout of the two eyes by listening for which sets of input neurons were firing at the same time. One of the rules of learning in neural networks, first outlined by the psychologist D. O. Hebb, is that "neurons that fire together wire together; neurons out of synch fail to link. " As the waves crisscross the retina for days and weeks, the visual thalamus downstream could organize itself into layers, each from a single eye, with adjacent neurons responding to adjacent parts of the retina. The cortex, in theory, could organize its wiring in a similar way. 49
Which parts of the brain actually use this auto-installation technique is another matter. The visual system does not appear to need the technique to grow topographically organized wiring; a rough topographic map develops under the direct control of the genes. Some neuroscientists believe that the fire-together-wire-together technique may still be used to make the maps more precise or to segregate the inputs from the two eyes. 50 That, too, has been challenged, but let us assume it is correct and see what it means.
The fire-together-wire-together process could, in theory, be set in motion by letting the eyeballs gaze at the world. The world has lines and edges that stimulate neighboring parts of the retina at the same time, and that provides the information the brain needs to set up or fine-tune an orderly map. But in the case of Shatz's cats, it works without any environmental input at all. The visual system develops in the pitch-dark womb, before the animal's eyes are open and before its rods and cones are even hooked up and functioning. The retinal waves are generated endogenously by the tissues of the retina during the period in which the visual brain has to wire itself up. In other words, the eye generates a test pattern, and the brain uses it to complete its own assembly. Ordinarily, axons from the eye carry information about things in the world, but the developmental program co-opted those axons to carry information about which neurons come from the same eye or the same place in the eye. A rough analogy occurred to me when I watched the cable TV installer figure out which cable in the basement led to a particular room upstairs. He attached a tone generator called a "screamer" to the end in the bedroom and then ran downstairs to listen for the signal on each cable in the bouquet coming out of the wall. Though the cables were designed to carry a television signal upstairs, not a test tone downstairs, they lent themselves to this other use during the installation process because an information conduit is useful for both purposes. {93}
The moral is that a discovery that brain development depends on brain activity may say nothing about learning or experience, only that the brain takes advantage of its own information-transmission abilities while wiring itself up. Fire-together-wire-together is a trick that solves a particular kind of wiring problem: connecting a surface of
? ? ? ? ? receptors to a maplike representation in the cortex. The problem is found not just in the visual system but in other spatial senses such as touch. That is because the problem of tiling a patch of primary visual cortex, which receives information from the 2-D surface of the retina, is similar to the problem of tiling a patch of primary somatosensory cortex, which receives information from the 2-D surface of the skin. Even the auditory system may use the trick, because the inputs representing different sound frequencies (roughly, pitches) originate in a 1-D membrane in the inner ear, and the brain treats pitch in audition the way it treats space in vision and touch.
But the trick may be useless elsewhere in the brain. The olfactory (smell) system, for example, wires itself by a completely different technique. Unlike sights, sounds, and touches, which are arranged by location when they arrive at the sensory cortex, smells arrive all mixed together, and they are analyzed in terms of the chemical compounds making them up, each detected by a different receptor in the nose. Each receptor connects to a neuron that carries its signal into the brain, and in this case the genome really does use a different gene for each axon when wiring them
into their respective places in the brain, a thousand genes in all. It economizes on genes in a remarkable way. The protein produced by each gene is used twice: once in the nose, as a receptor to detect an airborne chemical, and a second time in the brain, as a probe at the end of the corresponding axon to direct it to its proper spot in the olfactory bulb. 51
The wiring problems are different again for other parts of the brain, such as the medulla, which generates the swallowing reflex and other fixed action patterns; the amygdala, which handles fear and other emotions; and the ventromedial frontal cortex, which is involved in social reasoning. The fire-together-wire-together technique may be an ideal method for sensory maps and other structures that simply have to reproduce redundancies in the world or in other parts of the brain, such as primary sensory cortex for seeing, touching, and hearing. But other regions evolved with different functions, such as smelling or swallowing or avoiding danger or winning friends, and they have to be wired by more complicated techniques. This is simply a corollary of the general point with which I began the chapter: the environment cannot tell the various parts of an organism what their goals are.
The doctrine of extreme plasticity has used the plasticity discovered in primary sensory cortex as a metaphor for what happens elsewhere in the brain. The upshot of these two sections is that it is not a very good metaphor. If the plasticity of sensory cortex symbolized the plasticity of mental life as a whole, it should be easy to change what we don't like about ourselves or other people. {94}
Take a case very different from vision, sexual orientation. Most gay men feel stirrings of attraction to other males around the time of the first hormonal changes that presage puberty. No one knows why some boys become gay -- genes, prenatal hormones, other biological causes, and chance may all play a role -- but my point is not so much about becoming gay as about becoming straight. In the less tolerant past, unhappy gay men sometimes approached psychiatrists (and sometimes were coerced into approaching them) for help in changing their sexual orientation. Even today, some religious groups pressure their gay members to "choose" heterosexuality. Many techniques have been foisted on them: psychoanalysis, guilt mongering, and conditioning techniques that use impeccable fire-together-wire- together logic (for example, having them look at Playboy centerfolds while sexually aroused). The techniques are all failures. 52 With a few dubious exceptions (which are probably instances of conscious self-control rather than a
change in desire), the sexual orientation of most gay men cannot be reversed by experience. Some parts of the mind just aren't plastic, and no discoveries about how sensory co~rtex gets wired will change that fact.
What is the brain actually doing when it undergoes the changes we call plasticity? One commentator called it "the brain equivalent of Christ turning water into wine" and thus a disproof of any theory that parts of the brain have been specialized for their jobs by evolution. 53 Those who don't believe in miracles are skeptical. Neural tissue is not a magical substance that can assume any form demanded of it but a mechanism that obeys the laws of cause and effect. When we take a closer look at the prominent examples of plasticity, we discover that the changes are not miracles after all. In every case, the altered cortex is not doing anything very different from what it ordinarily does.
Most demonstrations of plasticity involve remappings within primary sensory cortex. A brain area for an amputated or immobilized finger may be taken over by an adjacent finger, or a brain area for a stimulated finger expands its borders at the expense of a neighbor. The brain's ability to reweight its inputs is indeed remarkable, but the kind of information processing done by the taken-over cortex has not fundamentally changed: the cortex is still processing information about the surface of the skin and the angles of the joints. And the representation of a digit or part of the visual field cannot grow indefinitely, no matter how much it is stimulated; the intrinsic wiring of the brain would prevent it. 54
What about the takeover of the visual cortex by Braille in blind people? At first glance it looks like real transubstantiation. But maybe not. We are not witnessing just any talent taking over just any vacant lot in the cortex. Braille reading may use the anatomy of the visual cortex in the same way that seeing does.
? ? ? ? ? Neuroanatomists have long known that there are as many fibers bringing {95} information down into the visual cortex from other brain areas as there are bringing information up from the eyes. 55 These top-down connections could have several uses. They may aim a spotlight of attention on portions of the visual field, or coordinate vision with the other senses, or group pixels into regions, or implement mental imagery, the ability to visualize things in the mind's eye. 56 Blind people may simply be using these prewired top-down connections to read Braille. They may be "imagining" the rows of dots as they feel them, much as a blindfolded person can imagine objects placed in his hand, though of course far more rapidly. (Previous research has established that blind people have mental images -- perhaps even visual images -- containing spatial information. )57 The visual cortex is well suited to the kind of computation needed for Braille. In sighted people the eyes scan around a scene, bringing fine detail into the fovea, the high-resolution center of the retina. This is similar to moving the hands over a line of Braille, bringing fine detail under the high-resolution skin of the fingertips. So the visual system may be functioning in blind people much as it does in sighted ones, despite the lack of input from the eyes. Years of practice at imagining the tactile world and attending to the details of Braille have led the visual cortex to make maximal use of the innate inputs from other parts of the brain.
With deafness, too, one of the senses is taking over the controls of suitable circuitry, rather than just moving into any old unoccupied territory. Laura Petitto and her colleagues found that deaf people use the superior gyrus of the temporal lobe (a region near the primary auditory cortex) to recognize the elements of signs in sign languages, just as hearing people use it to process speech sounds in spoken languages. They also found that the deaf use the lateral prefrontal cortex to retrieve signs from memory, just as hearing people use it to retrieve words from memory. 58 This should come as no surprise. As linguists have long known, sign languages are organized much like spoken languages. They use words, a grammar, and even phonological rules that combine meaningless gestures into meaningful signs, just as phonological rules in spoken languages combine meaningless sounds into meaningful words. 59 Spoken languages, moreover, are partly modular: the representations for words and rules can be distinguished from the input- output systems that connect them to the ears and the mouth. The simplest interpretation, endorsed by Petitto and her colleagues, is that the cortical areas recruited in signers are specialized for language (words and rules), not for speech per se. What the areas are doing in deaf people is the same as what they are doing in hearing people.
Let me turn to the most amazing plasticity of all: the rewired ferrets whose eyes fed their auditory thalamus and cortex and made those areas work like a visual thalamus and cortex. Even here, water is not being turned into wine. Sur and his colleagues noted the redirected input did not change the actual wiring of the auditory brain, only the pattern of synaptic strengths. As a result they {96} found many differences between the co-opted auditory brain and a normal visual brain. 60 The representation of the visual field in the auditory brain was fuzzier and more disorganized, because the tissue is optimized for auditory, not visual, analysis. The map of the visual field, for instance, was far more precise in the left-right direction than in the up-down direction. That is because the left-right direction was mapped onto an axis of the auditory cortex that in normal animals represents different sound frequencies and thus gets inputs from the inner ear that are precisely arranged in order of frequency. But the up-down direction was mapped onto the perpendicular axis of the auditory cortex, which ordinarily gets a mass of inputs of the same frequency. Sur also notes that the connections between the primary auditory cortex and other brain areas for hearing (the equivalent of the wiring diagram for the visual system on page 88) were unchanged by the new input.
So patterns in the input can tune a patch of sensory cortex to mesh with that input, but only within the limits of the wiring already present. Sur suggests that the reason the auditory cortex in the rewired ferrets can process visual information at all is that certain kinds of signal processing may be useful to perform on raw sensory input, whether it is visual, auditory, or tactile:
On this view, one function of sensory thalamus or cortex is to perform certain stereotypical operations on input regardless of modality [vision, hearing, or touch]; the specific type of sensory input of course provides the substrate information that is transmitted and processed. . . . If the normal organization of central auditory structures is not altered, or at least not altered significantly, by visual input, then we might expect some operations similar to those we observe on visual inputs in operated ferrets to be carried out as well in the auditory pathway in normal ferrets.
Humans don't just loosely associate things that resemble each other, or things that tend to occur together. They have combinatorial minds that enterrain propositions about what is true of what, and about who did what to {80} whom, when and where and why. And that requires a computational architecture that is more sophisticated than the uniform tangle of neurons used in generic connectionist networks. It requires an architecture equipped with logical apparatus like rules, variables, propositions, goal states, and different kinds of data structures, organized into larger systems. Many cognitive scientists have made this point, including Gary Marcus, Marvin Minsky, Seymour Papert, Jerry Fodor, Zenon Pylyshyn, John Anderson, Tom Bever, and Robert Hadley, and it is acknowledged as well by neural network modelers who are not in the connectionist school, such as John Hummel, Lokendra Shastri, and Paul Smolensky. 13 I have written at length on the limits of connectionism, both in scholarly papers and in popular books; here is a summary of my own case. 14
In a section called "Connectoplasm" in How the Mind Works, I laid out some simple logical relationships that underlie our understanding of a complete thought (such as the meaning of a sentence) but that are difficult to represent in generic networks. 15 One is the distinction between a kind and an individual: between ducks in general and this duck in particular. Both have the same features (swims, quacks, has feathers, and so on), and both are thus represented by the same set of active units in a standard connectionist model. But people know the difference.
A second talent is compositionality: the ability to entertain a new, complex thought that is not just the sum of the simple thoughts composing it but depends on their relationships. The thought that cats chase mice, for example, cannot be captured by activating a unit each for "cats," "mice," and "chase," because that pattern could just as easily stand for mice chasing cats.
A third logical talent is quantification (or the binding of variables): the difference between fooling some of the people all of the time and fooling all of the people some of the time. Without the computational equivalent of x's,y's, parentheses, and statements like "For all x," a model cannot tell the difference.
A fourth is recursion: the ability to embed one thought inside another, so that we can entertain not only the thought that Elvis lives, but the thought that the National Enquirer reported that Elvis lives, that some people believe the National Enquirer report that Elvis lives, that it is amazing that some people believe the National Enquirer report that Elvis lives, and so on. Connectionist networks would superimpose these propositions and thereby confuse their various subjects and predicates.
A final elusive talent is our ability to engage in categorical, as opposed to fuzzy, reasoning: to understand that Bob
? ? ? ? ? Dylan is a grandfather, even though he is not very grandfatherly, or that shrews are not rodents, though they look just like mice. With nothing but a soup of neurons to stand for an object's properties, and no provision for rules, variables, and definitions, the networks fall back on stereotypes and are bamboozled by atypical examples. {81}
In Words and Rules I aimed a microscope on a single phenomenon of language that has served as a test case for the ability of generic associative networks to account for the essence of language: assembling words, or pieces of words, into new combinations. People don't just memorize snatches of language but create new ones. A simple example is the English past tense. Given a neologism like to spam or to snarf, people don't have to run to the dictionary to look up their past-tense forms; they instinctively know that they are spammed and snarfed. The talent for assembling new combinations appears as early as age two, when children overapply the past-tense suffix to irregular verbs, as in We holded the baby rabbits and Horton heared a Who. 16
The obvious way to explain this talent is to appeal to two kinds of computational operations in the mind. Irregular forms like held and heard are stored in and retrieved from memory, just like any other word. Regular forms like walk- walked can be generated by a mental version of the grammatical rule "Add -ed to the verb. " The rule can apply whenever memory fails. It may be used when a word is unfamiliar and no past-tense form had been stored in memory, as in to spam, and it may be used by children when they cannot recall an irregular form like heard and need some way of marking its tense. Combining a suffix with a verb is a small example of an important human talent: combining words and phrases to create new sentences and thereby express new thoughts. It is one of the new ideas of the cognitive revolution introduced in Chapter 3, and one of the logical challenges for connectionism I listed in the preceding discussion.
Connectionists have used the past tense as a proving ground to see if they could duplicate this textbook example of human creativity without using a rule and without dividing the labor between a system for memory and a system for grammatical combination. A series of computer models have tried to generate past-tense forms using simple pattern associator networks. The networks typically connect the sounds in verbs with the sounds in the past-tense form: -am with -ammed, -ing with -ung, and so on. The models can then generate new forms by analogy, just like the generalization from tigers to lions: trained on crammed, a model can guess spammed; trained on folded, it tends to say holded.
But human speakers do far more than associate sounds with sounds, and the models thus fail to do them justice. The failures come from the absence of machinery to handle logical relationships. Most of the models are baffled by new words that sound different from familiar words and hence cannot be generalized by analogy. Given the novel verb to frilg, for example, they come up not with frilged, as people do, but with an odd mishmash like freezled. That is because they lack the device of a variable, like x in algebra or "verb" in grammar, which can apply to any member of a category, regardless of how familiar {82} its properties are. (This is the gadget that allows people to engage in categorical rather than fuzzy reasoning. ) The networks can only associate bits of sound with bits of sound, so when confronted with a new verb that does not sound like anything they were trained on, they assemble a pastiche of the most similar sounds they can find in their network.
The models also cannot properly distinguish among verbs that have the same sounds but different past-tense forms, such as ring the bell-rang the bell and ring the city-ringed the city. That is because the standard models represent
only sound and are blind to the grammatical differences among verbs that call for different conjugations. The key difference here is between simple roots like ring in the sense of "resonate" (past tense rang) and complex verbs derived from nouns like ring in the sense of "form a ring around" (past tense ringed). To register that difference, a language-using system has to be equipped with compositional data structures (such as "a verb made from the noun ring") and not just a beanbag of units.
Yet another problem is that connectionist networks track the statistics of the input closely: how many verbs of each sound pattern they have encountered. That leaves them unable to account for the epiphany in which young children discover the -ed rule and start making errors like holded and heared. Connectionist modelers can induce these errors only by bombarding the network with regular verbs (so as to burn in the -ed) in a way that is unlike anything real children experience. Finally, a mass of evidence from cognitive neuroscience shows that grammatical combination (including regular verbs) and lexical lookup (including irregular verbs) are handled by different systems in the brain rather than by a single associative network.
It's not that neural networks are incapable of handling the meanings of sentences or the task of grammatical conjugation. (They had better not be, since the very idea that thinking is a form of neural computation requires that some kind of neural network duplicate whatever the mind can do. ) The problem lies in the credo that one can do everything with a generic model as long as it is sufficiently trained. Many modelers have beefed up, retrofitted, or combined networks into more complicated and powerful systems. They have dedicated hunks of neural hardware to abstract symbols like "verb phrase" and "proposition" and have implemented additional mechanisms (such as synchronized firing patterns) to bind them together in the equivalent of compositional, recursive symbol structures.
? ? ? ? They have installed banks of neurons for words, or for English suffixes, or for key grammatical distinctions. They have built hybrid systems, with one network that retrieves irregular forms from memory and another that combines a verb with a suffix. 17
A system assembled out of beefed-up subnetworks could escape all the criticisms. But then we would no longer be talking about a generic neural network! We would be talking about a complex system innately tailored to {83} compute a task that people are good at. In the children's story called "Stone Soup," a hobo borrows the use of a woman's kitchen ostensibly to make soup from a stone. But he gradually asks for more and more ingredients to balance the flavor until he has prepared a rich and hearty stew at her expense. Connectionist modelers who claim to build intelligence out of generic neural networks without requiring anything innate are engaged in a similar business. The design choices that make a neural network system smart -- what each of the neurons represents, how they are wired together, what kinds of networks are assembled into a bigger system, in which way -- embody the innate organization of the part of the mind being modeled. They are typically hand-picked by the modeler, like an inventor rummaging through a box of transistors and diodes, but in a real brain they would have evolved by natural selection (indeed, in some networks, the architecture of the model does evolve by a simulation of natural selection). 18 The only alternative is that some previous episode of learning left the networks in a state ready for the current learning, but of course the buck has to stop at some innate specification of the first networks that kick off the learning process.
So the rumor that neural networks can replace mental structure with statistical learning is not true. Simple, generic networks are not up to the demands of ordinary human thinking and speaking; complex, specialized networks are a stone soup in which much of the interesting work has been done in setting up the innate wiring of the network. Once this is recognized, neural network modeling becomes an indispensable complement to the theory of a complex human nature rather than a replacement for it. 19 It bridges the gap between the elementary steps of cognition and the physiological activity of the brain and thus serves as an important link in the long chain of explanation between biology and culture. ~
FOR MOST OF its history, neuroscience was faced with an embarrassment: the brain looked as if it were innately specified in every detail. When it comes to the body, we can see many of the effects of a person's life experience: it may be tanned or pale, callused or soft, scrawny or plump or chiseled. But no such marks could be found in the brain. Now, something has to be wrong with this picture. People learn, and learn massively: they learn their language, their culture, their know-how, their database of facts. Also, the hundred trillion connections in the brain cannot possibly be specified individually by a 750-megabyte genome. The brain somehow must change in response to its input; the only question is how.
We are finally beginning to understand how. The study of neural plasticity is hot. Almost every week sees a discovery about how the brain gets wired in the womb and tuned outside it. After all those decades in which no one could find anything that changed in the brain, it is not surprising that the {84} discovery of plasticity has given the nature-nurture pendulum a push. Some people describe plasticity as a harbinger of an expansion of human potential in which the powers of the brain will be harnessed to revolutionize childrearing, education, therapy, and aging. And several manifestos have proclaimed that plasticity proves that the brain cannot have any significant innate organization. 20 In Rethinking Innateness, Jeffrey Elman and a team of West Pole connectionists write that predispositions to think about different things in different ways (language, people, objects, and so on) may be implemented in the brain only as "attention-grabbers" that ensure that the organism will receive "massive experience of certain inputs prior to subsequent learning. "21 In a "constructivist manifesto," the theoretical neuroscientists Stephen Quartz and Terrence Sejnowski write that "although the cortex is not a tabula rasa . . . it is largely equipotential at early stages," and therefore that innatist theories "appear implausible. "22
Neural development and plasticity unquestionably make up one of the great frontiers of human knowledge. How a linear string of DNA can direct the assembly of an intricate three-dimensional organ that lets us think, feel, and learn is a problem to stagger the imagination, to keep neuroscientists engaged for decades, and to belie any suggestion that we are approaching "the end of science. "
And the discoveries themselves are fascinating and provocative. The cerebral cortex (outer gray matter) of the brain has long been known to be divided into areas with different functions. Some represent particular body parts; others represent the visual field or the world of sound; still others concentrate on aspects of language or thinking. We now know that with learning and practice some of their boundaries can move around. (This does not mean that the brain tissue literally grows or shrinks, only that if the cortex is probed with electrodes or monitored with a scanner, the boundary where one ability leaves off and the next one begins can shift. ) Violinists, for example, have an expanded region of cortex representing the fingers of the left hand. 23 If a person or a monkey is trained on a simple task like recognizing shapes or attending to a location in space, neuroscientists can watch as parts of the cortex, or even
? ? ? ? ? ? ? ? ? individual neurons, take on the job. 24
The reallocation of brain tissue to new tasks is especially dramatic when people lose the use of a sense or body part. Congenitally blind people use their visual cortex to read Braille. 25 Congenitally deaf people use part of their auditory cortex to process sign language. 26 Amputees use the part of the cortex formerly serving the missing limb to represent other parts of their bodies. 27 Young children can grow up relatively normal after traumas to the brain that would turn adults into basket cases -- even removal of the entire left hemisphere, which in adults underlies language and logical reasoning. 28 All this {85} suggests that the allocation of brain tissue to perceptual and cognitive processes is not done permanently and on the basis of the exact location of the tissue in the skull, but depends on how the brain itself processes information.
This dynamic allocation of tissue can also be seen as the brain puts itself together in the womb. Unlike a computer that gets assembled in a factory and is turned on for the first time when complete, the brain is active while it is being assembled, and that activity may take part in the assembly process. Experiments on cats and other mammals have shown that if a brain is chemically silenced during fetal development it may end up with significant abnormalities. 29 And patches of cortex develop differently depending on the kind of input they receive. In an experimental tour de force, the neuroscientist Mriganka Sur literally rewired the brains of ferrets so that signals from their eyes fed into the primary auditory cortex, the part of the brain that ordinarily receives signals from the ears. 30 When he then probed the auditory cortex with electrodes, he found that it acted in many ways like the visual cortex. Locations in the visual field were laid out like a map, and individual neurons responded to lines and stripes at a particular orientation and direction of movement, similar to the neurons in an ordinary visual cortex. The ferrets could even use their rewired brains to move toward objects that were detectable by sight alone. The input to the sensory cortex must help to organize it: visual input makes the auditory cortex work something like the visual cortex.
What do these discoveries mean? Do they show that the brain is "able to be shaped, molded, modeled, or sculpted," as the dictionary definition of plastic would suggest? In the rest of this chapter I will show you that the answer is no. 31 Discoveries of how the brain changes with experience do not show that learning is more powerful than we thought, that the brain can be dramatically reshaped by its input, or that the genes do not shape the brain. Indeed, demonstrations of the plasticity of the brain are less radical than they first appear: the supposedly plastic regions of cortex are doing pretty much the same thing they would have been doing if they had never been altered. And the most recent discoveries on brain development have refuted the idea that the brain is largely plastic. Let me go over these points in turn.
The fact that the brain changes when we learn is not, as some have claimed, a radical discovery with profound implications for nature and nurture or human potential. Dmitri Karamazov could have deduced it in his nineteenth- century prison cell as he mulled over the fact that thinking comes from quivering nerve tails rather than an immaterial soul. If thought and action are products of the physical activity of the brain, and if thought and action can be affected by experience, then experience has to leave a trace in the physical structure of the brain. {86}
So there is. no scientific question as to whether experience, learning, and practice affect the brain; they surely do if we are even vaguely on the right track. It is not surprising that people who can play the violin have different brains from those who cannot, or that masters of sign language or of Braille have different brains from people who speak and read. Your brain changes when you are introduced to a new person, when you hear a bit of gossip, when you watch the Oscars, when you polish your golf stroke -- in short, whenever an experience leaves a trace in the mind. The only question is how learning affects the brain. Are memories stored in protein sequences, in new neurons or synapses, or in changes in the strength of existing synapses? When someone learns a new skill, is it stored only in organs dedicated to learning skills (like the cerebellum and the basal ganglia), or does it also adjust the cortex? Does an increase in dexterity depend on using more square centimeters of cortex or on using a greater concentration of synapses in the same number of square centimeters? These are important scientific problems, but they say nothing about whether people can learn, or how much. We already knew trained violinists play better than beginners or we would never have put their heads in the scanner to begin with. Neural plasticity is just another name for learning and development, described at a different level of analysis.
All this should be obvious, but nowadays any banality about learning can be dressed up in neurospeak and treated like a great revelation of science. According to a New York Times headline, "Talk therapy, a psychiatrist maintains, can alter the structure of the patient's brain. "32 I should hope so, or else the psychiatrist would be defrauding her clients. "Environmental manipulation can change the way [a child's] brain develops," the pediatric neurologist Harry Chugani told the Boston Globe. "A child surrounded by aggression, violence, or inadequate stimulation will reflect these connections in the brain and behavior. "33 Well, yes; if the environment affects the child at all, it would do so by changing connections in the brain. A special issue of the journal Educational Technology and Society was intended "to examine the position that learning takes place in the brain of the learner, and that pedagogies and technologies
? ? ? ? ? ? ? ? ? ? ? ? should be designed and evaluated on the basis of the effect they have on student brains. " The guest editor (a
biologist) did not say whether the alternative was that learning takes place in some other organ of the body like the pancreas or that it takes place in an immaterial soul. Even professors of neuroscience sometimes proclaim "discoveries" that would be news only to believers in a ghost in the machine: "Scientists have found that the brain is capable of altering its connections. . . . . . You have the ability to change the synaptic connections within the brain. "34 Good thing, because otherwise we would be permanent amnesiacs.
This neuroscientist is an executive at a company that "uses brain research {87} and technology to develop products intended to enhance human learning and performance," one of many new companies with that aspiration. "The
human being has unlimited creativity if focused and nurtured properly," says a consultant who teaches clients to draw diagrams that "map their neural patterns. " "The older you get, the more connections and associations your brain should be making," said a satisfied customer; "Therefore you should have more information stored in your brain.
You just need to tap into it. "35 Many people have been convinced by the public pronouncements of neuroscience advocates -- on the basis of no evidence whatsoever -- that varying the route you take when driving home can stave off the effects of aging. 36 And then there is the marketing genius who realized that blocks, balls, and other toys "provide visual and tactile stimulation" and "encourage movement and tracking," part of a larger movement of "brain- based" childrearing and education that we will meet again in the chapter on children. 37
These companies tap into people's belief in a ghost in the machine by implying that any form of learning that affects the brain (as opposed, presumably, to the kinds of learning that don't affect the brain) is unexpectedly real or deep or powerful. But this is mistaken. All learning affects the brain. It is undeniably exciting when scientists make a discovery about how learning affects the brain, but that does not make the learning itself any more pervasive or profound. ~
A second misinterpretation of neural plasticity can be traced to the belief that there is nothing in the mind that was not first in the senses. The most highly publicized discoveries about cortical plasticity concern primary sensory cortex, the patches of gray matter that first receive signals from the senses (via the thalamus and other subcortical organs). Writers who use plasticity to prop up the Blank Slate assume that if primary sensory cortex is plastic, the rest of the brain must be even more plastic, because the mind is built out of sensory experience. For example, one neuroscientist was quoted as saying that Sur's rewiring experiments "challenge the recent emphasis on the power of the genes" and "will push people back toward more consideration of environmental factors in creating normal brain organization. "38 But if the brain is a complex organ with many parts, the moral does not follow. Primary sensory cortex is not the bedrock of the mind but a gadget, one of many in the brain, that happens to be specialized for certain kinds of signal processing in the first stages of sensory analysis. Let's suppose that primary sensory cortex really were formless, getting all its structure from the input. Would that mean that the entire brain is formless and gets all of its structure from the input? Not at all.
For one thing, even primary sensory cortex is just one part of a huge, intricate system. To put things in perspective, here is a recent diagram of the wiring of the primate visual system:39 {88}
? ? ? ? ? ? ? ? ? Primary visual cortex is the box near the bottom labeled "V1. " It is one of at least fifty distinct brain areas devoted to visual processing, and they are interconnected in precise ways. (Despite the spaghetti-like appearance, not everything is connected to everything else. Only about a third of the logically possible connections between components are actually present in the brain. ) Primary visual cortex, by itself, is not enough to see with. Indeed, it is so deeply buried in the visual system that Francis Crick and the neuroscientist Christof Koch have argued that we are not conscious of anything that goes on in it. 40 What we see -- familiar colored objects arranged in a scene or moving in {89} particular ways -- is a product of the entire contraption. So even if the innards of the V1 box were completely specified by its input, we would have to explain the architecture of the rest of the visual system -- the fifty boxes and their connections. I don't mean to imply that the entire block diagram is genetically specified, but much of it almost certainly is. 41
And of course the visual system itself must be put into perspective, because it is just one part of the brain. The visual system dominates some half-dozen of the more than fifty major areas of the cortex that can be distinguished by their anatomy and connections. Many of the others underlie other functions such as language, reasoning, planning, and
? ? ? social skills. Though no one knows to what extent they are genetically prepared for their computational roles, there are hints that the genetic influence is substantial. 42 The divisions are established in the womb, even if the cortex is cut
off from sensory input during development. As development proceeds, different sets of genes are activated in different regions. The brain has a well-stocked toolbox of mechanisms to interconnect neurons, including molecules that attract or repel axons (the output fibers of neurons) to guide them to their targets, and molecules that glue them in place or ward them away. The number, size, and connectivity of cortical areas differ among species of mammals, and they differ between humans and other primates. This diversity is caused by genetic changes in the course of evolution that are beginning to be understood. 43 Geneticists recently discovered, for example, that different sets of genes are activated in the developing brain of humans and the developing brains of chimpanzees. 44
The possibility that cortical areas are specialized for different tasks has been obscured by the fact that different parts of the cortex look similar under a microscope. But because the brain is an information-processing system, that means little. The microscopic pits on a CD look the same regardless of what is recorded on it, and the strings of characters in different books look the same to someone who cannot read them. In an information-carrying medium, the content lies in combinatorial patterns among the elements -- in the case of the brain, the details of the microcircuitry -- and not in their physical appearance.
And the cortex itself is not the entire brain. Tucked beneath the cortex are other brain organs that drive important parts of human nature. They include the hippocampus, which consolidates memory and supports mental maps, the amygdala, which colors experience with certain emotions, and the hypothalamus, which originates sexual desire and other appetites. Many neuroscientists, even when they are impressed by the plasticity of the cortex, acknowledge that subcortical structures are far less plastic. 45 This is not a minor cavil about anatomy. Some commentators have singled out evolutionary psychology as a casualty of neural plasticity, saying that the changeability of the cortex proves that the brain cannot support evolutionary specializations. 46 But most proposals in evolutionary psychology are about drives like fear, sex, love, and {90} aggression, which reside largely in subcortical circuitry. More generally, on anyone's theory an innately shaped human ability would have to be implemented in a network of cortical and subcortical areas, not in a single patch of sensory cortex. ~
Another basic point about the brain has been lost in the recent enthusiasm for plasticity. A discovery that neural activity is crucial for brain development does not show either that learning is crucial in shaping the brain or that genes fail to shape the brain.
The study of neural development is often framed in terms of nature and nurture, but it is more fruitful to think of it as a problem in developmental biology -- how a ball of identical cells differentiates into a functioning organ. Doing so stands the conventional assumptions of associationism on their head. Primary sensory cortex, rather than being the firmest part of the brain on top of which successive stories can only be even more plastic, may be the part of the brain that is most dependent on the input for proper development.
In assembling a brain, a complete genetic blueprint is out of the question for two reasons. One is that a gene cannot anticipate every detail of the environment, including the environment consisting of the other genes in the genome. It has to specify an adaptive developmental program that ensures that the organism as a whole functions properly across variations in nutrition, other genes, growth rates over the lifespan, random perturbations, and the physical and social environment. And that requires feedback from the way the rest of the organism is developing.
Take the development of the body. The genes that build a femur cannot specify the exact shape of the ball on top, because the ball has to articulate with the socket in the pelvis, which is shaped by other genes, nutrition, age, and chance. So the ball and the socket adjust their shapes as they rotate against each other while the baby kicks in the womb. (We know this because experimental animals that are paralyzed while they develop end up with grossly deformed joints. ) Similarly, the genes shaping the lens of the growing eye cannot know how far back the retina is going to be or vice versa. So the brain of the baby is equipped with a feedback loop that uses signals about the sharpness of the image on the retina to slow down or speed up the physical growth of the eyeball. These are good examples of "plasticity," but the metaphor of plastic material is misleading. The mechanisms are not designed to allow variable environments to shape variable organs. They do the opposite: they ensure that despite variable environments, a constant organ develops, one that is capable of doing its job.
Like the body, the brain must use feedback circuits to shape itself into a working system. This is especially true in the sensory areas, which have to cope with growing sense organs. For that reason alone we would expect the activity
{91} of the brain to play a role in its own development, even if its end state, like those of the femur and the eyeball, is in some sense genetically specified. How this happens is still largely a mystery, but we know that patterns of neural stimulation can trigger the expression of a gene and that one gene can trigger many others. 47 Since every brain cell contains a complete genetic program, the machinery exists, in principle, for neural activity to trigger the development
? ? ? ? ? ? ? ? of an innately organized neural circuitry in any of several different regions. If so, brain activity would not be sculpting the brain; it would merely be telling the genome where in the brain a certain neural circuit should go.
So even an extreme innatist need not believe that the brain differentiates itself by the equivalent of GPS coordinates in the skull, following rules like "If you are between the left temple and the left ear, become a language circuit" (or a fear circuit, or a circuit for recognizing faces). A developmental program may be triggered in a part of the developing brain by some combination of the source of the stimulation, the firing pattern, the chemical environment, and other signals. The end result may be a faculty that is seated in different parts of the brain in different people. After all, the brain is the organ of computation, and the same computation can happen in different places as long as the pattern of information flow is the same. In your computer, a file or program may sit in different parts of memory or be fragmented across different sectors of the disk and work the same way in every case. It would not be surprising if the growing brain were at least that dynamic in allocating neural resources to computational demands.
The other reason that brains can't rely on a complete genetic blueprint is that the genome is a limited resource. Genes are constantly mutating over evolutionary time, and natural selection can weed out the bad ones only slowly. Most evolutionary biologists believe that natural selection can support a genome that is only so big. That means that the genetic plans for a complex brain have to be compressed to the minimum size that is consistent with the brain's developing and working properly. Though more than half the genome is put to work primarily or exclusively in the brain, that is not nearly enough to specify the brain's connection diagram.
The development program for the brain has to be resourceful. Take the problem of getting every axon (output fiber) from the eyes to connect to the brain in an orderly way. Neighboring points in the eye must connect to neighboring points in the brain (an arrangement called topographic mapping), and corresponding locations in the two eyes should end up near each other in the brain but not get mixed up with each other.
Rather than give each axon a genetically specified address, the mammalian brain may organize the connections in a cleverer way. In her studies of brain development in cats, the neuroscientist Carla Shatz has discovered that waves of activity flow across each retina, first in one direction, then in some other {92} direction. 48 That means that neurons that are next to each other in a single eye will tend to fire at around the same time, because they are often hit by the same wavefront. But axons from different eyes, or from distant locations in the same eye, will be uncorrelated in their activity, because a wave passing over one will miss the other. Just as you could reconstruct the seating diagram of a stadium if the fans were doing "the wave" along various directions and you knew only who stood up at which time (since people who stood up at the same time had to be seated near each other), the brain could reconstruct the spatial layout of the two eyes by listening for which sets of input neurons were firing at the same time. One of the rules of learning in neural networks, first outlined by the psychologist D. O. Hebb, is that "neurons that fire together wire together; neurons out of synch fail to link. " As the waves crisscross the retina for days and weeks, the visual thalamus downstream could organize itself into layers, each from a single eye, with adjacent neurons responding to adjacent parts of the retina. The cortex, in theory, could organize its wiring in a similar way. 49
Which parts of the brain actually use this auto-installation technique is another matter. The visual system does not appear to need the technique to grow topographically organized wiring; a rough topographic map develops under the direct control of the genes. Some neuroscientists believe that the fire-together-wire-together technique may still be used to make the maps more precise or to segregate the inputs from the two eyes. 50 That, too, has been challenged, but let us assume it is correct and see what it means.
The fire-together-wire-together process could, in theory, be set in motion by letting the eyeballs gaze at the world. The world has lines and edges that stimulate neighboring parts of the retina at the same time, and that provides the information the brain needs to set up or fine-tune an orderly map. But in the case of Shatz's cats, it works without any environmental input at all. The visual system develops in the pitch-dark womb, before the animal's eyes are open and before its rods and cones are even hooked up and functioning. The retinal waves are generated endogenously by the tissues of the retina during the period in which the visual brain has to wire itself up. In other words, the eye generates a test pattern, and the brain uses it to complete its own assembly. Ordinarily, axons from the eye carry information about things in the world, but the developmental program co-opted those axons to carry information about which neurons come from the same eye or the same place in the eye. A rough analogy occurred to me when I watched the cable TV installer figure out which cable in the basement led to a particular room upstairs. He attached a tone generator called a "screamer" to the end in the bedroom and then ran downstairs to listen for the signal on each cable in the bouquet coming out of the wall. Though the cables were designed to carry a television signal upstairs, not a test tone downstairs, they lent themselves to this other use during the installation process because an information conduit is useful for both purposes. {93}
The moral is that a discovery that brain development depends on brain activity may say nothing about learning or experience, only that the brain takes advantage of its own information-transmission abilities while wiring itself up. Fire-together-wire-together is a trick that solves a particular kind of wiring problem: connecting a surface of
? ? ? ? ? receptors to a maplike representation in the cortex. The problem is found not just in the visual system but in other spatial senses such as touch. That is because the problem of tiling a patch of primary visual cortex, which receives information from the 2-D surface of the retina, is similar to the problem of tiling a patch of primary somatosensory cortex, which receives information from the 2-D surface of the skin. Even the auditory system may use the trick, because the inputs representing different sound frequencies (roughly, pitches) originate in a 1-D membrane in the inner ear, and the brain treats pitch in audition the way it treats space in vision and touch.
But the trick may be useless elsewhere in the brain. The olfactory (smell) system, for example, wires itself by a completely different technique. Unlike sights, sounds, and touches, which are arranged by location when they arrive at the sensory cortex, smells arrive all mixed together, and they are analyzed in terms of the chemical compounds making them up, each detected by a different receptor in the nose. Each receptor connects to a neuron that carries its signal into the brain, and in this case the genome really does use a different gene for each axon when wiring them
into their respective places in the brain, a thousand genes in all. It economizes on genes in a remarkable way. The protein produced by each gene is used twice: once in the nose, as a receptor to detect an airborne chemical, and a second time in the brain, as a probe at the end of the corresponding axon to direct it to its proper spot in the olfactory bulb. 51
The wiring problems are different again for other parts of the brain, such as the medulla, which generates the swallowing reflex and other fixed action patterns; the amygdala, which handles fear and other emotions; and the ventromedial frontal cortex, which is involved in social reasoning. The fire-together-wire-together technique may be an ideal method for sensory maps and other structures that simply have to reproduce redundancies in the world or in other parts of the brain, such as primary sensory cortex for seeing, touching, and hearing. But other regions evolved with different functions, such as smelling or swallowing or avoiding danger or winning friends, and they have to be wired by more complicated techniques. This is simply a corollary of the general point with which I began the chapter: the environment cannot tell the various parts of an organism what their goals are.
The doctrine of extreme plasticity has used the plasticity discovered in primary sensory cortex as a metaphor for what happens elsewhere in the brain. The upshot of these two sections is that it is not a very good metaphor. If the plasticity of sensory cortex symbolized the plasticity of mental life as a whole, it should be easy to change what we don't like about ourselves or other people. {94}
Take a case very different from vision, sexual orientation. Most gay men feel stirrings of attraction to other males around the time of the first hormonal changes that presage puberty. No one knows why some boys become gay -- genes, prenatal hormones, other biological causes, and chance may all play a role -- but my point is not so much about becoming gay as about becoming straight. In the less tolerant past, unhappy gay men sometimes approached psychiatrists (and sometimes were coerced into approaching them) for help in changing their sexual orientation. Even today, some religious groups pressure their gay members to "choose" heterosexuality. Many techniques have been foisted on them: psychoanalysis, guilt mongering, and conditioning techniques that use impeccable fire-together-wire- together logic (for example, having them look at Playboy centerfolds while sexually aroused). The techniques are all failures. 52 With a few dubious exceptions (which are probably instances of conscious self-control rather than a
change in desire), the sexual orientation of most gay men cannot be reversed by experience. Some parts of the mind just aren't plastic, and no discoveries about how sensory co~rtex gets wired will change that fact.
What is the brain actually doing when it undergoes the changes we call plasticity? One commentator called it "the brain equivalent of Christ turning water into wine" and thus a disproof of any theory that parts of the brain have been specialized for their jobs by evolution. 53 Those who don't believe in miracles are skeptical. Neural tissue is not a magical substance that can assume any form demanded of it but a mechanism that obeys the laws of cause and effect. When we take a closer look at the prominent examples of plasticity, we discover that the changes are not miracles after all. In every case, the altered cortex is not doing anything very different from what it ordinarily does.
Most demonstrations of plasticity involve remappings within primary sensory cortex. A brain area for an amputated or immobilized finger may be taken over by an adjacent finger, or a brain area for a stimulated finger expands its borders at the expense of a neighbor. The brain's ability to reweight its inputs is indeed remarkable, but the kind of information processing done by the taken-over cortex has not fundamentally changed: the cortex is still processing information about the surface of the skin and the angles of the joints. And the representation of a digit or part of the visual field cannot grow indefinitely, no matter how much it is stimulated; the intrinsic wiring of the brain would prevent it. 54
What about the takeover of the visual cortex by Braille in blind people? At first glance it looks like real transubstantiation. But maybe not. We are not witnessing just any talent taking over just any vacant lot in the cortex. Braille reading may use the anatomy of the visual cortex in the same way that seeing does.
? ? ? ? ? Neuroanatomists have long known that there are as many fibers bringing {95} information down into the visual cortex from other brain areas as there are bringing information up from the eyes. 55 These top-down connections could have several uses. They may aim a spotlight of attention on portions of the visual field, or coordinate vision with the other senses, or group pixels into regions, or implement mental imagery, the ability to visualize things in the mind's eye. 56 Blind people may simply be using these prewired top-down connections to read Braille. They may be "imagining" the rows of dots as they feel them, much as a blindfolded person can imagine objects placed in his hand, though of course far more rapidly. (Previous research has established that blind people have mental images -- perhaps even visual images -- containing spatial information. )57 The visual cortex is well suited to the kind of computation needed for Braille. In sighted people the eyes scan around a scene, bringing fine detail into the fovea, the high-resolution center of the retina. This is similar to moving the hands over a line of Braille, bringing fine detail under the high-resolution skin of the fingertips. So the visual system may be functioning in blind people much as it does in sighted ones, despite the lack of input from the eyes. Years of practice at imagining the tactile world and attending to the details of Braille have led the visual cortex to make maximal use of the innate inputs from other parts of the brain.
With deafness, too, one of the senses is taking over the controls of suitable circuitry, rather than just moving into any old unoccupied territory. Laura Petitto and her colleagues found that deaf people use the superior gyrus of the temporal lobe (a region near the primary auditory cortex) to recognize the elements of signs in sign languages, just as hearing people use it to process speech sounds in spoken languages. They also found that the deaf use the lateral prefrontal cortex to retrieve signs from memory, just as hearing people use it to retrieve words from memory. 58 This should come as no surprise. As linguists have long known, sign languages are organized much like spoken languages. They use words, a grammar, and even phonological rules that combine meaningless gestures into meaningful signs, just as phonological rules in spoken languages combine meaningless sounds into meaningful words. 59 Spoken languages, moreover, are partly modular: the representations for words and rules can be distinguished from the input- output systems that connect them to the ears and the mouth. The simplest interpretation, endorsed by Petitto and her colleagues, is that the cortical areas recruited in signers are specialized for language (words and rules), not for speech per se. What the areas are doing in deaf people is the same as what they are doing in hearing people.
Let me turn to the most amazing plasticity of all: the rewired ferrets whose eyes fed their auditory thalamus and cortex and made those areas work like a visual thalamus and cortex. Even here, water is not being turned into wine. Sur and his colleagues noted the redirected input did not change the actual wiring of the auditory brain, only the pattern of synaptic strengths. As a result they {96} found many differences between the co-opted auditory brain and a normal visual brain. 60 The representation of the visual field in the auditory brain was fuzzier and more disorganized, because the tissue is optimized for auditory, not visual, analysis. The map of the visual field, for instance, was far more precise in the left-right direction than in the up-down direction. That is because the left-right direction was mapped onto an axis of the auditory cortex that in normal animals represents different sound frequencies and thus gets inputs from the inner ear that are precisely arranged in order of frequency. But the up-down direction was mapped onto the perpendicular axis of the auditory cortex, which ordinarily gets a mass of inputs of the same frequency. Sur also notes that the connections between the primary auditory cortex and other brain areas for hearing (the equivalent of the wiring diagram for the visual system on page 88) were unchanged by the new input.
So patterns in the input can tune a patch of sensory cortex to mesh with that input, but only within the limits of the wiring already present. Sur suggests that the reason the auditory cortex in the rewired ferrets can process visual information at all is that certain kinds of signal processing may be useful to perform on raw sensory input, whether it is visual, auditory, or tactile:
On this view, one function of sensory thalamus or cortex is to perform certain stereotypical operations on input regardless of modality [vision, hearing, or touch]; the specific type of sensory input of course provides the substrate information that is transmitted and processed. . . . If the normal organization of central auditory structures is not altered, or at least not altered significantly, by visual input, then we might expect some operations similar to those we observe on visual inputs in operated ferrets to be carried out as well in the auditory pathway in normal ferrets.
