It could never generate something like temporal
experience
for a machine.
Brett Bourbon - 1996 - Constructing a Replacement for the Soul
Wells' Time Machine, therefore, defines and functions through the logic o f the copula.
The disguised use o f this linguistic metaphor in organizing Time highlights the fundamental cognitive dependence o f the conceptual structures o f time and language. Language works as a form o f external memory. In this sense language and memory both transport information through time. We use this memory as a means of actively re-shaping elements o f our experience, including other people, into forms and relations that allow for thesuccessofourgoals. Inthissenseweattempttore-formulatethroughakindofviral infection, the internal state, the descriptions o f the world and the goals embodied in these descriptions (goals are often understood as ideal descriptions of self) of other people.
If language is a form of memory, then we should expect our memories to function throughakindoflanguage(asystemofsymbolicrelations). Thisiscertainlytrueof Minsky's K-Iines. K-lines wire together a set of agents active during an experience, and thusformamemoryofthatexperience. Theconnectionsbetweenagentsvaryinstrength, forming a hierarchy of levels. A K-line, to the degree that it links agents within such a hierarchy of relevant levels, sketches a set of relations within a loose syntax. Minsky organizes the formation o f these K-lines within "societies o f memory. " New K-lines are attached to the most recently active K-lines. When (Jack) (Fly) (Kite) are connected by a new K-line, predicates, that is, the K-lines defining each o f these terms, e. g. (Male) (Outside) (Young), are attached to the relevant agent, e. g. (Jack). Because these older K- lines are used to describe the new elements, as predicates, they are in effect nested within
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
578
? the new K-line. IfK-lines are used to form "societies ofmemory", therefore, they build syntactical trees. Minsky never addresses why the world should be categorized in this way. Nor does he examine how such categories would be constructed so that we could recognize them. What his model o f memory does demonstrate is the temptation to describe ourselves and our biology within grammars built from our language.
Predication links Well's Time Machine to all possible times (the set o f possible objects). Although K- lines set up a more complicated set o f relations and associations, these relationship are organized in a rough equivalent o f predication. The Time Machine works not only like parser, it reduces all temporality to the form o f what we understand as memory. Ourexperienceoftime,inspiteoftheroleofconsciousnessandmemoryin determining continuity and particular expectations, is quite different. For Well's the content of all possible moments is pre-determined and already established within the synchronicplainon(orin)whichthemachinetravels. Oursenseoftime,however,and also unlike the closed temporal-spatial loops described in Godel's solution ofEinstein's
gravitational field equations in General Relativity, is of a totalizing alteration or change in the entire universe, where the content o f future moments is understood as undetermined and therefore not yet real. In our experience there is a logical distinction between change (a physical process) and Time (our construction of this change into a form we can perceive). Time arises as an effect of our phenomenal observation of a succession of changes, determined in relation to the relative continuities of other objects or events, and in relation to the continuity of the phenomenal frame through which we represent reality (what we call our subjective consciousness).
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
579
? 14. 3 Generatingthepresentfromlanguage "A Rose is a Rose is a Rose"
To perceive time we must represent or model it. Any such model must organize sensory input within a temporal structure. Such a structure is difficult to imagine because the word "structure" defines spatial relationships, and thus can only be used in a vague metaphoricalsensewhenusedtoorganizetemporality. Whatwerecognizeastemporal structure is really repetition (of the sort that orders and constructs music--which is the formal art of structuring time in relation to sound).
Human attempts to re-create a continuous present rely on repetition in order to split the sound o f the word (signifier) from its concept or meaning (signified and referent). In other words, repetition dissolves the symbolic content of a word by erasing semantic difference. As meaning is dissolved, the temporal dimension slows to nothing more than an awareness of the progressive loss of meaning in the sentence. Our experience of reading non-sense exposes a curious relation between our awareness of temporal succession and language.
A single image is not splendor. Dirty is yellow. A sign of more in not mentioned. Apieceofcoffeeisnotadetainer. Theresemblancetoyellowisdirtier and distincter. The clean mixture is whiter and not coal color, never more coal color than altogether.
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
580
? The sight of a reason, the same sight slighter, the sight of a simpler negative answer, the same sore sounder, the intention to wishing, the same splendor, the same furniture. (Stein, 463)
Unlike some o f Lewis Carroll's nonsense lyrics, this passage plays between sense and nonsenseintheattempttoconstructwhatSteincalledacontinuouspresent. Whatwe apprehend as sense defines a frame, a set of expectations, which the subsequent non-sense dissolves. The failure ofthe frame to interpret the semantic content ofthe words throws us into an interpretative loop. We interpret that loop as a failure to progress beyond the immediate context.
Language is not simply structured serially, that is, it does not function through a successionofwords. IfitdidStein'spassagewouldclearlymakesense. Languageis structured through a series of nested domains. In a highly repetitive sentence, "Rose is a Rose. . these nested domains (syntactical categories) collapse into a tautological chain. In Stein's non-sense passage semantic meaning marks a stable moment (or frame) which disintegratesintoindeterminacy,butstillwithinastablesyntax. Theeffectistomodela mind capable o f formulating short-term predictions, but incapable o f organizing the facts (the words) in order to satisfy these predictions.
Stein wants to think like a chimp. D. Premack, in his attempt to evaluate the degree to which the chimpanzee has a theory of mind, formulates a distinction between simple and complex states. Simple states are "hard-wired, automatic and reflex- like, and encapsulated" (172). He defines these states as "seeing, wanting, and expecting". The pathways determining each o f these (with varying degrees o f complexity) are tied to direct
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
581
? sensory input, such that their is little mediating control by the organism over these states. Complex states, however, are highly mediated states in which some level o f decision- making is required in order to determine the state. The prototypical example is belief. Belief arises as a mediating and, some would say, conscious response to particular forms ofdoubt. Premack distinguishes two forms ofdoubt (and consequently ofbelief): doubt in the veracity o f sensory information (epistemological doubt) and doubt in the information communicated by a member o f one's group (fear o f deception).
Epistemological doubt is countered by conscious attempts to construct an external means of determining the truth of sensory input: observation, experiment, analysis, reason, art, religion. Premack characterizes epistemological doubt with three questions: "Do I really see X? " "Do I really want X? " "Are my expectations well founded? " If we ignore the problem of their linguistic form, these questions describe a critical process of categorization. Epistemological doubt of this sort is predicated (and expresses or functions through) a distinction between truth and falsity. In other words these questions, defined by their use of "really" and "well-founded" require doubt to be in place in order to be asked. They appear initially to be questions o f domain. These questions are what I would call questions of syntax concerned about what belongs where as what. In other words syntax defines a set o f domains that taken together define the form and legitimacy of a particular string to function within language, that is to be intelligible. Syntax, however and to what degrees of specificity it is defined, constructs the possibility of determining legitimacy or, in relation to our epistemological doubt, truth. Syntax implies an established semantics, just as questioning the truth of X requires the possibility of falsity.
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
582
? falsity. Syntaxdeterminesthedomainoflegitimacyasameansofstructuringthe possibility of doubt (or failure). Because a particular word might not be legitimate, syntax divorces the criterion for truth from the content of the word. The specific form of an entity is understood as variable and possibly false. This does not mean that a grammarians strictdefinitionofsyntaxdeterminesthesenseofasentence. Syntaxisitselfmuchmore fluidthancommonlysupposed. Strictsyntacticalrulessimplydescribethecenterofa syntactical domain. One can still make sense of words used within an incorrect syntax as long as they still reside within the domain defining their relationship with other words (and
thus its legitimacy as a member of a meaningful string). Once a word, however, can no longer be related to other words in a meaningful way, that word has left the syntactical domain that determined its legitimacy (and thus its meaningfulness). Thus one can see why a cognitive scientist like Schank argues for semantics over syntax. He should be arguing,however, foramorebroaddefinitionofsyntax,asyntaxthatdetermines relationships through the activation of semantic content within a particular domain (a possiblesetofrelations). Schank'sscriptorframeisasyntacticalstructure,onethat determines the legitimacy or meaningfulness of words by the establishment of a set of possible meanings, albeit possible meanings determined by previous knowledge. Belief as a form o f long-range prediction depends on a syntactical elaboration o f the present in order to create the possibility of a future.
The possibility of Premark's second form of doubt is dependent on the what R. Seyfarth and D Cheney call, in their study of meaning and language in Vervet monkeys, the attribution of mental states "such as knowledge, beliefs, and desires to others" (126).
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
583
? In their study they conclude that Vervet monkeys in spite of the character of three specific calls and the different responses these calls cause in those who hear them in warning of a snake as opposed to a martial eagle or a leopard do not have a language because they cannot determine the difference between a knowledgeable audience and an ignorant audience (127). They apparently cannot evaluate the knowledge o f those around them, because their communication is not attempting to change the mental state of their audience. Itissimplyasignalactivatingalearnedresponse. Theattributionofamental state to another seems to require the ability to choose. Making a choice (a kind of
thinking) involves constructing a world, a frame, or a domain of relations organized according to a particular grammar (a set of rules and values).
Chimps make choices. Do they then make conceptual worlds? In an experiment a female chimp was trained to add and count. Part ofthe training procedure required the chimp to play a game where two piles of candies were counted out. Whichever pile the chimp first point to was given to another chimp sitting in front of her in a cage. The object of the game was to get the most candies. Whenever the candies were counted out the chimp invariably pointed at the larger pile, thus losing. When numbers written on cards were substituted for the candies, however, the chimp was always able to point to the smaller number, thus insuring that she would be rewarded with the larger number of treats.
One could speculate. When the chimp saw the food an instinctual grab/eat rule (or agent)determinedherchoice. Sheplayedthecandygameusingherinstinctualrules. She needed instead to nest the candy game within the her instinctual game, by replacing the instinctual mechanism for achieving her desire for the most food with the mechanism
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
584
? defined by the game. By encoding the "amounts" o f candy within a numerical domain the relationship between the two piles can be determined without invoicing the grab/eat rule. Thisinformationisnolongerstoredasanimagewithinthegrab/eatrule. Thenumerical domain indicates the value of each number in relation to the other, not in relation to the chimp or her desire to eat. The failure of any abstract system to define this kind of personal relation requires that its values be accessed and assessed from another domain and according to another grammar. In this case, the chimp can then apply the rules o f the candy game to these "amounts" in order to determine the winning choice.
Any abstract system sets up a play between at least two different systems or domains. This recursive interaction creates a kind o f consciousness, because it creates the illusion o f free choice. This choice is not in any sense free, it is simply the mediation o f one domain by another. The chimp evaluates how to get food [an algorithm defined by CHOOSE THE MOST DESIRABLE and THE MOST DESIRABLE IS THE MOST FOOD] through the algorithm of the candy game [CHOOSE THE LEAST FIRST], The transcription of candies into number allows both of these algorithms to function together.
The three systems of relations in the previous experiment are all defined as systems o f value. These systems o f value are really systems o f meaning because they are sets o f relations. Semantic meaning within any discourse is primarily the articulation of a particularsetofrelations. Weassumethissetofrelationsisnotarbitrary. Thismeans they are constructed according to a particular logic. This logic is a logic of difference.
The statement "x means y" requires at some level, although not necessarily at the conceptual level Saussure suggests, that the notions "x" and "y" be understood as "not z",
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
585
? "not w". Even to say this, however, requires that the notion "x" be crystallized in such a way that such a comparison is possible. How do we know that 'x' is not the same as ly'? We know this because they sound different, or because their shapes are different. Shape and sound serve as common denominators. Thus to speak o f difference requires that "x" function within a realm of common terms or qualities, which means a realm of pre- established possible relations and configurations. Thus what I first called a logic of difference is a difference mediated by a commonality. This common context is not given, but is constructed. (On a fundamental level, however, the initial contexts would be created primarily out o f the biological structures used to interpret our interactions with our environment).
Value is determined through differences expressed within a common context. A common context means in relation to a binary descriptive system: between two similar phonemes, between more and less, and so on. Values generated out ofthese metaphoric matrices are re-coded into more complex systems o f relations. We can easily see how this works in the chimp experiment. How can the chimp nest the rules o f the candy game within its instinctual grab/eat game? Encoding the amount o f candy in numbers created a domain of pure value organized around more and less. This information was embedded in the world o f the candy game where the output o f the algorithm CHOOSE THE LESS selects the lesser value. This value is eliminated and the larger value is transferred into the
domainofthechimpsgrab/eatrule. Ineachcasevalueisdeterminedbyhowtheeventis encoded within a system ofvalues. The situation facing the chimp is successively translated into different conceptual worlds, where the meaning o f that information is
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
586
? determined by the values (in this case simple algorithms) organizing the relations within that world.
Thus, thinking is a process ofworld-making. A Dutch psychologist, de Groot, discovered that chess masters through a process o f implicit pruning do not see bad moves. They act within or through a grammar or a domain defined exclusively by good moves. They construct a conceptual world of good moves. This world defines what they see: it defines the moves the chess master recognizes as possible.
How does someone determine which of the possible moves or relations is correct, best, or relevant? This is too large a question to answer here. I can suggest, however, how we determine the relevant from the irrelevant within a frame or grammar in a general way. In an obvious way relevance is a function of understanding how something functions within a frame or domain. Frames must be extremely flexible to be able to handle the high degree of uncertainty and complexity of our experience. If we re-define determining relevance as making a choice we can make some progress. Choice arises through a kind of recursive nesting of domains and grammars. The interaction of these domains and grammars selects relationships from each that are integrated within a new domain and grammar, thus constructing an alternate world. This world defines what is possible. One assumes that at some level or in some world one is left with only a single possibility. This choice (really an algorithm) is transported to higher levels o f organization where it appears like we have made a conscious choice.
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
587
? 14. 4 A wink in time means two
Before we can build a belief in the future, we must build awareness. We can build a basic time detector by using difference detectors, or what Minsky calls time-blinking:
Any agent that is sensitive to changes in time can also be used to detect differences. For whenever we expose such an agent, first to a situation A and then to a situation B, any output from that agent will signify some difference between A and B. (240)
While time-blinking partially removes the problem of comparing two inputs from different agents without requiring synchronous and identical frames (a trick it does largely by having a temporary memory), it does not explain how difference is translated into an ordered succession o f moments. One could, however, easily input the recognition o f a perceptual difference to a kind o f tape, as if marking a date or a second, which is then advanced. Suchaprocedurewouldrecordsuccessivedifferences,whichcouldfunction like a clock for human beings.
It could never generate something like temporal experience for a machine. By what process is temporal order perceived and organized such that consciousness understands itself as the present? Do all the inputs that make up consciousness run through a single agent (an agent dangerously close to a homunculus) in rapidsuccessioninorderthatwecanperceivedifferenceandcallthatdifferencetime? If not, how is the information that our brain receives, processes and constructs, all at different rates, constructed into a now? The formation of defined moments is a process of constructing meaningful information. A moment, therefore, defines those "differences that makeadifference. " Timeisaninformationstructurewithinwhichwefindourselves.
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
588
? Thus our machine must generate representations o f its world in succession in which it finds itself. It has to turn itselfinside out.
14. 5 "Be! Verb umprincipiant through the trancitive spaces! "
My machine lives in a world o f simple objects. As a time machine it does not recognize objects as objects, but objecthood, as that which can be noticed as something, which it perceives in what it considers a partial instant o f time. It does not recognize the world or the environment, but only something that triggers its optical apparatus as a somethingtobenoticed. Itsopticalapparatushasalreadysimplifieditsphenomenalfield into this categorical perception, which we can call the set o f objects. This information is sent to the Optical (O) input agent which registers this information within a formally defined phenomenal field. The machine can rcognize separate example of objecthood within a range from 1 to 5. This phenomenal field is defined by a set o f switches (5) that representanobjectbybeingonandrepresentnoobjectbybeingoff. Thusthemachine optical apparatus can immediately register up to 5 objects. An initial input, N l, once it has set these switches (once the optical information is represented as an internal state), is transferred to an Optical analyzer agent where it again sets a similar set of switches. If the next input (N2) to the Optical input agent resets the switches, it is registered as a different moment and is thus sent on to O difference detector. The difference detector records that adifferencehasoccured. IfitsinformationisidenticaltoNl,nochangeofstatetakes place. Because our machine has only one sensory input at this point, the failure to register
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
589
? difference is understood as non time; the first moment "continues" because the first state continues.
Once Nl has reset the difference detector, indicating a different moment registered as a change o f state, it enters a feedback loop. The detector's switches are then immediately reset by N2 (if there is an N2). N2 is similarly sent on a feedback loop but at twice the rate. Immediately after N2 resets the difference detector, N l resets it again.
This difference is converted into a value indicating the difference between these two states (degree o f change). The second cycle resets the detector to N2, before the next signal from O input is received.
Although it is not necessary to separate the process of detecting change from that of determining the degree of change, their functional difference allows us to split the presentintotwophenomenalelementsorinteractingmodels: anexperientialmodelandan evaluatory process. The difference detector, as the second element, serves as a kind of short-term memory within the phenomenal experience. It has, however, changed the nature o f the information perceived by the machine. Both kinds o f information determine the nature o f the present. It is the detector's separation from the initial model o f change
that allows the machine (to the degree that it is defined by its internal processes) to be aware of change. This means that the difference detector makes change, as defined by the 0 input agent, meaningful. The moment is actually not defined by any single state but by two states defined in relation to each other, embedded within the degree o f difference determined by the difference detector (so that Nl and N2 will be stored together as PI and P2). The difference detector, however, is inadequate for any short term memory. We
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
590
? need a memory that encodes the consciousness o f the machine, and that requires that the information from both agents be stored. Both Nl and N2 are sent into a single short term memory unit (they are connected by a simple K-line). This unit is organized within short term memory (STM) according to two parameters: the ordered received (representing temporal succession) and degree of difference. . Short term memory (STM) stores both our experience o f change (suitably simplified) and a particular fact about these experiences. Thesearenotidenticalbitsofinformation. Theanalyzerdeterminesthe relevant facts for the time machine. Given the formally defined character of the phenomenal field, this information can be used to actually structure STM. (There are 10
possible values 1 through 5 and -1 through -5 defined in relation to the second state (N2): there is no O, o f course)
Optical Difference Machir (N2 Input State)
Difference Valu
(fact)
N1 = P1
Optical Inupt Agent (Change detector)
Optical Difference Detector
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
Experiential Order
Short Term Memory
591
? This is, ofcourse, not a model ofhuman perception. We have eliminated some ofthe criticalproblemsinconstructingamodelofoursenseoftime. Theworldandthe informationfromthatworldisimmeasurablysimplified. Inmymachine,theformal continuity between moments is built into the form in which the sensory input is represented (a defined set o f switches). With only one kind o f sensory information (number of objects), we do not have the problem of synchronizing and integrating the information from different senses (and their processing agents within the brain). The initial formation o f the moment is defined by the limit inherent within the speed by which the optical apparatus can convert its sensory input into a set o f objects. Changes that take placeata ratefasterthanthemachine'sphysicalabilitytorecognizeasetofobjectsare simply not registered.
14. 6 The logic of short-term prediction
If my machine can recognize patterns, such that the number of objects defined in one moment is always followed by a defined number in another moment, it can make short-term predictions. Once a pattern has been established, it can be recalled and run through a memory recall agent (another difference detector) at a rate faster than the information processed by the Optical agent. I will not spend much time constructing the mechanics of such a process. What is important in this problem is less the way in which this information is stored, than in the syntactical logic it necessarily generates. The logic here is simple: if x (a certain number of objects) is registered it will be followd by y
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
592
? (another number ofobjects). Such predictions can, ofcourse, only happen ifthere is a pattern to be recognized.
Initially Short Term Memory (STM) is evaluated to determine a match with the initial optical input (Nl). If a match is found (through difference detectors attached to each memory slot), then the entire temporal unit, containing two states (PI, P2; remember PI) is transferred to the Memory Recall Agent. Nl and PI are processed as identical. The P2 state will not have an initial correlate state (it is run before N2). Because a prediction is based on understanding P2 as if it were N2, P2 must be understood as an N,
butnotastherealN2. Consequently,anysuchpredictionsrequireasymboliceconomy allowing for the conversion of Px into *Nx (where * indicates this input has an ontological claim equal in value but different in kind). The creation of an Nx state represents the creation of a temporal syntax. In order for the correlation of P2 with Nx to function as an expectation of N2, the machine must be able to act (or change its state as with Pavlov's dogs) on the basis of this correlation.
In Pavlov's bell experiment a similar temporal logic is manipulated. The equation o f food = salivate is re-wired to bell = salivate and is therefore based on an associated equivalence between food and bell. This equivalence, however, does not take place within a synchronic plane. It works because the sound of the bell recalls an established pattern recorded in memory. The P2 state of food following the PI state of the bell is understood asthesameasanNstate. Asymbolicinterchangetakesplacebetweenthepresentandthe future (patterned on a previously established relationship). A structural relationship has
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
593
? been established between these two diachronic states, which allows the content o f one state (the bell) to stand for the content of the other (food).
Predictions based on short term memory are stimulus dependent. They disappear as soon as the environmental stimulus that suggested them disappears. They define only a temporaryandunstablefuture. Amachinewithonlythiskindofmemorycouldnot engage in any long term planning. Such plans require an ability to invoke the possibility of the future on command, as well as much more complex reasoning and creative modeling.
14. 7 The continuous future: hearing of and speaidng in the new world order
The Time Machine's world is now a rectangular plane, on which, at some unspecified but unreachable distance, a number o f objects flash in and out o f existence. This plane is divided into a series of parallel districts (wide strips). The number of objects ineachdistrictchangeindependentlyofthenumberofobjectsinotherdistricts. No machine, o f which now their are many, can see the objects (the number o f objects) in a district other than the one it is in. The machines can move to other districts. To prevent any machine from becoming a part ofthe object field ofanother machine, all machines will move along the same line and can move around each other if one machine is in the way of another. (The eyes move to the side o f the machines head. The machines bump into other machines and then move around them; I will not include this perception and response withinmymodelinghereforavarietyofreasons. Thinkofthisbumpingandmovmentas a function o f the machine autonomic nervous system)(see Figure A).
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
594
? Figure A
Object Field
OO
Object Field
Object Field
Districts
For our machine to survive in this world it will need, in addition to the optical system (0 input; O diffemce detector; memory, etc. ), a vocal generator (V) an auditory sytem (A) and more complex memory and recognition processing. A picture o f these systems, while confusing in its details, at least gives a sense ofthe increase in complexity that we need to make this simple world meaningful in even the smallest degree (Figure B):
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
achin
595
? 14. 8 Another blueprint of time Figure B
input Self
Pattern Recognizer
A STM
(no match)
A/O lvalue tQL
Difference DetectorN
STM (match)
Input
O Diffe rence Detec or
0 STI
lemo jecalL
A/O LTM
14. 9 Mental imperialism: to make the world the mind
The goal o f the machines in this world is to find and cohabitant with another machine within its district through the recognition of its vocalization of its perception of thenumberofobjectswithinthedistrictitfindsitself. Thismeansamachineistryingto recognize that another machine 'exists' within the first machine's 'time-world. ' A machine will recognize another machine as an external expression o f its own temporal perception o f its time-world. Its time-world becomes its awn time-world by being
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
0 LTM (Patterns)
596
? externalized (recognized) as an external limit (the other machine) o f its own internal perceptions (in other,words it orients itself toward the world as if that world is both its world (defined by succession) and not its world (marked by its recognition o f another machine as another machine within its world).
A machine will now have a vocalizing agent (V) through which it will express the degree of change between two moments. This machine talks time. This vocalizing agent will receive this information from the O Difference Detector ater every five machine moments.
In order to hear these vocalizations, each machine will also have an auditory agent (A). Topreventconfusingthemachine'sownvoicewithanother's,thevocalizingagent will signal the auditory agent that it is speaking. Confirmation that a voice is the machines own can be confirmed using two methods. Because the distance between the vocalizing agent and the auditory agent is always the same, the rate at which the A agent receives an input after it receives the signal from V will always be the same. In addition the signal from V will also initialize the auditory agent at the specific value to be vocalized and thus the auditory agent can function as a difference machine where the difference between input and initial state should be 0. This information is shunted into its own special memory.
14. 10 Time and the other
The auditory agent will have a different causal history, or in terms of my temporal
machines, a different time-scale than the Optical agent. Organic brains receive information from their sensory inputs at different rates depending on the distance from the brain to the
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
597
? sensory receptor, the distance between processing agents in the brain, and the different rates at which these receptors and agents work. The more complex the sensory model of the world, the more complex the temporal model generated from each sense. Such complexityrequiresmediation. Inmymachine,sensoryconflictarisesfromthedifferent rates and content of the information processed by the O and A Agents. The mediation between these agents is accomplished by constructing a common structure in which the differences in their content can be expressed independently o f each other.
The auditory agent in the machine will construct a short-term memory using a difference evaluator, similar to the O Difference Detector. Because the information received by A is already mediated by the optical agent, it cannot be used to directly model the number of objects in the external world. This auditory information describes the internal state of other machines. The Auditory Agent, therefore, will evaluate differences between its auditory inputs (between machines) only in order to develop a time scale for its auditory perception. (In a more advanced machine it would be possible to begin to determine which inputs originate from the same machine). The machine has two sensory inputs. Twoidenticalauditoryinputswillnotbemistakenforasinglemomentunlesssuch an identity occurs "simultaneously" at O and A. These two different forms o f sensory input require the machine to construct its own internal representation o f time in order to mediate the differences, conflicts, and confusions between the auditory and optical time- scales. Because the auditory input communicates the degree of change perceived by what we know is another machine, this information must be evaluated in relation to the degree
o f optical change perceived by the listening machine. Unlike the O Agent, the A Agent is
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
? supported by another more fundamental agent that batches together two auditory states into a single auditory moment. The A Agent we are constructing interprets these momentsasmeaningfulpackagesofsound. Whymeaningful? Meaningisusedhereonly to indicate that these inputs do not refer to the same thing as a machine's initial optical input, but must be related to the information generated from its own Optical Difference Detector.
The difference values generated from its Auditory agent can have little sense to our machine. If we first imagine the machine's auditory sense without reference to its alreadyestablishedopticalsense,webegintounderstandtheconfusion. Itcanhear information communicated from beyond its own district. It has no idea how many machines it can hear nor can it tell the difference between one machine or another (all machine voices are identical and it senses are not refined enough to distinguish between thedistanceofvoiceexceptwhentheyareagoodnumberofdistrictsaway). This auditory information can only be used to define a series o f random differences marking the changes that they themselves cause in the auditory perception apparatus of our machine: an auditory time-scale or map.
If, however, these auditory inputs can be compared with the vocalizations of our machine, or even better with the values generated from the Optical Difference Detector, this auditory information no longer simply serves to define a time-scale in which it is the difference between inputs, and not their content, which carries information. . The machine will test all o f its O short term memory slots (with priority given to the most recent). Once it finds a match (again through a difference test), it will wait for 5 moments in order
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
599
? to retest the match, which will have to match not only in value but also in the O memory slot it is found. This means that a test will take at least as long as 5 moments, slow but necessary if a district is as wide as the distance it takes sound to travel for 5 machine moments(itmightbefilledwithsomedensegasorevenwater). Thisretestingwillalso reduce the problem o f false matches (where a degree o f change value o f +2 could be obtained by a 5 moment followed by a 3 moment and a 3 moment followed by a 1 moment). It is, o f course, not even necessary that a real match, from our perspective, take place. Itisenoughthatitseemslikeamatchtothemachines(althoughanyfalsematch willdissolvefairlyquickly. Itisunlikelygiventhenumberofpossiblecombinationsinour 5 object system that the difference ratio between moments would remain the same in two
different districts for more than 3 moments). The machine edits out A inputs different from its own internal state as "noise" once a match has been discovered.
14. 11 Looking for Mr. Goodmachine
If a machine fails to find an auditory match with its own O Difference Detector
after 3 vocalizations ( in order to give machines which have not yet vocalized but are within the same district time to communicate with this other machine before it moves), it moves the distance possible in 3 moments, and then trumpets its degree o f change value. (The machine has eyes on the sides o f its head so that it can see, and thus function within theprimaltime-scalethatdeterminesitsmomentsanditsrateofvocalization). Ifit processes a match in transit, the machine will stop and retest the match. If it finds a match then it doesn't move. Both machines are in the same district and, therefore, happiness!
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
600
? Once a positive match has been made three things will happen. First, a pattern detector will correlate a signal from the Optical Difference Detector sent every Optical moment with its matched auditory input. It will discover that the match happens every 5 moments. Second, the correlated auditory and optical information is stored in Auditory/Optical Long-Term Memory (A/O LTM). Third, a signal is sent from the
A/O mediating agent to V in order to re-initialize the timing for vocalizations to match the vocalizationsofthemachinethatiswithinthedistrict. (Iamignoringthecaseofmore than one machine in the district, although the districts are large enough to accommodate more than one machine). At the Vocalizing Agent a difference detector is installed in order to detect the change from the previous vocalizing timing. This information is then sent to A/O LTM. The A/O LTM, therefore, is organized as a series of bifurcated units representing an Auditory value and an equal Optical value within the domain marked by the change in vocalization timing.
14. 12 Meta-temporal identities: the modeling of others as syntax
The A/O Evaluator has constructed a meta-temporal identity within LTM, an
identity (not yet an entity) that organizes temporal information (two levels of abstraction above the initial perception of change), instead of representing particular temporal states. The A/O Evaluator has integrated the O agent and A agent, and in so doing has created a more abstract and mediated information structure.
The disguised use o f this linguistic metaphor in organizing Time highlights the fundamental cognitive dependence o f the conceptual structures o f time and language. Language works as a form o f external memory. In this sense language and memory both transport information through time. We use this memory as a means of actively re-shaping elements o f our experience, including other people, into forms and relations that allow for thesuccessofourgoals. Inthissenseweattempttore-formulatethroughakindofviral infection, the internal state, the descriptions o f the world and the goals embodied in these descriptions (goals are often understood as ideal descriptions of self) of other people.
If language is a form of memory, then we should expect our memories to function throughakindoflanguage(asystemofsymbolicrelations). Thisiscertainlytrueof Minsky's K-Iines. K-lines wire together a set of agents active during an experience, and thusformamemoryofthatexperience. Theconnectionsbetweenagentsvaryinstrength, forming a hierarchy of levels. A K-line, to the degree that it links agents within such a hierarchy of relevant levels, sketches a set of relations within a loose syntax. Minsky organizes the formation o f these K-lines within "societies o f memory. " New K-lines are attached to the most recently active K-lines. When (Jack) (Fly) (Kite) are connected by a new K-line, predicates, that is, the K-lines defining each o f these terms, e. g. (Male) (Outside) (Young), are attached to the relevant agent, e. g. (Jack). Because these older K- lines are used to describe the new elements, as predicates, they are in effect nested within
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
578
? the new K-line. IfK-lines are used to form "societies ofmemory", therefore, they build syntactical trees. Minsky never addresses why the world should be categorized in this way. Nor does he examine how such categories would be constructed so that we could recognize them. What his model o f memory does demonstrate is the temptation to describe ourselves and our biology within grammars built from our language.
Predication links Well's Time Machine to all possible times (the set o f possible objects). Although K- lines set up a more complicated set o f relations and associations, these relationship are organized in a rough equivalent o f predication. The Time Machine works not only like parser, it reduces all temporality to the form o f what we understand as memory. Ourexperienceoftime,inspiteoftheroleofconsciousnessandmemoryin determining continuity and particular expectations, is quite different. For Well's the content of all possible moments is pre-determined and already established within the synchronicplainon(orin)whichthemachinetravels. Oursenseoftime,however,and also unlike the closed temporal-spatial loops described in Godel's solution ofEinstein's
gravitational field equations in General Relativity, is of a totalizing alteration or change in the entire universe, where the content o f future moments is understood as undetermined and therefore not yet real. In our experience there is a logical distinction between change (a physical process) and Time (our construction of this change into a form we can perceive). Time arises as an effect of our phenomenal observation of a succession of changes, determined in relation to the relative continuities of other objects or events, and in relation to the continuity of the phenomenal frame through which we represent reality (what we call our subjective consciousness).
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
579
? 14. 3 Generatingthepresentfromlanguage "A Rose is a Rose is a Rose"
To perceive time we must represent or model it. Any such model must organize sensory input within a temporal structure. Such a structure is difficult to imagine because the word "structure" defines spatial relationships, and thus can only be used in a vague metaphoricalsensewhenusedtoorganizetemporality. Whatwerecognizeastemporal structure is really repetition (of the sort that orders and constructs music--which is the formal art of structuring time in relation to sound).
Human attempts to re-create a continuous present rely on repetition in order to split the sound o f the word (signifier) from its concept or meaning (signified and referent). In other words, repetition dissolves the symbolic content of a word by erasing semantic difference. As meaning is dissolved, the temporal dimension slows to nothing more than an awareness of the progressive loss of meaning in the sentence. Our experience of reading non-sense exposes a curious relation between our awareness of temporal succession and language.
A single image is not splendor. Dirty is yellow. A sign of more in not mentioned. Apieceofcoffeeisnotadetainer. Theresemblancetoyellowisdirtier and distincter. The clean mixture is whiter and not coal color, never more coal color than altogether.
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
580
? The sight of a reason, the same sight slighter, the sight of a simpler negative answer, the same sore sounder, the intention to wishing, the same splendor, the same furniture. (Stein, 463)
Unlike some o f Lewis Carroll's nonsense lyrics, this passage plays between sense and nonsenseintheattempttoconstructwhatSteincalledacontinuouspresent. Whatwe apprehend as sense defines a frame, a set of expectations, which the subsequent non-sense dissolves. The failure ofthe frame to interpret the semantic content ofthe words throws us into an interpretative loop. We interpret that loop as a failure to progress beyond the immediate context.
Language is not simply structured serially, that is, it does not function through a successionofwords. IfitdidStein'spassagewouldclearlymakesense. Languageis structured through a series of nested domains. In a highly repetitive sentence, "Rose is a Rose. . these nested domains (syntactical categories) collapse into a tautological chain. In Stein's non-sense passage semantic meaning marks a stable moment (or frame) which disintegratesintoindeterminacy,butstillwithinastablesyntax. Theeffectistomodela mind capable o f formulating short-term predictions, but incapable o f organizing the facts (the words) in order to satisfy these predictions.
Stein wants to think like a chimp. D. Premack, in his attempt to evaluate the degree to which the chimpanzee has a theory of mind, formulates a distinction between simple and complex states. Simple states are "hard-wired, automatic and reflex- like, and encapsulated" (172). He defines these states as "seeing, wanting, and expecting". The pathways determining each o f these (with varying degrees o f complexity) are tied to direct
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
581
? sensory input, such that their is little mediating control by the organism over these states. Complex states, however, are highly mediated states in which some level o f decision- making is required in order to determine the state. The prototypical example is belief. Belief arises as a mediating and, some would say, conscious response to particular forms ofdoubt. Premack distinguishes two forms ofdoubt (and consequently ofbelief): doubt in the veracity o f sensory information (epistemological doubt) and doubt in the information communicated by a member o f one's group (fear o f deception).
Epistemological doubt is countered by conscious attempts to construct an external means of determining the truth of sensory input: observation, experiment, analysis, reason, art, religion. Premack characterizes epistemological doubt with three questions: "Do I really see X? " "Do I really want X? " "Are my expectations well founded? " If we ignore the problem of their linguistic form, these questions describe a critical process of categorization. Epistemological doubt of this sort is predicated (and expresses or functions through) a distinction between truth and falsity. In other words these questions, defined by their use of "really" and "well-founded" require doubt to be in place in order to be asked. They appear initially to be questions o f domain. These questions are what I would call questions of syntax concerned about what belongs where as what. In other words syntax defines a set o f domains that taken together define the form and legitimacy of a particular string to function within language, that is to be intelligible. Syntax, however and to what degrees of specificity it is defined, constructs the possibility of determining legitimacy or, in relation to our epistemological doubt, truth. Syntax implies an established semantics, just as questioning the truth of X requires the possibility of falsity.
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
582
? falsity. Syntaxdeterminesthedomainoflegitimacyasameansofstructuringthe possibility of doubt (or failure). Because a particular word might not be legitimate, syntax divorces the criterion for truth from the content of the word. The specific form of an entity is understood as variable and possibly false. This does not mean that a grammarians strictdefinitionofsyntaxdeterminesthesenseofasentence. Syntaxisitselfmuchmore fluidthancommonlysupposed. Strictsyntacticalrulessimplydescribethecenterofa syntactical domain. One can still make sense of words used within an incorrect syntax as long as they still reside within the domain defining their relationship with other words (and
thus its legitimacy as a member of a meaningful string). Once a word, however, can no longer be related to other words in a meaningful way, that word has left the syntactical domain that determined its legitimacy (and thus its meaningfulness). Thus one can see why a cognitive scientist like Schank argues for semantics over syntax. He should be arguing,however, foramorebroaddefinitionofsyntax,asyntaxthatdetermines relationships through the activation of semantic content within a particular domain (a possiblesetofrelations). Schank'sscriptorframeisasyntacticalstructure,onethat determines the legitimacy or meaningfulness of words by the establishment of a set of possible meanings, albeit possible meanings determined by previous knowledge. Belief as a form o f long-range prediction depends on a syntactical elaboration o f the present in order to create the possibility of a future.
The possibility of Premark's second form of doubt is dependent on the what R. Seyfarth and D Cheney call, in their study of meaning and language in Vervet monkeys, the attribution of mental states "such as knowledge, beliefs, and desires to others" (126).
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
583
? In their study they conclude that Vervet monkeys in spite of the character of three specific calls and the different responses these calls cause in those who hear them in warning of a snake as opposed to a martial eagle or a leopard do not have a language because they cannot determine the difference between a knowledgeable audience and an ignorant audience (127). They apparently cannot evaluate the knowledge o f those around them, because their communication is not attempting to change the mental state of their audience. Itissimplyasignalactivatingalearnedresponse. Theattributionofamental state to another seems to require the ability to choose. Making a choice (a kind of
thinking) involves constructing a world, a frame, or a domain of relations organized according to a particular grammar (a set of rules and values).
Chimps make choices. Do they then make conceptual worlds? In an experiment a female chimp was trained to add and count. Part ofthe training procedure required the chimp to play a game where two piles of candies were counted out. Whichever pile the chimp first point to was given to another chimp sitting in front of her in a cage. The object of the game was to get the most candies. Whenever the candies were counted out the chimp invariably pointed at the larger pile, thus losing. When numbers written on cards were substituted for the candies, however, the chimp was always able to point to the smaller number, thus insuring that she would be rewarded with the larger number of treats.
One could speculate. When the chimp saw the food an instinctual grab/eat rule (or agent)determinedherchoice. Sheplayedthecandygameusingherinstinctualrules. She needed instead to nest the candy game within the her instinctual game, by replacing the instinctual mechanism for achieving her desire for the most food with the mechanism
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
584
? defined by the game. By encoding the "amounts" o f candy within a numerical domain the relationship between the two piles can be determined without invoicing the grab/eat rule. Thisinformationisnolongerstoredasanimagewithinthegrab/eatrule. Thenumerical domain indicates the value of each number in relation to the other, not in relation to the chimp or her desire to eat. The failure of any abstract system to define this kind of personal relation requires that its values be accessed and assessed from another domain and according to another grammar. In this case, the chimp can then apply the rules o f the candy game to these "amounts" in order to determine the winning choice.
Any abstract system sets up a play between at least two different systems or domains. This recursive interaction creates a kind o f consciousness, because it creates the illusion o f free choice. This choice is not in any sense free, it is simply the mediation o f one domain by another. The chimp evaluates how to get food [an algorithm defined by CHOOSE THE MOST DESIRABLE and THE MOST DESIRABLE IS THE MOST FOOD] through the algorithm of the candy game [CHOOSE THE LEAST FIRST], The transcription of candies into number allows both of these algorithms to function together.
The three systems of relations in the previous experiment are all defined as systems o f value. These systems o f value are really systems o f meaning because they are sets o f relations. Semantic meaning within any discourse is primarily the articulation of a particularsetofrelations. Weassumethissetofrelationsisnotarbitrary. Thismeans they are constructed according to a particular logic. This logic is a logic of difference.
The statement "x means y" requires at some level, although not necessarily at the conceptual level Saussure suggests, that the notions "x" and "y" be understood as "not z",
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
585
? "not w". Even to say this, however, requires that the notion "x" be crystallized in such a way that such a comparison is possible. How do we know that 'x' is not the same as ly'? We know this because they sound different, or because their shapes are different. Shape and sound serve as common denominators. Thus to speak o f difference requires that "x" function within a realm of common terms or qualities, which means a realm of pre- established possible relations and configurations. Thus what I first called a logic of difference is a difference mediated by a commonality. This common context is not given, but is constructed. (On a fundamental level, however, the initial contexts would be created primarily out o f the biological structures used to interpret our interactions with our environment).
Value is determined through differences expressed within a common context. A common context means in relation to a binary descriptive system: between two similar phonemes, between more and less, and so on. Values generated out ofthese metaphoric matrices are re-coded into more complex systems o f relations. We can easily see how this works in the chimp experiment. How can the chimp nest the rules o f the candy game within its instinctual grab/eat game? Encoding the amount o f candy in numbers created a domain of pure value organized around more and less. This information was embedded in the world o f the candy game where the output o f the algorithm CHOOSE THE LESS selects the lesser value. This value is eliminated and the larger value is transferred into the
domainofthechimpsgrab/eatrule. Ineachcasevalueisdeterminedbyhowtheeventis encoded within a system ofvalues. The situation facing the chimp is successively translated into different conceptual worlds, where the meaning o f that information is
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
586
? determined by the values (in this case simple algorithms) organizing the relations within that world.
Thus, thinking is a process ofworld-making. A Dutch psychologist, de Groot, discovered that chess masters through a process o f implicit pruning do not see bad moves. They act within or through a grammar or a domain defined exclusively by good moves. They construct a conceptual world of good moves. This world defines what they see: it defines the moves the chess master recognizes as possible.
How does someone determine which of the possible moves or relations is correct, best, or relevant? This is too large a question to answer here. I can suggest, however, how we determine the relevant from the irrelevant within a frame or grammar in a general way. In an obvious way relevance is a function of understanding how something functions within a frame or domain. Frames must be extremely flexible to be able to handle the high degree of uncertainty and complexity of our experience. If we re-define determining relevance as making a choice we can make some progress. Choice arises through a kind of recursive nesting of domains and grammars. The interaction of these domains and grammars selects relationships from each that are integrated within a new domain and grammar, thus constructing an alternate world. This world defines what is possible. One assumes that at some level or in some world one is left with only a single possibility. This choice (really an algorithm) is transported to higher levels o f organization where it appears like we have made a conscious choice.
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
587
? 14. 4 A wink in time means two
Before we can build a belief in the future, we must build awareness. We can build a basic time detector by using difference detectors, or what Minsky calls time-blinking:
Any agent that is sensitive to changes in time can also be used to detect differences. For whenever we expose such an agent, first to a situation A and then to a situation B, any output from that agent will signify some difference between A and B. (240)
While time-blinking partially removes the problem of comparing two inputs from different agents without requiring synchronous and identical frames (a trick it does largely by having a temporary memory), it does not explain how difference is translated into an ordered succession o f moments. One could, however, easily input the recognition o f a perceptual difference to a kind o f tape, as if marking a date or a second, which is then advanced. Suchaprocedurewouldrecordsuccessivedifferences,whichcouldfunction like a clock for human beings.
It could never generate something like temporal experience for a machine. By what process is temporal order perceived and organized such that consciousness understands itself as the present? Do all the inputs that make up consciousness run through a single agent (an agent dangerously close to a homunculus) in rapidsuccessioninorderthatwecanperceivedifferenceandcallthatdifferencetime? If not, how is the information that our brain receives, processes and constructs, all at different rates, constructed into a now? The formation of defined moments is a process of constructing meaningful information. A moment, therefore, defines those "differences that makeadifference. " Timeisaninformationstructurewithinwhichwefindourselves.
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
588
? Thus our machine must generate representations o f its world in succession in which it finds itself. It has to turn itselfinside out.
14. 5 "Be! Verb umprincipiant through the trancitive spaces! "
My machine lives in a world o f simple objects. As a time machine it does not recognize objects as objects, but objecthood, as that which can be noticed as something, which it perceives in what it considers a partial instant o f time. It does not recognize the world or the environment, but only something that triggers its optical apparatus as a somethingtobenoticed. Itsopticalapparatushasalreadysimplifieditsphenomenalfield into this categorical perception, which we can call the set o f objects. This information is sent to the Optical (O) input agent which registers this information within a formally defined phenomenal field. The machine can rcognize separate example of objecthood within a range from 1 to 5. This phenomenal field is defined by a set o f switches (5) that representanobjectbybeingonandrepresentnoobjectbybeingoff. Thusthemachine optical apparatus can immediately register up to 5 objects. An initial input, N l, once it has set these switches (once the optical information is represented as an internal state), is transferred to an Optical analyzer agent where it again sets a similar set of switches. If the next input (N2) to the Optical input agent resets the switches, it is registered as a different moment and is thus sent on to O difference detector. The difference detector records that adifferencehasoccured. IfitsinformationisidenticaltoNl,nochangeofstatetakes place. Because our machine has only one sensory input at this point, the failure to register
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
589
? difference is understood as non time; the first moment "continues" because the first state continues.
Once Nl has reset the difference detector, indicating a different moment registered as a change o f state, it enters a feedback loop. The detector's switches are then immediately reset by N2 (if there is an N2). N2 is similarly sent on a feedback loop but at twice the rate. Immediately after N2 resets the difference detector, N l resets it again.
This difference is converted into a value indicating the difference between these two states (degree o f change). The second cycle resets the detector to N2, before the next signal from O input is received.
Although it is not necessary to separate the process of detecting change from that of determining the degree of change, their functional difference allows us to split the presentintotwophenomenalelementsorinteractingmodels: anexperientialmodelandan evaluatory process. The difference detector, as the second element, serves as a kind of short-term memory within the phenomenal experience. It has, however, changed the nature o f the information perceived by the machine. Both kinds o f information determine the nature o f the present. It is the detector's separation from the initial model o f change
that allows the machine (to the degree that it is defined by its internal processes) to be aware of change. This means that the difference detector makes change, as defined by the 0 input agent, meaningful. The moment is actually not defined by any single state but by two states defined in relation to each other, embedded within the degree o f difference determined by the difference detector (so that Nl and N2 will be stored together as PI and P2). The difference detector, however, is inadequate for any short term memory. We
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
590
? need a memory that encodes the consciousness o f the machine, and that requires that the information from both agents be stored. Both Nl and N2 are sent into a single short term memory unit (they are connected by a simple K-line). This unit is organized within short term memory (STM) according to two parameters: the ordered received (representing temporal succession) and degree of difference. . Short term memory (STM) stores both our experience o f change (suitably simplified) and a particular fact about these experiences. Thesearenotidenticalbitsofinformation. Theanalyzerdeterminesthe relevant facts for the time machine. Given the formally defined character of the phenomenal field, this information can be used to actually structure STM. (There are 10
possible values 1 through 5 and -1 through -5 defined in relation to the second state (N2): there is no O, o f course)
Optical Difference Machir (N2 Input State)
Difference Valu
(fact)
N1 = P1
Optical Inupt Agent (Change detector)
Optical Difference Detector
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
Experiential Order
Short Term Memory
591
? This is, ofcourse, not a model ofhuman perception. We have eliminated some ofthe criticalproblemsinconstructingamodelofoursenseoftime. Theworldandthe informationfromthatworldisimmeasurablysimplified. Inmymachine,theformal continuity between moments is built into the form in which the sensory input is represented (a defined set o f switches). With only one kind o f sensory information (number of objects), we do not have the problem of synchronizing and integrating the information from different senses (and their processing agents within the brain). The initial formation o f the moment is defined by the limit inherent within the speed by which the optical apparatus can convert its sensory input into a set o f objects. Changes that take placeata ratefasterthanthemachine'sphysicalabilitytorecognizeasetofobjectsare simply not registered.
14. 6 The logic of short-term prediction
If my machine can recognize patterns, such that the number of objects defined in one moment is always followed by a defined number in another moment, it can make short-term predictions. Once a pattern has been established, it can be recalled and run through a memory recall agent (another difference detector) at a rate faster than the information processed by the Optical agent. I will not spend much time constructing the mechanics of such a process. What is important in this problem is less the way in which this information is stored, than in the syntactical logic it necessarily generates. The logic here is simple: if x (a certain number of objects) is registered it will be followd by y
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
592
? (another number ofobjects). Such predictions can, ofcourse, only happen ifthere is a pattern to be recognized.
Initially Short Term Memory (STM) is evaluated to determine a match with the initial optical input (Nl). If a match is found (through difference detectors attached to each memory slot), then the entire temporal unit, containing two states (PI, P2; remember PI) is transferred to the Memory Recall Agent. Nl and PI are processed as identical. The P2 state will not have an initial correlate state (it is run before N2). Because a prediction is based on understanding P2 as if it were N2, P2 must be understood as an N,
butnotastherealN2. Consequently,anysuchpredictionsrequireasymboliceconomy allowing for the conversion of Px into *Nx (where * indicates this input has an ontological claim equal in value but different in kind). The creation of an Nx state represents the creation of a temporal syntax. In order for the correlation of P2 with Nx to function as an expectation of N2, the machine must be able to act (or change its state as with Pavlov's dogs) on the basis of this correlation.
In Pavlov's bell experiment a similar temporal logic is manipulated. The equation o f food = salivate is re-wired to bell = salivate and is therefore based on an associated equivalence between food and bell. This equivalence, however, does not take place within a synchronic plane. It works because the sound of the bell recalls an established pattern recorded in memory. The P2 state of food following the PI state of the bell is understood asthesameasanNstate. Asymbolicinterchangetakesplacebetweenthepresentandthe future (patterned on a previously established relationship). A structural relationship has
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
593
? been established between these two diachronic states, which allows the content o f one state (the bell) to stand for the content of the other (food).
Predictions based on short term memory are stimulus dependent. They disappear as soon as the environmental stimulus that suggested them disappears. They define only a temporaryandunstablefuture. Amachinewithonlythiskindofmemorycouldnot engage in any long term planning. Such plans require an ability to invoke the possibility of the future on command, as well as much more complex reasoning and creative modeling.
14. 7 The continuous future: hearing of and speaidng in the new world order
The Time Machine's world is now a rectangular plane, on which, at some unspecified but unreachable distance, a number o f objects flash in and out o f existence. This plane is divided into a series of parallel districts (wide strips). The number of objects ineachdistrictchangeindependentlyofthenumberofobjectsinotherdistricts. No machine, o f which now their are many, can see the objects (the number o f objects) in a district other than the one it is in. The machines can move to other districts. To prevent any machine from becoming a part ofthe object field ofanother machine, all machines will move along the same line and can move around each other if one machine is in the way of another. (The eyes move to the side o f the machines head. The machines bump into other machines and then move around them; I will not include this perception and response withinmymodelinghereforavarietyofreasons. Thinkofthisbumpingandmovmentas a function o f the machine autonomic nervous system)(see Figure A).
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
594
? Figure A
Object Field
OO
Object Field
Object Field
Districts
For our machine to survive in this world it will need, in addition to the optical system (0 input; O diffemce detector; memory, etc. ), a vocal generator (V) an auditory sytem (A) and more complex memory and recognition processing. A picture o f these systems, while confusing in its details, at least gives a sense ofthe increase in complexity that we need to make this simple world meaningful in even the smallest degree (Figure B):
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
achin
595
? 14. 8 Another blueprint of time Figure B
input Self
Pattern Recognizer
A STM
(no match)
A/O lvalue tQL
Difference DetectorN
STM (match)
Input
O Diffe rence Detec or
0 STI
lemo jecalL
A/O LTM
14. 9 Mental imperialism: to make the world the mind
The goal o f the machines in this world is to find and cohabitant with another machine within its district through the recognition of its vocalization of its perception of thenumberofobjectswithinthedistrictitfindsitself. Thismeansamachineistryingto recognize that another machine 'exists' within the first machine's 'time-world. ' A machine will recognize another machine as an external expression o f its own temporal perception o f its time-world. Its time-world becomes its awn time-world by being
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
0 LTM (Patterns)
596
? externalized (recognized) as an external limit (the other machine) o f its own internal perceptions (in other,words it orients itself toward the world as if that world is both its world (defined by succession) and not its world (marked by its recognition o f another machine as another machine within its world).
A machine will now have a vocalizing agent (V) through which it will express the degree of change between two moments. This machine talks time. This vocalizing agent will receive this information from the O Difference Detector ater every five machine moments.
In order to hear these vocalizations, each machine will also have an auditory agent (A). Topreventconfusingthemachine'sownvoicewithanother's,thevocalizingagent will signal the auditory agent that it is speaking. Confirmation that a voice is the machines own can be confirmed using two methods. Because the distance between the vocalizing agent and the auditory agent is always the same, the rate at which the A agent receives an input after it receives the signal from V will always be the same. In addition the signal from V will also initialize the auditory agent at the specific value to be vocalized and thus the auditory agent can function as a difference machine where the difference between input and initial state should be 0. This information is shunted into its own special memory.
14. 10 Time and the other
The auditory agent will have a different causal history, or in terms of my temporal
machines, a different time-scale than the Optical agent. Organic brains receive information from their sensory inputs at different rates depending on the distance from the brain to the
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
597
? sensory receptor, the distance between processing agents in the brain, and the different rates at which these receptors and agents work. The more complex the sensory model of the world, the more complex the temporal model generated from each sense. Such complexityrequiresmediation. Inmymachine,sensoryconflictarisesfromthedifferent rates and content of the information processed by the O and A Agents. The mediation between these agents is accomplished by constructing a common structure in which the differences in their content can be expressed independently o f each other.
The auditory agent in the machine will construct a short-term memory using a difference evaluator, similar to the O Difference Detector. Because the information received by A is already mediated by the optical agent, it cannot be used to directly model the number of objects in the external world. This auditory information describes the internal state of other machines. The Auditory Agent, therefore, will evaluate differences between its auditory inputs (between machines) only in order to develop a time scale for its auditory perception. (In a more advanced machine it would be possible to begin to determine which inputs originate from the same machine). The machine has two sensory inputs. Twoidenticalauditoryinputswillnotbemistakenforasinglemomentunlesssuch an identity occurs "simultaneously" at O and A. These two different forms o f sensory input require the machine to construct its own internal representation o f time in order to mediate the differences, conflicts, and confusions between the auditory and optical time- scales. Because the auditory input communicates the degree of change perceived by what we know is another machine, this information must be evaluated in relation to the degree
o f optical change perceived by the listening machine. Unlike the O Agent, the A Agent is
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
? supported by another more fundamental agent that batches together two auditory states into a single auditory moment. The A Agent we are constructing interprets these momentsasmeaningfulpackagesofsound. Whymeaningful? Meaningisusedhereonly to indicate that these inputs do not refer to the same thing as a machine's initial optical input, but must be related to the information generated from its own Optical Difference Detector.
The difference values generated from its Auditory agent can have little sense to our machine. If we first imagine the machine's auditory sense without reference to its alreadyestablishedopticalsense,webegintounderstandtheconfusion. Itcanhear information communicated from beyond its own district. It has no idea how many machines it can hear nor can it tell the difference between one machine or another (all machine voices are identical and it senses are not refined enough to distinguish between thedistanceofvoiceexceptwhentheyareagoodnumberofdistrictsaway). This auditory information can only be used to define a series o f random differences marking the changes that they themselves cause in the auditory perception apparatus of our machine: an auditory time-scale or map.
If, however, these auditory inputs can be compared with the vocalizations of our machine, or even better with the values generated from the Optical Difference Detector, this auditory information no longer simply serves to define a time-scale in which it is the difference between inputs, and not their content, which carries information. . The machine will test all o f its O short term memory slots (with priority given to the most recent). Once it finds a match (again through a difference test), it will wait for 5 moments in order
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
599
? to retest the match, which will have to match not only in value but also in the O memory slot it is found. This means that a test will take at least as long as 5 moments, slow but necessary if a district is as wide as the distance it takes sound to travel for 5 machine moments(itmightbefilledwithsomedensegasorevenwater). Thisretestingwillalso reduce the problem o f false matches (where a degree o f change value o f +2 could be obtained by a 5 moment followed by a 3 moment and a 3 moment followed by a 1 moment). It is, o f course, not even necessary that a real match, from our perspective, take place. Itisenoughthatitseemslikeamatchtothemachines(althoughanyfalsematch willdissolvefairlyquickly. Itisunlikelygiventhenumberofpossiblecombinationsinour 5 object system that the difference ratio between moments would remain the same in two
different districts for more than 3 moments). The machine edits out A inputs different from its own internal state as "noise" once a match has been discovered.
14. 11 Looking for Mr. Goodmachine
If a machine fails to find an auditory match with its own O Difference Detector
after 3 vocalizations ( in order to give machines which have not yet vocalized but are within the same district time to communicate with this other machine before it moves), it moves the distance possible in 3 moments, and then trumpets its degree o f change value. (The machine has eyes on the sides o f its head so that it can see, and thus function within theprimaltime-scalethatdeterminesitsmomentsanditsrateofvocalization). Ifit processes a match in transit, the machine will stop and retest the match. If it finds a match then it doesn't move. Both machines are in the same district and, therefore, happiness!
Reproduced with permission of the copyright owner. Further reproduction prohibited without permission.
600
? Once a positive match has been made three things will happen. First, a pattern detector will correlate a signal from the Optical Difference Detector sent every Optical moment with its matched auditory input. It will discover that the match happens every 5 moments. Second, the correlated auditory and optical information is stored in Auditory/Optical Long-Term Memory (A/O LTM). Third, a signal is sent from the
A/O mediating agent to V in order to re-initialize the timing for vocalizations to match the vocalizationsofthemachinethatiswithinthedistrict. (Iamignoringthecaseofmore than one machine in the district, although the districts are large enough to accommodate more than one machine). At the Vocalizing Agent a difference detector is installed in order to detect the change from the previous vocalizing timing. This information is then sent to A/O LTM. The A/O LTM, therefore, is organized as a series of bifurcated units representing an Auditory value and an equal Optical value within the domain marked by the change in vocalization timing.
14. 12 Meta-temporal identities: the modeling of others as syntax
The A/O Evaluator has constructed a meta-temporal identity within LTM, an
identity (not yet an entity) that organizes temporal information (two levels of abstraction above the initial perception of change), instead of representing particular temporal states. The A/O Evaluator has integrated the O agent and A agent, and in so doing has created a more abstract and mediated information structure.
