Tuesday, July 26, 2011

On the Rise of Subjective Experience, Part 2: Brain Loops and Strange Loops

Although we now have a collection of facts about the physical organization of the brain, understanding how these unitary physical processes can lead to a cohesive information processing structure is still a task so difficult that no one has satisfactorily done it. I find that, given our still relatively crude tracing of information through the majority of the cortex (The best such example being here), it is more instructive to shift gears for a moment, and talk about Douglas Hofstadter's concept of the strange (causal) loop.

Strange loops are defined as a feedback loop in which the input and output cross hierarchical levels. Now, typically this is a bit more ill defined, but here we will attach specific meaning to this concept - namely, that complexity increases when increasing in hierarchical level, and decreases when decreasing in hierarchical level. In practice, complexity here is the definition proposed by Kolmogorov, and widely accepted in computer science: the complexity of a string of information is equivalent to the length of the shortest program that could produce it. A corollary that quickly follows is that complexity of a string of information is roughly equivalent to the resources (time, energy) needed to produce that information.

In the brain, very complex higher-level constructs have evolved from patterns in incoming perceptual data, and these constructs can rightly be called concepts, ideas, emotions, etc. In fact, this level of pattern is complex enough to be essentially infinite, in terms of the combination of lower level concepts. If I ask you to imagine a "Pink Unicorn", you can easily conceive of it, despite the fact that it has no basis in reality. You simply construct it from the lower level concepts of "horse", "horn", and "pink".

At a much lower level, there are innumerably more simple firings - neuron to neuron transmissions coding not much more than their excitatory or inhibitory value. The key is that when looking at the structure of this activity, it is equally valid to talk about the emotions affecting the state of the brain, down to individual neurons (although it's a task beyond modern science to bridge these levels), as it is to talk about the interactions of all the low level, mechanistic neural activity creating these concepts. For a better metaphorical explanation, Hofstadter himself explains in this video (you'll need to click the second one for the full explanation, should it hold your interest):


Victim of the Brain - Youtube


The point to internalize here is the concept of recursive looping that was first intimated in talking about the physical functionality of the brain itself. This informational looping dips causally down to the simple levels of incoming perceptual data and outputs to organs and muscle, and all the way up to the abstract and infinitely combinatorial semantic constructs humans are capable of conceiving. Decision making causality can be explained equally well from a top down (mental constructs affecting brain) or a bottom up (moleculaes affecting neurons, and so forth) approach. The important trade off is that absolute information (resolution) is lost as the perceptual hierarchy is climbed, with the benefit being explainability - just the concept of "cat" quickly conveys a large amount of information between people, but leaves out a great deal of specific information about any specific cat.



Why this interplay between perception and conception? Clearly, the answer lies in evolution. Consider the following - the world you experience each and every day is not, in fact real. It is a simulation of what the brain THINKS the "outside world" is, based on strings of perceptual data. This is a key difference to consider! The actual reality of the outside world could be  vastly different than how we perceive it, but what is important is that our "virtual reality" constructed by the brain was (and is) useful to genetic fitness. This obviously suggests a high correlation with reality, but does not ensure it. Illusions are clear evidence of this:


More on this specific illusion later when discussing the processing structure of intelligent systems.

So then, the brain creates an incredibly detailed, constantly updating simulation space, but this alone is not sufficient to have a conscious system. In my view, it is likely the creation in the mind of the self as an avatar to place in the simulation that leads to the sensations of qualia. Consider, for example, that humans are one of only a few animals to "plan ahead" in such a way that situations totally unfamiliar to us can be overcome by use of our inductive reasoning from previous similar situations - we know the laws of physics at some intuitive level, for example, and thus can set traps to catch food.

The ability to construct detailed and relevant simulations hinges partly on the ability of the mind to properly project the abilities of the self into future hypothetical situations. This self-avatar is constantly updated from within and outside the brain, as opposed to the simulation environment which is largely constructed in lower perceptual levels. Less processing is required from perceptual data to construct an environment than is needed to construct the self-symbol, or indeed even integrate new data into the self-conception. This suggests the creation of consciousness is a high level, attentional, and resource-heavy process.

This "simulated world" is a view shared by Antti Revonsuo, and is really at some level functionally identical to all theories of qualia that involve the system "watching" itself in such a way that the processes of a self-updating central self symbol.

At this point, it is likely that there is a certain level of skepticism regarding this hierarchical level-crossing looping organization of informational transactions in the brain actually being able to produce subjective experience. And, frankly, that's a valid criticism. Without invoking more than classical information theory, it is safe to conclude that only physicalist explanations of qualia make sense. As the artificial intelligence researcher Marvin Minsky has said regarding qualia:

" Now, a philosophical dualist might then complain: "You've described how hurting affects your mind — but you still can't express how hurting feels." This, I maintain, is a huge mistake — that attempt to reify 'feeling' as an independent entity, with an essence that's indescribable. As I see it, feelings are not strange alien things. It is precisely those cognitive changes themselves that constitute what 'hurting' is — and this also includes all those clumsy attempts to represent and summarize those changes. The big mistake comes from looking for some single, simple, 'essence' of hurting, rather than recognizing that this is the word we use for complex rearrangement of our disposition of resources."

However, this doesn't mean that exploring the weirder side of theories of consciousness is without merit. Quantum mechanics, when invoked improperly, (as I will, no doubt, in the coming months) are fecund ground for all manner of untestable pseudoscience, without ever offering much in the way of tangible explanations. Quantum computing, however, is a potential consideration and has been proposed by some respected researchers, most notably Penrose and Hameroff, but also Hartmut Neven.

 Still, even without braving those waters, there is much to discuss regarding the relationship of the human brain's information processing structure to a more generalized framework of information processing applicable to Artificial General Intelligence systems. In particular, I'm tremendously fond of Ben Goertzel's work, which I believe goes a long way to bridging the gap between the physical brain state and the the patterns of informational flow that constitute a classical understanding of consciousness.

3D branching fractal structure. The blog's title begins to come into focus.

Next time: Goertzel's The Structure of Intelligence and the relationship to gamma synchrony- further applications in neuroengineering?

Thursday, July 21, 2011

On the Rise of Subjective Experience, Part 1: Geometry of Human Thalamocortical Processing

Now that the outline of the salient problem in thinking about consciousness has been elucidated, we can attempt to dive deeper into the types of thought patterns that (likely) comprise qualia. Unfortunately, thinking about this in a clear manner requires considering several transforms of the function of consciousness at the same time.
The physical geometry of the brain has been well studied and gives important insights as to how information moves through it. Because, for now (your own) human brain is the only device we can be sure generates subjective consciousness (though almost all large brains almost assuredly generate a type of the pattern we'll discuss), it is what will be referenced when speaking of the physical geometry of thought. Conveniently, we know the rules the brain must play by, which makes some inferences possible. Henry Markram's work with the Blue Brain Project shows patterns that aesthetically (and, as we'll see much later, informationally) resemble the activity of real human cortical columns. In short, some points to note about the physiological brain's relation to cognition:
1. The brain is organized on several levels and in several dimensions. The cortical minicolumn (a collection of neurons organized "vertically" (inside to outside) in the brain, has been suggested as the smallest functional unit in the brain, outside of the well-understood behavior of individual neurons. Additionally, the cortex features vertical layering that appears to correlate with interconnection density (higher internal to each layer than between layers)

Depiction of cortical columns, with layering. Identification of specific neuron types is less important than the concepts of horizontal and vertical organization

2. The cortex is organized into specialized "regions" associated with higher level functions such as vision, speech processing, speech generation, motor actions for each body part, and so on.

3. The cortex and thalamus are intimately connected, and moreso in humans than in any other mammal. This leads to a pattern of information processing that repeatedly enters and exits the thalamus and cortex. These "thalamocortical loops" form the basis of a physical pattern than is inherently recursive and continuous.

Note the fanning thalamocortical connections at the top.
4. Long range horizontal connections between brain regions (spindle neurons, among others) allows for important high speed modifications of the overall pattern of the brain. Long range neural synchronization is a strong proxy for intelligence and creativity both between species and within individual humans.

5. Synapse action is delocalized, which leads to the important phenomenon of temporal synchronization. Because each synapse leaks neuron transmitters, and because an action potential is transmitted to all attached efferent neurons, adjacent neurons, even when not firing, tend to oscillate their voltage potential together. This is why "brain-waves" exist - neurons synchronize due to inherent oscillation, like cicadas chirping at night. Neurons that fire together most often (remember not all stimuli, only the sum of stimuli causes an "all-or-nothign" downstream action potential) have their synaptic connections strengthened, which is the primary theoretical basis of the self-modification of the brain.

Conclusions: The above is a lot to take in all at once, so in the interest of recapitulation...

The brain is organized as a series of neurons segregated into many smaller functional units. Units show both a hierarchical (serial, with respect to signal processing) architecture, as well as a parallel processing architecture. Neural activity proceeds through these columns, but has strong interconnectivity via the thalamocortical system. Along with the synchronization of activation times, this allows the structure of information flow to become looplike - cortex, thalamus, cortex, thalamus. This means the state of the brain has a continuous self similarity that has the potential to give rise to subjective consciousness.

Most Important References:
 
Next time: The hyperspatial structure of neural information processing, infinite extensibility of semantic meaning, and the relation of subjective consciousness to physical reality (if there is one at all).

Wednesday, July 20, 2011

The Hard Problem, and others that aren't.

Before delving in to far more interesting waters, I think it's in my best interest to lay out what I find the most convincing responses to topics near and dear to the heart of many a prospective reader.


God - A topic so hackneyed on the internet that 50% of my potential readership just closed the tab. In short, science has explained so much about the universe we live in in a totally satisfactory way (despite the objections of Bill O'Reilly), that there is not any rational basis for belief in any sort of actively intervening deity. Any level of scientific literacy begins to marginalize the relevance of dogmatic religion. Personal belief systems like those held (or not!) by Spinoza or Einstein have effectively zero impact on actual day-to-day life; they behaved as if they were atheist/agnostic.With a nod to Arthur C. Clarke, "Any sufficiently advanced spiritual beliefs are indistinguishable from atheism."

 Fucking thing sucks.

Free Will - Every philosophically-inclined person is no doubt familiar with determinism - the concept that if physical laws are fixed, given one set of initial conditions, the outcome is inevitable. Obviously, in such a world, how can you will anything freely? Those clever enough to know a thing or two about quantum mechanics may seek some probabilistic "wiggle room" in the random true nature of the electron. (Note: further discussion on the implications and shortcomings of the Bell inequality would be out of place here. All in due time.).

This beat out an angel with a steering wheel jammed in the back of a cartoon man's head for your token "dualism" picture


Oftentimes, "quantum mystics" pontificate mightily about an ephemeral soul affecting the wavefunction of electrons in the brain as if there is a homunculus sitting at the very top of the chain of causality leading to intentioned action. The electron guides the conformation of a neuron's GPCR, perhaps, in turn concatenating an electrochemical storm... culminating in the decision to check your e-mail for the 15th time today.

However, there is a problem. In the vein of asking "who created God?", "How does a soul make decisions?". A dualistic model of free will is, as Daniel Dennett says, "not worth wanting". You already have been blessed with a fantastic device, perhaps the most informationally complex 1.5kg lump of matter in the galaxy: the human brain. The brain is a machine built for decision making: it instantly integrates perceptual data, learned memories, emotional state, and logically reasoned needs. It then weighs them all, and produces decisions that are more or less always aimed at maximizing the genetic fitness of its owner. In short, you make all the decisions you'd want to make, anyway. You have the type of free will worth wanting.

 This guy doesn't have the type of free will worth wanting, and he still isn't upset about it.


The subjective feeling of volition, however, is almost certainly a post hoc rationalization - brain imaging studies confirm that decisions are made significantly before the subject can self-report reaching a decision. subjects undergoing transcranial magnetic stimulation that forces a physical movement report feeling as if they themselves willed a movement.


Doing away with dualism, however, leads us to a far deeper issue simply known as The Hard Problem. In short - why consciousness? Surely, a sufficiently advanced computer could replicate all of our functions, our speech, even some of our art and science. There is no evidence that any human has performed a feat outside Turing computability, ever. However, each of us (or, at least I) lives a rich internal life - we have sensations. This subjective experience (typically referred to as qualia) cannot even be proven outside of one's own existence - it's a fundamentally solipsistic state (excepting the common evolution bit, which is the only reason I can trust it isn't exclusively zombies reading this). I believe that understanding why we have subjective experience is the most important problem facing man today - it's a topic intimately tied to philosophy, the design of artificial general intelligence, and the search for a "theory of everything".

Additional reading:

http://en.wikipedia.org/wiki/Hard_problem_of_consciousness
http://en.wikipedia.org/wiki/Freedom_Evolves
http://thesciencenetwork.org/media/videos/34/Transcript.pdf   (Page 9.5 to 11.5)