Wednesday, March 28, 2012

Wrapping up things related to working memeory


The new definition of working memory
In his seminar work on the capacity differences of individual working memory, Carpenter (Just & Carpenter, 1992) redefines its concept by borrowing a computational theory. They posit that both information restoring and processing are supported by the very same property named “Activation”.

When we are taking in new information from computations, each element is associated with an activation level. The element can be a word, sentence or a physical object such as a cat.

During the comprehension, only the element whose activation level exceeds the threshold value can enter working memory; in other words, not all the candidates are able to be further processed by brain even it is well retrieved from long-term memory.

However, people differ from each other with respect to their work memory capacity. In this case, which is seen as the total amount of activation level that the system can sustain.

Therefore, if at one time, the sum is about to go beyond the system limitation, certain chunk of old information must be de-allocated in order to accommodate more incoming data and computations.

Serving as one of fundamental concepts in cognitive science, we often find it in other literature.

Complementary learning systems
The hippocampal (HC) systems will be active in receiving information and temporally restoring the information, which means that the novel material cannot be truly learned immediately.

The neocortical systems will incorporate the new information gradually, as any quick absorption could be detrimental to existing structures of knowledge. 

The novel input need to go through various consolidation stages to obtain a membership from neocortical systems. Appropriate external events can serve as good opportunities and will help adjust neocortical connections.

Usually, the incorporation of unfamiliar material is slow, especially for arbitrary and idiosyncratic materials. Thus, when the memory traces degrade with time passing by, it is possible to lose them before they can be built into the shared structures in neocortical systems.

The complementary learning systems are more related to information storage and maintenance than information processing.

However, the weight changes of neurological connections may also be bound with “activation”. Without appropriate activations, the connections are not re-constructed or even established.

Although McCelland (McCelland & McNaughton, 1995) does not explicitly mention how the incorporation rate is to do with working memory capacity, the concept of “learning rate” may be a potential factor affected by the level of activation.

Metaphor
Metaphor in linguistic practices is fairly common, if a person wants to express certain idea from utterances, the hearer often can detect the meaning rather than the literal meaning of sentences.

If “S is P” actually refers to “S is R”, the comparison theory attempts to address the question of “how can we compute the potential value of R”; on the other hand, the interaction theory tries to look into the range restriction for R’s value by referencing the relationship between S and P.

To make this communication possible, the speaker and hearer must have something in common such as the principles to translate utterances.

Searles provides eight principles and suggests the methods by which the utterance of P term calls to mind the meaning of R term in the way pertaining to metaphor. For example, one principle is about human beings’ sensibility, and it is applicable for people from multiple cultures, as it is naturally determined.

From the perspective of working memory capacity, the duty to locate possible links between S and P or narrow the scope of R values heavily rely on activation for each property.

I maintain that the task to interpret metaphor is less like to challenge us in that there are normally three base elements to begin with, unless the range of R is quite large, or the “overlapping” attributes of S and P are too many.

In fact, an interesting question here is that: which principles consume more resources in working memory. The seemly more complex principle is not necessarily the one that requests a larger “brain”; it also depends on other constructs such as hearer’s knowledge base related to a specific domain.

Categorical Perception
The interplays between perceptual information and high-level knowledge of a particular object are another universal cognitive process. There are basically four rules that people use to group object.

While prototypes allow us to bring in more attributes to formulate semi-stereotypical representations, the exemplar models are stored stably in the memory, and they appear in a highly-abstracted form.

The process of establishing prototypes and exemplar sees the differences in the light of McCelland’s theory on complementary learning systems. Specifically, to build a new prototype may take a longer time than modeling an exemplar, as the former has to undergo a systematic procedure to live within existing structures that is shaped based on other surviving prototypes.

From the standpoint of working memory, it should work well to predict the efficiency of categorizing a perceived object.

Nevertheless, it may not directly determine how soon the new token will reach neocortical systems.
In the context of metaphor, in addition to referencing currently stored categories for the purpose of producing the metaphorical meanings of the utterance, we can also use the outcomes to re-categorize an object.

Cognitive Breakdowns
The cognitive breakdowns appear in multiple forms; for example, the loss of balance, the difficulty to focus, or the lack of reasoning capabilities.

Working memory is one major component being affected, for instance, some patients need to consistently re-chunk information in order to continue searching for the answer to a simple inquiry.

If the brain sees too much cognitive load, certain part of it will cease functioning. From that perspective, a wise usage of limited working memory resources is recommended for pertaining subjects.

The Representation of Personality in the Affective Reasoner
The situation is presented in frames, and frame matching asks for sufficient resources from working memory.

The computations on situation frames are supposed to generate emotion. Working memory is crucial for instantiating this intensive process on left hemisphere (LHS).

The emotion is only available if over intensity threshold, which is determined by bindings on LHS. Working memory is attributable to the binding process.

Some Implications for Design
First, designers should realize that users have different ability to store and process information; thus they should not be self-centered as the solution provider.

Second, designers must avoid using a solution that is too novel; although it may surprise users for its creativity, it may damage existing usage patterns that the users hold for other tasks at that moment.

Third, providing a "buffer-zone" for chunking/rechunking is recommended, as well as “Recognize Rather Than Recall”. Methods such as those will reduce users’ cognitive load, thus decrement the chances of over-charging working memory.

Forth, metaphor is equally important in that it is relatively easier for users to figure out the underlying meaning of design elements such as button or a gesture.

Furthermore, the calling for “universal design” does not only apply to people with physical disabilities, but also patients with brain damages at various levels.

Last but not least, if by its definition, the title of “User Experience” caters to user’s emotion responses, designers are expected to understand a little bit about the principles of emotion generation.
 
(© 2012 Miaoqi Zhu)

Tuesday, March 6, 2012

What if?

I just had this "crazy" thought:

What if each neuron represents each planet, what if each neurological connection represents each galaxy. We may just live in our brains...

One of my friends responded with his understanding. He said "we may live in other beings' brain." However, if I see "you", you are likely to be perceived by me, in that sense, it is not implausible to say that you are just "living" in the world of my brain. 

The question may need to be answered by philosophers, and it is difficult to prove or disprove anything by science, although it could be possible someday. 

(© 2012 Miaoqi Zhu)

Saturday, March 3, 2012

Complementary Learning Systems, Dreams


The motivation for this post stems from my recent reading on McClelland's complementary learning systems on “Hippocampus (HC) and Neocortex”. This paper is also kind of survey papers from certain perspective. In particular, the authors smartly put relevant theories together to reach the goal of demonstrating his own idea, which is: "the HC provides training trials, allowing the cortical system to select representations for itself through interleaved learning." The paper, of course, starts with two key question s of interest:
  1. Why is the HC system needed? If we have neocortex system that owns more neurons, why do we want HC to do?
  2. Why do the changes in neocortical connections take so long? In other words, can the new materials fully absorbed rapidly?
It looks like HC system is responsible for storing recent memory, and neocortex is used to reserve remote memory. To avoid interference with the knowledge stored in neocortex, HC is here to help accommodate the initial storage from a new learning event; in the meanwhile, to not bother existing system of knowledge structure, the changes should be made slowly within neocortex. There are certainly “communications” between HC and neocortex, otherwise, no information will be transferred, and no changes will be made.

Marr (1971) propose that the HC systems stores experience in the day time, and replayed the memories in the HC back to neocortex in the night. Does it imply that brain activities in the night are caused by consolidation (or the opposite)? For example, dream.

A researcher in this domain indicates that dreams can be emotional as we replay old memories and update them with novel information from recent events. Associating with personal experience, I agree with it, but I become more interested in the verb “update” in terms of its functionality. Specifically, why the brain needs to update in what sub-systems of our brains?

So a ROUGH idea here is that: if the dream happens partially owing to the connection changes (learning) in neocortex system from HC’s input, let us contemplate on some questions below:
  1. Is it due to too many computations requested from day-time tasks, so we better carry this out in the night time?
  2. Why should it appear in the form of visual imagery? Does it facilitate the learning process?
  3. Why cannot we dream every single night? If it stops dreaming, does it mean dreams are not caused by learning in HC and neocortex systems? Perhaps dream causes learning, not the opposite.
  4. The memory trace in HC will decay, if we have an exceptional set of material, will it take more priority to be incorporated into existing knowledge structure using this precious period of dreaming?
  5. What is the implication for HCI? Designing novel interfaces “encouraging” people to dream, thus users can learn it faster? This question may be addressed after knowing why exactly people dream.

Reference:

Web article: http://www.livestrong.com/article/78256-parts-brain-produce-dreams/

Marr, D. (1971). Simple memory: A theory for archicortex. The Philosophical Transactions of the Royal Society of London, 262(Series B), 23–81.

McClelland, J. L., McNaughton, B. L., & O'Reilly, R. C. (January 01, 1995). Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. Psychological Review, 102, 3, 419-57.

(© 2012 Miaoqi Zhu)