A mental image or mental picture is the representation in a person's mind of the physical world outside of that person. It is an experience that, on most occasions, significantly resembles the experience of perceiving some object, event, or scene, but occurs when the relevant object, event, or scene is not actually present to the senses. There are sometimes episodes, particularly on falling asleep (hypnagogic imagery) and waking up (hypnopompic), when the mental imagery, being of a rapid, phantasmagoric and involuntary character, defies perception, presenting a kaleidoscopic field, in which no distinct object can be discerned.
The nature of these experiences, what makes them possible, and their function (if any) have long been subjects of research and controversy in philosophy, psychology, cognitive science, and, more recently, neuroscience. As contemporary researchers use the expression, mental images or imagery can comprise information from any source of sensory input; one may experience auditory images, olfactory images, and so forth. However, the majority of philosophical and scientific investigations of the topic focus upon visual mental imagery. It has sometimes been assumed that, like humans, some types of animals are capable of experiencing mental images. Due to the fundamentally introspective nature of the phenomenon, there is little to no evidence either for or against this view.
Philosophers such as David Hume, and early experimental psychologists such as Wilhelm Wundt and William James, understood ideas in general to be mental images. Today it is very widely believed that much imagery functions as mental representations (or mental models,) playing an important role in memory and thinking. William Brant (2013, p. 12) traces the scientific use of the phrase "mental images" back to the John Tyndall's 1870 speech called the "Scientific Use of the Imagination." Some have gone so far as to suggest that images are best understood to be, by definition, a form of inner, mental or neural representation; in the case of hypnagogic and hypnapompic imagery, it is not representational at all. Others reject the view that the image experience may be identical with (or directly caused by) any such representation in the mind or the brain, but do not take account of the non-representational forms of imagery.
In 2010, IBM applied for a patent on a method to extract mental images of human faces from the human brain. It uses a feedback loop based on brain measurements of the fusiform face area in the brain that activates proportionate with degree of facial recognition. It was issued in 2015.
- How mental images form in the brain 1
- Philosophical ideas 2
- Mental imagery in experimental psychology 3
- Training and learning styles 4
- Visualization and the Himalayan traditions 5
- See also 6
- References 7
- Further reading 8
- External links 9
How mental images form in the brain
Common examples of mental images include daydreaming and the mental visualization that occurs while reading a book. Another is of the pictures summoned by athletes during training or before a competition, outlining each step they will take to accomplish their goal. When a musician hears a song, he or she can sometimes "see" the song notes in their head, as well as hear them with all their tonal qualities. This is considered different from an after-effect, such as an after-image. Calling up an image in our minds can be a voluntary act, so it can be characterized as being under various degrees of conscious control.
According to psychologist and cognitive scientist Steven Pinker, our experiences of the world are represented in our minds as mental images. These mental images can then be associated and compared with others, and can be used to synthesize completely new images. In this view, mental images allow us to form useful theories of how the world works by formulating likely sequences of mental images in our heads without having to directly experience that outcome. Whether other creatures have this capability is debatable.
There are several theories as to how mental images are formed in the mind. These include the Dual-Code Theory, the Propositional Theory, and the Functional-Equivalency Hypothesis. The Dual-Code Theory, created by Allan Paivio in 1971, is the theory that we use two separate codes to represent information in our brains: image codes and verbal codes. Image codes are things like thinking of a picture of a dog when you are thinking of a dog, whereas a verbal code would be to think of the word "dog". Another example is the difference between thinking of abstract words such as justice or love and thinking of concrete words like elephant or chair. When abstract words are thought of, it is easier to think of them in terms of verbal codes- finding words that define them or describe them. With concrete words, it is often easier to use image codes and bring up a picture of a human or chair in your mind rather than words associated or descriptive of them.
The Propositional Theory involves storing images in the form of a generic propositional code that stores the meaning of the concept not the image itself. The propositional codes can either be descriptive of the image or symbolic. They are then transferred back into verbal and visual code to form the mental image.
The Functional-Equivalency Hypothesis is that mental images are "internal representations" that work in the same way as the actual perception of physical objects. In other words, the picture of a dog brought to mind when the word dog is read is interpreted in the same way as if the person looking at an actual dog before them.
Mental images are an important topic in classical and modern philosophy, as they are central to the study of knowledge. In the Republic, Book VII, Plato has Socrates present the Allegory of the Cave: a prisoner, bound and unable to move, sits with his back to a fire watching the shadows cast on the cave wall in front of him by people carrying objects behind his back. These people and the objects they carry are representations of real things in the world. Unenlightened man is like the prisoner, explains Socrates, a human being making mental images from the sense data that he experiences.
The eighteenth-century philosopher Bishop idealism. Berkeley stated that reality is equivalent to mental images — our mental images are not a copy of another material reality but that reality itself. Berkeley, however, sharply distinguished between the images that he considered to constitute the external world, and the images of individual imagination. According to Berkeley, only the latter are considered "mental imagery" in the contemporary sense of the term.
The eighteenth century British writer, Dr. Samuel Johnson, criticized idealism. When asked what he thought about idealism, he is alleged to have replied "I refute it thus!" as he kicked a large rock and his leg rebounded. His point was that the idea that the rock is just another mental image and has no material existence of its own is a poor explanation of the painful sense data he had just experienced.
David Deutsch addresses Johnson's objection to idealism in The Fabric of Reality when he states that, if we judge the value of our mental images of the world by the quality and quantity of the sense data that they can explain, then the most valuable mental image — or theory — that we currently have is that the world has a real independent existence and that humans have successfully evolved by building up and adapting patterns of mental images to explain it. This is an important idea in scientific thought.
Critics of scientific realism ask how the inner perception of mental images actually occurs. This is sometimes called the "homunculus problem" (see also the mind's eye). The problem is similar to asking how the images you see on a computer screen exist in the memory of the computer. To scientific materialism, mental images and the perception of them must be brain-states. According to critics, scientific realists cannot explain where the images and their perceiver exist in the brain. To use the analogy of the computer screen, these critics argue that cognitive science and psychology have been unsuccessful in identifying either the component in the brain (i.e., "hardware") or the mental processes that store these images (i.e. "software").
Mental imagery in experimental psychology
One theory of the mind that was examined in these experiments was the "brain as serial computer" philosophical metaphor of the 1970s. Psychologist Zenon Pylyshyn theorized that the human mind processes mental images by decomposing them into an underlying mathematical proposition. Roger Shepard and Jacqueline Metzler challenged that view by presenting subjects with 2D line drawings of groups of 3D block "objects" and asking them to determine whether that "object" is the same as a second figure, some of which rotations of the first "object". Shepard and Metzler proposed that if we decomposed and then mentally re-imaged the objects into basic mathematical propositions, as the then-dominant view of cognition "as a serial digital computer" assumed, then it would be expected that the time it took to determine whether the object is the same or not would be independent of how much the object had been rotated. Shepard and Metzler found the opposite: a linear relationship between the degree of rotation in the mental imagery task and the time it took participants to reach their answer.
This mental rotation finding implied that the human mind — and the human brain — maintains and manipulates mental images as topographic and topological wholes, an implication that was quickly put to test by psychologists. Stephen Kosslyn and colleagues showed in a series of neuroimaging experiments that the mental image of objects like the letter "F" are mapped, maintained and rotated as an image-like whole in areas of the human visual cortex. Moreover, Kosslyn's work showed that there are considerable similarities between the neural mappings for imagined stimuli and perceived stimuli. The authors of these studies concluded that, while the neural processes they studied rely on mathematical and computational underpinnings, the brain also seems optimized to handle the sort of mathematics that constantly computes a series of topologically-based images rather than calculating a mathematical model of an object.
Recent studies in neurology and neuropsychology on mental imagery have further questioned the "mind as serial computer" theory, arguing instead that human mental imagery manifests both visually and kinesthetically. For example, several studies have provided evidence that people are slower at rotating line drawings of objects such as hands in directions incompatible with the joints of the human body, and that patients with painful, injured arms are slower at mentally rotating line drawings of the hand from the side of the injured arm.
Some psychologists, including Kosslyn, have argued that such results occur because of interference in the brain between distinct systems in the brain that process the visual and motor mental imagery. Subsequent neuroimaging studies showed that the interference between the motor and visual imagery system could be induced by having participants physically handle actual 3D blocks glued together to form objects similar to those depicted in the line-drawings. Amorim et al. have recently shown that, when a cylindrical "head" was added to Shepard and Metzler's line drawings of 3D block figures, participants were quicker and more accurate at solving mental rotation problems. They argue that motoric embodiment is not just "interference" that inhibits visual mental imagery but is capable of facilitating mental imagery.
These and numerous related studies have led to a relative consensus within cognitive science, psychology, neuroscience, and philosophy on the neural status of mental images. In general, researchers agree that, while there is no homunculus inside the head viewing these mental images, our brains do form and maintain mental images as image-like wholes. The problem of exactly how these images are stored and manipulated within the human brain, in particular within language and communication, remains a fertile area of study.
One of the longest-running research topics on the mental image has basis on the fact that people report large individual differences in the vividness of their images. Special questionnaires have been developed to assess such differences, including the Vividness of Visual Imagery Questionnaire (VVIQ) developed by David Marks. Laboratory studies have suggested that the subjectively reported variations in imagery vividness are associated with different neural states within the brain and also different cognitive competences such as the ability to accurately recall information presented in pictures Rodway, Gillies and Schepman used a novel long-term change detection task to determine whether participants with low and high vividness scores on the VVIQ2 showed any performance differences. Rodway et al. found that high vividness participants were significantly more accurate at detecting salient changes to pictures compared to low-vividness participants. This replicated an earlier study.
Recent studies have found that individual differences in VVIQ scores can be used to predict changes in a person's brain while visualizing different activities. Functional magnetic resonance imaging (fMRI) was used to study the association between early visual cortex activity relative to the whole brain while participants visualized themselves or another person bench pressing or stair climbing. Reported image vividness correlates significantly with the relative fMRI signal in the visual cortex. Thus, individual differences in the vividness of visual imagery can be measured objectively.
Logie, Pernet, Buonocore and Della Sala (2011) used behavioural and fMRI data for mental rotation from individuals reporting vivid and poor imagery on the VVIQ. Groups differed in brain activation patterns suggesting that the groups performed the same tasks in different ways. These findings help to explain the lack of association previously reported between VVIQ scores and mental rotation performance.
Training and learning styles
Some educational theorists have drawn from the idea of mental imagery in their studies of learning styles. Proponents of these theories state that people often have learning processes that emphasize visual, auditory, and kinesthetic systems of experience. According to these theorists, teaching in multiple overlapping sensory systems benefits learning, and they encourage teachers to use content and media that integrates well with the visual, auditory, and kinesthetic systems whenever possible.
Educational researchers have examined whether the experience of mental imagery affects the degree of learning. For example, imagining playing a 5-finger piano exercise (mental practice) resulted in a significant improvement in performance over no mental practice — though not as significant as that produced by physical practice. The authors of the study stated that "mental practice alone seems to be sufficient to promote the modulation of neural circuits involved in the early stages of motor skill learning."
Visualization and the Himalayan traditions
In general, Vajrayana Buddhism, Bön, and Tantra utilize sophisticated visualization or imaginal (in the language of Jean Houston of Transpersonal Psychology) processes in the thoughtform construction of the yidam sadhana, kye-rim, and dzog-rim modes of meditation and in the yantra, thangka, and mandala traditions, where holding the fully realized form in the mind is a prerequisite prior to creating an 'authentic' new art work that will provide a sacred support or foundation for deity.
- Eysenck, M. W. (2012). Fundamentals of cognition, 2nd ed. New York, NY: Psychology Press.
- McKellar, 1957
- Richardson, 1969
- Finke, 1989
- Thomas, 2003
- Wright, Edmond (1983). "Inspecting images". Philosophy 58 (223): 57–72 (see pp. 68–72).
- Reisberg, 1992
- Bensafi et al., 2003
- Aristotle: On the Soul III.3 428a
- Pavio, 1986
- Egan, 1992
- Barsalou, 1999
- Prinz, 2002
- Block, 1983
- Kosslyn, 1983
- Sartre, 1940
- Ryle, 1949
- Skinner, 1974
- Thomas, 1999
- Bartolomeo, 2002
- Bennett & Hacker, 2003
- IBM Patent Application: Retrieving mental images of faces from the human brain
- Business Machines : Patent Issued for Retrieving Mental Images of Faces from the Human Brain
- Plessinger, Annie. The Effects of Mental Imagery on Athletic Performance. The Mental Edge. 12/20/13. Web. http://www.vanderbilt.edu
- Sachs, Oliver (2007). Musicophilia: Tales of Music and the Brain. London: Picador. pp. 30–40.
- Pinker, S. (1999). How the Mind Works. New York: Oxford University Press.
- Paivio, Allan. 1941. Dual Coding Theory. Theories of Learning in Educational Psychology. (2013). Web. http://www.lifecircles-inc.com/Learningtheories/IP/paivio.html
- Mental Imaging Theories. 2013. Web. http://faculty.mercer.edu
- Eysenck, M. W. (2012). Fundamentals of Cognition, 2nd ed. New York, NY: Psychology Press.
- Shepard and Metzler 1971
- Gardner 1987
- Kosslyn 1995; see also 1994
- Parsons 1987; 2003
- Schwoebel et al. 2001
- Kosslyn et al. 2001
- Amorim et al. 2006
- Rohrer 2006
- Marks, 1973
- Rodway, Gillies and Schepman 2006
- Rodway et al. 2006
- Gur and Hilgard 1975
- Cui et al. 2007
- Pascual-Leone et al. 1995
- The Dalai Lama at MIT (2006)
- Mental Imagery
- Amorim, Michel-Ange, Brice Isableu and Mohammed Jarraya (2006) Embodied Spatial Transformations: “Body Analogy” for the Mental Rotation. Journal of Experimental Psychology: General.
- Barsalou, L.W. (1999). Perceptual Symbol Systems. Behavioral and Brain Sciences 22: 577-660.
- Bartolomeo, P. (2002). The Relationship Between Visual perception and Visual Mental Imagery: A Reappraisal of the Neuropsychological Evidence. Cortex 38: 357-378. Cortex open access archive
- Bennett, M.R. & Hacker, P.M.S. (2003). Philosophical Foundations of Neuroscience. Oxford: Blackwell.
- Bensafi, M., Porter, J., Pouliot, S., Mainland, J., Johnson, B., Zelano, C., Young, N., Bremner, E., Aframian, D., Kahn, R., & Sobel, N. (2003). Olfactomotor Activity During Imagery Mimics that During Perception. Nature Neuroscience 6: 1142-1144.
- Block, N. (1983). Mental Pictures and Cognitive Science. Philosophical Review 92: 499-539.
- Brant, W. (2013). Mental Imagery and Creativity: Cognition, Observation and Realization. Akademikerverlag. pp. 227. Saarbrücken, Germany. ISBN 978-3-639-46288-3
- Cui, X., Jeter, C.B., Yang, D., Montague, P.R.,& Eagleman, D.M. (2007). "Vividness of mental imagery: Individual variability can be measured objectively". Vision Research, 47, 474-478.
- Deutsch, David. The Fabric of Reality.
- Egan, Kieran (1992). Imagination in Teaching and Learning. Chicago: University of Chicago Press.
- Fichter, C. & Jonas, K. (2008). Image Effects of Newspapers. How Brand Images Change Consumers’ Product Ratings. Zeitschrift für Psychologie / Journal of Psychology, 216, 226-234.
- Finke, R.A. (1989). Principles of Mental Imagery. Cambridge, MA: MIT Press.
- Garnder, Howard. (1987) The Mind's New Science: A History of the Cognitive Revolution New York: Basic Books.
- Gur, R.C. & Hilgard, E.R. (1975). "Visual imagery and discrimination of differences between altered pictures simultaneously and successively presented". British Journal of Psychology, 66, 341-345.
- Kosslyn, Stephen M. (1983). Ghosts in the Mind's Machine: Creating and Using Images in the Brain. New York: Norton.
- Kosslyn, Stephen (1994) Image and Brain: The Resolution of the Imagery Debate. Cambridge, MA: MIT Press.
- Kosslyn, Stephen M., William L. Thompson, Irene J. Kim and Nathaniel M. Alpert (1995) Topographic representations of mental images in primary visual cortex. Nature 378: 496-8.
- Kosslyn, Stephen M., William L. Thompson, Mary J. Wraga and Nathaniel M. Alpert (2001) Imagining rotation by endogenous versus exogenous forces: Distinct neural mechanisms. NeuroReport 12, 2519–2525.
- Logie, R.H., Pernet, C.R., Buonocore, A., & Della Sala, S. (2011). "Low and high imagers activate networks differentially in mental rotation". Neuropsychologia, 49, 3071-3077.
- Marks, D.F. (1973). Visual imagery differences in the recall of pictures. British Journal of Psychology, 64, 17-24.
- Marks, D.F. (1995). New directions for mental imagery research. Journal of Mental Imagery, 19, 153-167.
- McGabhann. R, Squires. B, 2003, 'Releasing The Beast Within — A path to Mental Toughness', Granite Publishing, Australia.
- McKellar, Peter (1957). Imagination and Thinking. London: Cohen & West.
- Norman, Donald.
- Paivio, Allan (1986). Mental Representations: A Dual Coding Approach. New York: Oxford University Press.
- Parsons, Lawrence M. (1987) Imagined spatial transformations of one’s hands and feet. Cognitive Psychology 19: 178-241.
- Parsons, Lawrence M. (2003) Superior parietal cortices and varieties of mental rotation. Trends in Cognitive Science 7: 515-551.
- Pascual-Leone, Alvaro, Nguyet Dang, Leonardo G. Cohen, Joaquim P. Brasil-Neto, Angel Cammarota, and Mark Hallett (1995). Modulation of Muscle Responses Evoked by Transcranial Magnetic Stimulation During the Acquisition of New Fine Motor Skills. Journal of Neuroscience 
- Plato. The Republic (New CUP translation into English).
- Plato. Respublica (New CUP edition of Greek text).
- Prinz, J.J. (2002). Furnishing the Mind: Concepts and their Perceptual Basis. Boston, MA: MIT Press.
- Pylyshyn, Zenon W. (1973). What the mind’s eye tells the mind’s brain: a critique of mental imagery. Psychological Bulletin 80: 1-24
- Reisberg, Daniel (Ed.) (1992). Auditory Imagery. Hillsdale, NJ: Erlbaum.
- Richardson, A. (1969). Mental Imagery. London: Routledge & Kegan Paul.
- Rodway, P., Gillies, K. & Schepman, A. (2006). "Vivid imagers are better at detecting salient changes". Journal of Individual Differences 27: 218-228.
- Rohrer, T. (2006). The Body in Space: Dimensions of embodiment The Body in Space: Embodiment, Experientialism and Linguistic Conceptualization]. In Body, Language and Mind, vol. 2. Zlatev, Jordan; Ziemke, Tom; Frank, Roz; Dirven, René (eds.). Berlin: Mouton de Gruyter, forthcoming 2006.
- Ryle, G. (1949). The Concept of Mind. London: Hutchinson.
- Sartre, J.-P. (1940). The Psychology of Imagination. (Translated from the French by B. Frechtman, New York: Philosophical Library, 1948.)
- Schwoebel, John, Robert Friedman, Nanci Duda and H. Branch Coslett (2001). Pain and the body schema evidence for peripheral effects on mental representations of movement. Brain 124: 2098-2104.
- Skinner, B.F. (1974). About Behaviorism. New York: Knopf.
- Shepard, Roger N. and Jacqueline Metzler (1971) Mental rotation of three-dimensional objects. Science 171: 701-703.
- Thomas, Nigel J.T. (1999). Are Theories of Imagery Theories of Imagination? An Active Perception Approach to Conscious Mental Content. Cognitive Science 23: 207-245.
- Thomas, N.J.T. (2003). Mental Imagery, Philosophical Issues About. In L. Nadel (Ed.), Encyclopedia of Cognitive Science (Volume 2, pp. 1147–1153). London: Nature Publishing/Macmillan.
- Traill, R.R. (2015). Concurrent Roles for the Eye Concurrent Roles for the Eye (Passive 'Camera' plus Active Decoder) — Hence Separate Mechanisms?, Melbourne: Ondwelle Publications.
- Mental Imagery in the Stanford Encyclopedia of Philosophy
- Imagination, Mental Imagery, Consciousness, and Cognition: Scientific, Philosophical and Historical Approaches.
- Roadmind University The Roerich Psychodynamic Inventory (RPI) provides statistical data to determine the validity of mental imagery for cognition of the minds raw emotional state. (Dr. Robert Roerich MD.)
- Mental Imagery in Mathematics
- The Human Brain, Really Amazing!