Article published in:
Gesture
Vol. 15:1 (2016) ► pp. 60–78

Obligatory processing of irrelevant gesture

| A*STAR — Institute of High Performance Computing, Singapore
| Oxford Brookes University
This paper presents a study of selected iconic gestures with a view to determining their effects on RT in a task-relevant and a task-irrelevant context. In two experiments, participants were presented with a coloured shape on a computer screen, a spoken statement referring to the presented shape, and a gesture that was task irrelevant. The findings from both experiments show strong support for the assumption that gesture processing is obligatory; irrelevant gestures affected speed of task performance. Furthermore the findings suggest that for slower, more cognitively controlled decisions incongruent gestures have an inhibitory effect, while for faster, more cognitively automated decisions congruent gestures have a facilitatory effect.
Keywords: obligatory, inhibitory, facilitatory, speech, gesture, relevance, communication
Published online: 19 May 2016
https://doi.org/10.1075/gest.15.1.03fel
References

References

Barrett, Lisa F., Christine D. Wilson-Mendenhall, & Lawrence W. Barsalou
(2014) A psychological construction account of emotion regulation and dysregulation: The role of situated conceptualizations. In James J. Gross (Ed.), The handbook of emotion regulation (pp. 447–465). New York: Guilford.Google Scholar
Barsalou, Lawrence W.
(1999) Perceptual symbol systems. Behavioral & Brain Sciences, 22, 577–660.Google Scholar
Barsalou, Lawrence W. & Katja Wiemer-Hastings
(2005) Situated abstract concepts. In Diane Pecher & Rolf A. Zwaan (Eds.), Grounding cognition: The role of perception and action in memory, language, and thinking (pp. 129–163). Cambridge: Cambridge University Press. CrossrefGoogle Scholar
Bergen, Benjamin
(2012) Louder than words: The new science of how the mind makes meaning. New York: Basic Books.Google Scholar
Bernardis, Paolo, Elena Salillas, & Nicoletta Caramelli
(2008) Behavioural and neurophysiological evidence of semantic interaction between iconic gestures and words. Cognitive Neuropsychology, 25 (7/8), 1114–1128. CrossrefGoogle Scholar
Bloem, Ineke, Sylvia van den Boogaard, & Wido La Heij
(2004) Semantic facilitation and semantic interference in language production: Further evidence for the conceptual selection model of lexical access. Journal of Memory and Language, 51, 307–323. CrossrefGoogle Scholar
Damasio, Antonio
(1999) The feeling of what happens: Body and emotion in the making of consciousness. New York: Harcourt.Google Scholar
Diederich, Adele & Hans Colonius
(2015) The time window of multisensory integration: Relating reaction times and judgments of temporal order. Psychological Review 2015, Feb 23. Online at http://​www​.academia​.edu​/9450758​/The​_time​_window​_of​_multisensory​_integration​_relating​_reaction​_times​_and​_judgments​_of​_temporal​_order, last date of access 20 March 2015. CrossrefGoogle Scholar
Gellatly, Angus R.H. & Vernon H. Gregg
(1974) The effect of set size on the latency to name words. Acta Psychologica, 38, 93–98. CrossrefGoogle Scholar
Gentner, Dedre, Özyürek, Aslı, Özge Gürcanli, & Susan Goldin-Meadow
(2013) Spatial language facilitates spatial cognition: Evidence from children who lack language input. Cognition, 127, 318–330. CrossrefGoogle Scholar
Gibbs, Raymond W.
(2003) Embodied experience and linguistic meaning. Brain & Language, 84, 1–15. CrossrefGoogle Scholar
Gibson, James J.
(1979) The ecological approach to visual perception. Hillsday: Erlbaum.Google Scholar
Glenberg, Arthur M. & Michael P. Kaschak
(2002) Grounding language in action. Psychonomic Bulleting & Review, 9, 558–565. CrossrefGoogle Scholar
Hauk, Olaf, Ingrid Johnsrude, & Friedemann Pulvermueller
(2004) Somatotopic representation of action words in human motor and premotor cortex. Neuron, 41, 301–307. CrossrefGoogle Scholar
Holle, Henning & Thomas C. Gunter
(2007) The role of iconic gestures in speech disambiguation: ERP evidence. Journal of Cognitive Neuroscience, 19 (7), 1175–1192. CrossrefGoogle Scholar
Hostetter, Autumn B. & Martha W. Alibali
(2008) Visible embodiment: Gestures as simulated action. Psychonomic Bulletin & Review, 15 (3), 495–514. CrossrefGoogle Scholar
Kelly, Spencer D., Aslı Özyürek, & Eric Maris
(2010) Two sides of the same coin: Speech and gesture mutually interact to enhance comprehension. Psychological Science, 21, 260–267. CrossrefGoogle Scholar
Kelly, Spencer D., Peter Creigh, & James Bartolotti
(2010) Integrating speech and iconic gestures in a Stroop-like task: Evidence for automatic processing. Journal of Cognitive Neuroscience, 22, 683–694. CrossrefGoogle Scholar
Lakoff, George & Mark Johnson
(1980) Metaphors we live by. Chicago: University of Chicago Press.Google Scholar
(1999) Philosophy in the flesh: The embodied mind and its challenge to western thought. New York: Basic Books.Google Scholar
McNamara, Timothy P.
(2005) Semantic priming: Perspectives from memory and word recognition. New York: Psychology Press. CrossrefGoogle Scholar
Mayr, Susanne & Alex Buchner
(2007) Negative priming as a memory phenomenon. A review of 20 years of negative priming research. Zeitschrift für Psychologie, 215 (1), 35–51. CrossrefGoogle Scholar
Metta, Giorgio, et al.
(2008) The iCub humanoid robot: An open platform for research in embodied cognition. In Raj Madhavan & Elena R. Messina (Eds.), Proceedings of the 8th Workshop on Performance Metrics for Intelligent Systems (pp. 50–56). New York: ACM. CrossrefGoogle Scholar
Neely, James H.
(1991) Semantic priming effects in visual word recognition: A selective review of current findings and theories. In Derek Besner & Glyn W. Humphreys (Eds.), Basic processes in reading: Visual word recognition (pp. 264–336). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.Google Scholar
Neggers, Bas & Harold Bekkering
(2001) Gaze anchoring to a pointing target is present during the entire pointing movement and is driven by a non-visual signal. Journal of Neurophysiology, 86, 961–970.Google Scholar
Niebur, Ernst, et al.
(2001) Research, robots, and reality: A statement on current trends in biorobotics. Behavioral and Brain Sciences, 24 (6), 1072–1073. CrossrefGoogle Scholar
Obermeier, Christian & Thomas C. Gunter
(2014) Multisensory integration: The case of a time window of gesture-speech integration. Journal of Cognitive Neuroscience, 27 (2), 292–307. CrossrefGoogle Scholar
Pouw, Wim T.J.L.. et al.
(2014) Toward a more embedded/extended perspective on the cognitive function of gestures. Frontiers in Psychology, 5, 359. CrossrefGoogle Scholar
Prinz, Jesse J. & Lawrence W. Barsalou
(2000) Steering a course for embodied representation. In Eric Dietrich & Arthur B. Markman (Eds.), Cognitive dynamics: Conceptual and representational change in humans and machines (pp. 51–77). Cambridge, MA: MIT Press.Google Scholar
Rizzolatti, Giacomo & Laila Craighero
(2004) The mirror neuron system. Annual Review of Neuroscience, 27, 169–192. CrossrefGoogle Scholar
Rizzolatti, Giacomo, Luciano Fadiga, Vittorio Gallese, & Leonardo Fogassi
(1996) Premotor cortex and the recognition of motor actions. Cognitive Brain Research, 3, 131–141. CrossrefGoogle Scholar
Seliger, Herbert
(1980) Utterance planning and correction behavior: Its function in the grammar construction process for second language learners. In Hans W. Dechert & Manfred Raupach (Eds.), Towards a crosslinguistic assessment of speech production (pp. 87–99). Frankfurt am Main, Germany: Peter Lang.Google Scholar
So, Wing-Chee, Alvan Low Yi-Feng, De-Fu Yap, Eugene Kheng, & Ju-Min Melvin Yap
(2013) Iconic gestures prime words: Comparison of priming effects when gestures are presented alone and when they are accompanying speech. Frontiers in Psychology, 4, 779. CrossrefGoogle Scholar
Tipper, Steven P.
(1985) The negative priming effect: Inhibitory priming by ignored objects. Quarterly Journal of Experimental Psychology: Human Experimental Psychology, 37 (4), 571–590. CrossrefGoogle Scholar
Tversky, Barbara & Brigitte M. Hard
(2009) Embodied and disembodied cognition: Spatial perspective taking. Cognition, 110, 124–129. CrossrefGoogle Scholar
Vacharkulksemsuk, Tanya & Barbara L. Fredrickson
(2012) Strangers in sync: Achieving embodied rapport through shared movements. Journal of Experimental Social Psychology, 48, 399–402. CrossrefGoogle Scholar
Vainiger, Dana, Ludovica Labruna, Richard Ivry, & Michal Lavidor
(2014) Beyond words: Evidence for automatic language–gesture integration of symbolic gestures but not dynamic landscapes. Psychological Research, 78, 55–69. CrossrefGoogle Scholar
van Dantzig, Saskia, René Zeelenberg, & Diane Pecher
(2009) Unconstraining theories of embodied cognition. Journal of Experimental Social Psychology, 45, 345–351. CrossrefGoogle Scholar
Yap, De-Fu, Wing-Chee So, Yu-Min Melvin Yap, Tan, Ying-Quan, & Ruo-Li Serene Teoh
(2011) Iconic gestures prime words. Cognitive Science, 35 (1), 171–183. CrossrefGoogle Scholar
Ziemke, Tom & Robert Lowe
(2009) On the role of emotion in embodied cognitive architectures: From organisms to robots. Cognitive Computation, 1 (1), 104–117. CrossrefGoogle Scholar