Imitation of a Pedagogical Agent’s Gestures Enhances Memory for Words in Second Language

Manuela Macedonia; Kirsten Bergmann; Friedrich Roithmayr

doi:doi:10.11648/j.sjedu.20140205.15

| Peer-Reviewed

Imitation of a Pedagogical Agent’s Gestures Enhances Memory for Words in Second Language

Manuela Macedonia, Kirsten Bergmann, Friedrich Roithmayr

Published in Science Journal of Education (Volume 2, Issue 5)

Received: 13 October 2014 Accepted: 28 October 2014 Published: 10 November 2014

Views: Downloads:

Download PDF

Share This Article

Twitter
Linked In
Facebook

Abstract

Pedagogical agents (PAs) are virtual characters in computer-based learning environments. PAs can train humans in various domains. Here, a PA cues subjects to learn vocabulary items through enactment, i.e., to perform an illustrative gesture while learning a word. It is well known that enactment impacts memory. Also, imitation is a natural mechanism driving learning. Combining both enactment and imitation could improve memory even more. In a within-subjects study, 44 school children learned 45 vocabulary items according to three conditions: an audio-visual baseline, an observation condition (participants watched the PA during enactment) and an imitation condition (participants imitated the PA’s gestures). We documented learning progress by cued recall tests. Over four days, we found that, compared to the baseline and to mere observation, imitation of enactment significantly enhanced memory for words in the foreign language.

Published in	Science Journal of Education (Volume 2, Issue 5)
DOI	10.11648/j.sjedu.20140205.15
Page(s)	162-169
Creative Commons	This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium or format, provided the original work is properly cited.
Copyright	Copyright © The Author(s), 2014. Published by Science Publishing Group

Keywords

Pedagogical Agent, Multilingualism, Imitation, Enactment, Gestures, Memory

References

[1]	M. Macedonia, I. Groher, and F. Roithmayr, “Intelligent Virtual Agents as Language Trainers Facilitate Multilingualism”. Frontiers in Psychology, 2014. 5.
[2]	J. Cassell, Embodied conversational agents. 2000, Cambridge, Mass. ; London: MIT Press.
[3]	S. Heidig and G. Clarebout, “Do pedagogical agents make a difference to student motivation and learning?”. Educational Research Review, 2011. 6(1): p. 27-54.
[4]	R.-J. Beun, E. Vos, and C. Witteman, “Embodied Conversational Agents: Effects on Memory Performance and Anthropomorphisation”, in Intelligent Virtual Agents, T. Rist, et al., Editors. 2003, Springer Berlin Heidelberg. p. 315-319.
[5]	J. Miksatko, K. Kipp, and M. Kipp, “The Persona Zero-Effect: Evaluating Virtual Character Benefits on a Learning Task with Repeated Interactions”, in Intelligent Virtual Agents, J. Allbeck, et al., Editors. 2010, Springer Berlin Heidelberg. p. 475-481.
[6]	K. Bergmann and M. Macedonia, “A Virtual Agent as Vocabulary Trainer: Iconic Gestures Help to Improve Learners' Memory Performance”, in Proceedings of the 13th International Conference on Intelligent Virtual Agents., T.I.C.o.I.V.A.I. 2013), Editor 2013. p. submitted.
[7]	M. Macedonia, K. Müller, and A.D. Friederici, “The impact of iconic gestures on foreign language word learning and its neural substrate”. Human Brain Mapping, 2011. 32(6): p. 982-998.
[8]	H.D. Zimmer, Memory for action: a distinct form of episodic memory? 2001, Oxford: Oxford University Press. ix, 205 p.
[9]	M. Macedonia and K. Von Kriegstein, “Gestures enhance foreign language learning”. Biolinguistics, 2012. 6(Special Issue "Embodiment"): p. 393-416.
[10]	M. Macedonia, “A bizarre pedagogical virtual trainer enhances memory for words in a foreign language”. International Journal of Computer Science and Artificial Intelligence, 2014. 4(2): p. 24-34.
[11]	S.T. Fiske, A.J.C. Cuddy, and P. Glick, “Universal dimensions of social cognition: warmth and competence”. Trends in Cognitive Sciences, 2007. 11(2): p. 77-83.
[12]	M. Macedonia, R. Kern, and F. Roithmayr, “Do children accept virtual agents as foreign language trainers?”. International Journal of Learning,Teaching, and Educational Research, 2014. 7(1): p.131-137.
[13]	J. Engelkamp and H. Krumnacker, “Imaginale und motorische Prozesse beim Behalten verbalen Materials”. Zeitschrift für experimentelle und angewandte Psychologie, 1980(27): p. 511-533.
[14]	R.L. Cohen, “On the generality of some memory laws.”. Scand J Psychol, 1981. 22: p. 267-281.
[15]	J. Engelkamp and H. Zimmer, “Zum Einfluß von Wahrnehmen und Tun auf das Behalten von Verb-Objekt-Phrasen”. Sprache & Kognition, 1983(2): p. 117-127.
[16]	J. Engelkamp, et al., “Memory of self-performed tasks: Self-performing during recognition”. Memory and Cognition, 1994. 22(1): p. 34-39.
[17]	K. Masumoto, et al., “Reactivation of physical motor information in the memory of action events”. Brain Res, 2006. 1101(1): p. 102-9.
[18]	J. Engelkamp and H.D. Zimmer, “Motor program information as a separable memory unit”. Psychological Research, 1984(46): p. 283–299.
[19]	J. Engelkamp and H.D. Zimmer, “Motor programs and their relation to semantic memory”. German Journal of Psychology, 1985(9): p. 239–254.
[20]	K. Stefan, et al., “Formation of a Motor Memory by Action Observation”. J. Neurosci., 2005. 25(41): p. 9339-9346.
[21]	N.E. Miller and J. Dollard, Social learning and imitation. 1979, Westport, Conn.: Greenwood Press. xiv, 341 p.
[22]	B.G. Galef and K.N. Laland, “Social Learning in Animals: Empirical Studies and Theoretical Models”. BioScience, 2005. 55(6): p. 489-499.
[23]	C.M. Heyes and B.G. Galef, Social learning in animals : the roots of culture. 1996, San Diego: Academic Press. xix, 411 p.
[24]	T.R. Zentall, “Action imitation in birds”. Learn Behav, 2004. 32(1): p. 15-23.
[25]	K. Thonhauser, et al., “Social learning in Cartilaginous fish (stingrays Potamotrygon falkneri)”. Animal Cognition, 2013. 16(6): p. 927-932.
[26]	A.N. Meltzoff and M.K. Moore, “Imitation of facial and manual gestures by human neonates”. Science, 1977. 198(4312): p. 74-78.
[27]	J. Piaget, H.E. Gruber, and J.J. Vonèche, The essential Piaget. 1977, London: Routledge and K. Paul. xlii, 881 p.
[28]	A.N. Meltzoff and M.K. Moore, “Newborn-Infants Imitate Adult Facial Gestures”. Child Development, 1983. 54(3): p. 702-709.
[29]	V. Gallese, et al., “Action recognition in the premotor cortex”. Brain, 1996. 119(2): p. 593-609.
[30]	G. Rizzolatti and L. Craighero, “The mirror-neuron system”. Annu Rev Neurosci, 2004. 27: p. 169-92.
[31]	H. Théoret and A. Pascual-Leone, “Language Acquisition: Do as You Hear”. Current Biology. 12(21): p. R736-R737.
[32]	M. Pelaez, J. Virues-Ortega, and J.L. Gewirtz, “Reinforcement of vocalizations through contingent vocal imitation”. J Appl Behav Anal, 2011. 44(1): p. 33-40.
[33]	D. Lenzi, et al., “Neural basis of maternal communication and emotional expression processing during infant preverbal stage”. Cereb Cortex, 2009. 19(5): p. 1124-33.
[34]	L.W. Barsalou, “Grounded cognition”. Annual Review of Psychology, 2008. 59: p. 617-645.
[35]	V. Gallese and G. Lakoff, “The Brain's concepts: the role of the Sensory-motor system in conceptual knowledge”. Cogn Neuropsychol, 2005. 22(3): p. 455-79.
[36]	D. McNeill, How language began : gesture and speech in human evolution. xiv, 264 pages.
[37]	M. Gentilucci and M.C. Corballis, “From manual gesture to speech: A gradual transition”. Neuroscience & Biobehavioral Reviews, 2006. 30(7): p. 949-960.
[38]	J.M. Iverson and S. Goldin-Meadow, “Gesture paves the way for language development”. Psychological Science, 2005. 16(5): p. 367-371.
[39]	S. Ozcaliskan and S. Goldin-Meadow, “Gesture is at the cutting edge of early language development”. Cognition, 2005. 96(3): p. B101-B113.
[40]	S. Goldin-Meadow and M.W. Alibali, “Gesture's Role in Speaking, Learning, and Creating Language”. Annual Review of Psychology, 2013. 64(1): p. 257-283.
[41]	S.D. Kelly, A. Ozyurek, and E. Maris, “Two sides of the same coin: speech and gesture mutually interact to enhance comprehension”. Psychol Sci, 2010. 21(2): p. 260-7.
[42]	M. Macedonia and W. Klimesch, “Long term effects of gestures on memory for foreign language words trained in the classroom”. Mind, Brain and Education, 2014. 8(1): p. In Press.
[43]	R. Reißenweber, Programmieren mit PEARL. 1988, München, Wien R. Oldenbourg Verlag.
[44]	H. Welbergen, D. Reidsma, and S. Kopp, “An Incremental Multimodal Realizer for Behavior Co-Articulation and Coordination”, in Intelligent Virtual Agents, Y. Nakano, et al., Editors. 2012, Springer Berlin Heidelberg. p. 175-188.
[45]	H. Vilhjálmsson, et al., “The Behavior Markup Language: Recent Developments and Challenges”, in Intelligent Virtual Agents, C. Pelachaud, et al., Editors. 2007, Springer Berlin Heidelberg. p. 99-111.
[46]	M. Macedonia, “Learning a Second Language Naturally: The Voice Movement Icon Approach”. Journal of Educational and Developmental Psychology, 2013. 3(2): p. 102-116.
[47]	M. Macedonia and T.R. Knösche, “Body in Mind: How Gestures Empower Foreign Language Learning”. Mind, Brain, and Education, 2011. 5(4): p. 196-211.
[48]	K. Bergmann and M. Macedonia, “A Virtual Agent as Vocabulary Trainer: Iconic Gestures Help to Improve Learners’ Memory Performance”, in Intelligent Virtual Agents, R. Aylett, et al., Editors. 2013, Springer Berlin Heidelberg. p. 139-148.

Cite This Article

Plain Text BibTeX RIS

APA Style

Manuela Macedonia, Kirsten Bergmann, Friedrich Roithmayr. (2014). Imitation of a Pedagogical Agent’s Gestures Enhances Memory for Words in Second Language. Science Journal of Education, 2(5), 162-169. https://doi.org/10.11648/j.sjedu.20140205.15

Copy | Download

ACS Style

Manuela Macedonia; Kirsten Bergmann; Friedrich Roithmayr. Imitation of a Pedagogical Agent’s Gestures Enhances Memory for Words in Second Language. Sci. J. Educ. 2014, 2(5), 162-169. doi: 10.11648/j.sjedu.20140205.15

Copy | Download

AMA Style

Manuela Macedonia, Kirsten Bergmann, Friedrich Roithmayr. Imitation of a Pedagogical Agent’s Gestures Enhances Memory for Words in Second Language. Sci J Educ. 2014;2(5):162-169. doi: 10.11648/j.sjedu.20140205.15

Copy | Download

@article{10.11648/j.sjedu.20140205.15,
  author = {Manuela Macedonia and Kirsten Bergmann and Friedrich Roithmayr},
  title = {Imitation of a Pedagogical Agent’s Gestures Enhances Memory for Words in Second Language},
  journal = {Science Journal of Education},
  volume = {2},
  number = {5},
  pages = {162-169},
  doi = {10.11648/j.sjedu.20140205.15},
  url = {https://doi.org/10.11648/j.sjedu.20140205.15},
  eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.sjedu.20140205.15},
  abstract = {Pedagogical agents (PAs) are virtual characters in computer-based learning environments. PAs can train humans in various domains. Here, a PA cues subjects to learn vocabulary items through enactment, i.e., to perform an illustrative gesture while learning a word. It is well known that enactment impacts memory. Also, imitation is a natural mechanism driving learning. Combining both enactment and imitation could improve memory even more. In a within-subjects study, 44 school children learned 45 vocabulary items according to three conditions: an audio-visual baseline, an observation condition (participants watched the PA during enactment) and an imitation condition (participants imitated the PA’s gestures). We documented learning progress by cued recall tests. Over four days, we found that, compared to the baseline and to mere observation, imitation of enactment significantly enhanced memory for words in the foreign language.},
 year = {2014}
}

Copy | Download

TY  - JOUR
T1  - Imitation of a Pedagogical Agent’s Gestures Enhances Memory for Words in Second Language
AU  - Manuela Macedonia
AU  - Kirsten Bergmann
AU  - Friedrich Roithmayr
Y1  - 2014/11/10
PY  - 2014
N1  - https://doi.org/10.11648/j.sjedu.20140205.15
DO  - 10.11648/j.sjedu.20140205.15
T2  - Science Journal of Education
JF  - Science Journal of Education
JO  - Science Journal of Education
SP  - 162
EP  - 169
PB  - Science Publishing Group
SN  - 2329-0897
UR  - https://doi.org/10.11648/j.sjedu.20140205.15
AB  - Pedagogical agents (PAs) are virtual characters in computer-based learning environments. PAs can train humans in various domains. Here, a PA cues subjects to learn vocabulary items through enactment, i.e., to perform an illustrative gesture while learning a word. It is well known that enactment impacts memory. Also, imitation is a natural mechanism driving learning. Combining both enactment and imitation could improve memory even more. In a within-subjects study, 44 school children learned 45 vocabulary items according to three conditions: an audio-visual baseline, an observation condition (participants watched the PA during enactment) and an imitation condition (participants imitated the PA’s gestures). We documented learning progress by cued recall tests. Over four days, we found that, compared to the baseline and to mere observation, imitation of enactment significantly enhanced memory for words in the foreign language.
VL  - 2
IS  - 5
ER  -

Copy | Download

Author Information

Manuela Macedonia

Department for Information Systems, Johannes Kepler University, Linz, Austria
Kirsten Bergmann

SFB 673, CITEC, Bielefeld University, Germany
Friedrich Roithmayr

Department for Information Systems, Johannes Kepler University, Linz, Austria

Download PDF

Sections

Plain Text BibTeX RIS

APA Style

Manuela Macedonia, Kirsten Bergmann, Friedrich Roithmayr. (2014). Imitation of a Pedagogical Agent’s Gestures Enhances Memory for Words in Second Language. Science Journal of Education, 2(5), 162-169. https://doi.org/10.11648/j.sjedu.20140205.15

Copy | Download

ACS Style

Manuela Macedonia; Kirsten Bergmann; Friedrich Roithmayr. Imitation of a Pedagogical Agent’s Gestures Enhances Memory for Words in Second Language. Sci. J. Educ. 2014, 2(5), 162-169. doi: 10.11648/j.sjedu.20140205.15

Copy | Download

AMA Style

Manuela Macedonia, Kirsten Bergmann, Friedrich Roithmayr. Imitation of a Pedagogical Agent’s Gestures Enhances Memory for Words in Second Language. Sci J Educ. 2014;2(5):162-169. doi: 10.11648/j.sjedu.20140205.15

Copy | Download

@article{10.11648/j.sjedu.20140205.15,
  author = {Manuela Macedonia and Kirsten Bergmann and Friedrich Roithmayr},
  title = {Imitation of a Pedagogical Agent’s Gestures Enhances Memory for Words in Second Language},
  journal = {Science Journal of Education},
  volume = {2},
  number = {5},
  pages = {162-169},
  doi = {10.11648/j.sjedu.20140205.15},
  url = {https://doi.org/10.11648/j.sjedu.20140205.15},
  eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.sjedu.20140205.15},
  abstract = {Pedagogical agents (PAs) are virtual characters in computer-based learning environments. PAs can train humans in various domains. Here, a PA cues subjects to learn vocabulary items through enactment, i.e., to perform an illustrative gesture while learning a word. It is well known that enactment impacts memory. Also, imitation is a natural mechanism driving learning. Combining both enactment and imitation could improve memory even more. In a within-subjects study, 44 school children learned 45 vocabulary items according to three conditions: an audio-visual baseline, an observation condition (participants watched the PA during enactment) and an imitation condition (participants imitated the PA’s gestures). We documented learning progress by cued recall tests. Over four days, we found that, compared to the baseline and to mere observation, imitation of enactment significantly enhanced memory for words in the foreign language.},
 year = {2014}
}

Copy | Download

TY  - JOUR
T1  - Imitation of a Pedagogical Agent’s Gestures Enhances Memory for Words in Second Language
AU  - Manuela Macedonia
AU  - Kirsten Bergmann
AU  - Friedrich Roithmayr
Y1  - 2014/11/10
PY  - 2014
N1  - https://doi.org/10.11648/j.sjedu.20140205.15
DO  - 10.11648/j.sjedu.20140205.15
T2  - Science Journal of Education
JF  - Science Journal of Education
JO  - Science Journal of Education
SP  - 162
EP  - 169
PB  - Science Publishing Group
SN  - 2329-0897
UR  - https://doi.org/10.11648/j.sjedu.20140205.15
AB  - Pedagogical agents (PAs) are virtual characters in computer-based learning environments. PAs can train humans in various domains. Here, a PA cues subjects to learn vocabulary items through enactment, i.e., to perform an illustrative gesture while learning a word. It is well known that enactment impacts memory. Also, imitation is a natural mechanism driving learning. Combining both enactment and imitation could improve memory even more. In a within-subjects study, 44 school children learned 45 vocabulary items according to three conditions: an audio-visual baseline, an observation condition (participants watched the PA during enactment) and an imitation condition (participants imitated the PA’s gestures). We documented learning progress by cued recall tests. Over four days, we found that, compared to the baseline and to mere observation, imitation of enactment significantly enhanced memory for words in the foreign language.
VL  - 2
IS  - 5
ER  -

Copy | Download