Emotions Recognition between facial expressions and body movements
Keywords:
pandemic, Emotion, Emotion recognition, Facial expression, body expression
Abstract
This research aims to study the ability to recognize emotions between facial and body expressions. It was carried out through two methodologically independent experiments; The first experiment focused on comparing the performance of 19 participants in identifying emotions through facial and body expressions. It appears that the subjects identify more accurately the facial expressions in the emotions of anger, sadness, happiness, and neutral expressions versus body expressions, except for fear in which no significant difference appeared between the two channels. The second experiment aims to examine the effect of emotional bodily expressions on the judgment of emotional facial expressions by providing compound stimuli that combine facial and body cues to 18 participants. The results indicate that the judgment of facial expressions is unevenly influenced by emotional body expressions that accompanies them. All the emotional stimuli used in the two experiments were taken from the BEAST and FACS database. With the participation of a sample of faculty’s students between 20 and 30 years old. taken together, we emphasize through our data on the importance of the body and the face in emotional communication, and suggest modifying the basic models of perception of facial expressions to include face-body interaction.
Metrics
Metrics Loading ...
References
Allport, F. H. (1924). Social psychology. Houghton Mifflin.
Asch, C. E. (1952). Social psychology. Englewood Cliffs, NJ: Prentice Hall.
Atkinson, A. P., Dittrich, W. H., Gemmell, A. J., and Young, A. W. (2004). Emotion perception from dynamic and static body expressions in point-light and full-light displays. Perception 33, 717–746. DOI: 10.1068/p5096
Aviezer, H., Ensenberg., &Hassin, R. R. (2017). The inherently contextualized nature of facial emotion perception. Current Opinion in Psychology, 17; 47-54.
Aviezer, H., Hassin, R. R., Ryan, J., Grady, C., Susskind, J., Anderson, A., ...&Bentin, S. (2008). Angry, disgusted, or afraid?Studies on the malleability of emotion perception. Psychological science, 19(7), 724-732.
Aviezer, H., Messinger, D. S., Zangvil, S., Mattson, W. I., Gangi, D. N., &Todorov, A. (2015). Thrill of victory or agony of defeat? Perceivers fail to utilize information in facial movements. Emotion, 15(6), 791.
Aviezer, H., Trope, Y., &Todorov, A. (2012). Body cues, not facial expressions, discriminate between intense positive and negative emotions. Science, 338(6111), 1225-1229. DOI: 10.1126/science.1224313
Birdwhistell, R. L. (1963). The kinesic level in the investigation of the emotions. Knapp (ed.), 123-131.
Blake, R., &Shiffrar, M. (2007).Perception of human motion. Annual review of psychology, 58. DOI: https://doi.org/10.1146/annurev.psych.57.102904.190152
Carney, D. R., Cuddy, A. J., and Yap, A. J. (2010). Power posing: brief nonverbal displays affect neuroendocrine levels and risk tolerance. Psychol. Sci. 21, 1363–1368.
Crane, E. A., and Gross, M. M. (2007). “Motion capture and emotion: affect detection in whole body movement,” in Affective Computing and Intelligent Interaction ACII 2007. Lecture Notes in Computer Science, vol 4738, eds A. C. R. Paiva, R. Prada, and R. W. Picard (Berlin; Heidelberg: Springer), 95–101. doi: https://doi.org/10.1007/978-3-540-74889-2_9
Dael, N., Mortillaro, M., & Scherer, K. R. (2012).Emotion expression in body action and posture. Emotion, 12(5), 1085-1101. DOI: https://doi.org/10.1037/a0025737
Damasio, A. R. (1999). The Feeling of What Happens: Body and Emotion in the Making of Consciousness. San Diego, CA; New York, NY; London: Houghton Mifflin Harcourt).
Darwin, C. (1872/1965).The Expression of the Emotions in Man and Animals (Chicago: University of Chicago Press).
De Gelder, B. (2009). Why bodies? Twelve reasons for including bodily expressions in affective neuroscience. Philosophical Transactions of the Royal Society B: Biological Sciences, 364(1535), 3475-3484. DOI: https://dx.doi.org/10.1098%2Frstb.2009.0190
De Gelder, B. (2016). Emotions and the Body.Oxford University Press.
De Gelder, B., & Van den Stock, J. (2011). The bodily expressive action stimulus test (BEAST). Construction and validation of a stimulus basis for measuring perception of whole body expression of emotions. Frontiers in psychology, 2, 181.
De Meijer, M. (1989).The contribution of general features of body movement to the attribution of emotions. Journal of Nonverbal behavior, 13(4), 247-268.
Downing, P. E., Jiang, Y., Shuman, M., &Kanwisher, N. (2001).A cortical area selective for visual processing of the human body. Science, 293(5539), 2470-2473.
Duclos, S. E., and Laird, J. D. (2001).The deliberate control of emotional experience through control of expressions. Cogn. Emotion 15, 27–56. doi: 10.1080/02699930126057
Ekman, P. (1965). Differential communication of affect by head and body cues. Journal of personality and social psychology, 2(5), 726. DOI: 10.1037/h0022736
Ekman, P. (1970). Universal Facial Expressions of Emotions. California Mental Health Research Digest, 8(4), 151-158.
Ekman, P. (1972). Universals and Cultural Differences in Facial Expressions of Emotions.In Cole, J. (Ed.), Nebraska Symposium on Motivation (pp. 207-282). Lincoln, NB: University of Nebraska Press.
Ekman, P. (2003). InEmotions revealed: Recognizing Faces and Feelings to Improve Communication and Emotional Life. Bmj, 328 (Suppl S5).
Ekman, P., & Friesen, W. V. (1971).Constants across cultures in the face and emotion. Journal of personality and social psychology, 17(2), 124.
Ekman, P., & Friesen, W. V. (1978). The facial action coding system: A technique for the measurement of facial movement. Palo Alto, CA: Consulting Psychologists Press.
Hadjikhani, N., & de Gelder, B. (2003). Seeing fearful body expressions activates the fusiform cortex and amygdala. Current Biology, 13(24), 2201-2205.
Izard, C. E. (1971). The face of emotion.
Klineberg, O. (1938). Emotional expression in Chinese literature. The Journal of Abnormal and Social Psychology, 33(4), 517.
La Barre, W. (1947). The cultural basis of emotions and gestures.journal of personality, Vol. 60 September
Martin‐Key, N. A., Graf, E. W., Adams, W. J., & Fairchild, G. (2018).Facial emotion recognition and eye movement behaviour in conduct disorder. Journal of Child Psychology and Psychiatry, 59(3), 247-257.
Matsumoto, D. (2004). Paul Ekman and the legacy of universals. Journal of Research in Personality, 38(1), 45-51. DOI: 10.1016/j.jrp.2003.09.005
Meeren, H. K., van Heijnsbergen, C. C., & de Gelder, B. (2005). Rapid perceptual integration of facial expression and emotional body language. Proceedings of the National Academy of Sciences, 102(45), 16518-16523. DOI: 10.1073/pnas.0507650102
Michalak, J., Troje, N. F., Fischer, J., Vollmar, P., Heidenreich, T., and Schulte, D. (2009). Embodiment of sadness and depression–gait patterns associated with dysphoric mood. Psychosom. Med. 71, 580–587. doi: 10.1097/PSY.0b013e3181a2515c
Roether, C. L., Omlor, L., Christensen, A., and Giese, M. A. (2009). Critical features for the perception of emotion from gait. J. Vis. 9:15. doi: 10.1167/9.6.15
Sawada, M., Suda, K., and Ishii, M. (2003). Expression of emotions in dance: relation between arm movement characteristics and emotion. Percept.Mot. Skills 97, 697–708. doi: 10.2466/pms.2003.97.3.697
Scherer, K. R. (1986). Vocal affect expression: A review and a model for future research. Psychological Bulletin, 99(2), 143–165.
Schützwohl, A., &Reisenzein, R. (2012). Facial expressions in response to a highly surprising event exceeding the field of vision: a test of Darwin's theory of surprise. Evolution and Human Behavior, 33(6), 657-664.
Schwarzlose, R. F., Baker, C. I., &Kanwisher, N. (2005). Separate face and body selectivity on the fusiform gyrus. Journal of Neuroscience, 25, 11055–11059.
Shafir, T., Taylor, S. F., Atkinson, A. P., Langenecker, S. A., and Zubieta, J.-K.(2013). Emotion regulation through execution, observation, and imagery of emotional movements. Brain Cogn. 82, 219–227. doi: 10.1016/j.bandc.2013.03.001
Strack, F., Martin, L. L., and Stepper, S. (1988). Inhibiting and facilitating conditions of the human smile: a nonobtrusive test of the facial feedback hypothesis. J. Pers. Soc. Psychol. 54:768–777. doi: 10.1037//0022-3514.54.5.768
Tomkins, S. S., &McCarter, R. (1964). What and where are the primary affects? Some evidence for a theory. Perceptual and motor skills, 18(1), 119-158.
Van den Stock, J., Righart, R., & De Gelder, B. (2007). Body expressions influence recognition of emotions in the face and voice. Emotion, 7(3), 487.
Wallbott, H. G. (1998). Bodily expression of emotion. European journal of social psychology, 28(6), 879-896.
Waters, A. M., Bradley, B. P., &Mogg, K. (2014). Biased attention to threat in paediatric anxiety disorders (generalized anxiety disorder, social phobia, specific phobia, separation anxiety disorder) as a function of'distress' versus' fear'diagnostic categorization. Psychologicalmedicine, 44(3), 607.
Winters, A. F. (2008). Emotion, embodiment, and mirror neurons in dance/movement therapy: a connection across disciplines. Am. J. Dance Ther. 30, 84–105.
Asch, C. E. (1952). Social psychology. Englewood Cliffs, NJ: Prentice Hall.
Atkinson, A. P., Dittrich, W. H., Gemmell, A. J., and Young, A. W. (2004). Emotion perception from dynamic and static body expressions in point-light and full-light displays. Perception 33, 717–746. DOI: 10.1068/p5096
Aviezer, H., Ensenberg., &Hassin, R. R. (2017). The inherently contextualized nature of facial emotion perception. Current Opinion in Psychology, 17; 47-54.
Aviezer, H., Hassin, R. R., Ryan, J., Grady, C., Susskind, J., Anderson, A., ...&Bentin, S. (2008). Angry, disgusted, or afraid?Studies on the malleability of emotion perception. Psychological science, 19(7), 724-732.
Aviezer, H., Messinger, D. S., Zangvil, S., Mattson, W. I., Gangi, D. N., &Todorov, A. (2015). Thrill of victory or agony of defeat? Perceivers fail to utilize information in facial movements. Emotion, 15(6), 791.
Aviezer, H., Trope, Y., &Todorov, A. (2012). Body cues, not facial expressions, discriminate between intense positive and negative emotions. Science, 338(6111), 1225-1229. DOI: 10.1126/science.1224313
Birdwhistell, R. L. (1963). The kinesic level in the investigation of the emotions. Knapp (ed.), 123-131.
Blake, R., &Shiffrar, M. (2007).Perception of human motion. Annual review of psychology, 58. DOI: https://doi.org/10.1146/annurev.psych.57.102904.190152
Carney, D. R., Cuddy, A. J., and Yap, A. J. (2010). Power posing: brief nonverbal displays affect neuroendocrine levels and risk tolerance. Psychol. Sci. 21, 1363–1368.
Crane, E. A., and Gross, M. M. (2007). “Motion capture and emotion: affect detection in whole body movement,” in Affective Computing and Intelligent Interaction ACII 2007. Lecture Notes in Computer Science, vol 4738, eds A. C. R. Paiva, R. Prada, and R. W. Picard (Berlin; Heidelberg: Springer), 95–101. doi: https://doi.org/10.1007/978-3-540-74889-2_9
Dael, N., Mortillaro, M., & Scherer, K. R. (2012).Emotion expression in body action and posture. Emotion, 12(5), 1085-1101. DOI: https://doi.org/10.1037/a0025737
Damasio, A. R. (1999). The Feeling of What Happens: Body and Emotion in the Making of Consciousness. San Diego, CA; New York, NY; London: Houghton Mifflin Harcourt).
Darwin, C. (1872/1965).The Expression of the Emotions in Man and Animals (Chicago: University of Chicago Press).
De Gelder, B. (2009). Why bodies? Twelve reasons for including bodily expressions in affective neuroscience. Philosophical Transactions of the Royal Society B: Biological Sciences, 364(1535), 3475-3484. DOI: https://dx.doi.org/10.1098%2Frstb.2009.0190
De Gelder, B. (2016). Emotions and the Body.Oxford University Press.
De Gelder, B., & Van den Stock, J. (2011). The bodily expressive action stimulus test (BEAST). Construction and validation of a stimulus basis for measuring perception of whole body expression of emotions. Frontiers in psychology, 2, 181.
De Meijer, M. (1989).The contribution of general features of body movement to the attribution of emotions. Journal of Nonverbal behavior, 13(4), 247-268.
Downing, P. E., Jiang, Y., Shuman, M., &Kanwisher, N. (2001).A cortical area selective for visual processing of the human body. Science, 293(5539), 2470-2473.
Duclos, S. E., and Laird, J. D. (2001).The deliberate control of emotional experience through control of expressions. Cogn. Emotion 15, 27–56. doi: 10.1080/02699930126057
Ekman, P. (1965). Differential communication of affect by head and body cues. Journal of personality and social psychology, 2(5), 726. DOI: 10.1037/h0022736
Ekman, P. (1970). Universal Facial Expressions of Emotions. California Mental Health Research Digest, 8(4), 151-158.
Ekman, P. (1972). Universals and Cultural Differences in Facial Expressions of Emotions.In Cole, J. (Ed.), Nebraska Symposium on Motivation (pp. 207-282). Lincoln, NB: University of Nebraska Press.
Ekman, P. (2003). InEmotions revealed: Recognizing Faces and Feelings to Improve Communication and Emotional Life. Bmj, 328 (Suppl S5).
Ekman, P., & Friesen, W. V. (1971).Constants across cultures in the face and emotion. Journal of personality and social psychology, 17(2), 124.
Ekman, P., & Friesen, W. V. (1978). The facial action coding system: A technique for the measurement of facial movement. Palo Alto, CA: Consulting Psychologists Press.
Hadjikhani, N., & de Gelder, B. (2003). Seeing fearful body expressions activates the fusiform cortex and amygdala. Current Biology, 13(24), 2201-2205.
Izard, C. E. (1971). The face of emotion.
Klineberg, O. (1938). Emotional expression in Chinese literature. The Journal of Abnormal and Social Psychology, 33(4), 517.
La Barre, W. (1947). The cultural basis of emotions and gestures.journal of personality, Vol. 60 September
Martin‐Key, N. A., Graf, E. W., Adams, W. J., & Fairchild, G. (2018).Facial emotion recognition and eye movement behaviour in conduct disorder. Journal of Child Psychology and Psychiatry, 59(3), 247-257.
Matsumoto, D. (2004). Paul Ekman and the legacy of universals. Journal of Research in Personality, 38(1), 45-51. DOI: 10.1016/j.jrp.2003.09.005
Meeren, H. K., van Heijnsbergen, C. C., & de Gelder, B. (2005). Rapid perceptual integration of facial expression and emotional body language. Proceedings of the National Academy of Sciences, 102(45), 16518-16523. DOI: 10.1073/pnas.0507650102
Michalak, J., Troje, N. F., Fischer, J., Vollmar, P., Heidenreich, T., and Schulte, D. (2009). Embodiment of sadness and depression–gait patterns associated with dysphoric mood. Psychosom. Med. 71, 580–587. doi: 10.1097/PSY.0b013e3181a2515c
Roether, C. L., Omlor, L., Christensen, A., and Giese, M. A. (2009). Critical features for the perception of emotion from gait. J. Vis. 9:15. doi: 10.1167/9.6.15
Sawada, M., Suda, K., and Ishii, M. (2003). Expression of emotions in dance: relation between arm movement characteristics and emotion. Percept.Mot. Skills 97, 697–708. doi: 10.2466/pms.2003.97.3.697
Scherer, K. R. (1986). Vocal affect expression: A review and a model for future research. Psychological Bulletin, 99(2), 143–165.
Schützwohl, A., &Reisenzein, R. (2012). Facial expressions in response to a highly surprising event exceeding the field of vision: a test of Darwin's theory of surprise. Evolution and Human Behavior, 33(6), 657-664.
Schwarzlose, R. F., Baker, C. I., &Kanwisher, N. (2005). Separate face and body selectivity on the fusiform gyrus. Journal of Neuroscience, 25, 11055–11059.
Shafir, T., Taylor, S. F., Atkinson, A. P., Langenecker, S. A., and Zubieta, J.-K.(2013). Emotion regulation through execution, observation, and imagery of emotional movements. Brain Cogn. 82, 219–227. doi: 10.1016/j.bandc.2013.03.001
Strack, F., Martin, L. L., and Stepper, S. (1988). Inhibiting and facilitating conditions of the human smile: a nonobtrusive test of the facial feedback hypothesis. J. Pers. Soc. Psychol. 54:768–777. doi: 10.1037//0022-3514.54.5.768
Tomkins, S. S., &McCarter, R. (1964). What and where are the primary affects? Some evidence for a theory. Perceptual and motor skills, 18(1), 119-158.
Van den Stock, J., Righart, R., & De Gelder, B. (2007). Body expressions influence recognition of emotions in the face and voice. Emotion, 7(3), 487.
Wallbott, H. G. (1998). Bodily expression of emotion. European journal of social psychology, 28(6), 879-896.
Waters, A. M., Bradley, B. P., &Mogg, K. (2014). Biased attention to threat in paediatric anxiety disorders (generalized anxiety disorder, social phobia, specific phobia, separation anxiety disorder) as a function of'distress' versus' fear'diagnostic categorization. Psychologicalmedicine, 44(3), 607.
Winters, A. F. (2008). Emotion, embodiment, and mirror neurons in dance/movement therapy: a connection across disciplines. Am. J. Dance Ther. 30, 84–105.
Published
2022-03-31
How to Cite
ALHACINI, I. I., & BOUSSETA, A. (2022). Emotions Recognition between facial expressions and body movements . Social Sciences Journal, 16(1), 301-327. https://doi.org/10.34118/ssj.v16i1.1931
Issue
Section
Articles
Copyright (c) 2022 Social Sciences Journal
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
