| 1 |
Interpersonal Synchrony: From Social Perception to Social Interaction
|
|
|
|
In: Social Signal Processing ; https://hal-pasteur.archives-ouvertes.fr/pasteur-02070422 ; Edited by Judee K. Burgoon, University of Arizona Nadia Magnenat-Thalmann, Université de Genève Maja Pantic, Imperial College London Alessandro Vinciarelli, University of Glasgow. Social Signal Processing, Cambridge University Press, pp.202-212, 2017, Social Signal Processing, 9781316676202. ⟨10.1017/9781316676202.015⟩ ; https://www.cambridge.org/core/books/social-signal-processing/interpersonal-synchrony-from-social-perception-to-social-interaction/50D491B6C3AB7767858C80CF612C28A5 (2017)
|
|
Abstract:
International audience ; IntroductionSynchrony refers to individuals’ temporal coordination during social interactions (Cappella, 2005). The analysis of this phenomenon is complex, requiring the perception and integration of multimodal communicative signals. The evaluation of synchrony has received multidisciplinary attention because of its role in early development (Feldman, 2003), language learning (Goldstein, King, & West, 2003), and social connection (Harrist & Waugh, 2002). Initially, instances of synchrony were directly perceived in the data by trained observers. Several methods have been proposed to evaluate interactional synchrony, ranging from behavior microanalysis (Cappella, 1997) to global perception of synchrony (Bernieri, Reznick, & Rosenthal, 1988). Behavioral synchrony has now captured the interest of researchers in such fields as social signal processing, robotics, and machine learning (Prepin & Pelachaud, 2011; Kozima, Michalowski, & Nakagawa, 2009).In this chapter, we focus especially on description and definition of synchrony for the development of computational models. The chapter begins with a review of evidences of interpersonal synchrony from different research domains (psychology, clinics, neuroscience and biology). Then, we introduce a working definition of interpersonal synchrony (see Proposed Definition). The chapter surveys evaluation models and methods from the literature of psychology (see Non-computational Methods of Synchrony Assessment) and social signal processing (see Fully Automatic Measures of Synchrony). Finally, the chapter discusses a number of challenges that need to be addressed (see Conclusions and Main Challenges).Non-verbal Evidence of Interpersonal SynchronyAmong social signals, synchrony and coordination have been considered lately (Ramseyer & Tschacher, 2010; Delaherche et al., 2012). Condon and Ogston (1967) initially proposed a microanalysis of human behavior (body motion and speech intonation) and evidenced the existence of interactional synchrony, the coordination between listener's and speaker's body movements, or between the listener's body movement and the speaker's pitch and stress variations. Bernieri et al. (1988) define coordination as the “degree to which the behaviors in an interaction are non-random, patterned or synchronized in both form and timing”. (Kendon, 1970) raises fundamental questions about the condition of interactional synchrony arousal and its function in interaction. When he synchronizes with the speaker, the listener demonstrates his ability to anticipate what the speaker is going to say. In this way, he gives feedback to the speaker and smoothens the running of the encounter.
|
|
Keyword:
[SDV.NEU.SC]Life Sciences [q-bio]/Neurons and Cognition [q-bio.NC]/Cognitive Sciences
|
|
URL: https://hal-pasteur.archives-ouvertes.fr/pasteur-02070422
https://doi.org/10.1017/9781316676202.015
|
|
BASE
|
|
Hide details
|
|
|
| 2 |
Fera 2015 - second facial expression recognition and analysis challenge
|
|
|
|
In: http://www.cs.nott.ac.uk/%7Epszmv/Documents/FERA2015.pdf (2015)
|
|
BASE
|
|
Show details
|
|
|
| 3 |
M.: A semi-automatic methodology for facial landmark annotation. In
|
|
|
|
In: http://ibug.doc.ic.ac.uk/media/uploads/documents/sagonas_cvpr_2013_amfg_w.pdf (2013)
|
|
BASE
|
|
Show details
|
|
|
| 4 |
The first facial expression recognition and analysis challenge
|
|
|
|
In: http://ibug.doc.ic.ac.uk/media/uploads/documents/pdf17.pdf (2011)
|
|
BASE
|
|
Show details
|
|
|
| 5 |
Audiovisual discrimination between speech and laughter: Why and when visual information might help
|
|
|
|
In: http://ibug.doc.ic.ac.uk/media/uploads/documents/petridispantic_2011_tmm.pdf (2011)
|
|
BASE
|
|
Show details
|
|
|
| 6 |
Classifying laughter and speech using audio-visual feature prediction
|
|
|
|
In: http://ibug.doc.ic.ac.uk/media/uploads/documents/ICASSP-2010-PetridisEtAl-CAMERA.pdf (2010)
|
|
BASE
|
|
Show details
|
|
|
| 7 |
Static vs. Dynamic Modeling of Human Nonverbal Behavior from Multiple Cues and Modalities
|
|
|
|
In: http://www.doc.ic.ac.uk/~maja/ICMI-2009-PetridisEtAl-CAMERA.pdf (2009)
|
|
BASE
|
|
Show details
|
|
|
| 8 |
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions
|
|
|
|
In: http://www.doc.ic.ac.uk/~maja/PAMI-AVemotionSurvey-CAMERA.pdf (2009)
|
|
BASE
|
|
Show details
|
|
|
| 10 |
Social Signal Processing: Survey of an Emerging Domain
|
|
|
|
In: http://www.idiap.ch/~vincia/papers/sspsurvey.pdf (2008)
|
|
BASE
|
|
Show details
|
|
|
| 11 |
Social Signal Processing: State-of-the-art and future perspectives of an emerging domain
|
|
|
|
In: http://www.idiap.ch/~vincia/papers/bravetopic.pdf (2008)
|
|
BASE
|
|
Show details
|
|
|
| 12 |
Social Signal Processing: State-of-the-art and future perspectives of an emerging domain
|
|
|
|
In: http://www.doc.ic.ac.uk/~maja/ACM-MM-2008-VinciarelliEtAl-CAMERA.pdf (2008)
|
|
BASE
|
|
Show details
|
|
|
| 13 |
Social Signal Processing: Survey of an Emerging Domain
|
|
|
|
In: http://www.doc.ic.ac.uk/~maja/IVCJ-SSPsurvey-FINAL.pdf (2008)
|
|
BASE
|
|
Show details
|
|
|
| 14 |
Fusion of audio and visual cues for laughter detection
|
|
|
|
In: http://www.doc.ic.ac.uk/~maja/CIVR-2008-PetridisPantic-CAMERA.pdf (2008)
|
|
BASE
|
|
Show details
|
|
|
| 15 |
Facial Action Recognition for Facial Expression Analysis from Static Face Images
|
|
|
|
In: http://www.kbs.twi.tudelft.nl/People/Staff/M.Pantic/SMCB-2004-final.pdf (2004)
|
|
BASE
|
|
Show details
|
|
|
| 16 |
20 Machine Analysis of Facial Expressions 1. Human Face and Its Expression
|
|
|
|
In: http://s.i-techonline.com/Book/Face-Recognition/ISBN978-3-902613-03-5-fr20.pdf
|
|
BASE
|
|
Show details
|
|
|
| 17 |
VISUAL-ONLY DISCRIMINATION BETWEEN NATIVE AND NON-NATIVE SPEECH
|
|
|
|
In: http://ibug.doc.ic.ac.uk/media/uploads/documents/georgakisetal_visualonlynativevsnonnative.pdf
|
|
BASE
|
|
Show details
|
|
|
| 18 |
20 Machine Analysis of Facial Expressions 1. Human Face and Its Expression
|
|
|
|
In: http://mplab.ucsd.edu/~marni/pubs/panticbartlett_2007.pdf
|
|
BASE
|
|
Show details
|
|
|
| 19 |
20 Machine Analysis of Facial Expressions 1. Human Face and Its Expression
|
|
|
|
In: http://www.doc.ic.ac.uk/~maja/PanticBartlett-Chapter-Proof2.pdf
|
|
BASE
|
|
Show details
|
|
|
| 20 |
Social Signal Processing: The Research Agenda
|
|
|
|
In: http://ibug.doc.ic.ac.uk/media/uploads/documents/looking@people-panticetal-revision-final.pdf
|
|
BASE
|
|
Show details
|
|
|
|
|
