Talking Bodies: Sensitivity to De-synchronization of Conversations

Rachel McDonnell, Cathy Ennis, Simon Dobbyn, and Carol O'Sullivan

Graphics, Vision and Visualisation Group, Trinity College Dublin

Abstract

In this paper, we investigate human sensitivity to the coordination and timing of conversational body language for virtual characters. First, we captured the full body motions (excluding faces and hands) of three actors conversing about a range of topics, in either a polite (i.e., one person talking at a time) or debate/argument style. Stimuli were then created by applying the motion-captured conversations from the actors to virtual characters. In a 2AFC experiment, participants viewed paired sequences of synchronized and de-synchronized conversations and were asked to guess which was the real one. Detection performance was above chance for both conversation styles but more so for the polite conversations, where de-synchronization was more noticeable.

 

Paper (pdf)

Movie (quicktime)