Quantifying the interplay of gaze and gesture in deixis using an experimental-simulative approach
- Gaze and gestures have been studied qualitatively, e.g., by Kendon and others (Kendon, 1990; McNeill, 1992; Kendon, 2004; McNeill, 2006). A quantitative assessment of gaze and gestures in dialogue, in particular regarding precise orientations, positions and timings, however, has only been possible with the advent of advanced measuring technologies, such as motion capturing or eye tracking. Especially in dynamic natural environments, when interlocutors are concerned with their surrounding three-dimensional environment, a precise three-dimensional reconstruction of the set-up is required to analyze the produced multimodal utterances. In this article we review several of our past projects with a focus on our experimental-simulative approach in which we combine state-of-the-art tracking technologies with 3D representations and computer simulations to test different hypotheses in the context of deixis in human-human interaction.
| Author: | Thies PfeifferORCiD, Patrick Renner |
|---|---|
| DOI: | https://doi.org/10.1075/ais.10.06pfe |
| ISBN: | 9789027263469 |
| Parent Title (English): | Eye-tracking in Interaction: Studies on the role of eye gaze in dialogue |
| Publisher: | John Benjamins Publishing Company |
| Place of publication: | Amsterdam |
| Editor: | Geert Brône, Bert Oben |
| Document Type: | Part of a Book |
| Language: | English |
| Year of Completion: | 2018 |
| Release Date: | 2025/05/30 |
| Tag: | deixis; experimental-simulative approach; interplay of gaze and gesture |
| First Page: | 109 |
| Last Page: | 138 |
| Institute: | Fachbereich Technik |
| Research Focus Area: | Industrielle Informatik |