Perception of co-speech gestures in aphasic patients: A visual exploration study during the observation of dyadic conversations

Preisig, Basil (2015). Perception of co-speech gestures in aphasic patients: A visual exploration study during the observation of dyadic conversations [Movie]. researchsquare

[img] Video
Perception of co-speech gestures in aphasic patients.avi - Published Version
Available under License BORIS Standard License.

Download (33MB)

Background: Co-speech gestures are part of nonverbal communication during conversations. They either support the verbal message or provide the interlocutor with additional information. Furthermore, they prompt as nonverbal cues the cooperative process of turn taking. In the present study, we investigated the influence of co-speech gestures on the perception of dyadic dialogue in aphasic patients. In particular, we analysed the impact of co-speech gestures on gaze direction (towards speaker or listener) and fixation of body parts. We hypothesized that aphasic patients, who are restricted in verbal comprehension, adapt their visual exploration strategies. Methods: Sixteen aphasic patients and 23 healthy control subjects participated in the study. Visual exploration behaviour was measured by means of a contact-free infrared eye-tracker while subjects were watching videos depicting spontaneous dialogues between two individuals. Cumulative fixation duration and mean fixation duration were calculated for the factors co-speech gesture (present and absent), gaze direction (to the speaker or to the listener), and region of interest (ROI), including hands, face, and body. Results: Both aphasic patients and healthy controls mainly fixated the speaker’s face. We found a significant co-speech gesture x ROI interaction, indicating that the presence of a co-speech gesture encouraged subjects to look at the speaker. Further, there was a significant gaze direction x ROI x group interaction revealing that aphasic patients showed reduced cumulative fixation duration on the speaker’s face compared to healthy controls. Conclusion: Co-speech gestures guide the observer’s attention towards the speaker, the source of semantic input. It is discussed whether an underlying semantic processing deficit or a deficit to integrate audio-visual information may cause aphasic patients to explore less the speaker’s face. Keywords: Gestures, visual exploration, dialogue, aphasia, apraxia, eye movements

Item Type:

Audiovisual Material & Event (Movie)

Division/Institute:

04 Faculty of Medicine > University Psychiatric Services > University Hospital of Geriatric Psychiatry and Psychotherapy
04 Faculty of Medicine > Department of Head Organs and Neurology (DKNS) > Clinic of Neurology

Graduate School:

Graduate School for Health Sciences (GHS)

UniBE Contributor:

Preisig, Basil

Subjects:

600 Technology > 610 Medicine & health

Publisher:

researchsquare

Language:

German

Submitter:

Basil Preisig

Date Deposited:

14 Apr 2016 11:27

Last Modified:

14 Apr 2016 11:27

BORIS DOI:

10.7892/boris.80962

URI:

https://boris.unibe.ch/id/eprint/80962

Actions (login required)

Edit item Edit item
Provide Feedback