Multimodal Pragmatic Markers of Feedback in Dialogue

Historically, the field of discourse marker research has moved from relying on intuition to more and more ecological data, with written, spoken, and now multimodal corpora available to study these pervasive pragmatic devices. For some topics, video is necessary to capture the complexity of interacti...

Full description

Saved in:
Bibliographic Details
Main Authors: Ludivine Crible, Loulou Kosmala
Format: Article
Language:English
Published: MDPI AG 2025-05-01
Series:Languages
Subjects:
Online Access:https://www.mdpi.com/2226-471X/10/6/117
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1839653522307547136
author Ludivine Crible
Loulou Kosmala
author_facet Ludivine Crible
Loulou Kosmala
author_sort Ludivine Crible
collection DOAJ
description Historically, the field of discourse marker research has moved from relying on intuition to more and more ecological data, with written, spoken, and now multimodal corpora available to study these pervasive pragmatic devices. For some topics, video is necessary to capture the complexity of interactive phenomena, such as feedback in dialogue. Feedback is the process of communicating engagement, alignment, and affiliation (or lack thereof) to the other speaker, and has attracted a lot of attention recently, from fields such as psycholinguistics, conversation analysis, or second language acquisition. Feedback can be expressed by a variety of verbal/vocal and visual/gestural devices, from questions to head nods and, crucially, discourse or pragmatic markers such as “okay, alright, yeah”. Verbal-vocal and visual-gestural forms often co-occur, which calls for more investigation of their combinations. In this study, we analyze multimodal pragmatic markers of feedback in a corpus of French dialogues, where all feedback devices have previously been categorized into either “alignment” (expression of mutual understanding) or “affiliation” (expression of shared stance). After describing the distribution and forms within each modality taken separately, we will focus on interesting multimodal combinations, such as [negative <i>oui</i> ‘yes’ + head tilt] or [<i>mais oui</i> ‘but yes’ + forward head move], thus showing how the visual modality can affect the semantics of verbal markers. In doing so, we will contribute to defining multimodal pragmatic markers, a status which has so far been restricted to verbal markers and manual gestures, at the expense of other devices in the visual modality.
format Article
id doaj-art-4e566c34e98a43fab0462be1f7fb0ff9
institution Matheson Library
issn 2226-471X
language English
publishDate 2025-05-01
publisher MDPI AG
record_format Article
series Languages
spelling doaj-art-4e566c34e98a43fab0462be1f7fb0ff92025-06-25T14:05:16ZengMDPI AGLanguages2226-471X2025-05-0110611710.3390/languages10060117Multimodal Pragmatic Markers of Feedback in DialogueLudivine Crible0Loulou Kosmala1Faculty of Arts and Philosophy, Ghent University, 9000 Ghent, BelgiumEnglish Department, Université Paris-Est Créteil, 94000 Créteil, FranceHistorically, the field of discourse marker research has moved from relying on intuition to more and more ecological data, with written, spoken, and now multimodal corpora available to study these pervasive pragmatic devices. For some topics, video is necessary to capture the complexity of interactive phenomena, such as feedback in dialogue. Feedback is the process of communicating engagement, alignment, and affiliation (or lack thereof) to the other speaker, and has attracted a lot of attention recently, from fields such as psycholinguistics, conversation analysis, or second language acquisition. Feedback can be expressed by a variety of verbal/vocal and visual/gestural devices, from questions to head nods and, crucially, discourse or pragmatic markers such as “okay, alright, yeah”. Verbal-vocal and visual-gestural forms often co-occur, which calls for more investigation of their combinations. In this study, we analyze multimodal pragmatic markers of feedback in a corpus of French dialogues, where all feedback devices have previously been categorized into either “alignment” (expression of mutual understanding) or “affiliation” (expression of shared stance). After describing the distribution and forms within each modality taken separately, we will focus on interesting multimodal combinations, such as [negative <i>oui</i> ‘yes’ + head tilt] or [<i>mais oui</i> ‘but yes’ + forward head move], thus showing how the visual modality can affect the semantics of verbal markers. In doing so, we will contribute to defining multimodal pragmatic markers, a status which has so far been restricted to verbal markers and manual gestures, at the expense of other devices in the visual modality.https://www.mdpi.com/2226-471X/10/6/117pragmatic markersalignmentmultimodalityconversational French
spellingShingle Ludivine Crible
Loulou Kosmala
Multimodal Pragmatic Markers of Feedback in Dialogue
Languages
pragmatic markers
alignment
multimodality
conversational French
title Multimodal Pragmatic Markers of Feedback in Dialogue
title_full Multimodal Pragmatic Markers of Feedback in Dialogue
title_fullStr Multimodal Pragmatic Markers of Feedback in Dialogue
title_full_unstemmed Multimodal Pragmatic Markers of Feedback in Dialogue
title_short Multimodal Pragmatic Markers of Feedback in Dialogue
title_sort multimodal pragmatic markers of feedback in dialogue
topic pragmatic markers
alignment
multimodality
conversational French
url https://www.mdpi.com/2226-471X/10/6/117
work_keys_str_mv AT ludivinecrible multimodalpragmaticmarkersoffeedbackindialogue
AT louloukosmala multimodalpragmaticmarkersoffeedbackindialogue