Multimodal perspectives on communication with face masks in times of covid-19
DOI:
https://doi.org/10.29397/reciis.v18i3.4314Keywords:
Talk-in-interaction, Face masks, Covid-19, Intercorporeality, IntersynesthesiaAbstract
Recent studies on talk-in-interaction emphasize the intercorporeal holistic nature of human action. Given that our everyday communication had changed profoundly during the covid-19 pandemic, considering the interactional constraints related to our limited mobility, social distancing, and the use of face masks, we pose the following question in this article: What happens when the use of face masks blocks important parts of interactional fluency and how do interactants deal with it? Through collection, transcription, and analysis of data from videos from the first months after the outbreak, the following results were revealed: (a) raising of the eyebrow as a marker of focal accent; (b) enlargement of gestural space and frequent use of beat gestures, when social distancing and mask-wearing are at play; (c) at a micro level, compensation for the loss of facial expression due to mask-wearing, through intonational cues.
References
ALLWOOD, Jens. Bodily communication dimensions of expression and content. In: GRANSTRÖM, Björn; HOUSE, David; KARLSSON, Inger. (ed.). Multimodality in language and speech systems. Dordrecht: Springer, 2002. p. 7-26. DOI: https://doi.org/10.1007/978-94-017-2367-1_2. Disponível em: https://link.springer.com/chapter/10.1007/978-94-017-2367-1_2. Acesso em: 2 set. 2024.
BAVELAS, Janet; GERWING, Jennifer; HEALING, Sara. Including facial gestures in gesture-speech ensembles. In: SEYFEDDINIPUR, Mandana; GULLBERG, Marianne (ed.). From gesture in conversation to visible action as utterance. Amsterdam; Filadélfia: John Benjamins, 2014. p. 15-34. DOI: https://doi.org/10.1075/z.188.02bav. Disponível em: https://benjamins.com/catalog/z.188.02bav. Acesso em: 2 set. 2024.
BRESSEM, Jana; MÜLLER, Cornelia. A repertoire of German recurrent gestures with pragmatic functions. In: MÜLLER, Cornelia et al. (org.). Body – Language – Communication: an international handbook on multimodality in human interaction. Berlim: De Gruyter Mouton, 2014. v. 1. p. 1575-1591. DOI: https://doi.org/10.1515/9783110302028.1575. Disponível em: https://www.degruyter.com/document/doi/10.1515/9783110302028.1575/html. Acesso em: 2 set. 2024.
CARBON, Claus-Christian. Wearing face masks strongly confuses counterparts in reading emotions. PsyArXiv Preprints, 2020. Preprint. DOI: https://doi.org/10.31234/osf.io/x3uh6. Disponível em: https://psyarxiv.com/x3uh6/. Acesso em: 5 out. 2020.
COUPER-KUHLEN, Elizabeth; SELTING, Margret. Interactional linguistics: studying language in social interaction. Cambridge: Cambridge University Press, 2018.
COUPER-KUHLEN, Elizabeth; SELTING, Margret (ed.). Prosody in conversation. interactional studies. Cambridge; Nova Iorque: Cambridge University Press, 1996. DOI: https://doi.org/10.1017/CBO9780511597862. Disponível em: https://www.cambridge.org/core/books/prosody-in-conversation/8AA48A4FB98505F2AD5BB6D501B7B05A. Acesso em: 2 set. 2024.
DE VOS, Jonas. The effect of covid-19 and subsequent social distancing on travel behavior. Transportation Research Interdisciplinary Perspectives, [s. l.], v. 5, maio 2020. DOI: https://doi.org/10.1016/j.trip.2020.100121. Disponível em: https://www.sciencedirect.com/science/article/pii/S2590198220300324?via%3Dihub. Acesso em: 5 out. 2020.
EN CUBA: obligatorio usar nasobuco en el transporte público. [S. l.: s. n.], 28 mar. 2020. 1 vídeo (1m56s). Publicado pelo Canal Caribe. Disponível em: https://youtu.be/tU1p3P_vTOU?si=UWmVR0FD1vxuYLGb. Acesso em: 15 abr. 2024.
FLECHA-GARCÍA, María L. Eyebrow raises in dialogue and their relation to discourse structure, utterance function, and pitch accents in English. Speech Communication, [s. l.], v. 52, n. 6, p. 542-554, jun. 2010. DOI: http://dx.doi.org/10.1016/j.specom.2009.12.003. Disponível em: https://www.sciencedirect.com/science/article/pii/S0167639309001782?via%3Dihub. Acesso em: 5 out. 2020.
GONÇALVES, Sineide. Interação 2020CLBrPSF1. [S. l.: s. n.], 27 jan. 2022. 1 vídeo (47s). Publicado pelo canal Dra. Sineide Gonçalves. Disponível em: https://www.youtube.com/watch?v=D18aF9j_hDo. Acesso em: 15 abr. 2024.
GOODWIN, Charles. Conversational organization: interaction between speakers and hearers (Language, thought, and culture). Nova Iorque: Academic Press, 1981.
GOODWIN, Charles. Gesture as a resource for the organization of mutual orientation. Semiotica, [s. l.], v. 62, n. 1-2, p. 29-49, 1986. DOI: https://doi.org/10.1515/semi.1986.62.1-2.29. Disponível em: https://www.degruyter.com/document/doi/10.1515/semi.1986.62.1-2.29. Acesso em: 12 set. 2024.
HALL, Edward T. A system for the notation of proxemic behavior. American Anthropologist, [s. l.], v. 65, n. 5, p. 1003-1026, out. 1963. Disponível em: https://e-edu.nbu.bg/pluginfile.php/1261108/mod_resource/content/1/Edward%20Hall%20-%20A%20System%20for%20the%20Notation%20of%20Proxemic%20Behavior%201963.pdf. Acesso em: 5 out. 2020.
KATILA, Julia; GAN, Yumei; GOODWIN, Marjorie H. Interaction rituals and ‘social distancing’: New haptic trajectories and touching from a distance in the time of Covid-19. Discourse Studies, [s. l.], v. 22, n. 4, p. 418-440, 2020. DOI: https://doi.org/10.1177/1461445620928213. Disponível em: https://journals.sagepub.com/doi/10.1177/1461445620928213. Acesso em: 5 out. 2020.
KENDON, Adam. Conducting interaction: Patterns of behavior in focused encounters. Cambridge: Cambridge University Press, 1990.
KENDON, Adam. Gesture: visible action as utterance. Cambridge: Cambridge University Press, 2004.
MCNEILL, David. Gesture and thought. Chicago: University of Chicago Press, 2005.
MCNEILL, David. Hand and mind: what gestures reveal about thought. Chicago: University of Chicago Press, 1992.
MCNEILL, David. Why we gesture: the surprising role of hand movements in communication. Cambridge: Cambridge University Press, 2016. DOI: https://psycnet.apa.org/doi/10.1017/CBO9781316480526. Disponível em: https://www.cambridge.org/core/books/why-we-gesture/5A54FFD659C12DEBDB7A4718ECB7687C. Acesso em: 2 set. 2024.
MDR. Interview mit einem Friseur. [S. l.: s. n.], 2020. 1 vídeo. Disponível em: https://www.youtube.com/watch?v=pNtv_dcnG88. Acesso em: 5 set. 2020.
MENDEL, Lisa Lucks; GARDINO, Julie A.; ATCHERSON, Samuel R. Speech understanding using surgical masks: a problem in health care? Journal of American Academy of Audiology, Burlington, v. 19, n. 9, p. 686-695, 2008. DOI: https://doi.org/10.3766/jaaa.19.9.4. Disponível em: https://www.memphis.edu/spal/pdfs/2008mendel_et_al_speech_understanding.pdf. Acesso em: 5 out. 2020.
MEYER, Christian; STREECK, Jürgen; JORDAN, J. Scott. Introduction. In: MEYER, Christian; STREECK, Jürgen; JORDAN, J. Scott. (ed.). Incorporeality: emerging socialities in interaction. Nova Iorque: Oxford University Press, 2017.
SCHRÖDER, Ulrike et al. Um sistema para transcrever a fala-em-interação: GAT 2. Veredas – Revista de Estudos Linguísticos, Juiz de Fora, v. 20, n. 2, p. 6-61, 2016. Disponível em: https://periodicos.ufjf.br/index.php/veredas/article/view/28203. Acesso em: 2 set. 2024.
SELTING, Margret. Lists as embedded structures and the prosody of lists construction as an interactional resource. InLiSt: Interaction and Linguistic Structures, [s. l.], n. 35, p. 1-65, 2003. Disponível em: https://d-nb.info/1079796010/34. Acesso em: 5 out. 2020.
SELTING, Margret et al. A system for transcribing talk-in-interaction: GAT 2. Gesprächsforschung: Online-Zeitschrift Zur Verbalen Interaktion, [s. l.], n. 12, v. p. 1-51, 2011. Disponível em: http://www.gespraechsforschung-online.de/fileadmin/dateien/heft2011/px-gat2-englisch.pdf. Acesso em: 2 set. 2024.
STIVERS, Tanya. Stance, alignment, and affiliation during storytelling: when nodding is a token of affiliation. Research on Language & Social Interaction, [s. l.], v. 41, n. 1, p. 31-57, 2008. DOI: https://doi.org/10.1080/08351810701691123. Disponível em: https://www.tandfonline.com/doi/full/10.1080/08351810701691123. Acesso em: 5 out. 2020.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Ulrike Agathe Schröder, Anna Ladilova, Sineide Gonçalves, Fernanda Roque Amendoeira

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Author’s rights: The author retains unrestricted rights over his work.
Rights to reuse: Reciis adopts the Creative Commons License, CC BY-NC non-commercial attribution according to the Policy on Open Access to Knowledge by Oswaldo Cruz Foundation. With this license, access, download, copy, print, share, reuse, and distribution of articles is allowed, provided that it is for non-commercial use and with source citation, granting proper authorship credits and reference to Reciis. In such cases, no permission is required from the authors or editors.
Rights of authors’s deposit / self-archiving: The authors are encouraged to deposit the published version, along with the link of their article in Reciis, in institutional repositories.