TY - ABST

T1 - Emotional displays when blind people encounter problems with new technology

AU - Due, Brian Lystgaard

AU - Nielsen, Ann Merrit Rikke

N1 - Conference code: 18

PY - 2023

Y1 - 2023

N2 - People with visual impairment (PVI) increasingly use mainstream technologies, such as smart phones and digital assistants featuring AI in their everyday lives. The PVI’s limited visual access can prove challenging whenlearning to use these technologies. This paper explores how PVI manage their conduct when they encounter problems with using new technology and how this leads to e.g. frustration, anger or self-consciousness, observable in interaction as emotional displays (Local & Walker, 2008; Ruusuvuori, 2012). The paper examines the interaction between the researcher, the AI, and the PVI in the face of two types of problems: when things go wrong due to faulty technology and when things go wrong due to the participants inability to utilize the technology correctly due to their visual impairment. Data are video ethnographic recordings of people born with or with late blindness who are testing or using the Google Home assistant in their homes and the Seeing AI app for shopping for the first time. Participants are equipped with the new technologies but their use of it is naturally organized in situ, producing the data as semi-experimental. The users can be considered ‘atypical’ not just due to their visually impairment but also due to their novices status with respect to technology used, leading to recurrent trial-and-error sequences. By applying EMCA (Streeck et al., 2011) to video recordings of these settings we explore PVI’s practices for managing conduct in the face of challenges with the use of new tech as well astheir multimodally displayed emotional stance when partaking in these complex activities. This paper discusses the methodological consequences of designing research projects that put participants “on the spot” in new types of situations affects and contributes methodologically with reflections on and suggestions for conducting video ethnographic studies of atypical populations and use of new tech. The paper also contributes to EMCA research into emotional displays as observable in interaction.Goodwin, C. (2007). Participation, Stance and Affect in the Organization of Activities. Discourse and society,18(1), 53–74.Goodwin, C., & Goodwin, M. H. (2000). Emotion within Situated Activity. I Duranti (ed.) Linguistic Anthropology:A Reader. (s. 239–257). Malden, MA, Oxford, Blackwell.Goodwin, M. H., Cekaite, A., Goodwin, C., & Tulbert, E. (2011). Emotion as Stance. I A. Peräkylä & M-L. Sorjônen(eds.) Emotion in interaction. Oxford University Press.Local, J., & Walker, G. (2008). Stance and affect in conversation: On the interplay of sequential and phoneticresources. Text & Talk, 28(6), 723–747. https://doi.org/10.1515/TEXT.2008.037Peräkylä, A., & Sorjonen, M.-L. (2012). Emotion in Interaction (Illustrated edition). OUP USA.Ruusuvuori, J. (2012). Emotion, Affect and Conversation. I The Handbook of Conversation Analysis (s. 330–349).John Wiley & Sons, Ltd. https://doi.org/10.1002/9781118325001.ch16Streeck, J., Goodwin, C., & LeBaron, C. D. (2011). Embodied interaction: Language and body in the material world/. University Press.

AB - People with visual impairment (PVI) increasingly use mainstream technologies, such as smart phones and digital assistants featuring AI in their everyday lives. The PVI’s limited visual access can prove challenging whenlearning to use these technologies. This paper explores how PVI manage their conduct when they encounter problems with using new technology and how this leads to e.g. frustration, anger or self-consciousness, observable in interaction as emotional displays (Local & Walker, 2008; Ruusuvuori, 2012). The paper examines the interaction between the researcher, the AI, and the PVI in the face of two types of problems: when things go wrong due to faulty technology and when things go wrong due to the participants inability to utilize the technology correctly due to their visual impairment. Data are video ethnographic recordings of people born with or with late blindness who are testing or using the Google Home assistant in their homes and the Seeing AI app for shopping for the first time. Participants are equipped with the new technologies but their use of it is naturally organized in situ, producing the data as semi-experimental. The users can be considered ‘atypical’ not just due to their visually impairment but also due to their novices status with respect to technology used, leading to recurrent trial-and-error sequences. By applying EMCA (Streeck et al., 2011) to video recordings of these settings we explore PVI’s practices for managing conduct in the face of challenges with the use of new tech as well astheir multimodally displayed emotional stance when partaking in these complex activities. This paper discusses the methodological consequences of designing research projects that put participants “on the spot” in new types of situations affects and contributes methodologically with reflections on and suggestions for conducting video ethnographic studies of atypical populations and use of new tech. The paper also contributes to EMCA research into emotional displays as observable in interaction.Goodwin, C. (2007). Participation, Stance and Affect in the Organization of Activities. Discourse and society,18(1), 53–74.Goodwin, C., & Goodwin, M. H. (2000). Emotion within Situated Activity. I Duranti (ed.) Linguistic Anthropology:A Reader. (s. 239–257). Malden, MA, Oxford, Blackwell.Goodwin, M. H., Cekaite, A., Goodwin, C., & Tulbert, E. (2011). Emotion as Stance. I A. Peräkylä & M-L. Sorjônen(eds.) Emotion in interaction. Oxford University Press.Local, J., & Walker, G. (2008). Stance and affect in conversation: On the interplay of sequential and phoneticresources. Text & Talk, 28(6), 723–747. https://doi.org/10.1515/TEXT.2008.037Peräkylä, A., & Sorjonen, M.-L. (2012). Emotion in Interaction (Illustrated edition). OUP USA.Ruusuvuori, J. (2012). Emotion, Affect and Conversation. I The Handbook of Conversation Analysis (s. 330–349).John Wiley & Sons, Ltd. https://doi.org/10.1002/9781118325001.ch16Streeck, J., Goodwin, C., & LeBaron, C. D. (2011). Embodied interaction: Language and body in the material world/. University Press.

M3 - Conference abstract for conference

Y2 - 9 July 2023 through 14 July 2023

ER -