Exploring Deaf And Hard of Hearing Peoples' Perspectives On Tasks In Augmented Reality: Interacting With 3D Objects And Instructional Comprehension

Sanzida Mojib Luna, Jiangnan Xu, Garreth W. Tigwell, Nicolas LaLone, Michael Saker, Alan Chamberlain, David I. Schwartz, Konstantinos Papangelis

Research output: Chapter in Book/Report/Conference proceedingConference Proceeding (ISBN)

1 Citation (Scopus)

Abstract

Tasks in augmented reality (AR), such as 3D interaction and instructional comprehension, are often designed for users with uniform sensory abilities. Such an approach, however, can overlook the more nuanced needs of Deaf and Hard of Hearing (DHH) users who might have reduced auditory perception. To better understand these challenges, our study utilized the single-player AR game Angry Birds AR as a probe to explore how 11 DHH participants and 15 hearing participants experienced AR interactions. Our findings highlight that DHH users prefer interaction based on context, effective haptic cues, audio cue substitutes, and clear instructional design. We, therefore, propose the following design recommendations to enhance the accessibility of AR for DHH users. This includes customizable UI options, modular feedback systems, and virtual avatars for sign language instructions.
Original languageEnglish
Title of host publicationProceedings of the 2025 CHI Conference on Human Factors in Computing Systems
EditorsNaomi Yamashita, Vanessa Evers, Koji Yatani, Xianghua (Sharon) Ding, Bongshin Lee, Mashini Chetty, Phoebe Toups-Dugas
Place of PublicationNew York, NY, USA
PublisherAssociation for Computing Machinery
Pages1-14
Number of pages14
ISBN (Print)9798400713941
DOIs
Publication statusPublished - 25 Apr 2025
EventCHI '25: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems - Yokohama, Japan
Duration: 26 Apr 202501 May 2025

Publication series

NameCHI '25
PublisherAssociation for Computing Machinery

Conference

ConferenceCHI '25: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems
Country/TerritoryJapan
CityYokohama
Period26 Apr 202501 May 2025

Keywords

  • Deaf and Hard of Hearing
  • Augmented Reality
  • Accessibility
  • Accessible AR

Fingerprint

Dive into the research topics of 'Exploring Deaf And Hard of Hearing Peoples' Perspectives On Tasks In Augmented Reality: Interacting With 3D Objects And Instructional Comprehension'. Together they form a unique fingerprint.

Cite this