A CONTACTLESS GESTURE INTERFACE AS A WAY TO PROVIDE ACCESSIBILITY TO SELF-SERVICE KIOSKS FOR WHEELCHAIR USERS

Authors

DOI:

https://doi.org/10.32782/uad.2025.1.6

Keywords:

inclusive design, contactless gesture interface, accessibility of interactive displays, gesture recognition, public interactive self-service kiosks

Abstract

The aim of this article is to explore the potential of contactless gesture interfaces as an effective means of ensuring an inclusive digital environment for wheelchair users. The main focus is on analyzing the possibilities of implementing gesture interfaces in public interactive self-service kiosks, their impact on technology accessibility, user experience, and the adaptation of such systems to the needs of individuals with physical disabilities. The concept of inclusivity is examined as a fundamental principle in the development of accessible technologies. The article also discusses the concept of inclusive design, which involves creating products and environments that can be used by the widest possible range of people, regardless of their physical or cognitive limitations. Key aspects of adapting self-service kiosks to the needs of people with disabilities are identified. The study examines the challenges faced by users with limited mobility when interacting with self-service kiosks and analyzes existing solutions in gesture recognition technology. Their potential for developing an inclusive interface is evaluated. As part of the research, two prototypes of contactless gesture interfaces were developed, utilizing different approaches to gesture control. The usability and user perception of these interfaces were analyzed. The study also includes the development of recommendations for creating gesture-based interfaces. The proposed results can be used to improve interaction technologies in digital self-service kiosks, contributing to their enhanced accessibility and ensuring a comfortable experience for all user categories.

References

TensorFlow. About. URL: https://www.tensorflow.org/about (дата звернення: 27.01.2025).

Wobbrock J.O., Gajos K.Z., Kane S.K., Vanderheiden G.C. Ability-Based Design. Communications of the ACM. 2018. Vol. 61, No. 6. P. 62–71. DOI: https://doi.org/10.1145/3148051.

Tullis T., Albert B. Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics. 2nd ed. Morgan Kaufmann Publishers, 2013. P. 333.

Veijalainen A.-M. Breaking barriers: Accessible self-service kiosks for everyone. URL: https://api.semanticscholar.org/CorpusID:169007172 (дата звернення: 06.11.2024).

Maguire M.C. A Review of User-Interface Design Guidelines for Public Information Kiosk Systems. International Journal of Human-Computer Studies. 1999. Vol. 50, No. 3. P. 263–286. DOI: https://doi.org/10.1006/ijhc.1998.0243.

Siebenhandl K., Schreder G., Smuc M., Mayr E, A User-Centered Design Approach to Self-Service Ticket Vending Machines. IEEE Transactions on Professional Communication. 2013. Vol. 56, No. 2. P. 138–159. DOI: https://doi.org/10.1109/TPC.2013.2257213.

Allen J., Chudley J. Smashing UX Design: Foundations for Designing Online User Experiences. John Wiley & Sons, Ltd, 2012. P. 14

Newell A. User-Sensitive Design for Older and Disabled People. 2008. URL: https://www.researchgate.net/publication/229710245_User-Sensitive_Design_for_Older_and_Disabled_People (дата звернення: 27.01.2025).

Юзабіліті. Вікіпедія: вільна енциклопедія. URL: https://uk.wikipedia.org/wiki/%D0%AE%D0%B7%D0%B0%D0%B1%D1%96%D0%BB%D1%96%D1%82%D1%96 (дата звернення: 15.01.2025).

Hartson R., Pyla P. The UX Book: Process and Guidelines for Ensuring a Quality User Experience. Morgan Kaufmann Publishers, 2012. P. 24-26

Mueller J. Accessibility for Everybody: Understanding the Section 508 Accessibility Requirements. Appress, 2003. P. 104–105

Touchless experiences. Ultraleap. URL: https://www.ultraleap.com/enterprise/touchless-experiences/ (дата звернення: 31.12.2024).

Kelsen K. Unleashing the Power of Digital Signage: Content Strategies for the 5th Screen. Elsevier, 2010. P. 221-223

Koceski S., Koceska N. Vision-Based Gesture Recognition for Human-Computer Interaction and Mobile Robot’s Freight Ramp Control. Proceedings of the International Conference on Information Technology Interfaces, ITI. 2010. P. 289–294. DOI: https://doi.org/10.1109/ITI.2010.5543653.

Microsoft Design. Inclusive Design Toolkit Manual. 2016. URL: https://download.microsoft.com/download/B/0/D/B0D4BF87-09CE-4417-8F28-D60703D672ED/INCLUSIVE_TOOLKIT_MANUAL_FINAL.pdf (дата звернення: 31.10.2024).

Krueger, M. Artificial Reality II. Reading: Addison-Wesley, 1991. 320 с.

Bragdon A., DeLine R., Hinckley K., Morris M. Code Space. Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces. 2011. P. 212–221. DOI: https://doi.org/10.1145/2076354.2076393.

Ahlström D., Hasan K., Irani P. Are You Comfortable Doing That? Proceedings of the 16th International Conference on Human-Computer Interaction with Mobile Devices & Services – MobileHCI ’14. 2014. DOI: https://doi.org/10.1145/2628363.2628381.

Nagy R., Kucherenko T., Moell B., Pereira A., Kjellström H., Bernardet U. A Framework for Integrating Gesture Generation Models into Interactive Conversational Agents. arXiv preprint. 2021. arXiv:2102.12302.

Vuletic T., Duffy A., Hay L., McTeague C., Campbell G., Grealy M. Systematic Literature Review of Hand Gestures Used in Human-Computer Interaction Interfaces. International Journal of Human-Computer Studies. 2019. Vol. 129. P. 74–94. DOI: https://doi.org/10.1016/j.ijhcs.2019.03.005.

Cruz P.J., Vásconez J.P., Romero R., Chico A., Benalcázar M.E., Álvarez R., López L.I.B., Caraguay L.V. A Deep Q-Network Based Hand Gesture Recognition System for Control of Robotic Platforms. Scientific Reports. 2023. Vol. 13. P. 795. DOI: https://doi.org/10.1038/s41598-023-27448-8.

Wachs J., Stern H., Edan Y., Gillam M., Feied C., Smith M., Handler J. Gestix: A Doctor-Computer Sterile Gesture Interface for Dynamic Environments. Proceedings of the International Conference on Human-Computer Interaction, Beijing, China. 22–27 July 2007.

Interactive kiosk. Wikipedia. URL: https://en.wikipedia.org/wiki/Interactive_kiosk (дата звернення: 30.11.2024).

MirrorTouch: Combining Touch and Mid-Air Gestures for Public Displays. DOI: https://doi.org/10.1145/2628363.2628379.

Parra O., España S., Panach J.I., Pastor O. An Empirical Comparative Evaluation of gestUI to Include Gesture-Based Interaction in User Interfaces. Science of Computer Programming. 2019. Vol. 172. P. 232–263. DOI: https://doi.org/10.1016/j.scico.2019.07.004.

Study on the Design of a Non-Contact Interaction System Using Gestures: Framework and Case Study. Sustainability. DOI: 10.3390/su16219335.

Yang Y., Shen S., Lui K., Lee K., Chen J., Ding H., Liu L., Lu H., Duan L., Wang C. et al. Ultrasonic Robotic System for Noncontact Small Object Manipulation Based on Kinect Gesture Control. International Journal of Advanced Robotic Systems. 2017. Vol. 14. P. 1–7. DOI: https://doi.org/10.1177/1729881417738739.

Feng Y., Uchidiuno U.A., Zahiri H.R., George I., Park A.E., Mentis H. Comparison of Kinect and Leap Motion for Intraoperative Image Interaction. Surgical Innovation. 2020. Vol. 28. P. 33–40. DOI: https://doi.org/10.1177/1553350620947206.

Zhang N., Zhang J., Jiang S., Ge W. The Effects of Layout Order on Interface Complexity: An Eye-Tracking Study for Dashboard Design. Sensors. 2024. Vol. 24, No. 18. P. 5966. DOI: https://doi.org/10.3390/s24185966.

Saffer D. Designing Gestural Interfaces. 1st ed. O’Reilly Media, Sebastopol, CA, 2008. 218 p.

ADA Standards for Accessible Design. Kiosk. URL: https://kiosk.com (дата звернення: 23.10.2024).

Published

2025-03-31

How to Cite

Hrushovskyi Т. І. (2025). A CONTACTLESS GESTURE INTERFACE AS A WAY TO PROVIDE ACCESSIBILITY TO SELF-SERVICE KIOSKS FOR WHEELCHAIR USERS. Ukrainian Art Discourse, (1), 63–74. https://doi.org/10.32782/uad.2025.1.6

Issue

Section

Статті