Abstract—In this study, we report the development of a virtual reality (VR) system that evaluates executive function based on cleaning behaviors in real-time. It is known that patients with acquired brain injuries present adverse symptoms such as attention, memory, and functional disorders, as well as aphasia. Current methods to evaluate acquired brain injuries include tests such as the behavioral assessment of the dysexecutive syndrome (BADS) and digital clinical assessment for attention (D-CAT) tests; however, these tests require special/specific toolkits, and the methods are rigorous when applied for real-time dynamic evaluation. Moreover, patients are often burdened by the need to undergo paper tests as required by the evaluation methods. In this context, we propose and verify the efficacy of a method that offers real-time dynamic evaluation of acquired brain injury based on daily-living activities such as cooking, cleaning, and shopping. In this study, we focus on executive function relating to acquired brain injury, and we propose a real-time dynamic evaluation method for executive functioning using VR, which enables the automatic evaluation of subjects’ table-cleaning behavior. Our results indicate that our system can automatically assess subjects’ table cleaning behavior based on BADS test, while affording a cleaning behavior maximum average accuracy of 75.5%.

Index Terms—Executive function evaluation, cleaning behavior recognition, virtual reality, cognitive training system.

Sho Ooi is with Faculty of Information Science and Engineering, Ritsumeikan University, 1-1-1 Nojihigashi, Kusatsu-shi Shiga, 525-8577 Japan. Akihito Mihara is with Graduate School of Information Science and Engineering, Osaka Institute of Technology, 1-79-1 Kitayama, Hirakata-shi Osaka, 573-0171 Japan. Mutsuo Sano is with Fuculty of Information Science and Engineering, Osaka Institute of Technology, 1-79-1 Kitayama, Hirakata-shi Osaka, 573-0171 Japan. Hajime Tabuchi and Fumie Saito are with School of Medicine, Keio University, 35 Shinanomachi, Shinjuku-ku Tokyo, 160-8585 Japan. Satoshi Umeda is with Department of Psychology, Keio University, 2-15-45 Mita, Minato-ku Tokyo, 108-0073 Japan.

Cite:Sho Ooi, Akihito Mihara, Mutsuo Sano, Hajime Tabuchi, Fumie Saito, Satoshi Umeda, "Executive Function Evaluation System Based on Wiping Desk Behavior in Virtual Space," International Journal of Computer and Communication Engineering vol. 9, no. 4, pp. 149-159, 2020.

Copyright © 2020 by the authors. This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).