Background:

Traditional neurocognitive assessment methods predominantly rely on paper-and-pencil tests, which are often subjective and susceptible to biases in interpretation. These limitations necessitate a more objective approach to cognitive assessment. Virtual reality (VR) presents a promising solution by offering an immersive and controlled environment where cognitive functions can be evaluated with increased precision. By integrating physiological data, including eye-tracking and speech analysis, into VR-based assessments, we can gain deeper insights into cognitive processes. Machine learning models applied to this data further enhance the objectivity of the evaluation, allowing for precise detection of cognitive patterns and abnormalities.

Research Objectives:

The primary goal of this project is to develop a virtual clinic that serves as a neurocognitive assessment tool while also facilitating the study of team dynamics between healthcare professionals. Additionally, we aim to investigate the role and influence of an intelligent virtual agent within this collaborative environment. Our team has successfully built the foundational platform for the virtual clinic, and we now seek to expand its functionalities to support collaborative diagnosis and decision-making processes.

Research Plan:

(1) Enable multi-user collaboration (2) Implement an intelligent virtual agent capable of guiding users, offering medical insights, and influencing decision-making dynamics within the collaborative environment (3) Develop interactive scenarios where healthcare professionals work together to diagnose a patient (4) Design experiments, collect and analyze physiological and behavioral data

REU Student Outcomes:

This research project is well-suited for students with programming skills. The selected students will gain hands-on experience in VR technologies. Additionally, the student will be involved in experimental design, learning how to structure research methodologies for cognitive and behavioral studies. Students will be supervised by Dr. Faisal Aqlan and participate in writing conference and journal papers.