Is it possible to use highly realistic virtual reality in the elderly? A feasibility study with image-based rendering
Authors Benoit M, Guerchouche R, Petit PD, Chapoulie E, Manera V, Chaurasia G, Drettakis G, Robert P
Received 24 August 2014
Accepted for publication 17 October 2014
Published 3 March 2015 Volume 2015:11 Pages 557—563
Checked for plagiarism Yes
Review by Single anonymous peer review
Peer reviewer comments 5
Editor who approved publication: Dr Roger Pinder
Michel Benoit,1,2 Rachid Guerchouche,3 Pierre-David Petit,1 Emmanuelle Chapoulie,3 Valeria Manera,1 Gaurav Chaurasia,3 George Drettakis,3 Philippe Robert1,4
1EA CoBTeK/IA, University of Nice Sophia Antipolis, 2Clinique de Psychiatrie, Pole des Neurosciences Cliniques, CHU de Nice, 3Institut National de Recherche en Informatique et en Automatique, Sophia-Antipolis, 4Centre Mémoire de Ressources et de Recherche, CHU de Nice, Nice, France
Background: Virtual reality (VR) opens up a vast number of possibilities in many domains of therapy. The primary objective of the present study was to evaluate the acceptability for elderly subjects of a VR experience using the image-based rendering virtual environment (IBVE) approach and secondly to test the hypothesis that visual cues using VR may enhance the generation of autobiographical memories.
Methods: Eighteen healthy volunteers (mean age 68.2 years) presenting memory complaints with a Mini-Mental State Examination score higher than 27 and no history of neuropsychiatric disease were included. Participants were asked to perform an autobiographical fluency task in four conditions. The first condition was a baseline grey screen, the second was a photograph of a well-known location in the participant’s home city (FamPhoto), and the last two conditions displayed VR, ie, a familiar image-based virtual environment (FamIBVE) consisting of an image-based representation of a known landmark square in the center of the city of experimentation (Nice) and an unknown image-based virtual environment (UnknoIBVE), which was captured in a public housing neighborhood containing unrecognizable building fronts. After each of the four experimental conditions, participants filled in self-report questionnaires to assess the task acceptability (levels of emotion, motivation, security, fatigue, and familiarity). CyberSickness and Presence questionnaires were also assessed after the two VR conditions. Autobiographical memory was assessed using a verbal fluency task and quality of the recollection was assessed using the “remember/know” procedure.
Results: All subjects completed the experiment. Sense of security and fatigue were not significantly different between the conditions with and without VR. The FamPhoto condition yielded a higher emotion score than the other conditions (P<0.05). The CyberSickness questionnaire showed that participants did not experience sickness during the experiment across the VR conditions. VR stimulates autobiographical memory, as demonstrated by the increased total number of responses on the autobiographical fluency task and the increased number of conscious recollections of memories for familiar versus unknown scenes (P<0.01).
Conclusion: The study indicates that VR using the FamIBVE system is well tolerated by the elderly. VR can also stimulate recollections of autobiographical memory and convey familiarity of a given scene, which is an essential requirement for use of VR during reminiscence therapy.
Keywords: memory, elderly, virtual reality, image-based rendering, immersive environment, reminiscence therapy
Information and communication technologies (ICT) have proved to be useful in assessing and evaluating patients’ functional impairments, as well as in helping and supporting patients in everyday activities.1,2 Furthermore, ICT can play a key role in the stimulation and rehabilitation of disabled patients. For instance, Smartphones3 or SenseCams allowing capture of the subject’s personal experience have been shown to help retrieval in patients with memory difficulties.4 The use of ICT in cognitive disorders is expected, since it is recognized that these disorders are frequent in the elderly, play a major part in individual adaptation to the environment, and contribute to a poorer quality of life.
Virtual reality (VR), defined as a computer-simulated environment that can provide the sensation of physical presence in places representing real or imagined worlds, opens up a vast number of additional possibilities in many domains of therapy, including rehabilitation such as post-traumatic stress disorder5 and cognition6,7 and in many domains of therapy.6–10 Despite the fact that computer-based neuropsychological assessment is extensively used in elderly population,11 surprisingly few studies of VR have included old subjects.
Some factors associated with old age have been assumed to limit the use of VR in this population, such as coping with computerized or virtual environments, engagement in rigid procedures, and age-related or pathological cognitive impairment. These factors may contribute to higher interindividual differences in ICT tasks than with traditional (verbal, page-pencil) assessments.12 It has also been suggested that psychological factors would limit the use of VR in a population that is often seen as less involved in new technologies. Even if a cohort effect is frequently found with the use of many technical appliances, old people may engage in new tasks after a period of gradual familiarization, even when affected by cognitive disorders.13 Age-related physical limitations, such as retardation or sickness, might also limit the use of very reactive virtual environments. In contrast, most procedures may be adapted to compensate for individual slowness, making it possible to measure and take into account motion sickness before interpretation of the performance. This beneficial effect of VR with regard to compensating for physical deficit has been particularly demonstrated in severe clinical situations, such as stroke rehabilitation.14,15 Therefore, there is no rationale to keep old people away from new technologies, but it is necessary to confirm that they can accept a virtual environment and interact cognitively with it.
Among the cognitive functions, autobiographical memory has not been tested with old-age people in a virtual environment. Stimulation of autobiographical memory might be used for reminiscence therapy, which has demonstrated its efficacy in the non-pharmacological treatment of dementia.
Autobiographical memory is one of the essential components of human memory. It is defined as mental representations of events from one’s past and semantic information about the self.16 The retrieval of autobiographical memories is a complex process in which mental traces of past events and related semantic knowledge are shaped into mental representations in light of current goals and concerns. These mental representations can differ across many qualities, including their content, imagery, degree of consciousness, and emotional intensity. Autobiographical memories contribute to the development of a coherent sense of ourselves, our emotions, and our future plans,17 and play a major role in motivating behavior and in daily life. Episodic autobiographical memory, in particular the richness of detail, is impaired early in the course of Alzheimer’s disease and perhaps even in the preclinical phase, while semantic memories are preserved until the more advanced stages, indicating a dissociation between both memory systems.18,19
Autobiographical memories are one of the processes targeted by reminiscence therapy. Reminiscence therapy consists of discussion of past activities, events, and experiences with another person or group of people, usually with the aid of tangible prompts, such as photographs, household and other familiar items from the past, and music or archive sound recordings. Reminiscence therapy is one of the most popular psychosocial interventions in dementia care, and is highly rated by staff and participants. A review of the literature shows some improvement of functional ability in people with dementia but the number of well controlled studies in the field is limited.20
One of the most effective ways in which reminiscence therapy can be used to trigger autobiographical memories is the use of words and visual or other sensory cues. VR may be a promising tool in reminiscence therapy because of its visual realism and high degree of immersion. However, to our knowledge, no specific study has been conducted so far to test the potential value of VR specifically for reminiscence therapy. One possible reason for this lack of research is that it is very difficult to create a virtual environment that is sufficiently realistic and related to the subject’s history, for example, highly realistic three-dimensional places that are familiar to users. Manually creating such models specifically for the individual user is expensive and time-consuming, and often does not result in virtual images of sufficient realism. Another possible reason is that the more realistic the VR, the greater the chances of developing side effects, the most frequent of which is cybersickness,21 a form of motion sickness with symptoms reported to include nausea, vomiting, eyestrain, disorientation, ataxia, vertigo, and drowsiness.
This pilot study evaluated the acceptability to elderly subjects of a VR experience using the image-based rendering virtual environment (IBVE) approach.22 In order to test VR, we used an experiment inspired by reminiscence therapy which is known to help in the generation of autobiographical memories.
Materials and methods
Participants and clinical assessment
Participants were 18 healthy older volunteers recruited by the Nice Memory Center. At the time of inclusion, subjects underwent a clinical examination including screening for motor and visual deficiencies. Subjects were included if they had memory problems and a Mini-Mental State Examination score23 higher than 27. Subjects were not included if they had a clinical history of neuropsychiatric disease, dementia, or vision difficulties. Ethical approval was obtained from an Individuals Protection Committee. Initial assessment included the Mini-Mental State Examination, Short Cognitive Battery,24 Frontal Assessment Battery,25 Apathy Inventory,26 and Unified Parkinson’s Disease Rating Scale.27
Experimental conditions and systems technology
Participants were presented with four experimental conditions (Figure 1). Two conditions did not use VR (gray/FamPhoto) and the two other conditions included VR, one being familiar (FamIBVE) and one being unknown (UnknoIBVE). The subjects spent a maximum of 15 minutes in the VR conditions (ie, 7 minutes in each VR condition). After each condition, participants were asked whether they recognized the environment that had been presented. The VR hardware setup was located in the INRIA (Institut National de Recherche en Informatique et en Automatique) Sophia Antipolis center (Figure 2).
Figure 2 Hardware setup used for the experiments.
One of the technical challenges of this type of project is the development and use of an image-based rendering system22 that can easily capture and display a familiar and personalized environment with photographs as a starting point. The system also provides support for near-normal interaction with objects in the environment with finger tracking. At the time of the experiment, development of the image-based rendering algorithm we used was limited to a single screen, so we used only the front wall of a BARCO iSpace for our experiments. The size of the screen is 320 cm ×240 cm with a display resolution of 1,600×1,200 pixels. The projectors use passive Infitec stereo via glasses that are tracked using the ART tracking system (Advanced Realtime Tracking GmbH, Weilheim in Oberbayern, Germany).
Questionnaires, other dependent measures, data analysis
After exposure to each of the four experimental conditions, participants completed up to five self-report questionnaires assessing acceptability (levels of emotion, motivation, security, fatigue, and familiarity). These questionnaires were devised using classical Likert scale methodology (a horizontal line, on which a subject indicates his or her response by checking tick marks between 0 and 10). CyberSickness and Presence questionnaires were only completed after the two VR conditions, and were tested respectively with the 22-item Cybersickness questionnaire,28 and the general and spatial presence questionnaire.29 The questionnaire scores are explained in the notes for Table 1.
In order to assess autobiographical memories, we adapted the autobiographical fluency task30 to the context of the experiment. Subjects were placed in an experimental room, and while presented with visual material, they were asked to generate as many autobiographical memories as possible related to the presented environment in 2 minutes using short sentences. At the end of the session, the investigator assessed the quality of the recollection using the “remember/know” procedure.31 Each subject was asked to indicate for each of his/her recollections if he/she remembered it (conscious recollection of many vivid contextual details, such as “when” and “how” the information was learned) or if he/she knew it (the sensation that the event/environment had been seen before, but not being able to identify the reason why). The subject’s verbal outputs were directly recorded during the experiment and analyzed after the session by a speech therapist blinded to the research protocol. The score derived included the number of memories and number of remember and know recollections.
The statistical analysis was carried out using Statistical Package for the Social Sciences version 11.0 software (SPSS Inc., Chicago, IL, USA) with a significance level of 0.05. Values are expressed as the mean ± standard deviation. Mean comparisons between the conditions were performed using the Wilcoxon non-parametric test.
Eighteen healthy subjects (eleven men, seven women; mean age 68.2±7.8 years) were included (Table 2). Cognitive performance was in the normal range after controlling for age and educational level, and participants had no symptomatology on the Apathy Inventory or Unified Parkinson’s Disease Rating Scale. All subjects completed the experiment. Five participants were excluded from the autobiographical memory analysis because they were not living in Nice or surrounding area, so did not recognize the familiar town pictures.
Table 1 shows the acceptability and autobiographical memory results in the four conditions. Sense of security and fatigue were not significantly different between the four conditions. Motivation during the baseline (gray) condition was significantly lower than in the other conditions (P<0.05), motivation not different between the VR conditions and FamPhoto condition. The FamPhoto condition yielded a higher emotion score than the other conditions (P<0.05).
For the two VR conditions, data from the CyberSickness questionnaire indicated that participants did not experience important sickness (0, no cybersickness; 6, significant cybersickness) with UnknoIBVE (mean 0.46±0.1) or FamIBVE (mean 1.42±0.3). Scores on the Presence questionnaire were in the medium range (on a scale from 0 to 84). There were no significant differences between the two conditions for either the CyberSickness (P=0.11) or Presence (P=0.24) questionnaire.
Concerning the autobiographical fluency task, the total number of responses in the FamIBVE and FamPhoto conditions were significantly (P<0.05) higher than those in the gray and UnknoIBVE conditions. The number of “remember” responses was also significantly higher in the FamIBVE and FamPhoto conditions (P<0.01) than those observed in the gray and UnknoIBVE conditions. No other comparisons reached statistical significance.
This pilot study indicates that it is possible to use VR environments with elderly subjects. As reported in the questionnaires, the subjects felt that virtual environments were secure and did not report any significant fatigue. None of the subjects dropped out during the study. During the conditions employing VR, the degree of cybersickness, which is one classical weakness of the technique, was very low. This result was probably reinforced by the physical apparatus used (a chair) in the immersive room, allowing the participants to be seated beside a professional during the experience.
We also wanted to test the hypothesis that visual cues provided by VR can enhance the production of autobiographical memories, and more specifically that cues involving an environment related to the subject’s personal biography might generate better memory performance than a neutral environment.
Our results indicate that VR using IBVE stimulates autobiographical memory, as demonstrated by the increased total number of responses, as well as by the increased number of conscious recollections of memories for familiar versus unknown scenes. From a technical standpoint, the higher number of memories generated with FamIBVE than with UnknoIBVE is an indication that the IBVE system is able to convey familiarity in the immersive setting, but only when the environment is related to the individual’s personal history. However, performance observed with the VR environment was not superior to performance observed with a static photograph. One possible explanation relates to technical limitations arising from the use of a single screen (Figure 2). This restriction conducted to use a limited narrow field of view to allow a presentation at scale 1 of the environment on the screen. In contrast with the narrow field offered in the VR condition, the field of view of the photograph was much larger, offering the potential to elicit more emotion and memories.
Future studies should investigate whether this interpretation is correct. For instance, we expect that use of IBVE will increase when multiple screens become available, since the field of view will be much larger. This technical improvement will allow capturing in the VR environment, photographs with a larger field of view and offer a higher immersion experience.
This preliminary study has several limitations. We did not include a control group tested in a classical environment without any technological interface. Due to the non-availability of the experimental room in a clinical setting, the number of participants was small. The autobiographical memory results suggest that it may be interesting to use this VR system in a therapeutic context, for instance in patients with memory impairment, such as Alzheimer’s disease. However, we only included healthy elderly volunteers in the present study.
In conclusion, from a clinical perspective, the results of this study underline two main points. First, IBVE is suitable for use in the elderly. Second, use of VR can stimulate recollections of autobiographical memory. This pilot study will help to develop another experiment using virtual environment with patients in a real-care setting in order to confirm its promise for clinical care.
This study was supported by a grant from the FP7 European Commission Seventh Framework Programme VERVE project (Vanquishing fear and apathy through e-inclusion: http://www.verveconsortium.com/), by the Innovation Alzheimer Association, and by the French Region of Provence Alpes Cote d’Azur.
The authors report no conflicts of interest in this work.
Robert PH, Konig A, Andrieu S, et al. Recommendations for ICT use in Alzheimer’s disease assessment: Monaco CTAD expert meeting. J Nutr Health Aging. 2013;17(8):653–660.
Wichers M, Simons CJ, Kramer IM, et al. Momentary assessment technology as a tool to help patients with depression help themselves. Acta Psychiatr Scand. 2011;124(4):262–272.
Leo G, De Brivio E, Sautter S. Supporting autobiographical memory in patients with Alzheimer’s disease using smart phones. Appl Neuropsychol. 2011;18(1):69–76.
Browne G, Berry E, Kapur N, et al. SenseCam improves memory for recent events and quality of life in a patient with memory retrieval difficulties. Memory. 2011;19(7):713–722.
Rothbaum BO, Hodges LF, Ready D, Graap K, Alarcon RD. Virtual reality exposure therapy for Vietnam veterans with posttraumatic stress disorder. J Clin Psychiatry. 2001;62(8):617–622.
Rizzo A, Buckwalter J, Neumann U, Kesselman C, Thiebaux M. Basic issues in the application of virtual reality for the assessment and rehabilitation of cognitive impairments and functional dis abilities. Cyberpsychol Behav. 1998;1(1):59–78.
Plancher G, Tirard A, Gyselinck V, Nicolas S, Piolino P. Using virtual reality to characterize episodic memory profiles in amnestic mild cognitive impairment and Alzheimer’s disease: influence of active and passive encoding. Neuropsychologia. 2012;50(5):592–602.
Rizzo A, Kim G. A SWOT analysis of the field of VR rehabilitation and therapy. Presence. 2005;14:119–146.
Werner P, Rabinowitz S, Klinger E, Korczyn AD, Josman N. Use of the virtual action planning supermarket for the diagnosis of mild cognitive impairment: a preliminary study. Dement Geriatr Cogn Disord. 2009;27(4):301–309.
Plancher G, Barra J, Orriols E, Piolino P. The influence of action on episodic memory: a virtual reality study. Q J Exp Psychol A. 2013;66(5):895–909.
Parsey CM, Schmitter-Edgecombe M. Applications of technology in neuropsychological assessment. Clin Neuropsychol. 2013;27(8):1328–1361.
Chen C. Individual differences in a spatial-semantic virtual environment. J Am Soc Inf Sci. 2000;51:529–542.
Cohen-Mansfield J, Dakheel-Ali M, Marx MS. Engagement in persons with dementia: the concept and its measurement. Am J Geriatr Psychiatry. 2009;17(4):299–307.
Chung C, Pollock A, Campbell T, Durward B, Hagen S. Cognitive rehabilitation for executive dysfunction in adults with stroke or other adult nonprogressive acquired brain damage. Stroke. 2013;44(7):e77–e78.
Laver K, George S, Ratcliffe J, Crotty M. Virtual reality stroke rehabilitation – hype or hope? Aust Occup Ther J. 2011;58(3):215–219.
Conway A. Memory and the self. J Mem Lang. 2005;53(4):594–628.
Bluck S. Autobiographical memory: exploring its functions in everyday life. Memory. 2003;11(2):113–123.
Seidl U, Lueken U, Thomann PA, Geider J, Schroder J. Autobiographical memory deficits in Alzheimer’s disease. J Alzheimers Disease. 2011;27(3):567–574.
Berna F, Schonknecht P, Seidl U, Toro P, Schroder J. Episodic autobiographical memory in normal aging and mild cognitive impairment: a population-based study. Psychiatry Res. 2012;200(2–3):807–812.
Woods B, Spector A, Jones C, Orrell M, Davies S. Reminiscence therapy for dementia. Cochrane Database Syst Rev. 2005;2:CD001120.
Cobb S, Nichols S, Ramsey A, Wilson J. Virtual reality-induced symptoms and effects. Presence. 1999;8:169–186.
Chaurasia G, Duchene S, Sorkine Hornung O, Drettakis G. Depth synthesis and local warps for plausible image-based navigation. ACM Trans Graph. 2013;32(3):1–30.
Folstein MF, Folstein SE, McHugh PR. ‘Mini-mental test’. A practical method for grading the cognitive state of patients for the clinician. J Psychiatry Res. 1975;12:189–198.
Robert PH, Schuck S, Dubois B, et al. Screening for Alzheimer’s disease with the Short Cognitive Evaluation Battery. Dement Geriatr Cogn Disord. 2003;15(2):92–98.
Dubois B, Slachevsky A, Litvan I, Pillon B. The FAB: a Frontal Assessment Battery at bedside. Neurology. 2000;55(11):1621–1626.
Robert PH, Clairet S, Benoit M, et al. The apathy inventory: assessment of apathy and awareness in Alzheimer’s disease, Parkinson’s disease and mild cognitive impairment. Int J Geriatr Psychiatry. 2002;17(12):1099–1105.
Goetz CG, Tilley BC, Shaftman SR, et al. Movement Disorder Society-sponsored revision of the Unified Parkinson’s Disease Rating Scale (MDS-UPDRS): scale presentation and clinimetric testing results. Mov Disord. 2008;23(15):2129–2170.
Viaud-Delmon I, Ivanenko YP, Berthoz A, Jouvent R. Adaptation as a sensorial profile in trait anxiety: a study with virtual reality. J Anxiety Disord. 2000;14(6):583–601.
Schubert T, Friedmann F, Regenbrecht H. The experience of presence: factor analytic insights. Presence. 2001;10(3):266–281.
Dritschel BH, Williams JM, Baddeley AD, Nimmo-Smith I. Autobiographical fluency: a method for the study of personal memory. Mem Cognit. 1992;20(2):133–140.
Gardiner JM, Ramponi C, Richardson-Klavehn A. Experiences of remembering, knowing, and guessing. Conscious Cogn. 1998;7(1):1–26.
This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.Download Article [PDF]