Back to Journals » Advances in Medical Education and Practice » Volume 10

Augmented reality glasses improve adherence to evidence-based intubation practice

Authors Alismail A , Thomas J , Daher NS , Cohen A, Almutairi W, Terry MH, Huang C, Tan LD 

Received 16 January 2019

Accepted for publication 6 April 2019

Published 6 May 2019 Volume 2019:10 Pages 279—286

DOI https://doi.org/10.2147/AMEP.S201640

Checked for plagiarism Yes

Review by Single anonymous peer review

Peer reviewer comments 2

Editor who approved publication: Dr Md Anwarul Azim Majumder



Abdullah Alismail,1 Jonathan Thomas,2 Noha S Daher,3 Avi Cohen,4 Waleed Almutairi,1 Michael H Terry,1,5 Cynthia Huang,4 Laren D Tan1,4

1Cardiopulmonary Sciences Department, School of Allied Health Professions, Loma Linda University, Loma Linda, CA, USA; 2Zapara School of Business, La Sierra University, Riverside, CA, USA; 3Allied Health Studies, School of Allied Health Professoins, Loma Linda University, Loma Linda, CA, USA; 4Division of Pulmonary, Critical Care, Hyperbaric and Sleep Medicine, Department of Internal Medicine, Loma Linda University Medical Center, Loma Linda, CA, USA; 5Department of Respiratory Care, Loma Linda University Medical Center, Loma Linda, CA, USA

Background: The risk of failing or delaying endotracheal intubation in critically ill patients has commonly been associated with inadequate procedure preparation. Clinicians and trainees in simulation courses for tracheal intubation are encouraged to recall the steps of how to intubate in order to mitigate the risk of a failed intubation. The purpose of this study was to assess the effectiveness of using optical head mounted display augmented reality (AR) glasses as an assistance tool to perform intubation simulation procedure.
Methods: A total of 32 subjects with a mean age of 30±7.8, AR (n1=15) vs non-augmented reality(non-AR) (n2=17). The majority were males (n=22, 68.7%). Subjects were randomly assigned into two groups: the AR group and the non-AR group. Both groups reviewed a video on how to intubate following the New England Journal of Medicine (NEJM) intubation guidelines. The AR group had to intubate using the AR glasses head mount display compared to the non-AR where they performed regular intubation.
Results: The AR group took longer median (min, max) time (seconds) to ventilate than the non-AR group (280 (130,740) vs 205 (100,390); η2,=1.0, p=0.005, respectively). Similarly, there was a higher percent adherence of NEJM intubation checklist (100% in the AR group vs 82.4% in the non-AR group; η2,=1.8, p<0.001).
Conclusion: The AR glasses showed promise in assisting different health care professionals on endotracheal intubation simulation. Participants in the AR group took a longer time to ventilate but scored 100% in the developed checklist that followed the NEJM protocol. This finding shows that the AR technology can be used in a simulation setting and requires further study before clinical use.

Keywords: intubation, augmented reality, simulation, medical education

Introduction

The incidence of failed or delayed endotracheal intubation ranges from 1 in 1,000–2,000 cases in the elective setting,1,2 to 1 in 100 in the emergency department (ED).3,4 Acute respiratory failure and airway compromise are life-threatening moments in the critically ill patient. It often necessitates meticulous planning to reduce the rate of complications and maximize successful first-time intubation. While the curriculum for airway intubation differs among training programs, most undergo training through lecture-based presentations, videos, and hands-on simulations. At the same time, trainees and current practitioners are expected to recall steps of intubation to mitigate errors in endotracheal intubations; thus, using a checklist is recommended.5 A recent study by Miller6 supported the notion that simulation-based training was the more preferred training method for endotracheal intubations performed by respiratory therapists.6 Joffe, Liew, Olivar, Dagal, Grabinsky, Hallman, Treggiari7 reported in a national survey of airway management in the United States that most internal medicine and critical care programs have a formal airway management program utilizing simulation-based learning as a method of learning. In their report, almost 70% of the programs also used simulation-based training.7 McGaghie, Issenberg, Barsuk, Wayne8 reported how using simulation in medical education can improve technical skills in addition to interpersonal skills of the learner.8 As a result, simulation-based training is increasing among health care institutions as an effective and safe educational tool for health care providers.912 In fact, health care simulation is now considered to be an essential part of translational education research in medical education.13,14

The evolution of technology has enabled health care providers to access data efficiently and swiftly. In the realm of medical technological devices, the utilization of a medical device that can generate and enhance computer imagery is extremely beneficial to the proceduralist, trainee, and the educator. The purpose of this study was to evaluate the possibility and effectiveness of using optical head mounted display augmented reality (AR) glasses during endotracheal intubation simulation procedure. The AR glasses in this study were used to give real-time feedback to the learner while performing the procedure.

Methods

Ethical statement

This study was approved by the Institutional Review Board at Loma Linda University, Loma Linda, CA USA

Participants

A total of 32 subjects participated in this study. Participants were recruited from a health care medical center institution in Southern California. Participants represent a total of three professions (Medicine, Respiratory Care, and Sleep Technology). Subject enrolment was open to interested health care providers to participate as long as they have a minimum of Basic Life Support certification. Sleep technologists were allowed to join as they hold BLS certification and have taken an anatomy course of the airway. All participants provided their written informed consent to participate.

Design

Participants were randomized into two groups: AR group and non- augmented reality group (non-AR). The AR glasses used were AiRScouter WD-200B glasses developed by Brothers (Figure 1). The random allocation sequence was generated using an excel sheet. Both groups answered a questionnaire at baseline. The questionnaire covered demographic characteristics and questions about participant’s perception of the use of AR in intubation. The AR perception questions were ranked using a 4-point Likert scale (1= Strongly Disagree, 2= Disagree, 3= Agree, 4= Strongly Agree). All participants watched an educational video provided by the New England Medical Journal of Medicine (NEJM) on endotracheal intubation.15 AR subjects were given an instructional session on how to use the AR glasses. Participants were then divided into their perspective groups before performing the actual intubation on a manikin. In addition, equipment commonly available during intubations was provided during the simulation session for the participants to use (Figures 2 and 3).

Figure 1 AiRScouter WD-200B by Brothers (http://www.brother-usa.com/airscouter/). Not seen in the photo is the strap that connects to either of the headbands in the back. Label on this figure was added by the authors.17

Figure 2 Simulated view that the participant sees with AR glasses. The image area is approximated and can be adjusted by the viewer as needed. Participants are able to follow video image instructions to properly complete the procedure.

Figure 3 Picture showing how the AR glasses were used in the intubation procedure in terms of their position.

In the AR group, participants were trained on the use of the AR glasses until they were comfortable and familiar with the equipment (Figure 1). After training, research members reset the glasses to the manufacturer’s settings and then the participants were asked to start the procedure when they were ready.

The procedure would start once the participant places the AR glasses on his/her head (with the headband) and followed instructions that were projected on the eyepiece. The learner had a Bluetooth foot pedal that was connected to the glasses where they could control the real-time feedback PowerPoint slides. The presentation displayed on the AR glasses included intubation instructions as well as video graphics demonstrating proper intubation techniques. The PowerPoint slides contained a total of 14 slides all text instructions with three short instructional videos (Figure 2). The provided instructions were an adapted checklist that followed the NEJM intubation protocol.15 The research team developed a 17-point intubation checklist from the NEJM intubation video (Table 1). An observer from the research team timed the procedure from initiation to end while observing if participants adhered to the presented checklist in the eyepiece. Time to endotracheal intubation and ventilation were recorded as well. After the procedure was completed, participants were asked to fill out a validated post-AR experience survey that was developed by Santos et al, on the use of AR glasses.16 Figure 4 shows a diagram of the study design.

Table 1 17-point intubation checklist developed by the research team from the NEJM video

Figure 4 Study design.Abbreviations: NEJM, New England Journal of Medicine; AR, augmented reality.

In the non-AR group, participants were asked to start the intubation procedure after completing the questionnaire and watching the NEJM intubation video. Participants were required to audibly state every step they could recall from the NEJM video while performing the procedure. A research member recorded the procedure time from beginning to end and assessed the participants’ adherence to the checklist that was developed and adapted from the NEJM intubation protocol (Table 1). Time to endotracheal intubation and ventilation were recorded.

Data analyses

A sample size of 32 subjects was estimated using a large effect size of 0.9, power of 0.80, and level of significance of 0.05. Data were summarized using mean ± SD for quantitative variables and frequency (%) for categorical variables. The normality of the quantitative outcomes was assessed using the Kolmogorov–Smirnov Test. The distribution of characteristics of participants by study group was examined using Pearson’s chi-square test. An independent t-test was used to compare the mean age between the two study groups. Mann–Whitney Test was used to compare median time to ventilation and adherence between the two study groups. The level of significance was set at p≤0.05. Thematic analysis was used to analyze participants’ comments regarding the use of AR in the future for the AR group.

Results

A total of 32 subjects participated in this study with a mean age of 30±7.8 (Respiratory, n=19 (59.4%); Medical Doctor, n=11 (34.4%); Sleep Technology, n=2 (6.3%). The majority of the participants were males (n=22, 68.8%). There was no significant difference in baseline characteristics between the two groups (p>0.05, Table 2). The distribution of time to place the AR device on head and time for ventilation, and adherence were not approximately normal. There was a significant difference in median (min, max) time (seconds) to ventilate between AR and non-AR (280 (130,740) vs 205 (100,390); η2=1.0, p=0.005; Figure 5), respectively. Similarly, there was a significant difference in percent adherence to the intubation checklist between the two groups (100% in the AR group vs 82.4% in the non-AR group; η2=1.8, p<0.001). The most common intubation misses in the non-AR group in pre-intubation preparation were the removal of dentures, suction available, pulse oximeter, and blood pressure monitor. In the post-intubation checklist, the most common misses were securing tube, and forgetting to check the CO2 calorimeter.

Table 2 Frequency (%) of baseline characteristics of participants by study group (N=32)

Figure 5 Box and Whisker plot of time to ventilation by use of augmented reality glasses.

For baseline questionnaire on the subject’s perception of AR glasses, there was no significant difference in the perception of AR between the two groups (p>0.05), refer to Table 3.

Table 3 Median (min, max) of the baseline perceptiona of AR by study group

The majority of AR participants reported that they disagreed that the device caused fatigue, was bulky, heavy, and required additional work. Participants disagreed that the information that was displayed on the screen was difficult, confusing, displayed flickering, required additional body muscle work, and interfered with procedure skills. In addition, the majority of the AR participants agreed that the amount of information that was displayed was appropriate, fast, clear, easily understandable, and consistent. The application was comfortable for arm and hand, easy to control, and simple to operate (Table 4).

Table 4 Frequency (%) of post-AR perception from the AR group participants, N=13*

Participants’ comments showed an overarching theme, an effective education tool rather than actual use in the clinical setting. Following is a list of quotes that the participants provided: “The foot pedal was extremely slow to respond and often required several strong taps to change the slide on the PowerPoint. I felt that AR slowed me down as I already knew the next step that needed to be taken in the intubation procedure,” “feel that in certain procedures (like intubation) that are routinely done by some, using the AR is slowing us down, but I still consider it’s a great teaching tool”, “I believe the use of AR is helpful in the new coming learners. I as a person who has already learned how to intubate without the AR and has practiced intubating, it was hard not to get ahead of myself and stop to read the directions. I believe that this tool is and might be helpful for certain people but isn’t a complete replacement.”

Discussion

The objective of this study was to evaluate the effectiveness of using AR glasses as an assistance tool across different health care professions. Our findings indicate that using AR would have a significant positive impact in the simulation setting. Participants in the AR group had better adherence to the checklist compared to the non-AR group. To our knowledge, this is the first study to utilize AR glasses as a real-time feedback teaching and assistance tool during an intubation simulated procedure. The use of AR within the medical field has been evaluated and reported in other areas such as surgery and other bedside procedures.1821 Most of these reported evidence conclude that there is still a need to further evaluate the technology, and more studies are needed to show significant effectiveness in clinical practice. However, when comparing these findings to medical education, several studies showed real promise and effectiveness for student learner. Ma, Fallavollita, Seelbach, Von Der Heide, Euler, Waschke, Navab22 studied AR as a tool for anatomy education where they developed a “magic mirror” prototype for the learner. Their findings showed future promise on the use of AR technology in terms of anatomy education for medical students.22 Moro, Stromberga, Raikos, Stirling23 on the other hand evaluated the same domain, teaching anatomy for health science students, and evaluated the effectiveness of AR technology vs other technologies such as virtual reality (VR) and Tablet-based education. Positive results were also reported regarding the effectiveness of AR in teaching anatomy to health science learners. In addition, AR use did not show any significant side-effects such as headache and dizziness when compared to VR.23 Jeon, Choi, Kim24 evaluated the use of AR in ultrasound-guided vascular access in a randomized study. They found a significant decrease in time and number of redirections of vascular access to this technology. Wilson, Doswell, Fashola, Debeatham, Darko, Walker, Danner, Matthews, Weaver25 studied the use of AR as clinical support to treat tension pneumothoraces. Their study was similar to ours where they had two groups (Control vs AR) but measured different outcomes (ie, treating an emergency situation, tension pneumothorax in the battlefield using human cadavers). They found that participants in the AR group had a better odds ratio when it comes to their competency in performing needle decompression for tension pneumothorax. These findings are consistent with our study as our AR group resulted in the better adaption of the checklist and less errors (100% vs 82%).

Overall, based on our results, there is promise for the use of AR technology in medical education for health care professionals. The AR group was able to achieve 100% adherence to the NEJM intubation checklist.15 However, time to ventilation for the AR group was significantly longer as this was primarily due to the fact that the AR group had to read and follow real-time instructions projected on the glasses. These findings translate the effectiveness of AR use in an educational setting instead of real-life procedures. Therefore, future studies should evaluate the actual implementation of such technology within the curriculum of health care programs to understand it better. Other examples where AR can be tested and used within several health care professions are: 1) in the field of Respiratory Care (eg, arterial blood gas draws, intubation); 2) in the field of sleep studies (eg, electroencephalography placements). Kamphuis, Barsom, Schijven, Christoph26 shared great potential research questions future researchers should consider when implementing such a tool. An example of a question related to curriculum implementation: “What factors influence the implementation of an AR training system in a curriculum and how does that affect learning?”26

The findings of this study mimic the finding of a previously published study by the authors on the effectiveness of AR as an educational method in the simulation.27 The results of these two studies show how the use of advanced technology such as AR can enhance learning in advanced procedures such as intubation and central line placements.

Our study had some limitations. The factor of user experience and profession was not taken into consideration in group randomization. In the AR group, participants had less human intubation experience when compared to the non-AR group (46.7% vs 60%). This might explain why the AR group took a longer time in the procedure to ventilate. Another possibility of this delay is the amount of information being displayed in the glasses. Thus, a larger prospective study with balanced intubation experience in addition to evaluating the amount of information being displayed is warranted to provide stronger evidence on the use of AR as an endotracheal intubation tool.

Conclusion

Based on our findings, AR showed promise in assisting different health care professionals in endotracheal intubation simulation. Participants in the AR group had a long time to ventilate but also scored 100% in the developed checklist that followed NEJM endotracheal intubation protocol.

Acknowledgments

We are indebted to Brother International Corp., Bridgewater, NJ, USA, for providing the glasses to the study and Tom & Vi Zapara School of Business at La Sierra University on their collaboration and support.

Disclosure

The authors report no conflict of interest in this work.

References

1. Samsoon GL, Young JR. Difficult tracheal intubation: a retrospective study. Anaesthesia. 1987;42(5):487–490.

2. Rose DK, Cohen MM. The airway: problems and predictions in 18,500 patients. Can J Anaesth. 1994;41(5 Pt 1):372–383. doi:10.1007/BF03009858

3. Sakles JC, Laurin EG, Rantapaa AA, Panacek EA. Airway management in the emergency department: a one-year study of 610 tracheal intubations. Ann Emerg Med. 1998;31(3):325–332.

4. Goto T, Gibo K, Hagiwara Y, et al. Multiple failed intubation attempts are associated with decreased success rates on the first rescue intubation in the emergency department: a retrospective analysis of multicentre observational data. Scand J Trauma Resusc Emerg Med. 2015;23:5. doi:10.1186/s13049-014-0085-8

5. Cook TM, Woodall N, Harper J, Benger J; Fourth National Audit P. Major complications of airway management in the UK: results of the Fourth National Audit Project of the Royal College of Anaesthetists and the Difficult Airway Society. Part 2: intensive care and emergency departments. Br J Anaesth. 2011;106(5):632–642. doi:10.1093/bja/aer059

6. Miller AG. Endotracheal intubation training and skill maintenance for respiratory therapists. Respir Care. 2017;62(2):156–162. doi:10.4187/respcare.05037

7. Joffe AM, Liew EC, Olivar H, et al. A national survey of airway management training in United States internal medicine-based critical care fellowship programs. Respir Care. 2012;57(7):1084–1088. doi:10.4187/respcare.01540

8. McGaghie WC, Issenberg SB, Barsuk JH, Wayne DB. A critical review of simulation-based mastery learning with translational outcomes. Med Educ. 2014;48(4):375–385. doi:10.1111/medu.12391

9. Shrader S, Kostoff M, Shin T, et al. Using communication technology to enhance interprofessional education simulations. Am J Pharm Educ. 2016;80(1):13. doi:10.5688/ajpe80113

10. Singer BD, Corbridge TC, Schroedl CJ, et al. First-year residents outperform third-year residents after simulation-based education in critical care medicine. Simul Healthc. 2013;8(2):67–71. doi:10.1097/SIH.0b013e31827744f2

11. Schroedl CJ, Corbridge TC, Cohen ER, et al. Use of simulation-based education to improve resident learning and patient care in the medical intensive care unit: a randomized trial. J Crit Care. 2012;27(2):219.e217-213. doi:10.1016/j.jcrc.2011.08.006

12. Nestel D, Groom J, Eikeland-Husebo S, O’Donnell JM. Simulation for learning and teaching procedural skills: the state of the science. Simul Healthc. 2011;6 Suppl:S10–S13. doi:10.1097/SIH.0b013e318227ce96

13. Santen SA, Deiorio NM, Gruppen LD. Medical education research in the context of translational science. Acad Emerg Med. 2012;19(12):1323–1327. doi:10.1111/acem.12040

14. McGaghie WC, Issenberg SB, Cohen ER, Barsuk JH, Wayne DB. Translational educational research: a necessity for effective health-care improvement. Chest. 2012;142(5):1097–1103. doi:10.1378/chest.12-0148

15. Kabrhel C, Thomsen TW, Setnik GS, Walls RM. Orotracheal intubation. N Engl J Med. 2007;356(17):e15. doi:10.1056/NEJMc063190

16. Santos ME, Polvi J, Taketomi T, Yamamoto G, Sandor C, Kato H. Toward standard usability questionnaires for handheld augmented reality. IEEE Comput Graph Appl. 2015;35(5):66–75. doi:10.1109/MCG.2015.94

17. USA B. AirScouter WD-200B. AirScouter, editor. Available from: http://www.brother-usa.com/airscouter/

18. Teber D, Guven S, Simpfendorfer T, et al. Augmented reality: a new tool to improve surgical accuracy during laparoscopic partial nephrectomy? Preliminary in vitro and in vivo results. Eur Urol. 2009;56(2):332–338. doi:10.1016/j.eururo.2009.05.017

19. Su LM, Vagvolgyi BP, Agarwal R, Reiley CE, Taylor RH, Hager GD. Augmented reality during robot-assisted laparoscopic partial nephrectomy: toward real-time 3D-CT to stereoscopic video registration. Urology. 2009;73(4):896–900. doi:10.1016/j.urology.2008.11.040

20. Souzaki R, Ieiri S, Uemura M, et al. An augmented reality navigation system for pediatric oncologic surgery based on preoperative CT and MRI images. J Pediatr Surg. 2013;48(12):2479–2483. doi:10.1016/j.jpedsurg.2013.08.025

21. Caversaccio M, Garcia Giraldez J, Thoranaghatte R, et al. Augmented reality endoscopic system (ARES): preliminary results. Rhinology. 2008;46(2):156–158.

22. Ma M, Fallavollita P, Seelbach I, et al. Personalized augmented reality for anatomy education. Clin Anat. 2016;29(4):446–453. doi:10.1002/ca.22675

23. Moro C, Stromberga Z, Raikos A, Stirling A. The effectiveness of virtual and augmented reality in health sciences and medical anatomy. Anat Sci Educ. 2017;10(6):549–559. doi:10.1002/ase.1696

24. Jeon Y, Choi S, Kim H. Evaluation of a simplified augmented reality device for ultrasound-guided vascular access in a vascular phantom. J Clin Anesth. 2014;26(6):485–489. doi:10.1016/j.jclinane.2014.02.010

25. Wilson KL, Doswell JT, Fashola OS, et al. Using augmented reality as a clinical support tool to assist combat medics in the treatment of tension pneumothoraces. Mil Med. 2013;178(9):981–985. doi:10.7205/MILMED-D-13-00074

26. Kamphuis C, Barsom E, Schijven M, Christoph N. Augmented reality in medical education? Perspect Med Educ. 2014;3(4):300–311. doi:10.1007/s40037-013-0107-7

27. Huang CY, Thomas JB, Alismail A, et al. The use of augmented reality glasses in central line simulation: “see one, simulate many, do one competently, and teach everyone”. Adv Med Educ Pract. 2018;9:357–363. doi:10.2147/AMEP.S160704

Creative Commons License © 2019 The Author(s). This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.