Back to Journals » Journal of Multidisciplinary Healthcare » Volume 14

Zero-Heat-Flux and Esophageal Temperature Monitoring in Orthopedic Surgery: An Observational Study

Authors Munday J , Higgins N , Jones L, Vagenas D, Van Zundert A , Keogh S

Received 13 April 2021

Accepted for publication 14 June 2021

Published 12 July 2021 Volume 2021:14 Pages 1819—1827


Checked for plagiarism Yes

Review by Single anonymous peer review

Peer reviewer comments 3

Editor who approved publication: Dr Scott Fraser

Judy Munday,1,2 Niall Higgins,1,3 Lee Jones,1,4 Dimitrios Vagenas,4 André Van Zundert,1,5,6 Samantha Keogh1,3

1School of Nursing & Centre for Healthcare Transformation, Faculty of Health, Queensland University of Technology, Kelvin Grove, QLD, Australia; 2Department of Health and Nursing Science, Faculty of Health and Sports Sciences, University of Agder, Grimstad, Norway; 3Royal Brisbane and Women’s Hospital, Herston, QLD, Australia; 4Research Methods Group, Institute of Health and Biomedical Innovation (IHBI), Faculty of Health, Queensland University of Technology, Kelvin Grove, QLD, Australia; 5Department of Anaesthesia and Perioperative Medicine, Royal Brisbane and Women’s Hospital, Brisbane, QLD, Australia; 6School of Medicine, The University of Queensland, Brisbane, Australia & Queensland University of Technology, Brisbane, QLD, Australia

Correspondence: Judy Munday
School of Nursing & Centre for Healthcare Transformation, Queensland University of Technology, Rm 529, Level 5, N Block, Kelvin Grove, QLD, 4059, Australia
Tel +61 73138 8209
Fax +61 3138 3814
Email [email protected]

Purpose: Perioperative hypothermia prevention requires regular, accurate, and consistent temperature monitoring. Zero-heat-flux (ZHF) thermometry offers a non-invasive, measurement method that can be applied across all surgical phases. The purpose of this study was to measure agreement between the zero-heat-flux device and esophageal monitoring, sensitivity, and specificity to detect hypothermia and patient acceptability amongst patients undergoing upper and lower limb orthopedic surgery.
Patients and Methods: This prospective, observational study utilized Bland–Altman analysis and Lin’s concordance coefficient to measure agreement between devices, sensitivity and specificity to detect hypothermia and assessed patient acceptability amongst 30 patients between December 2018 and June 2019.
Results: Bias was observed between devices via Bland Altman, with bias dependent on actual temperature. The mean difference ranged from − 0.16°C at 34.9°C (where the mean of ZHF was lower than the esophageal device) to 0.46°C at 37.25°C (where the mean of ZHF was higher than esophageal device), with 95% limits of agreement (max) upper LOA = 0.80 to 1.41, lower LOA = − 1.12 to − 0.50. Seventy-five percentage of zero-heat-flux measurements were within 0.5°C of esophageal readings. Patient acceptability was high; 96% (n=27) stated that the device was comfortable.
Conclusion: ZHF device achieved lesser measurement accuracy with core (esophageal) temperature compared to earlier findings. Nonetheless, due to continuous capability, non-invasiveness and patient reported acceptability, the device warrants further evaluation.
Title Registration: The study was registered at (reference: ACTRN12619000842167).

Keywords: perioperative, thermoregulation, thermometry, sensitivity, specificity


Regular, accurate body temperature monitoring is vital to detect early disturbance in core temperature1–3 and prevent perioperative hypothermia3 or hyperthermia.2 Core temperature is tightly regulated, and even mild perioperative hypothermia is associated with adverse consequences.3–9 The lack of accurate, user-friendly temperature monitoring devices is a known barrier to optimum thermoregulation practices across the multidisciplinary perioperative pathway.10,11 International guidelines specify that temperature measurement is conducted at specific, regular intervals, using a consistent device.3 Yet temperature monitoring is often neglected entirely,12 or poorly implemented10,12,13 with multiple devices employed across perioperative phases. Non-invasive devices to estimate core temperature (using correction factors) are predominantly utilized despite unreliability and being easily influenced by operator inefficiency. Until recently, the most accurate devices have been invasive, expensive, and only suitable for anesthetized patients.14

Non-invasive yet accurate temperature measurement devices, suitable for both awake and anesthetized patients across all perioperative phases, have potential to facilitate improved monitoring practices amongst multidisciplinary perioperative health-care providers. The non-invasive zero-heat-flux (ZHF) temperature monitoring device (Bair Hugger™, 3M, St Paul, MN, USA) offers continuous capability for both awake and anesthetized patients. Introduced almost fifty years ago, initial use remained limited due to practical drawbacks.15 However, current and updated ZHF devices, with more efficient calibration and lightweight design15 are now widely available. The device measures tissue temperature at 1–2 cm below the skin surface of the forehead, and is considered an indirect measurement of core temperature.16

The device has been validated in populations including cardiac surgery,15,17,18 gynecology,19,20 trauma,19 major abdominal surgery,21,22 neurosurgery,23 vascular,17 urologic,22 and combined elective surgeries.24,25 A recent meta-analysis compared the device to core temperature in 22 comparisons from 16 studies: the pooled estimate for mean bias was 0.03°C,16 however the clinical utility of the device was not evaluated. Limited studies have assessed the accuracy of the device during orthopedic surgery, nor have studies assessed patient acceptability. Ideally, measurement accuracy and agreement are tested against gold standard pulmonary artery (PA) temperatures obtained through a Swan-Ganz catheter.15,18 Esophageal temperature monitoring is more commonly utilized and provides a reliable but invasive mode of core temperature measurement1,26 closely correlated to PA temperature in anaesthetized patients.27

This prospective, observational study utilized esophageal temperature as an adequate comparison to determine accuracy with the Bair Hugger™ ZHF device, for patients undergoing elective orthopedic surgery. Specifically, we aimed to establish measurement accuracy as the primary outcome. Secondary outcomes include sensitivity and specificity to detect hypothermia, and patient acceptability of the device.

Materials and Methods


Full ethical approval for this observational study was obtained from the Royal Brisbane and Women’s Hospital (RBWH) Human Research Ethics Committee (HREC) on 17th September 2018 (reference DM/MDF/DEF/42859) and administrative approval was obtained from Queensland University of Technology (QUT) HREC. The study was conducted in accordance with the Declaration of Helsinki. The study was registered at (reference: ACTRN12619000842167) and is reported according to the Standards for Reporting Diagnostic Accuracy Studies (STARD).28

Participants, Recruitment, and Setting

A priori, a total of 30 participants were recruited at a large, metropolitan hospital in South East Queensland, Australia, between December 2018 and June 2019. All participants were adults over 18 years of age undergoing elective orthopedic upper or lower limb surgery under general anesthesia, with endotracheal tube (ET) placement and esophageal temperature monitoring. Patients were excluded if they presented with forehead/neck rash or infection, or had known esophageal varices, or an American Society of Anesthesiologists (ASA) Physical Status class >III. A priori, participants experiencing unexpected blood loss were not eligible for inclusion, with planned exclusion after enrolment (however, no patients were excluded on this basis). After providing informed consent on admission, participants meeting the inclusion criteria were enrolled in the study upon arrival for surgery.

Study Protocol

All 30 participants received similar general anesthetic procedure and technique. Standard monitoring, including electrocardiogram (ECG), pulse oximetry, and non-invasive blood pressure (NIBP) were attached, as per usual care. All patients received a warmed cotton blanket, fluid warming to 38.5°C via Biegler™ fluid warmer (Bauerbach, Austria) and full or partial body forced air warming, dependent upon surgical site, commencing at 47°C and then automatically decreasing to 45°C, as per the study protocol (and as per normal operating function of the Covidien Warm Touch™ forced air warmer). Ambient temperature was recorded in preoperative areas and the operating theatre (OT).

Temperature Monitoring

Upon arrival to the preoperative area, prior to anesthesia induction, the independent Research Nurse attached a single use, adhesive, disposable Bair Hugger™ ZHF sensor to the forehead, above the orbital ridge. The adhesive pad comprises a thermal insulator, covered by an electric heater. Heat flow through the insulator is eliminated by the servo-control of the heater, so that the heater and skin temperature become equal.

After OT transfer, and during anesthesia induction, a DeRoyal™ (Powell, TN, USA) esophageal temperature monitoring probe was inserted into the distal esophagus near the left atrium by the study anesthesiologist. With depth and placement in the esophagus confirmed at the time of intubation via videolaryngoscopy,29 the probe was secured with an endotracheal tube. Esophageal monitoring was discontinued at the end of anesthesia and prior to admission to PACU.

Data Collection

Intraoperative continuous temperature data for both devices was automatically recorded into the hospital computerized Automated Anesthetic Record Keeping (AARK) system and was independently extracted by the surgical data custodian into MS Excel™. Surgical data, including duration of surgery, ambient temperature, and demographic data (age, gender), were recorded by the Research Nurse. ZHF monitoring was continued until initial temperature measurement upon transfer to the Post Anesthetic Care Unit (PACU). Patient acceptability was ascertained upon discharge from PACU or on the next postoperative day: patients were asked to rate their response on a five-point Likert scale (0 strongly disagree to 5 strongly agree) regarding first, whether the device was comfortable to wear and secondly, whether they would be prepared to wear the device again. Device failure and other adverse events were recorded.

Statistical Analysis

Agreement between monitoring routes, the mean difference between devices, the variability of the individual differences and measurement bias were analyzed using Bland Altman plots,30 accounting for repeated measurements, specifically the correlated nature of the data measured on the same individual, with a linear mixed model.31 An acceptable limit of agreement between measurements was set at ± 0.5°C, which is the conventional acceptable limit of agreement for temperature monitoring devices.15 The first 10 min of intraoperative ZHF and esophageal temperatures were not analysed to allow for ramp-up time (for the ZHF device) and equilibrium to be attained. Temperature measurement pairs were extracted at 5-min intervals from the continuous temperature measurements, as per previous studies,21 and data were analyzed up until 100 min of surgery time.

Lin’s concordance correlation coefficient (CCC) was calculated for longitudinal data using R Concordance Correlation Coefficient for Repeated Measures (CCCRM) package.™32,33 Sensitivity and specificity values with 95% confidence intervals for hypothermia (defined as temperature <36.0 °C)3 were calculated using a general estimating equation using R™33 and custom written code implementing statistical methods described by Genders et al.34 Demographic data (analyzed via R™), device failure, and patient acceptability are reported using means and standard deviations, medians and ranges, or rates and percentages, as appropriate. McBride’s strength of agreement criteria for continuous variables was used (whereby >0.99: almost perfect; >0.95–0.99: substantial; <0.90: poor).35 Investigators (JM, LJ, and DV) not involved with data collection were responsible for data analysis.


Thirty patients were enrolled in the study and monitored with ZHF and esophageal devices (see Figure 1). Complete temperature data were available for 23 cases, due to device failure (see below): 448 measurement pairs were included in the analysis.

Figure 1 Flow diagram of study processes.

Demographic and Surgical Data

Demographic and surgical data are presented in Table 1. The mean baseline temperature (°C) on arrival to the induction room was 36.5°C (SD 0.54).

Table 1 Demographic and Surgical Data

Agreement Between Zero-Heat-Flux and Esophageal Devices

Lin’s concordance coefficient (CCC) was used to measure how well pairs of ZHF-esophageal observations agreed relative to esophageal monitoring. The observed CCC was 0.75 (95% CI: 0.63 to 0.84) indicating poor agreement (<0.90) according to McBride’s strength-of-agreement criteria for continuous variables.35 In the mixed model Bland–Altman plot, time and the mean of the two devices were fitted as fixed effects. However, time was not found to have a significant effect (b = −0.0012, p = 0.072), so it was removed from the final model. Model residuals were examined for heteroscedasticity, normality, and linearity using plots and descriptive statistics and met assumptions.

In the simplest case, where the mean difference between ZHF and esophageal devices was examined, the difference was found to be 0.14°C, with limits of agreement of −0.71 to 1.04. However, further modeling showed that these estimates are not an accurate representation of bias, as the mean difference changes through the measured range of temperature and can be described using a regression line (b0=−9.35 + b1=0.263X, where X= mean temperature of the two devices). The slope (b1) of the regression line represents proportional bias (b1 = 0.263, 95% CI: 0.118 to 0.409, p <0.001) with the mean agreement dependent on the actual temperature. The mean difference in the Bland Altman plot ranged from to −0.16°C at 34.9°C (where the mean of ZHF was lower than the esophageal device) to 0.46°C at 37.25°C (where the mean of ZHF was higher than esophageal device), with 95% limits of agreement (max) upper LOA = 0.80 to 1.41, lower LOA = −1.12 to −0.50 (Figure 2). It should be noted that three-quarters (75%) of measurements were within the clinical limit of 0.5°C.

Figure 2 Bland Altman plot: Temperature differences and mean of esophageal and ZHF devices. Dashed red line indicates mean bias, estimated through a regression line (linear mixed model). Dashed blue lines indicate 95% limit of agreement (LOA). Boundaries of clinically acceptable agreement set at 0.5°C and indicated by shaded grey box.

Sensitivity and Specificity to Detect Hypothermia

The ZHF device detected hypothermia with a sensitivity of 0.80 (95% CI: 0.65 to 0.89) and a specificity of 0.72 (95% CI: 0.55 to 0.84). The intra-cluster correlation (ICC) for sensitivity was 0.30 and for specificity was 0.42.

Patient Acceptability

Of 28 participants, 96% (n=27) stated that the ZHF device was comfortable to wear, with 39% (n=11) responding that they agreed, and 57% (n=16) stating that they strongly agreed. One patient was unsure. All 28 participants surveyed (100%) stated that they would be prepared to wear the device again, with 43% (n=12) stating that they agreed and 57% (n=16) stating that they strongly agreed. Data for the remaining two participants were missing as they were discharged after hours from PACU when the Research Nurse was not available.

Adverse Outcomes and Device Failure

Dermatitis was experienced by one participant and was noted when the ZHF device was removed in PACU. In seven cases device or database failure occurred, thus inhibiting complete data analysis of temperature outcomes for these participants: in three of these cases, temperature data could not be retrieved for either device. Data for the esophageal temperature data could not be retrieved for two cases, and in the two remaining cases, data were not retrievable for the ZHF device. In one case, failure of the ZHF device was attributable to dislodgement during x-ray.


This study found mean agreement between ZHF and esophageal temperature monitoring devices, although poor overall, was dependent on the actual temperature. Patient-reported acceptability, absent from previously published evaluations of this device, was high.

Our study utilized a combination of methods to fully assess measurement error between devices. Bland Altman plots, though a well-established method to visually represent differences between devices, may be open to interpretation and proportional bias may not always be obvious, especially with repeated measures. Regression models allow formal testing of proportional bias and provide an unbiased estimate. Bland and Altman provide an example incorporating the 95% LOA with regression models, which we have modified to adjust for repeated measures.36 To our knowledge, few studies in this area have used this method to study bias, possibly due to the lack of easy application in statistical software. Morettini et al used concordance analysis to produce a regression line with general estimating equations (GEE) to account for repeated measures, finding significant bias which they concluded was not clinically important and they did not adjust the Bland Altman plot.22

In our study, a linear mixed model examining the differences between devices revealed that the simple mean difference of 0.14°C is misleading, as it averages out positive and negative results. At lower temperatures the ZHF device tended to have lower readings than the esophageal device, whereas at higher temperatures ZHF tended to have higher readings. Therefore, differences are better described using a regression equation. For example, at 34.5°C the difference between devices is −0.27, indicating a lower reading for the ZHF device, whilst at 35.5°C the difference is close to zero and at 36.5°C, the difference is 0.26, indicating higher ZHF readings (see Figure 2). In the mildly hypothermic range (35.0°C to 35.9°C) the ZHF device may more accurately reflect core temperature, but in moderate hypothermia (34.0–34.9°C) or normal ranges (above 36°C3) the ZHF may be less accurate. Conway et al's16 recent meta-analysis corrected for repeated measures in studies where this was not conducted: pooled estimate for the mean bias was 0.03°C. However, this represents mean bias across various reference devices in both intensive care and perioperative settings.16

In our study, only three-quarters of the ZHF measurements were between 0.5°C of esophageal readings, compared to 97.7% of readings within 0.5°C obtained by Jack et al’s comparison with esophageal readings25 and 94% of readings during slow core temperature change in Boisson et al study of major abdominal surgery.21 Boisson et al also observed that, during rapid temperature change, only 39% of temperature pairs were equal or less than 0.5°C in relation to percentage of absolute difference.21 In our study, LCCC indicated poor agreement between ZHF and esophageal devices, with wide LOA from the Bland Altman, clearly more than the boundary of clinically acceptable agreement of 0.5°C (Figure 2). An even tighter boundary for clinically acceptable agreement between devices and true core temperature (between ± 0.1°C to 0.2°C) has been suggested,19 given advancements in temperature device technology. The boundary of 0.5°C represents wide variation in a tightly controlled vital sign and remains clinically relevant in the context of temperature management decision-making.

The device failure and data recording issues we experienced are not unique. West et al’s secondary analysis of agreement of ZHF compared with nasopharynx or oropharynx measurements excluded data from six out of 200 participants due to device failure.24 Data recording or retrieval problems were also reported by Boisson et al,21 Pesonen et al,23 Iden et al,19 Jack et al,25 and Eshraghi et al.15 Concerns regarding quality of manually recorded data are well-founded. However, our findings and previous studies suggest potential superiority of automatically recorded temperatures, as discussed by Freundlich,37 may be undermined by retrieval issues and device failures that are not easily resolved during complex procedures. Nonetheless, automatically recorded, continuous temperature recording may offer additional benefits for reporting temperature metrics and quality indicators:38 failure to manually document intraoperative temperatures is widely acknowledged.10,13,39 Provision of non-invasive, continuous monitoring devices, such as the ZHF device, may increase willingness to monitor and record, as well as awareness of, intraoperative core temperature.40

Few prior studies have analyzed sensitivity and specificity of non-invasive temperature monitoring devices for hypothermia detection.41 Kimberger et al reported sensitivity and specificity for hypothermia detection by a non-invasive double sensor device as 0.77 (0.54 to 0.99) and 0.93 (0.7 to 0.99).42 We found that the ZHF achieved slightly improved sensitivity (0.80, 95% CI 0.65 to 0.89) but lower specificity in hypothermia detection (0.72, 95% CI: 0.55 to 0.84). Therefore, reliance upon ZHF devices for hypothermia detection may feasibly result in some normothermic patients receiving warming measures, based on the lower specificity. Nonetheless, our findings also indicate greater agreement with esophageal readings at 35.5°C. Sensitivity and specificity analyses should be included in future, larger studies, for both detection of hypothermia and fever.

Adverse events, as per earlier studies, were minimal: one case of ZHF-related dermatitis was observed. Earlier studies suggest the device is well tolerated:21,22 short-term, residual marks from the adhesive have been described.22 Our study found that self-reported, retrospective, patient acceptability of the device, described as comfort and preparedness to wear the device again, was high. Sekhon et al suggest that anticipated acceptability can be assessed prior to interventions, to determine modifications to increase acceptability, yet propose that retrospective acceptability measurement allows participants opportunity to reflect on the whole experience of an intervention.43 Insight into patient-assessed acceptability of a relatively new device is invaluable. The continuous capability, involving transfer between areas with a disposable sensor pad attached to the forehead, was well-tolerated by patients. Nonetheless, the device requires mains power and staff reported the need to unplug the device during transfer was a limitation, as was inability to retrieve raw values from the unit itself.

As per earlier reports, measurement accuracy of the ZHF device may inhibit use where wide variations or rapid temperature change are anticipated.21 However, the device is potentially less prone to operator error than other non-invasive peripheral devices (which estimate core temperature via correction factor) including aural canal thermometry, which requires careful placement and visualization of the tympanic membrane for optimal efficiency, which under normal clinical circumstances is not conducted. The ease of use, patient tolerability, and continuous monitoring capability22,24 suggests that the ZHF device may offer a viable option to improve compliance with consistent temperature measurement guidelines across perioperative care phases and multidisciplinary care providers.3,44 Yet the utility and application of the device is inhibited by, importantly, lesser measurement accuracy and specificity, along with practical concerns regarding retrieval of raw values from the unit.


This study experienced a relatively high number of device and database retrieval failures, partly due to the utilization of automatically documented temperature data, resulting in a small sample size. For research purposes, manual recordings of temperature at narrow intervals over long procedures may improve reliability if cross-checked against automatic readings but may inhibit feasibility by increasing data collection burden. Our study offers a pragmatic evaluation of the performance of both devices in clinical settings, highlighting practical considerations broadly applicable to intraoperative temperature monitoring. Additionally, extraction of data at 5-min intervals over 100 min enabled analysis of 448 measurement pairs, facilitating data analysis.


The ZHF device achieved lesser measurement accuracy with core (esophageal) temperature compared to earlier findings. Nonetheless, due to continuous capability, non-invasiveness and patient reported acceptability, the device warrants further evaluation.

Data Sharing Statement

De-identified participant temperature data are available on request from the Corresponding Author.


The authors wish to acknowledge the support of Edward Gosden (formerly Institute of Health and Biomedical Innovation, Queensland University of Technology), Associate Professor Kerstin Wyssusek, and Mrs Christine Woods (Royal Brisbane and Women’s Hospital).


This study was supported by a QUT School of Nursing pilot study grant.


JM has attended a workshop as part of a Special Interest Group for Hypothermia sponsored by 3M, following the conduct of this study. No support was received from 3M for the conduct of this study. SK reports that her employer (QUT) has received monies on her behalf from BD Medical for educational consultancies, outside the submitted work. The remaining authors (NH, AVZ, LJ, and DV) have no potential conflicts of interest to report.


1. Sessler DI. Temperature monitoring: the consequences and prevention of mild perioperative hypothermia. South African J Anaesth Analg. 2014;20(1):25–31. doi:10.1080/22201173.2014.10844560

2. Sessler DI, Warner D, Warner M. Temperature monitoring and perioperative thermoregulation. Anesthesiology. 2008;109(2):318–338. doi:10.1097/ALN.0b013e31817f6d76

3. National Institute for Health and Care Excellence. Hypothermia: prevention and management in adults having surgery 2008 (Updated 2016). 2016.

4. Sessler D. Complications and treatment of mild hypothermia. Anesthesiology. 2001;95(2):531–543. doi:10.1097/00000542-200108000-00040

5. Rajagopalan S, Mascha E, Na J, Sessler D. The effects of mild perioperative hypothermia on blood loss and transfusion requirement. Anesthesiology. 2008;108(1):71–77. doi:10.1097/01.anes.0000296719.73450.52

6. Kurz A, Sessler D, Lenhardt R. Perioperative normothermia to reduce the incidence of surgical-wound infection and shorten hospitalization. N Engl J Med. 1996;334(19):1209–1216. doi:10.1056/NEJM199605093341901

7. Balki I, Khan JS, Staibano P, et al. Effect of perioperative active body surface warming systems on analgesic and clinical outcomes: a systematic review and meta-analysis of randomized controlled trials. Anesth Analg. 2020;131(5):1430–1443. doi:10.1213/ANE.0000000000005145

8. Beilin B, Shavit Y, Razumovsky J, Wolloch Y, Zeidel A, Bessler H. Effects of mild perioperative hypothermia on cellular immune responses. Anesthesiology. 1998;89(5):1133–1140. doi:10.1097/00000542-199811000-00013

9. Lenhardt R, Marker E, Goll V, et al. Mild intraoperative hypothermia prolongs postanesthetic recovery. Anesthesiol. 1997;87(6):1318–1323. doi:10.1097/00000542-199712000-00009

10. Munday J, Hines S, Chang AM. Evidence utilisation project: management of inadvertent perioperative hypothermia. The challenges of implementing best practice recommendations in the perioperative environment. Int J Evid Based Healthc. 2013;11(4):305–311. doi:10.1111/1744-1609.12035

11. Munday J, Delaforce A, Forbes G, Keogh S. Barriers and enablers to the implementation of perioperative hypothermia prevention practices from the perspectives of the multidisciplinary team: a qualitative study using the theoretical domains framework. J Multidiscip Healthc. 2019;12:395. doi:10.2147/JMDH.S209687

12. Arkiliç CF, Akça O, Taguchi A, Sessler DI, Kurz A. Temperature monitoring and management during neuraxial anesthesia: an observational study. Anesth Analg. 2000;91(3):662–666. doi:10.1213/00000539-200009000-00031

13. Duff J, Walker K, Edward K-L, Williams R, Sutherland-Fraser S. Incidence of perioperative inadvertent hypothermia and compliance with evidence-based recommendations at four Australian hospitals: a retrospective chart audit. ACORN. 2014;27(3):16.

14. National Institute for Health and Care Excellence (NICE). Bair Hugger for measuring core temperature during perioperative care. Medtech Innov Brief. 2017.

15. Eshraghi Y, Nasr V, Parra-Sanchez I, et al. An evaluation of a zero-heat-flux cutaneous thermometer in cardiac surgical patients. Anesth Analg. 2014;119(3):543–549. doi:10.1213/ANE.0000000000000319

16. Conway A, Bittner M, Phan D, et al. Accuracy and precision of zero-heat-flux temperature measurements with the 3M™ Bair Hugger™ temperature monitoring system: a systematic review and meta-analysis. J Clin Monit Comput. 2020.

17. Mäkinen M-T, Pesonen A, Jousela I, et al. Novel zero-heat-flux deep body temperature measurement in lower extremity vascular and cardiac surgery. J Cardiothorac Vasc Anesth. 2016;30(4):973–978. doi:10.1053/j.jvca.2016.03.141

18. Gomez-Romero F, Fernandez-Prada M, Fernandez-Suarez F, et al. Intra-operative temperature monitoring with two non-invasive devices (3M Spoton® and Dräger Tcore®) in comparison with the Swan-Ganz catheter. Cirugía Cardiovasc. 2019;26(4):191–196. doi:10.1016/j.circv.2019.06.002

19. Iden T, Horn E-P, Bein B, Böhm R, Beese J, Höcker J. Intraoperative temperature monitoring with zero heat flux technology (3M SpotOn sensor) in comparison with sublingual and nasopharyngeal temperature: an observational study. Eur J Anaesthesiol (EJA). 2015;32(6):387–391. doi:10.1097/EJA.0000000000000232

20. Kollmann A, Brogly N, Alsina E, Huercio I, Gilsanz F. Validation of the Zero-Heat-Flux thermometer (SpotOn®) in major gynecological surgery to monitor intraoperative core temperature: a comparative study with esophageal core temperature. Minerva Anestesiol. 2019;85(4):351–357.

21. Boisson M, Alaux A, Kerforne T, et al. Intra-operative cutaneous temperature monitoring with zero-heat-flux technique (3M SpotOn) in comparison with oesophageal and arterial temperature: a prospective observational study. Eur J Anaesthesiol. 2018;35(11):825–830. doi:10.1097/EJA.0000000000000822

22. Morettini E, Turchini F, Tofani L, Villa G, Ricci Z, Romagnoli S. Intraoperative core temperature monitoring: accuracy and precision of zero-heat flux heated controlled servo sensor compared with esophageal temperature during major surgery; the ESOSPOT study. J Clini Mon Comput. 2019;24(5):1–9.

23. Pesonen E, Silvasti-Lundell M, Niemi T, Kivisaari R, Hernesniemi J, Mäkinen M-T. The focus of temperature monitoring with zero-heat-flux technology (3M Bair-Hugger): a clinical study with patients undergoing craniotomy. J Clin Monit Comput. 2019;33(5):917–923. doi:10.1007/s10877-018-0227-z

24. West N, Cooke E, Morse D, Merchant R, Görges M. Zero-heat-flux core temperature monitoring system: an observational secondary analysis to evaluate agreement with naso-/oropharyngeal probe during anesthesia. J Clin Monit Comput. 2019;34:1121–1129.

25. Jack JM, Ellicott H, Jones C, Bremner S, Densham I, Harper C. Determining the accuracy of zero-flux and ingestible thermometers in the peri-operative setting. J Clin Monit Comput. 2019;33(6):1113–1118. doi:10.1007/s10877-019-00252-9

26. Lefrant J-Y, Muller L, de La Coussaye J, et al. Temperature measurement in intensive care patients: comparison of urinary bladder, oesophageal, rectal, axillary, and inguinal methods versus pulmonary artery core method. Intensive Care Med. 2003;29(3):414–418. doi:10.1007/s00134-002-1619-5

27. Makic M, Lovett K, Azam M. Placement of an esophageal temperature probe by nurses. AACN Adv Crit Care. 2012;23(1):24–31. doi:10.4037/NCI.0b013e31823324f3

28. Bossuyt P, Reitsma J, Bruns D, et al. STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies. Clin Chem. 2015;61(12):1446–1452. doi:10.1373/clinchem.2015.246280

29. van Zundert A, Wyssusek K, Vivian V. Verification of nasopharyngeal temperature probes—they are not always where you think they are! Anesth Analg. 2016;123(5):1338–1339. doi:10.1213/ANE.0000000000001542

30. Bland J, Altman D. Agreement between methods of measurement with multiple observations per individual. J Biopharm Stat. 2007;17(4):571–582. doi:10.1080/10543400701329422

31. Parker R, Weir C, Rubio N, et al. Application of mixed effects limits of agreement in the presence of multiple sources of variability: exemplar from the comparison of several devices to measure respiratory rate in COPD patients. PLoS One. 2016;11(12):e0168321. doi:10.1371/journal.pone.0168321

32. Carrasco JL. CCCCRM: Concordance Correlation Coefficient for Repeated (And Non-Repeated) Measures. Version 1.2.1 ed. R package; 2015.

33. Team RC. R: A Language and Environment for Statistical Computing [Computer Program]. R Foundation for Statistical Computing; 2013.

34. Genders T, Spronk S, Stijnen T, Steyerberg E, Lesaffre E, Hunink M. Methods for calculating sensitivity and specificity of clustered data: a tutorial. Radiology. 2012;265(3):910–916. doi:10.1148/radiol.12120509

35. McBride GB. A proposal for strength-of-agreement criteria for Lin’s concordance correlation coefficient. In: Ltd NIWA Client Report: HAM2005-062. Hamilton, New Zealand: National Institute of Water and Atmospheric Research; 2005.

36. Bland J, Altman D. Measuring agreement in method comparison studies. Stat Methods Med Res. 1999;8(2):135–160. doi:10.1177/096228029900800204

37. Freundlich R, Nelson SE, Qiu Y, Ehrenfeld J, Sandberg W, Wanderer J. A retrospective evaluation of the risk of bias in perioperative temperature metrics. J Clin Monit Comput. 2019;33(5):911–916. doi:10.1007/s10877-018-0233-1

38. Epstein RH, Dexter F, Hofer IS, et al. Perioperative temperature measurement considerations relevant to reporting requirements for national quality programs using data from anesthesia information management systems. Anesth Analg. 2018;126(2):478–486. doi:10.1213/ANE.0000000000002098

39. Brogly N, Alsina E, de Celis I, Huercio I, Dominguez A, Gilsanz F. Perioperative temperature control: survey on current practices. Rev Esp Anestesiol Reanim. 2016;63(4):207–211. doi:10.1016/j.redar.2015.06.006

40. Alfonsi P, Bekka S, Aegerter P, Farag E; SFAR Research Network Investigators. Prevalence of hypothermia on admission to recovery room remains high despite a large use of forced-air warming devices: findings of a non-randomized observational multicenter and pragmatic study on perioperative hypothermia prevalence in France. PLoS One. 2019;14(12):e0226038. doi:10.1371/journal.pone.0226038

41. Niven D, Gaudet J, Laupland K, Mrklas K, Roberts D, Stelfox H. Accuracy of peripheral thermometers for estimating temperature: a systematic review and meta-analysis. Ann Intern Med. 2015;163(10):768–777. doi:10.7326/M15-1150

42. Kimberger O, Thell R, Schuh M, Koch J, Sessler D, Kurz A. Accuracy and precision of a novel non-invasive core thermometer. Br J Anaesth. 2009;103(2):226–231. doi:10.1093/bja/aep134

43. Sekhon M, Cartwright M, Francis J. Acceptability of healthcare interventions: an overview of reviews and development of a theoretical framework. BMC Health Serv Res. 2017;17(1):1–13. doi:10.1186/s12913-017-2031-8

44. Munday J, Delaforce A, Heidke P, et al. Management of hypothermia in the perioperative environment. Standards for Perioperative Nursing in Australia. (15th Edition) Australian College of Perioperative Nursing (ACORN). 2018.

Creative Commons License © 2021 The Author(s). This work is published by Dove Medical Press Limited, and licensed under a Creative Commons Attribution License. The full terms of the License are available at The license permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.