Back to Journals » Neuropsychiatric Disease and Treatment » Volume 16

Comparing Expert and Non-Expert Assessment of Patients Presenting with Neurological Symptoms to the Emergency Department: A Retrospective Observational Study

Authors Hoyer C , Stein P, Ebert A , Rausch HW, Nagel S, Eisele P , Alonso A, Platten M , Szabo K 

Received 27 October 2019

Accepted for publication 28 December 2019

Published 13 February 2020 Volume 2020:16 Pages 447—456


Checked for plagiarism Yes

Review by Single anonymous peer review

Peer reviewer comments 2

Editor who approved publication: Dr Roger Pinder

Carolin Hoyer,1 Patrick Stein,1 Anne Ebert,1 Hans-Werner Rausch,1 Simon Nagel,2 Philipp Eisele,1 Angelika Alonso,1 Michael Platten,1 Kristina Szabo1

1Department of Neurology, UniversitätsMedizin Mannheim, Heidelberg University, Mannheim, Germany; 2Department of Neurology, University Hospital, Heidelberg University, Mannheim, Germany

Correspondence: Carolin Hoyer
Department of Neurology, Universitätsmedizin Mannheim, Theodor-Kutzer-Ufer 1-3, Mannheim 68135, Germany
Tel +49-621-383-2885
Fax +49-621-383-3807
Email [email protected]

Objective: Referrals to neurology in emergency departments (ED) are continuously increasing, currently representing 15% of all admissions. Existing triage systems were developed for general medical populations and have not been validated for patients with neurological symptoms.
Methods: To characterize neurological emergencies, we first retrospectively analyzed symptoms, service times and resources of the cohort of neurological referrals to a German interdisciplinary ED (IED) during 2017 according to urgency determined by final IED diagnosis. In a second step, we performed a retrospective assignment of consecutive patients presenting in April 2017 according to internal guidelines as either acute (requiring diagnostic/therapeutic procedures within 24 hrs) or non-acute neurological conditions as well as a retrospective classification according to the Emergency Severity Index (ESI). Both assessments were compared with the urgency according to the final ER diagnosis.
Results: In a 12-month period, 36.4% of 5340 patients were rated as having an urgent neurological condition; this correlated with age, door-to-doctor time, imaging resource use and admission (p < 0.001, respectively). In a subset of 275 patients, 59% were retrospectively triaged as acute according to neurological expertise and 48% according to ESI categories 1 and 2. Neurological triage identified urgency with a significantly higher sensitivity (94.8, p < 0.01) but showed a significantly lower specificity (55.1, p < 0.05) when compared to ESI (80.5 and 65.2, respectively).
Conclusion: The ESI may not take specific aspects of neurological emergency (eg, time-sensitivity) sufficiently into account. Refinements of existing systems or supplementation with dedicated neurological triage tools based on neurological expertise and experience may improve the triage of patients with neurological symptoms.

Keywords: neurology, emergency


Emergency conditions represent a large portion of the global burden of disease, and emergency department (ED) utilization in many countries has substantially increased in recent years.1,2 In Germany, for instance, the number of referrals has risen to approximately 20 million over the past several years and is expected to increase further.3 Notably, there has been a substantial increase in ED patients with neurological disturbances and disorders, currently accounting for 15% of ED admissions and up to 26% of medical patients in general.46 Treatment of patients with neurological emergencies such as acute ischemic stroke, cerebral hemorrhage, status epilepticus or meningoencephalitis is often time-sensitive and requires swift management in the ED.710 In many cases, the character and acuity of the presenting neurological disturbances clearly indicate the necessity for rapid diagnostic and therapeutic procedures in an ED setting. Often, however, the handling of patients with neurological signs and symptoms can be challenging for prehospital first-aid and non-neurological emergency care providers because symptoms may be non-specific and related to a wide spectrum of differential diagnoses and hence different degrees of urgency.11

Triage systems were developed to facilitate acuity assessment and to predict patient disposition and resource utilization. The Emergency Severity Index (ESI) is one of the most commonly used formal five-level triage systems developed to estimate acuity and resource consumption. The ESI system rates patients from level 1 (most acutely ill) to level 5 (least resource-intensive) and has been shown to have a high inter-observer agreement and to predict hospital admission and location of admission.12,13 To date, however, there is no dedicated validation study of existing triage systems to assess their performance in neurological patients, nor exists a dedicated triage system for patients with neurological complaints.

Our aims in this retrospective study were, first, to characterize neurological emergencies at presentation to an interdisciplinary ED (IED) and, second, to evaluate the sensitivity and specificity of the ESI compared to an expert neurological assessment of these patients.


Study Design

We retrospectively analyzed patient records of 5340 patients who consecutively presented or were referred to the IED of the University Medical Centre, Mannheim, Germany, between January 1st 2017 and December 31st 2017 for neurological consultation. The study protocol has been approved by the Ethics Committee II, Medical Faculty Mannheim, Heidelberg University, reference number 2018-502N-MA, and has been performed with the ethical standards laid down in the 1964 Declaration of Helsinki and its later amendments. Due to the retrospective design and lack of study-related interventions, no consent to participate was obtained. The manuscript does not contain clinical studies or patient data.

In the Mannheim IED, at least one neurology resident is present 24/7 either for first-line assessment if prehospital assessment or evaluation on arrival suggests a neurological condition, or second-line if first-line assessment by a non-neurologist IED physician suggests a neurological condition. Cases were identified by filtering the ED database for patients coded to present with a chief complaint that was evaluated by emergency medical service or ED staff upon arrival to be a neurological symptom or complaint.

Analysis of Neurological Referrals to the Interdisciplinary ED

Data extracted from patient records include basic demographic information, chief complaint/presenting symptom categorized according to Royl,14 door-to-doctor time, length of IED stay and resource utilization (computed tomography (CT)/angiography (CTA), magnetic resonance imaging (MRI), lumbar puncture (LP), electroencephalography (EEG)) during patients’ stay in the IED. Based on information from diagnostic procedures and the final IED diagnosis, patients were retrospectively classified as having either an urgent neurological condition or a non-urgent neurological condition, representing the gold standard of “true” urgency.15 In accordance with Barbadoro, an urgent neurological condition was defined as any condition requiring in-hospital equipment for diagnostic or therapeutic purposes immediately or within the next 24 hrs to avoid harmful consequences for the patient.16 A non-urgent neurological condition, in contrast, refers to any neurological condition not meeting these requirements, eg, those suitable for further work-up in an outpatient setting. We analyzed and compared the characteristics of the two groups.

Retrospective Non-Formalized Expert Neurological Evaluation versus ESI

In a second step, records of a subset of 299 patients consecutively presenting to the ED during a 4-week period were retrospectively evaluated for level of acuity by two experienced neurologists with more than 4-year practical experience in the IED: only the history pertaining to the chief complaint and symptoms, any additional pre-existing diagnoses and current medication were presented, on the basis of which it was determined whether the patient was thought to require diagnostic or therapeutic procedures within the next 24 hrs (acute), or whether this was a condition not necessitating such procedures (non-acute). This decision was made with reference to internal guidelines which were established with close reference to official guidelines of the German Neurological Society for the management of neurological conditions. These guidelines have been in use for several years and are continually checked and updated. In addition, retrospective ESI ratings were performed. Sensitivity, specificity, positive and negative predictive values for the non-formalized neurological evaluation and ESI identification of acute cases (“ESI acute” subsuming ESI categories 1 and 2) against the gold standard urgent/non-urgent were calculated. For an overview of methods, see Figure 1.

Figure 1 Flowchart of study analysis. First, clinical characteristics and medical procedures of all neurological referrals to the IED during 2017 were analyzed and compared for urgent and non-urgent cases according to the final diagnosis. In a second step, an informal triage in 299 of these patients was performed according to our internal guidelines as either acute or non-acute. This was compared with a classification according to the ESI. Abbreviations: IED, interdisciplinary emergency department; ER, emergency room; ESI, Emergency Severity Index.

Statistical Analysis

Statistical analysis was performed with IBM SPSS Statistics version 22.0. The distribution of categorical variables between urgent and non-urgent patients was compared by Chi2 tests. Group comparisons of ordinal data were assessed using Mann–Whitney-U-tests and group comparisons of metric data were assessed using independent samples t-tests. Bonferroni correction for multiple testing was applied where suitable. In the tables and in the text unadjusted p-values are given, but in the case of multiple testing, these are interpreted as significant only if still significant after Bonferroni correction. McNemar’s Chi2 test was used to compare performance measures (sensitivity and specificity) of ESI and expert neurological assessment.17 A p-value of <0.05 was considered significant.

Patient and Public Involvement

Patients and/or public were not involved in this study.


Characteristics of Neurological Referrals to the IED

Within the 12-month observational period, a total of 45,445 patients were seen in the IED. Of these, 5340 (12.0%) patients were evaluated by a neurologist. Mean age of all neurologically evaluated patients was 56.2 years (SD ±21.27), 2583 (48.4%) were male. We identified 1896 patients (36.4%) with an urgent neurological condition and 2427 patients (46.6%) with a non-urgent neurological condition (Table 1). Moreover, 890 patients presented with a neurological chief complaint but ultimately did not have a neurological diagnosis. The non-urgent population comprised significantly more patients of up to 65 years of age, while in the urgent group, there were significantly more patients over 65 years of age (p<0.001). Patients with an urgent condition were brought to the IED by paramedics and/or an emergency physician significantly more frequently than non-urgent patients (n= 1283 [67.7%] vs n=1192 [49.1%], p<0.001), whose presentation was more often self-initiated, or they were referred by a practice-based physician (n=1233 [50.8%] vs n=611 [32.2%], p<0.001). Overall, vertigo (n=793, 14.9%), motor deficits (n=672, 12.6%), headache (n=663, 12.4%) and epileptic seizures (n=590, 11.0%) were the most frequent chief complaints. Patients over 65 years of age most frequently presented with motor deficits (n=374), aphasia/dysarthria/dysphagia (n=369) and vertigo (n=270), while headaches (n=588), vertigo (n=526) and epileptic seizures (n=444) were the major causes for ED visits of younger patients. Disturbed consciousness, motor deficits, vision disturbances as well as aphasia/dysarthria/dysphagia were significantly more frequently found as presenting symptoms of urgent patients (p<0.001). On the other hand, epileptic seizures, headaches and vertigo were more common in non-urgent patients (p<0.001). Even though certain chief complaints were more common in patients presenting with an urgent condition versus those with a non-urgent condition and vice-versa, chief complaints alone did not sufficiently identify patients categorized as urgent and requiring immediate medical assessment. While urgent patients were seen by a doctor faster (33.7 vs 43.7 min, p<0.001), the length of stay in the IED did not differ between patients with an urgent vs a non-urgent neurological diagnosis (253.5 vs 250.1 min, p=0.528). Overall, 2215 patients (51.2%) were admitted. Significantly more urgent patients (n=1764, 93.0%) than non-urgent patients (n=451, 18.6%) were admitted to hospital (p<0.001). A detailed description of the study population is presented in Table 1.

Table 1 Characterization of Neurological Referrals to the IED in a 12-Month Period

Retrospective Neurological Evaluation and Triage According to ESI

Of a subset of 299 patients consecutively admitted to our IED during a 4-week-period, 24 were diagnosed as not neurological and were excluded from further analysis. The mean age of the remaining 275 patients was 55.05 years (SD ± 21.36 years), 128 (46.5%) were men. Of the 275 cases, retrospective neurological evaluation rendered 162 patients (58.9%) as needing immediate neurological treatment or diagnostic procedures and 113 (41.1%) as not needing immediate medical attention. The reason for acuity was a) time-sensitive diagnostic procedures or treatment in 141 cases (51.3%), b) the need for immediate and continuous monitoring in 18 cases (6.5%), and c) treatment or monitoring not suited for an outpatient setting in nine cases (3.3%), respectively. In the group of cases rated acute, the most common final diagnoses were acute ischemic stroke (n=37, 22.8%) and seizures (n=24, 14.8%). In those cases that were rated as non-acute, the most common final diagnoses were headache and seizures (each n=22, 19.5%). Of the 113 non-acute patients, a relevant previous neurological diagnosis was known in 26 patients (23.0%), mostly a previously diagnosed epilepsy (n=16, 14.2%).

Concerning ESI, the distributions were as follows: ESI 1 n=2 (0.72%), ESI 2 n=129 (46.9%), ESI 3 n=86 (31.3%), ESI 4 n=43 (15.6%), and ESI 5 n=15 (5.5%), respectively. Of the two patients triaged as ESI category 1, one patient presented with a status epilepticus and the second with symptoms suggestive of an acute cerebrovascular event and signs of raised intracranial pressure, subsequently diagnosed with an intracerebral hemorrhage. Both patients were rated as needing “immediate life-saving intervention” due to respiratory distress. The most common final diagnoses in category 2 were seizures (n=40, 31.0%) and ischemic stroke (n=34, 26.4%). In ESI category 3, the most common diagnoses were headache (n=24, 27.9%) and vertigo (n=16, 18.6%).

The number of admissions and utilization of specific neurological resources (CCT/CTA, MRI, LP) by retrospective neurological assessment and ESI categories is presented in Table 2. The distribution of ESI categories 1–5 compared to the neurological assessment as acute or non-acute is depicted in Figure 2. The distribution of cases as acute/non-acute according to neurological evaluation and as ESI acute (subsuming ESI categories 1 and 2)/ESI non-acute (subsuming ESI categories 3 to 5) across a spectrum of diagnoses is depicted in Figure 3. Specificity, sensitivity, positive and negative predictive values of the non-formalized neurological evaluation as acute vs non-acute and ESI acute are presented in Table 3. The expert neurological evaluation was significantly more sensitive (p<0.01) while ESI (in the previously mentioned dichotomous distinction “ESI acute” subsuming ESI categories 1 and 2 vs “ESI non-acute” subsuming categories 3 to 5) was significantly more specific (p<0.05).

Table 2 Utilization of Neurological Resources (CCT, CTA, MRI, LP) in the Emergency Department and Admissions/Discharges by Neurological Evaluation and ESI Categories

Table 3 Comparison Between Acute Neurological Cases as Identified by Neurological Expert Assessment and ESI

Figure 2 Distribution of the ESI categories 1–5 according to neurological expert evaluation as acute versus non-acute. Distribution of the ESI categories 1–5 according to neurological expert triage in 299 consecutive patients. Abbreviation: ESI, Emergency Severity Index.

Figure 3 Distribution of cases as acute/non-acute according to neurological expert evaluation (top) and as ESI acute (subsuming ESI categories 1 and 2)/ESI non-acute (subsuming ESI categories 3 to 5; bottom) across a spectrum of diagnoses. Abbreviations: ESI, Emergency Severity Index; CNS, central nervous system.


In our retrospective analysis of patient characteristics and medical procedures of neurological patients in an IED of a university hospital, only slightly more than 50% of patients required hospitalization. In addition, a retrospective non-formalized neurological expert evaluation was more sensitive but less specific than ESI.

The ESI is one of the most widely used triage algorithms and supports decision-making by taking information regarding clinical risk status and expected resource utilization into account.12 Recently, criticism was raised regarding a lack of reliable discrimination, leading to a high percentage of patients triaged to ESI category 3.18,19 In our cohort of patients with neurological signs and complaints and confirming data reported by Lange and coworkers,20 we found a considerable number of patients receiving ESI category 2, because patients with seizures and suddenly occurring focal deficits regardless of onset are triaged to this level. From a neurological perspective, there is a highly relevant difference in acuity of a patient with a focal neurological deficit that has been present for 2 hrs or for 12 hrs, or between a patient with a first-ever seizure or a recurrent seizure and a history of epilepsy.

Patients with highly acute neurological diseases formally do not qualify for the highest urgency level in ESI, as they rarely present in states requiring immediate life-saving interventions. In addition, vital signs, which in established triage systems take precedence over the time-is-brain concept,20 in most cases do not convey neurological urgency. Cerebrovascular disease excellently illustrates this aspect: therapeutic options are time-limited and even long-term prognosis depends on the actual timing of treatment. In acute ischemic stroke, the sooner treatment with the thrombolytic agent rt-PA is administered to patients, the greater the benefit, especially if started within 90 mins following symptom onset.21 A waiting time of 10 mins for a patient with an acute neurological deficit as formally granted by many triage systems and subsequent delay in diagnosis and treatment may thus negatively impact patient outcome. In recent years, a variety of interventions have been investigated to improve the early management of patients with suspected stroke, ranging from the development of stroke recognition tools to the establishment of stroke codes on pre-notification or upon arrival.2225 These procedures have been highly effective, and it is common practice to incorporate them into institutional policies so that they may override the acuity assignment as formally specified by triage. However, it is unclear whether stroke codes are also activated when patients present with mild or atypical symptoms, which have been shown to lead to more frequent assignments to non-acute ESI categories with the ensuing risk of delayed diagnosis and therapy.26,27 Patients presenting with dizziness or vertigo are also assigned to lower acuity categories unless vital signs are alarming. Subtler abnormalities, eg, of the oculomotor system, that are suggestive of a central nervous system pathology may be missed in the initial assessment of these patients by the triage nurse or non-neurologists.28 Since dizziness is a frequent complaint in patients presenting to the emergency department, the detection of the small portion of patients with a serious underlying etiology is particularly challenging. A timely and accurate bedside diagnosis is required in the interests of patient safety but also economically, given the enormous costs caused by inappropriate or unnecessary testing.

Another aspect of the problem is illustrated by the fact that approximately half of all patients evaluated by a neurologist ultimately did not require hospitalization. Hospital admission rates from the ED are influenced by a variety of factors including patient age and affected organ system, with admission rates for general medicine, vascular and neurosurgery patients generally being higher than those for neurological patients.29,30 For this patient group, a previous study found a hospital admission rate from the ED of 58.1%.29 In a study by Robertson et al, only one-third of patients referred for neurological assessment to a rapid referral neurological acute clinic were retrospectively considered to have warranted an urgent evaluation.31 On a related note, providing a diagnosis rather than obtaining therapeutic recommendations has been identified as the main motivation for in-house neurological consultation requests in a recent Spanish study.32 Insufficient experience, the fear of missing a critical time-window for therapy initiation and resulting safety-thinking may lead non-neurological medical care providers to initiate emergency assessments sooner rather than later even with non-specific symptoms or benign conditions.33 While such an approach generally appears to favor patient safety, it may result in over-testing and over-diagnosis yielding adverse consequences of their own.34 In general, patients not requiring urgent diagnosis or treatment substantially contribute to the increase of ED presentations observed in recent years.35 The potential 24/7 availability of resources versus difficulties receiving prompt appointments with non-hospital neurologists and the perceived convenience of access to different medical specialties in particular motivate patients to visit the ED for non-urgent conditions.36,37 This development has prompted the search for alternative solutions,38,39 those specifically addressing neurological patients include email triage and urgent assessment clinics.40 However, many of these options will not be able to provide immediate evaluation, which still leaves a considerable portion of patients seeking help in EDs. Accordingly, methods of formal and objective assessment of urgency as well as ED suitability are required, reverberating in an extended understanding of triage incorporating aspects of demand management.41

Taking these facets of neurological emergency care into account, triaging patients with neurological complaints is challenging: On the one hand, algorithms should be sensitive enough to capture true emergencies even in cases of atypical or subtle presentations, and they need to be specific so as to facilitate the adequate and targeted allocation of limited resources. The neurological expert assessment was demonstrated to be more sensitive than ESI in the detection of urgent neurological conditions – the neurological understanding of what constitutes an emergency certainly contributes to this finding. ESI, on the other hand, was more specific. We do not argue, however, that triage of patients with neurological complaints should be performed by neurologists. Our investigation should rather be taken as an incentive to refine their representation in current triage systems in order to account for their idiosyncrasies and thus to continually improve patient care.

Our findings should be interpreted in the context of some limitations. First, this study is a retrospective cohort study, and as such, subject to the characteristic limitations of using retrospective data, especially as it critically relies on the accuracy of patient records obtained from the hospital electronic database. Second, the study was conducted as a single-center analysis; therefore, the results might not be generalizable to other IEDs with different patient populations and organizational structures. The retrospective evaluation of acuity and urgency also possesses inherent limitations. To begin with, the assessment of acuity in our study relied on written information. Since both analytical and intuitive processes impact on clinical decision-making, any retrospective evaluation, lacking the experiential component, will most likely be skewed.42 Moreover, it is difficult to retrospectively evaluate the necessity of a diagnostic test, particularly when negative. On a related note, the identification of “true” urgency, which is required to assess the performance of a triage system, is inherently problematic.43 Finally, we did not perform a detailed analysis of patients who presented with non-neurological symptoms but eventually received a neurological diagnosis. While undoubtedly of high interest and value, we focused on neurological chief complaints as presenting symptoms.


To date, there is no specific triage instrument for neurological complaints, and no studies have addressed the suitability of established triage instruments for neurological assessment. Our data show that a neurological expert assessment is more sensitive than ESI. Our finding of a lower specificity on the other hand indicates that the presentation of neurological conditions can often be non-specific or ambiguous. Both aspects can be best met by providing neurological expertise as early as possible. In light of recent developments in the treatment of ischemic stroke with extended time-frames for acute intervention, first-line neurological presence and experience is needed in the emergency room and will become increasingly relevant.44 A crucial step for future improvements of ED neurological evaluation concerns a sufficient appraisal of symptom acuity and temporal evolution and the acknowledgement of the syndromal character of many neurological conditions. This may be done by refining current triage systems through a more elaborate representation of neurological symptoms. Moreover, the incorporation of aspects of demand management may also contribute to improvement in care, for example, through the establishment of alternative models of out-patient neurological care to relieve ED overcrowding.

Author Contributions

All authors contributed to data analysis, drafting or revising the article, gave final approval of the version to be published, and agree to be accountable for all aspects of the work.


Prof. Dr. Simon Nagel reports personal fees from Brainomix, personal fees from Pfizer, grants from Cerenovus, personal fees from Böhringer Ingelheim, outside the submitted work. The authors report no other conflicts of interest in this work.


1. Pines JM, Hilton JA, Weber EJ, et al. International perspectives on emergency department crowding. Acad Emerg Med. 2011;18(12):1358–1370. doi:10.1111/acem.2011.18.issue-12

2. Trzeciak S, Rivers EP. Emergency department overcrowding in the United States: an emerging threat to patient safety and public health. Emerg Med J. 2003;20(5):402–405. doi:10.1136/emj.20.5.402

3. Schöpke TP. T. Kennzahlen von Notaufnahmen in Deutschland. Notfall Rettungsmed. 2011;14:371–378. doi:10.1007/s10049-011-1435-y

4. Steiner D, Renetseder F, Kutz A, et al. Performance of the manchester triage system in adult medical emergency patients: a prospective cohort study. J Emerg Med. 2016;50(4):678–689. doi:10.1016/j.jemermed.2015.09.008

5. Wallesch C. Organisation of emergency services in german university and general hospitals - neurological aspects. Aktuelle Neurologie. 2007;34(07):416–421. doi:10.1055/s-2007-971028

6. Topka H, Pfefferkorn T, Andres F, et al. [Online survey of the organizational structures of emergency neurology in Germany]. Nervenarzt. 2017;88(6):625–634. doi:10.1007/s00115-017-0343-x

7. Gumbinger C, Reuter B, Stock C, et al. Time to treatment with recombinant tissue plasminogen activator and outcome of stroke in clinical practice: retrospective analysis of hospital quality assurance data with comparison with results from randomised clinical trials. BMJ. 2014;348:g3429. doi:10.1136/bmj.g3429

8. Ohwaki K, Yano E, Nagashima H, Hirata M, Nakagomi T, Tamura A. Blood pressure management in acute intracerebral hemorrhage: relationship between elevated blood pressure and hematoma enlargement. Stroke. 2004;35(6):1364–1367. doi:10.1161/01.STR.0000128795.38283.4b

9. Trinka E, Cock H, Hesdorffer D, et al. A definition and classification of status epilepticus–report of the ILAE task force on classification of status epilepticus. Epilepsia. 2015;56(10):1515–1523. doi:10.1111/epi.13121

10. Auburtin M, Wolff M, Charpentier J, et al. Detrimental role of delayed antibiotic administration and penicillin-nonsusceptible strains in adult intensive care unit patients with pneumococcal meningitis: the PNEUMOREA prospective multicenter study. Crit Care Med. 2006;34(11):2758–2765. doi:10.1097/01.CCM.0000239434.26669.65

11. Newman-Toker DE, Moy E, Valente E, Coffey R, Hines AL. Missed diagnosis of stroke in the emergency department: a cross-sectional analysis of a large population-based sample. Diagnosis (Berl). 2014;1(2):155–166. doi:10.1515/dx-2013-0038

12. Gilboy NTT, Travers D, Rosenau AM. Emergency Severity Index (ESI): A Triage Tool for Emergency Department Care, Version 4. Implementation Handbook 2012 ed. Rockville: MD Agency for Healthcare Research and Quality; 2011. AHRQ Publication No.12-0014.

13. Tanabe P, Gimbel R, Yarnold PR, Kyriacou DN, Adams JG. Reliability and validity of scores on the emergency severity index version 3. Acad Emerg Med. 2004;11(1):59–65. doi:10.1111/acem.2004.11.issue-1

14. Royl G, Ploner CJ, Mockel M, Leithner C. [Neurological chief complaints in an emergency room]. Nervenarzt. 2010;81(10):1226–1230. doi:10.1007/s00115-010-3020-x

15. Kuriyama A, Urushidani S, Nakayama T. Five-level emergency triage systems: variation in assessment of validity. Emerg Med J. 2017;34:703–710. doi:10.1136/emermed-2016-206295

16. Barbadoro P, Di Tondo E, Menditto VG, et al. Emergency department non-urgent visits and hospital readmissions are associated with different socio-economic variables in Italy. PLoS One. 2015;10(6):e0127823. doi:10.1371/journal.pone.0127823

17. Kim S, Lee W. Does McNemar’s test compare the sensitivities and specificities of two diagnostic tests? Stat Methods Med Res. 2017;26(1):142–154. doi:10.1177/0962280214541852

18. Dugas AF, Kirsch TD, Toerper M, et al. An electronic emergency triage system to improve patient distribution by critical outcomes. J Emerg Med. 2016;50(6):910–918. doi:10.1016/j.jemermed.2016.02.026

19. Christ M, Grossmann F, Winter D, Bingisser R, Platz E. Modern triage in the emergency department. Dtsch Arztebl Int. 2010;107(50):892–898. doi:10.3238/arztebl.2010.0892

20. Lange R, Popp S, Erbguth F. [Focal point emergency departments]. Nervenarzt. 2016;87(6):592–602. doi:10.1007/s00115-016-0116-y

21. Hacke W, Donnan G, Fieschi C, et al. Association of outcome with early stroke treatment: pooled analysis of ATLANTIS, ECASS, and NINDS rt-PA stroke trials. Lancet. 2004;363(9411):768–774.

22. Rudd M, Buck D, Ford GA, Price CI. A systematic review of stroke recognition instruments in hospital and prehospital settings. Emerg Med J. 2016;33(11):818–822. doi:10.1136/emermed-2015-205197

23. Meretoja A, Weir L, Ugalde M, et al. Helsinki model cut stroke thrombolysis delays to 25 minutes in Melbourne in only 4 months. Neurology. 2013;81(12):1071–1076. doi:10.1212/WNL.0b013e3182a4a4d2

24. Van Schaik SM, Van der Veen B, Van den Berg-vos RM, Weinstein HC, Bosboom WM. Achieving a door-to-needle time of 25 minutes in thrombolysis for acute ischemic stroke: a quality improvement project. J Stroke Cerebrovasc Dis. 2014;23(10):2900–2906. doi:10.1016/j.jstrokecerebrovasdis.2014.07.025

25. Vanhoucke J, Hemelsoet D, Achten E. et al. Impact of a code stroke protocol on the door-to-needle time for IV thrombolysis: a feasibility study. Acta Clin Belg;2019. 1–8. doi:10.1080/17843286.2019.1607991

26. Madsen TE, Choo EK, Seigel TA, Palms D, Silver B. Lack of gender disparities in emergency department triage of acute stroke patients. West J Emerg Med. 2015;16(1):203–209. doi:10.5811/westjem.2014.11.23063

27. Tennyson JC, Michael SS, Youngren MN, Reznek MA. Delayed recognition of acute stroke by emergency department staff following failure to activate stroke by emergency medical services. West J Emerg Med. 2019;20(2):342–350. doi:10.5811/westjem.2018.12.40577

28. Kerber KA, Morgenstern LB, Meurer WJ, et al. Nystagmus assessments documented by emergency physicians in acute dizziness presentations: a target for decision support? Acad Emerg Med. 2011;18(6):619–626. doi:10.1111/acem.2011.18.issue-6

29. Rizos T, Juttler E, Sykora M, Poli S, Ringleb PA. Common disorders in the neurological emergency room–experience at a tertiary care hospital. Eur J Neurol. 2011;18(3):430–435. doi:10.1111/ene.2011.18.issue-3

30. Singler K, Bail HJ, Christ M, et al. [Correlation of patients age on length of stay and admission rate in a German emergency department]. Dtsch Med Wochenschr. 2013;138(30):1503–1508. doi:10.1055/s-0033-1343315

31. Robertson NP, Shaunak S, Compston DA. Urgent neurology out-patient referrals from primary health care physicians. QJM. 1998;91(4):309–313. doi:10.1093/qjmed/91.4.309

32. Aller-Alvarez JS, Quintana M, Santamarina E, Alvarez-Sabin J. Descriptive analysis of neurological in-hospital consultations in a tertiary hospital. Neurologia. 2017;32(3):152–157. doi:10.1016/j.nrl.2015.08.001

33. Moeller JJ, Kurniawan J, Gubitz GJ, Ross JA, Bhan V. Diagnostic accuracy of neurological problems in the emergency department. Can J Neurol Sci. 2008;35(3):335–341. doi:10.1017/S0317167100008921

34. Newman-Toker DE, McDonald KM, Meltzer DO. How much diagnostic safety can we afford, and how should we decide? A health economics perspective. BMJ Qual Saf. 2013;22(Suppl 2):ii11–ii20. doi:10.1136/bmjqs-2012-001616

35. Scherer M, Luhmann D, Kazek A, Hansen H, Schafer I. Patients attending emergency departments. Dtsch Arztebl Int. 2017;114(39):645–652. doi:10.3238/arztebl.2017.0645

36. Schmiedhofer M, Searle J, Slagman A, Frick J, Ruhla S, Mockel M. [Perception of the emergency department for outpatient care in a rural region in saxony-anhalt: a qualitative survey of patients and general practitioners]. Dtsch Med Wochenschr. 2017;142(10):e61–e73. doi:10.1055/s-0043-100639

37. Schmiedhofer MH, Searle J, Slagman A, Mockel M. [Exploring patient motives to use emergency departments for non-urgent conditions: a qualitative study]. Gesundheitswesen. 2017;79(10):835–844. doi:10.1055/s-0042-100729

38. Yau FF, Tsai TC, Lin YR, Wu KH, Syue YJ, Li CJ. Can different physicians providing urgent and non-urgent treatment improve patient flow in emergency department? Am J Emerg Med. 2018;36(6):993–997. doi:10.1016/j.ajem.2017.11.010

39. Goncalves-Bradley DC, Iliffe S, Doll HA, et al. Early discharge hospital at home. Cochrane Database Syst Rev. 2017;6:CD000356.

40. Ahmed RM, Green T, Halmagyi GM, Lewis SJ. A new model for neurology care in the emergency department. Med J Aust. 2010;192(1):30–32. doi:10.5694/j.1326-5377.2010.tb03398.x

41. Huibers LA, Moth G, Bondevik GT, et al. Diagnostic scope in out-of-hours primary care services in eight European countries: an observational study. BMC Fam Pract. 2011;12:30. doi:10.1186/1471-2296-12-30

42. Noon AJ. The cognitive processes underpinning clinical decision in triage assessment: a theoretical conundrum? Int Emerg Nurs. 2014;22(1):40–46. doi:10.1016/j.ienj.2013.01.003

43. Twomey M, Wallis LA, Myers JE. Limitations in validating emergency department triage scales. Emerg Med J. 2007;24(7):477–479. doi:10.1136/emj.2007.046383

44. Hacke W. A new DAWN for imaging-based selection in the treatment of acute stroke. N Engl J Med. 2018;378(1):81–83. doi:10.1056/NEJMe1713367

Creative Commons License © 2020 The Author(s). This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.