Preliminary findings on the reliability and validity of the Cantonese Birmingham Cognitive Screen in patients with acute ischemic stroke
Received 30 March 2015
Accepted for publication 21 April 2015
Published 16 September 2015 Volume 2015:11 Pages 2377—2390
Checked for plagiarism Yes
Review by Single anonymous peer review
Peer reviewer comments 2
Editor who approved publication: Professor Wai Kwong Tang
Xiaoping Pan,1,* Haobo Chen,1,2,* Wai-Ling Bickerton,2 Johnny King Lam Lau,2 Anthony Pak Hin Kong,3 Pia Rotshtein,2 Aihua Guo,1 Jianxi Hu,1 Glyn W Humphreys4
1Department of Neurology, Guangzhou First People’s Hospital, Guangzhou Medical University, Guangzhou, People’s Republic of China; 2School of Psychology, University of Birmingham, Birmingham, UK; 3Department of Communication Sciences and Disorders, University of Central Florida, Orlando, FL, USA; 4Department of Experimental Psychology, University of Oxford, Oxford, UK
*These authors contributed equally to this work
Background: There are no currently effective cognitive assessment tools for patients who have suffered stroke in the People’s Republic of China. The Birmingham Cognitive Screen (BCoS) has been shown to be a promising tool for revealing patients’ poststroke cognitive deficits in specific domains, which facilitates more individually designed rehabilitation in the long run. Hence we examined the reliability and validity of a Cantonese version BCoS in patients with acute ischemic stroke, in Guangzhou.
Method: A total of 98 patients with acute ischemic stroke were assessed with the Cantonese version of the BCoS, and an additional 133 healthy individuals were recruited as controls. Apart from the BCoS, the patients also completed a number of external cognitive tests, including the Montreal Cognitive Assessment Test (MoCA), Mini Mental State Examination (MMSE), Albert’s cancellation test, the Rey–Osterrieth Complex Figure Test, and six gesture matching tasks. Cutoff scores for failing each subtest, ie, deficits, were computed based on the performance of the controls. The validity and reliability of the Cantonese BCoS were examined, as well as interrater and test–retest reliability. We also compared the proportions of cases being classified as deficits in controlled attention, memory, character writing, and praxis, between patients with and without spoken language impairment.
Results: Analyses showed high test–retest reliability and agreement across independent raters on the qualitative aspects of measurement. Significant correlations were observed between the subtests of the Cantonese BCoS and the other external cognitive tests, providing evidence for convergent validity of the Cantonese BCoS. The screen was also able to generate measures of cognitive functions that were relatively uncontaminated by the presence of aphasia.
Conclusion: This study suggests good reliability and validity of the Cantonese version of the BCoS. The Cantonese BCoS is a very promising tool for the detection of cognitive problems in Cantonese speakers.
Keywords: cerebral infarction, cognitive impairment, neuropsychological testing, validation test, reliability test, Cantonese speakers
There is a high incidence of stroke in the People’s Republic of China, with the age-standardized annual incidence of first stroke among Chinese individuals aged 45–74 years falling between 205 and 584 per 100,000.1 Stroke is a common cause of cognitive impairment.2 Prior studies have shown that between 44% and 74% of patients present with some degree of cognitive disturbance when tested 6 months after their stroke – with the incidence dependent on the type of cognitive problem and the form of measurement.3 Since early intervention can improve outcome,4,5 it is important to test stroke patients and to detect cognitive impairments in the subacute stage.
The Mini Mental State Examination (MMSE)6 and the Montreal Cognitive Assessment Test (MoCA)7 are probably the most commonly used cognitive screening tests in the People’s Republic of China, if not worldwide. However, the MMSE lacks sensitivity to detect patients with mild symptoms, especially those with visuospatial and executive function impairments.8 The MoCA, though more sensitive than the MMSE,9 remains limited. For example, being developed for dementia, the MoCA is not “tuned” to detect some of the common cognitive problems after stroke – notably visuospatial neglect and apraxia.10–13 Moreover, both the MMSE and the MoCA are highly verbal screens, with the majority of tests requiring good verbal abilities. This means that patients with aphasia found after stroke can fail the tests for reasons to do with language impairments and not the putative factors being tested (eg, memory or attention). There is also a lack of specificity in assigning a problem to a specific cognitive function. These screens typically return an overall score, which cannot be easily used to direct treatment, as treatment needs to target the specific cognitive problem (eg, therapy for spatial neglect differs from that for apraxia).
The Birmingham Cognitive Screen (BCoS) battery14 is a new instrument that was developed to screen individuals for cognitive problems after a stroke and to generate a cognitive profile across a range of cognitive domains (Attention and Executive Function; Language; Memory; Number Skills; and Praxis). Importantly, the test is designed to maximize inclusion of stroke patients, while generating test results that are uncontaminated by the co-occurrence of language or spatial attention problems, which can otherwise have a contaminating impact on performance. The test is made “aphasia friendly” by including short, high-frequency words, whenever possible, when language is not directly assessed and by incorporating forced-choice response options (so aphasic patients can point even when they cannot make a verbal response). The tests are “neglect friendly” in their spatial design (the stimuli are vertically aligned in the mid-line, in order to avoid interference of neglect) and the use of multimodal exposures.
The participants were 98 patients with ischemic stroke, from the Neurological Department of Guangzhou First People’s Hospital, and 133 healthy controls. The control participants were recruited from the physical examination center in the hospital, from among relatives of the patients, and from among residents of several old peoples’ communities in Guangzhou. All the participants were native Cantonese speakers.
All the control participants were aged 50 years or above, without a history of brain lesion and without complaint of memory loss. Participants who had a MoCA score less than 22 were excluded from the control group.15,16
Patients were recruited between July 2013 and March 2014.
The inclusion criteria for the patient group were as follows:
- Aged 50 years and above
- Within 2 weeks of a confirmed stroke and without a prior history of brain lesion; the patient was judged by the clinical team to be able to concentrate for at least 45 minutes, to enable the tests to be administered
- The patient consented to testing and signed the consent document.
The exclusion criteria were:
- Past history of cognitive impairment and brain lesion including a history of stroke
- The presence of chronic heart failure, anemia, or other diseases that may lead to cognitive impairment
- Inability to concentrate for at least 45 minutes.
The study was approved by the local research ethics committee, and participants gave informed, written consent.
Cultural and linguistic modifications of BCoS
The validity and reliability of the BCoS has previously been established in English (in the UK).17 In the present paper, we report on the validity and reliability of the Cantonese version of the screen. For this version, four specific cultural and linguistic modifications were made.
Some of the items were identified as being culturally inappropriate in the People’s Republic of China, and these were replaced (eg, the picture of a colander was rejected, as colanders are not standardly used in Chinese cooking; this was replaced with a picture of a spatula).
Sentence reading and nonword reading
Here, we define a “regular” character as one being “regular-consistent” while an “exception” character as one being “irregular-inconsistent”. Both ‘regularity’ and ‘consistency’ are often used to describe mapping between orthography and phonology.18 Broadly speaking, a written word (ie, a character in Chinese writing) is regular if its pronunciation follows the grapheme-to-phoneme correspondence rules of the written language (eg, “doctor” in English);19 and a word/character is an exception if its pronunciation deviates from those rules (eg, “daughter” in English). Consistency is described with respect to the orthographic body and the phonological rime. A consistent word/character (eg, wade in English) is one that has a word-body (-ade) pronounced in the same way for the entire set of orthographic neighbors (eg, spade, jade, made). An inconsistent word/character (e.g., wave in English) has among its neighbors at least one exception word (eg, have).
In the Cantonese sentence reading task, we included only ‘regular’ characters which are also ‘consistent’, that is, those having a consistency value of >80% (ie, more than 80% of its orthographic neighbors are pronounced in the same way as the chosen word). With regard to the ‘exception’ characters, we included only ‘irregular’ characters which are also ‘inconsistent’, that is, those having a consistent value of <20% (ie, less than 20% of its orthographic neighbors are pronounced in the same way as it is). On the whole, all items chosen have a frequency of >200 (in millions) documented in Leung et al (unpublished database, 2010).
Gesture production and gesture recognition
Some of the gestures were replaced to fit with Chinese culture and daily habits (eg, the gesture of hitchhiking was rejected because this activity is not common in the People’s Republic of China; this item was then replaced with a gesture of rubbing one’s thumb and forefinger together to indicate money).
Chinese character writing is an equivalent task to (real) word writing in the original English version. During the task, a common, familiar word (eg, “”, the word for “eye” in Chinese) consisting of the target character (eg, “”, /ngaan5/) and another character that often coappears (eg, “”, /zing1/) is voiced out, although the participant is only required to produce the target character in the written response. There are four items in this test, half of which are concrete characters (representing real objects), and the other half are abstract (representing concepts). Within each category, one item is a regular character, while the other is an exception character. The characters were taken from The Hong Kong, Mainland China and Taiwan: Chinese Character Frequency list (http://humanum.arts.cuhk.edu.hk/Lexis/chifreq/), with a word frequency ranging between 5000/663461 and 11115/663461. The 15 characters are controlled for the six tones in Cantonese, part-of-speech, number of strokes, and phonetic structures (“CV”, “CVV”, and “CVC”),20 with minimal repetition of the same onsets and rimes. Disyllabic and trisyllabic word items were created by randomly combining the 15 characters. Character combination was subsequently verified to ensure that characters do not exist together in any known words in Cantonese. Regarding nonword writing, a test of writing Chinese pseudocharacters (or nonwords) is not available in the Cantonese version, as it is impossible to achieve in the logographic Chinese writing system.
A forward–backward translation of the BCoS was conducted. The battery was first translated from English into Cantonese by author AK. Author JL then translated the Cantonese version back into English. Any disagreements (<5% out of all translated items) were subsequently resolved to maintain the integrity, consistency, and accuracy of the translation. Note that some items in subtests were replaced by stimuli with cultural and linguistic modifications (as described above); all other items were directly adopted and translated from the English version.
All the patients were tested on the Cantonese version of the BCoS, the MoCA, the MMSE, Albert’s test of neglect,21 the Rey–Osterrieth Complex Figure Test,22 and six gesture matching tasks from Goldenberg.23 The MoCA and MMSE were used to validate assessments of language, number processing, and memory; the Rey–Osterrieth Complex Figure Test was used to validate complex figure copying; Albert’s test was used to validate the BCoS measure of neglect (Apple cancellation); and Goldenberg’s tasks were employed to validate the praxis tests in the BCoS. All the participants were randomly assessed by one of four testers in our study. All the testers were doctors in the Neurological Department, and all were trained in test administration by the research teams at Birmingham and Oxford Universities (UK). The interrater reliability was shown in the results.
Subsets of the controls and the patients were retested on a second occasion to establish test–retest reliability. The subject’s identity (as a control or patient) was not blind to the testers, as it is almost impossible to blind a tester to the presence of a hemiplegia or a major cognitive deficit in a stroke patient. Also, scores requiring qualitative judgments of performance were assessed by two other testers in order to evaluate interrater reliability. The testers were blind to each other’s score.
Demographic data were compared between the control and patient groups using an independent t-test. Cutoffs were set at the 5th percentile, for scores indicating high ability, and at the 95th percentile, for scores indicating difficulties, and were smoothed across age groups. Pearson’s correlation tests were used to test the test–retest reliability and convergent validity. The interrater reliability was addressed by calculating interclass correlations among the scores of three parallel ratings of the Cantonese version BCoS.
A total of 133 healthy participants were assessed, with 51 males and 82 females. The average age of these controls was 65.70±8.99 years, and the average years of education was 9.12±4.20. Ninety-eight stroke patients participated, including 57 males and 41 females. Considering the decay of cognitive ability along with age growth, participants were divided into two age groups. Within each of the age groups, the patients and controls did not differ in either their age or the level of education (both P>0.05) (Table S1).
There were 98 patients in our study, including 39 patients with left hemispheric lesion, 36 with right hemispheric lesion, five with bilateral hemispheric lesion, and 15 with brainstem and cerebellum lesion. According to the TOAST classification,24 there were 30 patients with large-artery atherosclerosis, seven with cardioembolism, 57 with small-artery occlusion, and four with undetermined etiology. The average National Institutes of Health Stroke Scale (NIHSS) score of the patient group was 2.355±2.45 (ranged from 0 to 15).
The standardization sample for BCOS was divided into two age groups: 50–69 years and ≥70 years. The mean score and 5th and 95th percentile cutoffs are presented in Table 1. The test labels presented in the table were all taken from the BCoS.24 Subtests were divided into their respective domains.
Table 1 Mean scores, and 5th and 95th percentiles across the two age groups of healthy participants
Cutoff scores were set at the 5th percentile for scores indicating high ability and the 95th percentile for scores indicating difficulties, smoothed across age groups. The cutoffs were set at the 2.5th and 97.5th percentiles for subtests that had two tails (eg, the spatial asymmetry scores, which could be positive or negative).
Table 2 Numbers of patients who were impaired on BCoS subtests
The results are consistent with considerable numbers of patients being impaired relative to our cutoffs – up to 40% of the patients had some impairment in complex figure copy, and about 20% had problems in aspects of controlled attention (eg, auditory attention accuracy). Note that these particular tests are relatively unbound by culture.
The test–retest assessments were performed on the eleven controls, who were examined with a test–retest interval ranging from 122 to 330 days (205±95.93 days). The average age of these participants was 63.8 years (SD =7.99 years), and they had received an average of 10.5 years of education (SD =3.39 years). There were five males and six females. In addition, test–retest resampling was also carried out on 15 stroke patients. The average age of the stroke patients was 64.5 years (SD =6.66 years). There were 12 males and three females, and they had received an average 9 years of education (SD =3.17 years). The test–retest interval in this case ranged from 102 to 191 days (144.2±25.61 days).
The data were analyzed in two ways. First, correlations were conducted between the test and retest scores, pooling the data across patients and controls to maximize power. Tests were not included here, where the controls were uniformly at ceiling. This meant, too, that for the measure of spatial attention, we took only the overall score and not the asymmetry scores (since controls showed no spatial asymmetries). The correlation results are shown in Table 3.
Table 3 Correlations between the initial test scores and the retest scores
There were reliable correlations across all the subtests that remained after filtering for ceiling effects. These correlations were not solely due to the contrast between patients and controls, and were apparent even when each group was considered alone.
In the second analysis, we assessed performance differences at times 1 and 2, using the Wilcoxon signed rank test. As for the correlation analyses, the assessments were performed only for tests where the controls did not score at ceiling and then, pooling the data across the patients and the controls (Tables S2, S3, and S4). In nearly all cases, there were no differences between performance on the two test occasions. The exceptions to this were for the recognition test and the second recall task, where performance improved on the second test occasion. This held for the data for the patients when they were considered alone too (P=0.026 [recognition test] and P=0.064 [second recall test]).
There are five tests in the BCoS where scoring requires qualitative judgments of performance: the sentence construction task, multistep object use tasks, gesture production, imitation, and figure copying. To assess interrater reliability, three independent raters scored the performance of ten ischemic stroke patients, and interclass correlations (ICC) between the scores of the three parallel ratings of the BCoS subtests were calculated. Results showed that there was no significant difference between the raters’ judgments in respect of these qualitative assessments (Table S5).
The different subtests of the BCOS were validated against existing measures chosen to index the same underlying cognitive function. The standard tests selected for each BCoS subtest are listed in Table 4, along with the number of participants (patients and controls) for which data were collected and correlated. The data reported in Table 4 cover both patients and controls (pooled results) and indicate reliable correlations across all the selected tasks. This did not reflect purely the difference between the patients and the controls, and similar results occurred for just the patients considered alone (Table S6).
Table 4 Correlations with comparable standardized tasks
The results indicate reliable correlations between the subtests of the BCoS and the standard tests chosen to measure selective cognitive functions.
Performance of patients with aphasia
Due to its design (ie, the use of short, high-frequency words and forced-choice testing), the BCoS is able to gain measures on many functions for patients with language problems. This is less apparent for other screens, such as the MMSE and the MoCA, where measures depend on the patients having good spoken language. To assess the effectiveness of the BCoS for these patients, we examined the performance of patients with and without a problem on the sentence construction test of the tests of controlled attention (auditory attention and executive function), memory (story free- recall 1 and story recognition 1), character writing, and praxis (figure copy and multistep object use). Patients were defined as having a spoken language problem if they fell beneath the cutoff on the sentence construction test. We divided patients into two subgroups based on their sentence construction scores. Table 5 presents the numbers of patients in each group who were impaired on the tests mentioned above, according to the cutoffs given in Table 1. The comparisons of incidence rate of disability in controlled attention, memory, character writing, and praxis, between patients with and without spoken problem were presented in Table 5 as well.
Table 5 Numbers of patients in each group who were impaired on the tests
The table indicates that the aphasic patients largely performed worse than the nonaphasic patients in most of the subtests. Nevertheless, in very many cases, at least half the aphasic patients were able to generate normal scores on other aspects of the BCoS.
There is currently no screen for Chinese individuals (Cantonese speakers) that has been specially designed (ie, being “aphasia and neglect friendly”) to maximize the inclusion of patients after stroke while being sensitive to common cognitive problems after stroke (such as spatial neglect and apraxia). To rectify this, we constructed a Cantonese version of the BCoS, a screen designed specifically to address these problems in English. We showed that the Cantonese version BCoS has high convergent validity; there were reliable correlations between each of the subtests and standard tests in the literature chosen to assess a particular aspect of cognition. This demonstrates that the Cantonese version BCoS does indeed assess the subfunctions being proposed. The Cantonese version BCoS also had good test–retest reliability, and there was good reliability across trained testers in the scoring of the qualitative aspects of the screen. Moreover, by using the screen, we were able to generate scores on non-language-based tests in patients with poor language (eg, the measures of executive function in patients with poor picture naming). Thus the Cantonese version BCoS can be very useful for generating cognitive profiles that are (relatively) uncontaminated by poor language, in stroke patients.
The screen did indicate that there were relatively high numbers of patients with cognitive impairments after their stroke. Around 40% of the patients showed poor figure copy, and 30% were impaired on the BCoS measures of sustained attention – these tests either use nonverbal or (at most) very simple linguistic material, so it is interesting that high incidence rates were noted. In addition to this, there were high incidence rates for apraxia and impaired spatial attention (~27% of the sample were impaired on the multistep object use task and on gesture recognition, and ~28% of patients had an impairment on the test of spatial attention). Given that these impairments are not measured in standard screens currently applied in the People’s Republic of China (ie, the MoCA and the MMSE), the Cantonese version BCoS certainly has distinct advantages. Notably, the majority of subjects recruited in our patient group had lacunar infarction (57 out of 98 patients in our group suffered from small-artery occlusion). According to previous studies, mild cognitive impairment was present in up to 50% of patients with lacunar stroke, even in those with minimal or without physical disabilities.25,26 Other research has shown that more than half of patients with a first-ever lacunar stroke and without cognitive impairment show minor neuropsychological alterations, particularly in the performance of executive functions (eg, semantic fluency) and short-delayed verbal memory. Therefore it is very important to include a “neuropsychological study” in future clinical trials in patients with lacunar stroke.27
Another advantage of the Cantonese version BCoS compared with other current screens relates to the procedures for reporting BCoS scores. The BCoS uses a “wheel of cognition”, which enables deficits (or strengths) in particular domains of cognition to be grasped at a glance (Figure S1). This facilitates the reporting of domain-specific deficits (rather than reporting back a single score, as is done for the MoCA and the MMSE), which we suggest is important in order to target rehabilitation at the subdomains that are affected in the patients. We suggest that the combined use of the Cantonese version BCoS and of its reporting scheme will substantially improve the early detection and rehabilitation of cognitive problems after stroke in the People’s Republic of China.
However, there were still some limitation in our study. Firstly, the stroke patients recruited in the study generally had relatively low NIHSS scores, indicating that their neurological functions were mildly to moderately impaired. Hence it is unclear whether the Cantonese version BCoS is effective enough for stroke patients with severe neurological impairments. Secondly, our sample size was relatively small. Therefore a larger sample for reassessment is needed in the future study, to make the data more representative. Finally, since the time required for completing the questionnaire is about 1 hour, some patient data were missing because of fatigue or inability to concentrate for such a lengthy period.
This work was supported by a grant from the Science and Technology Program of Guangzhou, People’s Republic of China (grant number 2012J5100039).
The authors report no conflicts of interest in this work.
Tsai CF, Thomas B, Sudlow CL. Epidemiology of stroke and its subtypes in Chinese vs white populations: a systematic review. Neurology. 2013;81(3):264–272.
Rasquin SM, Lodder J, Visser PJ, Lousberg R, Verhey FR. Predictive accuracy of MCI subtypes for Alzheimer’s disease and vascular dementia in subjects with mild cognitive impairment: a 2-year follow-up study. Dement Geriatr Cogn Disord. 2005;19(2–3):113–119.
Alvarez-Sabín J, Román GC. Citicoline in vascular cognitive impairment and vascular dementia after stroke. Stroke. 2011;42(1 Suppl):S40–S43.
Blackburn DJ, Krishnan K, Fox L, et al. Prevention of Decline in Cognition after Stroke Trial (PODCAST): a study protocol for a factorial randomised controlled trial of intensive versus guideline lowering of blood pressure and lipids. Trials. 2013;14:401.
Erkinjuntti T, Román G, Gauthier S, Feldman H, Rockwood K. Emerging therapies for vascular dementia and vascular cognitive impairment. Stroke. 2004;35(4):1010–1017.
Folstein MF, Folstein SE, McHugh PR. “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12(3):189–198.
Nasreddine ZS, Phillips NA, Bédirian V, et al. The Montreal Cognitive Assessment, MoCA: A brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53(4):695–699.
Dong Y, Sharma VK, Chan BP, et al. The Montreal Cognitive Assessment (MoCA) is superior to the Mini-Mental State Examination (MMSE) for the detection of vascular cognitive impairment after acute stroke. J Neurol Sci. 2010;299(1–2):15–18.
Pendlebury ST, Cuthbertson FC, Welch SJ, Mehta Z, Rothwell PM. Underestimation of cognitive impairment by Mini-Mental State Examination versus the Montreal Cognitive Assessment in patients with transient ischemic attack and stroke: a population-based study. Stroke. 2010;41(6):1290–1293.
Bickerton WL, Riddoch MJ, Samson D, Balani AB, Mistry B, Humphreys GW. Systematic assessment of apraxia and functional predictions from the Birmingham Cognitive Screen. J Neurol Neurosurg Psychiatry. 2012;83(5):513–521.
Bickerton WL, Samson D, Williamson J, Humphreys GW. Separating forms of neglect using the Apples Test: validation and functional prediction in chronic and acute stroke. Neuropsychology. 2011;25(5):567–580.
Chechlacz M, Rotshtein P, Roberts KL, Bickerton WL, Lau JK, Humphreys GW. The prognosis of allocentric and egocentric neglect: evidence from clinical scans. PLoS One. 2012;7(11):e47821.
Nys GM, van Zandvoort MJ, de Kort PL, et al. The prognostic value of domain-specific cognitive abilities in acute first-ever stroke. Neurology. 2005;64(5):821–827.
Bisiker J, Bickerton W-L. Using a comprehensive and standardised cognitive screen to guide cognitive rehabilitation in stroke. Br J Occup Ther. 2013;76(3):151–156.
Wong A, Xiong YY, Kwan PW, et al. The validity, reliability and clinical utility of the Hong Kong Montreal Cognitive Assessment (HK-MoCA) in patients with cerebral small vessel disease. Dement Geriatr Cogn Disord. 2009;28(1):81–87.
Yeung PY, Wong LL, Chan CC, Leung JL, Yung CY. A validation study of the Hong Kong version of Montreal Cognitive Assessment (HK-MoCA) in Chinese older adults in Hong Kong. Hong Kong Med J. 2014;20(6):504–510.
Humphreys GW, Bickerton W-L, Sampson D, Riddoch M. BCoS cognitive screen. Hove: Psychology Press; 2012.
Lee CY, Tsai JL, Su EC, Tzeng OJ, Hung DL. Consistency, regularity, and frequency effects in naming Chinese charcters. Lang Linguist. 2005;6(1):75–107.
Venezky RL. The Structure of English Orthography. The Hague, the Netherlands: Mouton; 1970.
Bauer RS, Benedict PK. Modern Cantonese phonology. Berlin: Mouton de Gruyter; 1997.
Albert ML. A simple test of visual neglect. Neurology. 1973;23(6):658–664.
Cherrier, MM, Mendez MF, Dave M, Perryman KM. Performance on the Rey-Osterrieth Complex Figure Test in Alzheimer disease and vascular dementia. Cognitive and Behavioral Neurology. Neuropsychiatry Neuropsychol Behav Neurol. 1999;12(2):95–101.
Goldenberg G. Defective imitation of gestures in patients with damage in the left or right hemispheres. J Neurol Neurosurg Psychiatry. 1996;61(2):176–180.
Adams HP, Bendixen BH, Kappelle LJ, et al. Classification of subtype of acute ischemic stroke. Definitions for use in a multicenter clinical trial. TOAST. Trial of Org 10172 in Acute Stroke Treatment. Stroke. 1993;24(1):35–41.
Jacova C, Pearce LA, Costello R, et al. Cognitive impairment in lacunar strokes: the SPS3 trial. Ann Neurol. 2012;72(3):351–362.
Grau-Olivares M, Arboix A, Bartrés-Faz D, Junqué C. Neuropsychological abnormalities associated with lacunar infarction. J Neurol Sci. 2007;257(1–2):160–165.
Blanco-Rojas L, Arboix A, Canovas D, Grau-Olivares M, Oliva Morera JC, Parra O. Cognitive profile in patients with a first-ever lacunar infarct with and without silent lacunes: a comparative study. BMC Neurol. 2013;13:203.
Birmingham Cognitive Screen (BCoS)-Cantonese
Table S1 The comparison in age and education years between controls and patients within each age group (mean ± standard deviation)
Table S2 Comparisons of test–retest scores (pooled across patients and controls)
Table S3 Comparisons of test–retest scores (control group)
Table S4 Comparisons of test–retest scores (patient group)
Table S5 Interrater reliability for the sentence construction tasks, multistep object use, gesture production, gesture imitation, and figure copying
This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.