Atormac
Neurology India
menu-bar5 Open access journal indexed with Index Medicus
  Users online: 5712  
 Home | Login 
About Editorial board Articlesmenu-bullet NSI Publicationsmenu-bullet Search Instructions Online Submission Subscribe Videos Etcetera Contact
  Navigate Here 
 Search
 
  » Next article
  » Previous article 
  » Table of Contents
  
 Resource Links
  »  Similar in PUBMED
 »  Search Pubmed for
 »  Search in Google Scholar for
 »Related articles
  »  Article in PDF (525 KB)
  »  Citation Manager
  »  Access Statistics
  »  Reader Comments
  »  Email Alert *
  »  Add to My List *
* Registration required (free)  

 
  In this Article
 »  Abstract
 »  Introduction
 »  Patients and Methods
 »  Results
 »  Discussion
 »  References
 »  Article Figures
 »  Article Tables

 Article Access Statistics
    Viewed6808    
    Printed201    
    Emailed6    
    PDF Downloaded182    
    Comments [Add]    
    Cited by others 8    

Recommend this journal

 


 
ORIGINAL ARTICLE
Year : 2010  |  Volume : 58  |  Issue : 5  |  Page : 702-707

The concise cognitive test for dementia screening: Reliability and effects of demographic variables as compared to the mini mental state examination


Consultant Neurologist, Lanka Hospitals, Colombo, Sri Lanka

Date of Acceptance11-Jul-2010
Date of Web Publication28-Oct-2010

Correspondence Address:
Srikanth Srinivasan
Consultant Neurologist, Lanka Hospitals, Elvitigala Road, Colombo-05
Sri Lanka
Login to access the Email id

Source of Support: None, Conflict of Interest: None


DOI: 10.4103/0028-3886.72167

Rights and Permissions

 » Abstract 

Background: The Mini Mental State Examination (MMSE) is widely used for dementia screening but has several shortcomings such as prominent ceiling effects, inadequate sensitivity to mild cognitive impairment, and uneven sampling of the major cognitive domains. Aims: In this study, we pilot a new dementia screening test - the Concise Cognitive Test (CONCOG) - designed to overcome the above short comings and describe the reliability measures and age, education, and gender effects. The CONCOG has a total score of 30, and has subtests for orientation, naming, registration, free recall and recognition of four words, semantic verbal fluency and copying. Patients and Methods: Participants were screened to exclude those with any neurological or psychiatric disease, simultaneously administered the CONCOG, and a Hybrid Mini Mental State Examination (HMMSE) adapted from Folstein's MMSE and Ganguli's Hindi Mental State Examination. Results: The study sample had 204 subjects over the age of 60 years with a mean of 73 years and education level of 8 (4.5) years. Internal consistency for the CONCOG (Cronbach's alpha) was 0.74, inter-rater reliability (Kendall's tau-b) was 0.9, and the one-month test-retest reliability (Kendall's tau-b) was 0.7. Age and education level, but not gender, significantly influenced performance on both scales. Although the influence of age on the two scales was to a similar degree, the HMMSE was more affected by education than the CONCOG. Of 204 subjects, only 12 (5.7%) subjects obtained the maximum score on the CONCOG compared with 30 (14.1%) subjects on the HMMSE. The CONCOG took less than 10 minutes to complete in this sample. Age and education stratified norms are presented for the CONCOG. Conclusions: The CONCOG is a reliable cognitive screening measure. It has negligible ceiling effects, is less influenced by education compared with the HMMSE, and offers subscale scores for the major cognitive domains.


Keywords: Age, dementia, education, Mini Mental State Examination, screening


How to cite this article:
Srinivasan S. The concise cognitive test for dementia screening: Reliability and effects of demographic variables as compared to the mini mental state examination. Neurol India 2010;58:702-7

How to cite this URL:
Srinivasan S. The concise cognitive test for dementia screening: Reliability and effects of demographic variables as compared to the mini mental state examination. Neurol India [serial online] 2010 [cited 2019 Nov 16];58:702-7. Available from: http://www.neurologyindia.com/text.asp?2010/58/5/702/72167



 » Introduction Top


Screening for dementia/cognitive impairment in the clinic requires an instrument that is brief, yet reliable. Despite universal use for this purpose, the Mini Mental State Examination (MMSE) [1] has many shortcomings such as insensitivity to mild and subcortical pattern of impairment, prominent ceiling effects, and uneven sampling of major cognitive domains. These concerns remain despite many translations and adaptations for populations with low literacy levels. [2],[3],[4]

However, it has not been possible to stop using the MMSE because of its simplicity, brevity, and the absence of the need for specialized testing material. The need for an alternative to the MMSE has lead to the development of cognitive screening measures such as the Demtect, [5],[6] seven minute screen [7],[8],[9],[10] 7 MS, and the Montreal Cognitive Assessment. [11],[12],[13] Though these measures have demonstrated better sensitivity and specificity for diagnosing early dementia/mild cognitive impairment compared with the MMSE they take longer to administer, are more affected by education while some of them require complex test materials and are not easy to score.

We collated well accepted cognitive screening items into the Concise Cognitive Test (CONCOG) to overcome the above shortcomings. Our main concerns were to keep the scale brief, simple, covering all major cognitive domains, and have minimal ceiling and educational effects. In this article, we describe the development, initial validation, and norming of the CONCOG in healthy elderly individuals.


 » Patients and Methods Top


Subjects

After obtaining informed consent, all volunteering community-dwelling cognitively healthy elders were administered an initial screening interview and a clinical examination to exclude medical, neurological, or psychiatric illnesses that might affect cognition. All eligible subjects were then administered the CONCOG and the Hybrid Mini Mental State Examination (HMMSE) by the same rater in a language of their choice (English, Sinhala, or Tamil), without repeating items common to both. The study was approved by the local institutional review board.

Scales

The HMMSE was created by amalgamating Folstein et al.'s MMSE [1] and Ganguli et al.'s Hindi Mental State Examination. [2] This was to improve its screening power without eliminating the MMSE's advantage of being not affected by education and culture fair as compared with the MMSE. The orientation items were as in the MMSE, but with minor modifications. Serial subtraction of 7s was replaced by serial subtraction of 3s. The unrelated words for learning and recall were administered in the same way as in the CONCOG. The repetition, visual comprehension, verbal sentence production, and copying items were as in the MMSE. This HMMSE is nearly identical to a previous Sinhala version of the MMSE validated in Sri Lanka. [3]

The CONCOG is shown in the Appendix. It has items screening for the following cognitive domains: orientation to time (3 points), language (7 points), verbal episodic memory (8 points), visuospatial skills (4 points), and executive functions (8 points). We deliberately reduced the points for the orientation domain and allocated more weight to language, memory and executive function domains in keeping with their importance in the diagnosis of dementia and the differentiation of subtypes. The orientation item has only 3 points as compared with the MMSE which has 10 points. The language item includes naming of seven body parts. The memory item includes learning, delayed free recall, and multiple choice recognition of four unrelated words. Category verbal fluency (animals per minute) was chosen as the executive function item. The visuospatial domain includes copying of two simple diagrams (flower and diamond within a square). The total possible score on the CONCOG is also 30 in keeping with our aim of retaining the familiar format of the MMSE.

Neuropsychological measures


A subset of 30 patients also underwent neuropsychological assessment at the same time that the brief scales were administered. These neuropsychological measures consisted of

  • word list learning (eight words; three trials), delayed word list recall, and word recognition
  • picture learning (eight pictures; two trials), delayed picture recall, and picture recognition
  • Silhouette naming and dot position discrimination subtests from the Visual Object and Space Perception Battery
  • Buccofacial praxis, limb praxis production, and limb praxis reception
  • Maze completion task
  • Alternate target cancellation test
  • Go-no-go test


These tests assessed the domains of episodic memory, visual perception and spatial skills, praxis and executive functions.

Statistics

SPSS version 16.00 and MedCalc software [14] were used for all statistical analyses. Test-retest and inter-rater reliability for the CONCOG and correlations between the two scales and neuropsychological tests assessing the major cognitive domains were calculated using Kendall's coefficient b and Pearson's correlation coefficient. Multiple linear regression was employed to assess effects of age, gender, and education on test scores. Means, standard deviations, and percentile scores were calculated for groups stratified a priori according to age (≤75 and >75) and education (≤8 years and >8 years). One-way analysis of variance followed by post hoc comparisons using Scheffe's procedure were used to compare group differences. All analyses were two-tailed and the significance level was set at P<0.05.


 » Results Top


The total sample consisted of 204 subjects with a male:female distribution of 123:81. There were 58 subjects (28.4%) with less than five years of formal schooling and 15 (7.3%) with more than 15 years of education. There were 46 subjects (22.5%) over the age of 80 years and 12 (5.8%) below the age of 60 years. The CONCOG could be administered in less than 10 minutes and was well accepted by all subjects, as evidenced by no refusals. Internal consistency (Cronbach's alpha) for the CONCOG was 0.7. Inter-rater reliability was excellent (Kendall's tau-b=0.9). One month test-retest reliability was high (Kendall's tau-b=0.7). Of 204 subjects, only 12 subjects (5.7% of the sample) scored at ceiling level for the CONCOG compared with 30 (14.1% of the sample) for the HMMSE.

The CONCOG also had a more normal distribution of scores than the HMMSE as shown in [Figure 1]. Convergent validity was assessed by examining correlations (using Kendall's tau-b) between the CONCOG/HMMSE and neuropsychological measures of memory, praxis, visual perception and spatial skills, and executive functions to a subset of 30 subjects. The CONCOG showed significant correlations with neuropsychological measures of memory and executive function and better correlations with tests for perception and ideomotor praxis than the HMMSE [Table 1].
Table 1: Correlations between neuropsychological tests and the two brief scales

Click here to view
Figure 1: Distribution of scores for the two scales

Click here to view


Linear regression analyses to determine the influence of gender, age, and education on HMMSE and CONCOG test scores revealed the following: age and education, but not gender, significantly affected CONCOG and HMMSE test performances. Although the effect of age on both the scales was similar, the HMMSE was more affected by education than the CONCOG [Table 2]. Correlations between the subtests of the CONCOG and age and education were also determined - education had significant positive correlations with all subtests except memory, whereas age had significant negative correlations with verbal fluency, memory, and copying subtests.
Table 2: Results of multiple linear regression

Click here to view


We also looked at the relative difficulty of each subscale of the CONCOG in the present sample by calculating the percentage of the whole sample that scored at ceiling level. The verbal fluency subscale was the one with lowest percentage of subjects scoring at ceiling level, while the orientation subscale showed the most number of subjects scoring at ceiling level [Table 3].
Table 3: Ceiling effects on the CONCOG and subscales

Click here to view


Means, standard deviations, 7 th , 10 th , and 25 th percentile scores on the HMMSE and CONCOG for the four groups identified a priori were calculated. One way analysis of variance followed by post hoc group comparisons using Scheffe's procedure showed that the mean CONCOG and HMMSE scores were significantly different only for the following groups: group with age ≤75 and education >8 years vs. all other subgroups [Table 4].
Table 4: Age and education stratified norms

Click here to view



 » Discussion Top


Our initial expectations in developing the CONCOG seem to have been met to a great extent. The new scale is brief, simple, and does not require any specialized test material. It has showed good construct validity, high test-retest and inter-rater reliability. It demonstrates significant correlations with neuropsychological measures of memory and executive functions and better correlations with tests for perception and ideomotor praxis than the HMMSE. Compared with the version of the MMSE used in this study, the new scale is less influenced by the level of education. It has also demonstrated less ceiling effects than the HMMSE. But unlike the MMSE, it samples all major cognitive domains, especially executive function tests, which is a very important domain in dementia screening especially for the subcortical dementias. Because the language and visuospatial items are also better represented, the CONCOG would also be useful in tracking the longitudinal progression of cognitive deficits in dementia. The memory subscale comprising four word learning followed by delayed free recall and recognition and the verbal fluency subscale would also prove to be useful in screening for subcortical dementias, where the memory impairment is of the retrieval type rather than one of storage. The reduced weighting given to the orientation subscale would help minimize false positive results, as has already been shown in a previous study from India. [10]

Thus the CONCOG seems to perform adequately on five of the six psychometric measures recommended for an ideal dementia screening test. [15] We decided against the practice of choosing a well-established screening test and suitably adapt and translate that to meet our needs, [2],[3],[4] as we strongly believe that a screening test introduced in a language and socio-cultural milieu vastly different from the one in which it is intended to be used might not perform well as a test that has been primarily designed for use in that population itself. This might be so not only because of the varying educational levels in populations, but also due to differing importance given to various items that constitute these tests. For example, South Asian elders would be specially disadvantaged in copying a three dimensional cube or tests of phonemic fluency. This has already been substantiated in a few studies that have directly compared performance on cognitive screening items between Asian and Caucasian elders. [16],[17],[18],[19],[20] Even the use of a common screening instrument initially developed for a population with low literacy levels does not obviate the effects of education and culture, as has been conclusively shown by the 10/66 dementia research group in the largest ever normative study of a cognitive screening test (Community screening instrument for dementia). [21]

The MMSE (in a translated or adapted version) has been administered to elders in the Indian subcontinent in a few studies. [22],[23],[24] It has been directly compared with the Rowland Universal Dementia Assessment Scale (RUDAS) and the Addenbrooke's Cognitive Examination (ACE). A small pilot study assessed the equivalence between the MMSE and HMSE in a North Indian site, and concluded that there were discrepancies in classification of cognitive status using either scale. [23] In the largest such comparative study to date, it was shown that education and age significantly affected scores on the MMSE and ACE, with the level of education having a far greater influence on test scores than age. [22] Gender did not significantly affect scores in that study. In the study that compared the MMSE with the RUDAS, education had stronger correlation with the MMSE than the RUDAS. [24] Similar to the above studies, age and education, but not gender, were found to significantly affect scores on the Community Screening Interview for dementia (CSI-D) in both rural and urban Indian sites. [21]

A few limitations to this study also need to be pointed out. The sample size of 205 is not adequate enough to develop norms for a cognitive screening test. The subjects recruited here might not be fully representative of elders living in the community with varying educational and socioeconomic levels. More robust norms for the scale can only be developed, if longitudinal follow-up of these normal elderly subjects is done and scores of those who subsequently go on to develop any cognitive impairment are excluded.

In keeping with the recommendations of the Vascular Cognitive Impairment Harmonization standards committee the CONCOG fits into the role of a 5 minute screen. [25] However, the goals expected to be fulfilled with its development would be achieved only if we demonstrate that the CONCOG is sensitive enough to detect mild cognitive impairment. These studies are currently underway and would form the bases for future publications.[Additional file 1]

 
 » References Top

1.Folstein MF, Folstein SE, McHugh PR. 'Mini-mental state'. A practical method for grading the cognitive state of patients for the clinician. J Psych Res 1975;12:189-98.  Back to cited text no. 1
    
2.Ganguli M, Ratcliff G, Chandra V, Sharma S, Gilby JE, Pandav R, et al. A Hindi version of the MMSE: the development of a cognitive screening instrument for a largely illiterate rural elderly population in India. Int J Geriatr Psychiatry 1995;10:367-77.   Back to cited text no. 2
    
3.De Silva HA, Gunatilake SB. Mini Mental State Examination in Sinhalese: a sensitive test to screen for dementia in Sri Lanka. Int J Geriatr Psychiatry 2002;17:134-9.  Back to cited text no. 3
[PUBMED]  [FULLTEXT]  
4.Xu G, Meyer JS, Huang Y, Du Fang, Chowdhury M, Quach M. Adapting Mini-Mental State Examination for dementia screening among illiterate or minimally educated elderly Chinese. Int J Geriatr Psychiatry 2003;18:609-16.  Back to cited text no. 4
    
5.Kalbe E, Kessler J, Calabrese P, Smith R, Passmore AP, Brand M,et al. DemTect: a new, sensitive cognitive screening test to support the diagnosis of mild cognitive impairment and early dementia. Int J Geriatr Psychiatry 2004;19:136-43.  Back to cited text no. 5
[PUBMED]  [FULLTEXT]  
6.Larner AJ. DemTect: 1-year experience of a neuropsychological screening test for dementia.Age Ageing 2007;36:326-7.  Back to cited text no. 6
[PUBMED]  [FULLTEXT]  
7.Solomon PR, Hirschoff A, Kelly B, Relin M, Brush M, DeVeaux RD, et al. A 7 minute neurocognitive screening battery highly sensitive to Alzheimer's disease. Arch Neurol 1998;55:349-55.  Back to cited text no. 7
[PUBMED]  [FULLTEXT]  
8.Meulen EF, Schmand B, van Campen JP, de Koning SJ, Ponds RW, Scheltens P, et al. The seven minute screen: a neurocognitive screening test highly sensitive to various types of dementia. J Neurol Neurosurg Psychiatry 2004;75:700-5.  Back to cited text no. 8
[PUBMED]  [FULLTEXT]  
9.Ijuin M, Homma A, Mimura M, Kitamura S, Kawai Y, Imai Y,et al. Validation of the 7-Minute Screen for the detection of early-stage Alzheimer's disease. Dement Geriatr Cogn Disord 2008;25:248-55.  Back to cited text no. 9
[PUBMED]  [FULLTEXT]  
10.De Jager CA, Thambisetty M, Praveen KV, Sheeba PD, Ajini KN, Sajeev A, et al. Utility of the Malayalam translation of the 7 - minute screen for Alzheimer's disease risk in an Indian community. Neurol India 2008;56:161-6.  Back to cited text no. 10
    
11.Nasreddine ZS, Phillips NA, Bιdirian V, Charbonneau S, Whitehead V, Collin I, et al. The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc 2005;53:695-9.  Back to cited text no. 11
    
12.Smith T, Gildeh N, Holmes C.The Montreal Cognitive Assessment: validity and utility in a memory clinic setting. Can J Psychiatry 2007;52:329-32.  Back to cited text no. 12
[PUBMED]    
13.Nazem S, Siderowf AD, Duda JE, Have TT, Colcher A, Horn SS, et al. Montreal cognitive assessment performance in patients with Parkinson's disease with "normal" global cognition according to mini-mental state examination score. J Am Geriatr Soc 2009;57:304-8.  Back to cited text no. 13
[PUBMED]  [FULLTEXT]  
14.MedCalc for Windows, version 9.5.0.0 (MedCalc Software, Mariakerke, Belgium)  Back to cited text no. 14
    
15.Gifford DR, Cummings JL. Evaluating dementia screening tests: methodologic standards to rate their performance. Neurology 1999;52:224-7.  Back to cited text no. 15
[PUBMED]  [FULLTEXT]  
16.Mathuranath PS, Hodges JR, Mathew R, Cherian PJ, George A, Bak TH. Adaptation of the ACE for a Malayalam speaking population in southern India. Int J Geriatr Psychiatry 2004;19:1188-94.  Back to cited text no. 16
[PUBMED]  [FULLTEXT]  
17.Mathew R, Mathuranath PS. Issues in evaluation of cognition in the elderly in developing countries. Ann Indian Acad Neurol 2008;11:82-8.  Back to cited text no. 17
[PUBMED]  Medknow Journal  
18.Ratcliff G, Ganguli M, Chandra V, Sharma S, Belle S, Seaberg E, et al. Effects of literacy and education on measures of word fluency. Brain Lang 1998;61:115-22.   Back to cited text no. 18
    
19.Mathuranath PS, George A, Cherian PJ, Alexander A, Sarma SG, Sarma PS. Effects of age, education and gender on verbal fluency. J Clin Exp Neuropsychol 2003;25:1057-64.  Back to cited text no. 19
[PUBMED]    
20.Dodge HH, Meguro K, Ishii H, Yamaguchi S, Saxton JA, Ganguli M. Cross-cultural comparisons of the Mini-mental State Examination between Japanese and U.S. cohorts. Int Psychogeriatr 2009;21:113-22.  Back to cited text no. 20
    
21.Sosa AL, Albanese E, Prince M, Acosta D, Ferri CP, Guerra M, et al. Population normative data for the 10/66 Dementia Research Group cognitive test battery from Latin America, India and China: a cross-sectional survey. BMC Neurol 2009;26:9-48.  Back to cited text no. 21
    
22.Mathuranath PS, Cherian JP, Mathew R, George A, Alexander A, Sarma SP. Mini mental state examination and the Addenbrooke's cognitive examination: effect of education and norms for a multicultural population. Neurol India 2007;55:106-10.  Back to cited text no. 22
[PUBMED]  Medknow Journal  
23.Tiwari SC, Tripathi RK, Kumar A. Applicability of the Mini-mental State Examination (MMSE) and the Hindi Mental State Examination (HMSE) to the urban elderly in India: a pilot study. Int Psychogeriatr 2009;21:123-8.   Back to cited text no. 23
[PUBMED]  [FULLTEXT]  
24.Iype T, Ajitha BK, Antony P, Ajeeth NB, Job S, Shaji KS. Usefulness of the Rowland Universal Dementia Assessment scale in South India. J Neurol Neurosurg Psychiatry 2006;77:513-4.  Back to cited text no. 24
[PUBMED]  [FULLTEXT]  
25.Hachinski V, Iadecola C, Petersen RC, Breteler MM, Nyenhuis DL, Black SE, et al. National Institute of Neurological Disorders and Stroke-Canadian Stroke Network vascular cognitive impairment harmonization standards. Stroke 2006;37:2220-41.  Back to cited text no. 25
[PUBMED]  [FULLTEXT]  


    Figures

  [Figure 1]
 
 
    Tables

  [Table 1], [Table 2], [Table 3], [Table 4]

This article has been cited by
1 Improvement of Screening Accuracy of Mini-Mental State Examination for Mild Cognitive Impairment and Non-Alzheimerćs Disease Dementia by Supplementation of Verbal Fluency Performance
Jee Wook Kim,Dong Young Lee,Eun Hyun Seo,Bo Kyung Sohn,Young Min Choe,Shin Gyeom Kim,Shin Young Park,IL Han Choo,Jong Chul Youn,Jin Hyeong Jhoo,Ki Woong Kim,Jong Inn Woo
Psychiatry Investigation. 2014; 11(1): 44
[Pubmed] | [DOI]
2 Rastreio cognitivo em pacientes com acidente vascular cerebral: um estudo transversal
Ana Amália Torres Souza Gandour Dantas,Sara Viviane de Souza Torres,Izabel Myckilane Alves de Farias,Suzane Beatriz Calixto de Lira SantćAna,Tania Fernandes Campos
Jornal Brasileiro de Psiquiatria. 2014; 63(2): 98
[Pubmed] | [DOI]
3 Prophylactic effects of duloxetine on post-stroke depression symptoms: An open single-blind trial
Zhang, L.-S. and Hu, X.-Y. and Yao, L.-Y. and Geng, Y. and Wei, L.-L. and Zhang, J.-H. and Chen, W.
European Neurology. 2013; 69(6): 336-343
[Pubmed]
4 The Sensitivity and Specificity of Subjective Memory Complaints and the Subjective Memory Rating Scale, Deterioration Cognitive Observee, Mini-Mental State Examination, Six-Item Screener and Clock Drawing Test in Dementia Screening
S. Ramlall,J. Chipps,A.I. Bhigjee,B.J. Pillay
Dementia and Geriatric Cognitive Disorders. 2013; 36(1-2): 119
[Pubmed] | [DOI]
5 The potential value of early screening for neurological deficits in participants in certain sports
Ivan Sosa,Ines Strenja Linic,Anja Petaros,Andrej Desnica,Alan Bosnar
Medical Hypotheses. 2011; 77(4): 633
[Pubmed] | [DOI]
6 The potential value of early screening for neurological deficits in participants in certain sports
Sosa, I., Linic, I.S., Petaros, A., Desnica, A., Bosnar, A.
Medical Hypotheses. 2011; 77(4): 633-637
[Pubmed]
7 Cognitive dysfunction in normally aging urban older adults: A community-based study
Tripathi, R.K. and Tiwari, S.C.
Indian Journal of Psychological Medicine. 2011; 33(2): 177-181
[Pubmed]
8 Preoperative assessment and management of patient with psychiatric comorbidity
Miodrag Milenovic,Nevena Kalezic,Dusica Simic,Draga Dimitrijevic,Dejan Markovic,Ivan Dimitrijevic
Acta chirurgica iugoslavica. 2011; 58(2): 143
[Pubmed] | [DOI]



 

Top
Print this article  Email this article
Previous article Next article
Online since 20th March '04
Published by Wolters Kluwer - Medknow