Introduction: Recent introductions of disease-modifying treatments for Alzheimer’s disease have re-invigorated the cause of early dementia detection. Cognitive “paper and pencil” tests represent the bedrock of clinical assessment, because they are cheap, easy to perform, and do not require brain imaging or biological testing. Cognitive tests vary greatly in duration, complexity, sociolinguistic biases, probed cognitive domains, and their specificity and sensitivity of detecting cognitive impairment (CI). Consequently, an ecologically valid head-to-head comparison seems essential for evidence-based dementia screening. Method: We compared five tests: Montreal cognitive assessment (MoCA), Alzheimer’s disease assessment scale-cognitive subscale (ADAS), Addenbrooke’s cognitive examination (ACE-III), euro-coin handling test (Eurotest), and image identification test (Phototest) on a large sample of seniors (N = 456, 77.9 ± 8 years, 71% females). Their specificity and sensitivity were estimated in a novel way by contrasting each test’s outcome to the majority outcome across the remaining tests (comparative specificity and sensitivity calculation [CSSC]). This obviates the need for an a priori gold standard such as a clinically clear-cut sample of dementia/MCI/controls. We posit that the CSSC results in a more ecologically valid estimation of clinical performance while precluding biases resulting from different dementia/MCI diagnostic criteria and the proficiency in detecting these conditions. Results: There exists a stark trade-off between behavioral test specificity and sensitivity. The test with the highest specificity had the lowest sensitivity, and vice versa. The comparative specificities and sensitivities were, respectively: Phototest (97%, 47%), Eurotest (94%, 55%), ADAS (90%, 68%), ACE-III (72%, 77%), MoCA (55%, 95%). Conclusion: Assuming a CI prevalence of 10%, the shortest (∼3 min) and the simplest instrument, the Phototest, was shown to have the best overall performance (accuracy 92%, PPV 66%, NPV 94%).

1.
Reisberg
B
,
Doody
R
,
Stöffler
A
,
Schmitt
F
,
Ferris
S
,
Möbius
HJ
, et al
.
Memantine in moderate-to-severe Alzheimer’s disease
.
N Engl J Med
.
2003
;
348
(
14
):
1333
41
.
2.
Cummings
JL
,
Morstorf
T
,
Zhong
K
.
Alzheimer’s disease drug-development pipeline: few candidates, frequent failures
.
Alzheimers Res Ther
.
2014
;
6
(
4
):
37
.
3.
Kalaria
RN
,
Maestre
GE
,
Arizaga
R
,
Friedland
RP
,
Galasko
D
,
Hall
K
, et al
.
Alzheimer’s disease and vascular dementia in developing countries: prevalence, management, and risk factors
.
Lancet Neurol
.
2008
;
7
(
9
):
812
26
.
4.
Goodman
RA
,
Lochner
KA
,
Thambisetty
M
,
Wingo
TS
,
Posner
SF
,
Ling
SM
.
Prevalence of dementia subtypes in United States Medicare fee-for-service beneficiaries, 2011–2013
.
Alzheimers Dement
.
2017
;
13
(
1
):
28
37
.
5.
Holstein
J
,
Chatellier
G
,
Piette
F
,
Moulias
R
.
Prevalence of associated diseases in different types of dementia among elderly institutionalized patients: analysis of 3447 records
.
J Am Geriatr Soc
.
1994
;
42
(
9
):
972
7
.
6.
Berr
C
,
Wancata
J
,
Ritchie
K
.
Prevalence of dementia in the elderly in Europe
.
Eur Neuropsychopharmacol
.
2005
;
15
(
4
):
463
71
.
7.
Mehta
D
,
Jackson
R
,
Paul
G
,
Shi
J
,
Sabbagh
M
.
Why do trials for Alzheimer’s disease drugs keep failing? A discontinued drug perspective for 2010-2015
.
Expert Opin Investig Drugs
.
2017
;
26
(
6
):
735
9
.
8.
Brayne
C
,
Kelly
S
.
Against the stream: early diagnosis of dementia, is it so desirable
.
BJPsych Bull
.
2019
;
43
(
3
):
123
5
.
9.
Iliffe
S
,
Manthorpe
J
,
Eden
A
.
Sooner or later? Issues in the early diagnosis of dementia in general practice: a qualitative study
.
Fam Pract
.
2003
;
20
(
4
):
376
81
.
10.
Salloway
S
,
Sperling
R
,
Fox
NC
,
Blennow
K
,
Klunk
W
,
Raskind
M
, et al
.
Two phase 3 trials of bapineuzumab in mild-to-moderate Alzheimer’s disease
.
N Engl J Med Overseas Ed
.
2014
;
370
(
4
):
322
33
.
11.
Doody
RS
,
Thomas
RG
,
Farlow
M
,
Iwatsubo
T
,
Vellas
B
,
Joffe
S
, et al
.
Phase 3 trials of solanezumab for mild-to-moderate Alzheimer’s disease
.
N Engl J Med
.
2014
;
370
(
4
):
311
21
.
12.
Mintun
MA
,
Lo
AC
,
Duggan Evans
C
,
Wessels
AM
,
Ardayfio
PA
,
Andersen
SW
, et al
.
Donanemab in early Alzheimer’s disease
.
N Engl J Med
.
2021
;
384
(
18
):
1691
704
.
13.
Planche
V
,
Villain
N
.
US food and drug administration approval of aducanumab: is amyloid load a valid surrogate end point for Alzheimer disease clinical trials
.
JAMA Neurol
.
2021
;
78
(
11
):
1307
8
.
14.
van Dyck
CH
,
Swanson
CJ
,
Aisen
P
,
Bateman
RJ
,
Chen
C
,
Gee
M
, et al
.
Lecanemab in early Alzheimer’s disease
.
N Engl J Med
.
2023
;
388
(
1
):
9
21
.
15.
Sims
JR
,
Zimmer
JA
,
Evans
CD
,
Lu
M
,
Ardayfio
P
,
Sparks
J
, et al
.
Donanemab in early symptomatic alzheimer disease: the TRAILBLAZER-ALZ 2 randomized clinical trial
.
JAMA
.
2023
;
330
(
6
):
512
27
.
16.
Sabbagh
MN
,
Boada
M
,
Borson
S
,
Chilukuri
M
,
Dubois
B
,
Ingram
J
, et al
.
Early detection of mild cognitive impairment (MCI) in primary care
.
J Prev Alzheimers Dis
.
2020
;
7
(
3
):
165
70
.
17.
Thambisetty
M
,
Howard
R
.
Lecanemab trial in AD brings hope but requires greater clarity
.
Nat Rev Neurol
.
2023
;
19
(
3
):
132
3
.
18.
Dubois
B
,
Hampel
H
,
Feldman
HH
,
Scheltens
P
,
Aisen
P
,
Andrieu
S
, et al
.
Preclinical Alzheimer’s disease: definition, natural history, and diagnostic criteria
.
Alzheimers Dement
.
2016
;
12
(
3
):
292
323
.
19.
US Preventive Services Task Force
,
Owens
DK
,
Davidson
KW
,
Krist
AH
,
Barry
MJ
,
Cabana
M
, et al
.
Screening for cognitive impairment in older adults: US preventive services task force recommendation statement
.
JAMA
.
2020
;
323
(
8
):
757
63
.
20.
Ismail
Z
,
Black
SE
,
Camicioli
R
,
Chertkow
H
,
Herrmann
N
,
Laforce
R
Jr
, et al
.
Recommendations of the 5th Canadian Consensus Conference on the diagnosis and treatment of dementia
.
Alzheimers Dement
.
2020
;
16
(
8
):
1182
95
.
21.
Rasmussen
J
,
Langerman
H
.
Alzheimer’s disease: why we need early diagnosis
.
DNND
.
2019
;
9
:
123
30
.
22.
Panegyres
PK
,
Berry
R
,
Burchell
J
.
Early dementia screening
.
Diagnostics
.
2016
;
6
(
1
):
6
.
23.
Pasquier
F
.
Early diagnosis of dementia: neuropsychology
.
J Neurol
.
1999
;
246
(
1
):
6
15
.
24.
Leifer
BP
.
Early diagnosis of Alzheimer’s disease: clinical and economic benefits
.
J Am Geriatr Soc
.
2003
;
51
(
5 Suppl Dementia
):
S281
8
.
25.
Yu
SY
,
Lee
TJ
,
Jang
SH
,
Han
JW
,
Kim
TH
,
Kim
KW
.
Cost-effectiveness of nationwide opportunistic screening program for dementia in South Korea
.
J Alzheimers Dis
.
2015
;
44
(
1
):
195
204
.
26.
de Vugt
ME
,
Verhey
FRJ
.
The impact of early dementia diagnosis and intervention on informal caregivers
.
Prog Neurobiol
.
2013
;
110
:
54
62
.
27.
Weimer
DL
,
Sager
MA
.
Early identification and treatment of Alzheimer’s disease: social and fiscal outcomes
.
Alzheimers Dement
.
2009
;
5
(
3
):
215
26
.
28.
Woods
B
,
Arosio
F
,
Diaz
A
,
Gove
D
,
Holmerová
I
,
Kinnaird
L
, et al
.
Timely diagnosis of dementia? Family carers’ experiences in 5 European countries
.
Int J Geriatr Psychiatry
.
2019
;
34
(
1
):
114
21
.
29.
Blennow
K
,
Zetterberg
H
.
Biomarkers for Alzheimer’s disease: current status and prospects for the future
.
J Intern Med
.
2018
;
284
(
6
):
643
63
.
30.
Mantzavinos
V
,
Alexiou
A
.
Biomarkers for Alzheimer’s disease diagnosis
.
Curr Alzheimer Res
.
2017
;
14
(
11
):
1149
54
.
31.
Al-Qazzaz
NK
,
Ali
SHBM
,
Ahmad
SA
,
Chellappan
K
,
Islam
MS
,
Escudero
J
.
Role of EEG as biomarker in the early detection and classification of dementia
.
Sci World J
.
2014
;
2014
:
e906038
.
32.
Craig-Schapiro
R
,
Fagan
AM
,
Holtzman
DM
.
Biomarkers of Alzheimer’s disease
.
Neurobiol Dis
.
2009
;
35
(
2
):
128
40
.
33.
Bush
C
,
Kozak
J
,
Elmslie
T
.
Screening for cognitive impairment in the elderly
.
Can Fam Physician
.
1997
;
43
:
1763
8
.
34.
Yokomizo
JE
,
Simon
SS
,
Bottino
CM
.
Cognitive screening for dementia in primary care: a systematic review
.
Int Psychogeriatr
.
2014
;
26
(
11
):
1783
804
.
35.
Iracleous
P
,
Nie
JX
,
Tracy
CS
,
Moineddin
R
,
Ismail
Z
,
Shulman
KI
, et al
.
Primary care physicians’ attitudes towards cognitive screening: findings from a national postal survey
.
Int J Geriatr Psychiatry
.
2010
;
25
(
1
):
23
9
.
36.
Nasreddine
ZS
,
Phillips
NA
,
Bédirian
V
,
Charbonneau
S
,
Whitehead
V
,
Collin
I
, et al
.
The Montreal Cognitive assessment, MoCA: a brief screening tool for mild cognitive impairment
.
J Am Geriatr Soc
.
2005
;
53
(
4
):
695
9
.
37.
Costa
AS
,
Fimm
B
,
Friesen
P
,
Soundjock
H
,
Rottschy
C
,
Gross
T
, et al
.
Alternate-form reliability of the Montreal cognitive assessment screening test in a clinical setting
.
Dement Geriatr Cogn Disord
.
2012
;
33
(
6
):
379
84
.
38.
Rosen
G
.
A new rating scale for Alzheimer’s disease
.
Am J Psychiatry
.
1984
.
39.
Hsieh
S
,
Schubert
S
,
Hoon
C
,
Mioshi
E
,
Hodges
JR
.
Validation of the addenbrooke’s cognitive examination III in frontotemporal dementia and Alzheimer’s disease
.
Dement Geriatr Cogn Disord
.
2013
;
36
(
3–4
):
242
50
.
40.
Carnero-Pardo
C
,
Montoro-Ríos
MT
.
[Preliminary evaluation of a new screening test for dementia (Eurotest)]
.
Rev Neurol
.
2004
;
38
(
03
):
201
9
.
41.
Carnero-Pardo
C
,
Gurpegui
M
,
Sanchez-Cantalejo
E
,
Frank
A
,
Mola
S
,
Barquero
MS
, et al
.
Diagnostic accuracy of the Eurotest for dementia: a naturalistic, multicenter phase II study
.
BMC Neurol
.
2006
;
6
(
1
):
15
.
42.
Carnero-Pardo
C
,
Montoro Ríos
MT
.
Test de las fotos
.
Rev Neurol
.
2004
;
39
(
09
):
801
6
.
43.
Carnero-Pardo
C
,
Espejo-Martinez
B
,
Lopez-Alcalde
S
,
Espinosa-Garcia
M
,
Saez-Zea
C
,
Vilchez-Carrillo
R
, et al
.
Effectiveness and costs of phototest in dementia and cognitive impairment screening
.
BMC Neurol
.
2011
;
11
(
1
):
92
.
44.
Carnero-Pardo
C
,
Espejo-Martínez
B
,
López-Alcalde
S
,
Espinosa-García
M
,
Sáez-Zea
C
,
Hernández-Torres
E
, et al
.
Diagnostic accuracy, effectiveness and cost for cognitive impairment and dementia screening of three short cognitive tests applicable to illiterates
.
PLoS One
.
2011
;
6
(
11
):
e27069
.
45.
Damian
AM
,
Jacobson
SA
,
Hentz
JG
,
Belden
CM
,
Shill
HA
,
Sabbagh
MN
, et al
.
The Montreal Cognitive assessment and the mini-mental state examination as screening instruments for cognitive impairment: item analyses and threshold scores
.
Dement Geriatr Cogn Disord
.
2011
;
31
(
2
):
126
31
.
46.
Matias-Guiu
JA
,
Cortés-Martínez
A
,
Valles-Salgado
M
,
Rognoni
T
,
Fernández-Matarrubia
M
,
Moreno-Ramos
T
, et al
.
Addenbrooke’s cognitive examination III: diagnostic utility for mild cognitive impairment and dementia and correlation with standardized neuropsychological tests
.
Int Psychogeriatr
.
2017
;
29
(
1
):
105
13
.
47.
Cano
SJ
,
Posner
HB
,
Moline
ML
,
Hurt
SW
,
Swartz
J
,
Hsu
T
, et al
.
The ADAS-cog in Alzheimer’s disease clinical trials: psychometric evaluation of the sum and its parts
.
J Neurol Neurosurg Psychiatry
.
2010
;
81
(
12
):
1363
8
.
48.
Matías-Guiu
JA
,
Valles-Salgado
M
,
Rognoni
T
,
Hamre-Gil
F
,
Moreno-Ramos
T
,
Matías-Guiu
J
.
Comparative diagnostic accuracy of the ACE-III, MIS, MMSE, MoCA, and RUDAS for screening of alzheimer disease
.
Dement Geriatr Cogn Disord
.
2017
;
43
(
5–6
):
237
46
.
49.
Carnero-Pardo
C
,
Rego-García
I
,
Mené Llorente
M
,
Alonso Ródenas
M
,
Vílchez Carrillo
R
.
Diagnostic performance of brief cognitive tests in cognitive impairment screening
.
Neurologia
.
2022
;
37
(
6
):
441
9
.
50.
Cheung
G
,
Clugston
A
,
Croucher
M
,
Malone
D
,
Mau
E
,
Sims
A
, et al
.
Performance of three cognitive screening tools in a sample of older New Zealanders
.
Int Psychogeriatr
.
2015
;
27
(
6
):
981
9
.
51.
Reid
LM
,
MacLullich
AMJ
.
Subjective memory complaints and cognitive impairment in older people
.
Dement Geriatr Cogn Disord
.
2006
;
22
(
5–6
):
471
85
.
52.
Potocnik
J
,
Ovcar Stante
K
,
Rakusa
M
.
The validity of the Montreal cognitive assessment (MoCA) for the screening of vascular cognitive impairment after ischemic stroke
.
Acta Neurol Belg
.
2020
;
120
(
3
):
681
5
.
53.
Ulbl
J
,
Rakusa
M
.
Validation of Slovenian version of ADAS-Cog for patients with mild cognitive impairment and Alzheimer’s disease
.
Acta Neurol Belg
.
2022
;
122
(
3
):
695
702
.
54.
Novak
A
,
Vizjak
K
,
Gacnik
A
,
Rakusa
M
.
Cognitive impairment in people with epilepsy: Montreal Cognitive Assessment (MoCA) as a screening tool
.
Acta Neurol Belg
.
2023
;
123
(
2
):
451
6
.
55.
Virtanen
P
,
Gommers
R
,
Oliphant
TE
,
Haberland
M
,
Reddy
T
,
Cournapeau
D
, et al
.
SciPy 1.0: fundamental algorithms for scientific computing in Python
.
Nat Methods
.
2020
;
17
(
3
):
261
72
.
56.
Harris
CR
,
Millman
KJ
,
van der Walt
SJ
,
Gommers
R
,
Virtanen
P
,
Cournapeau
D
, et al
.
Array programming with NumPy
.
Nature
.
2020
;
585
(
7825
):
357
62
.
57.
Pedregosa
F
,
Varoquaux
G
,
Gramfort
A
,
Michel
V
,
Thirion
B
,
Grisel
O
, et al
.
Scikit-learn: machine learning in Python
.
J Machine Learn Res
.
2011
;
12
(
85
):
2825
30
.
58.
Seabold
S
,
Perktold
J
.
Statsmodels: econometric and statistical modeling with Python
. In:
Proceedings of the 9th Python in science Conference
.
2010
; p.
92
6
.
59.
Zheng
B
,
Agresti
A
.
Summarizing the predictive power of a generalized linear model
.
Stat Med
.
2000
;
19
(
13
):
1771
81
.
60.
Mukherjee
A
,
Agrawal
M
.
Use of GLM approach to assess the responses of tropical trees to urban air pollution in relation to leaf functional traits and tree characteristics
.
Ecotoxicol Environ Saf
.
2018
;
152
:
42
54
.
61.
Mbachu
HI
,
Nduka
EC
,
Nja
ME
.
Designing a pseudo R-squared goodness-of-fit measure in generalized linear models
.
J Math Res
.
2012
;
4
(
2
):
p148
.
62.
Bollen
KA
.
Latent variables in psychology and the social sciences
.
Annu Rev Psychol
.
2002
;
53
(
1
):
605
34
.
63.
Ismail
K
.
Unravelling factor analysis
.
BMJ Ment Health
.
2008
;
11
(
4
):
99
102
.
64.
Adachi
K
.
Factor analysis procedures revisited from the comprehensive model with unique factors decomposed into specific factors and errors
.
Psychometrika
.
2022
;
87
(
3
):
967
91
.
65.
Corrada
MM
,
Brookmeyer
R
,
Paganini-Hill
A
,
Berlau
D
,
Kawas
CH
.
Dementia incidence continues to increase with age in the oldest old: the 90+ study
.
Ann Neurol
.
2010
;
67
(
1
):
114
21
.
66.
Piccininni
M
,
Rohmann
JL
,
Wechsung
M
,
Logroscino
G
,
Kurth
T
.
Should cognitive screening tests Be corrected for age and education? Insights from a causal perspective
.
Am J Epidemiol
.
2023
;
192
(
1
):
93
101
.
67.
Alenius
M
,
Ngandu
T
,
Koskinen
S
,
Hallikainen
I
,
Hänninen
T
,
Karrasch
M
, et al
.
Education-based cutoffs for cognitive screening of Alzheimer’s disease
.
Dement Geriatr Cogn Disord
.
2022
;
51
(
1
):
42
55
.
68.
Bartolini
M
,
Coccia
M
,
Luzzi
S
,
Provinciali
L
,
Ceravolo
MG
.
Motivational symptoms of depression mask preclinical Alzheimer’s disease in elderly subjects
.
Dement Geriatr Cogn Disord
.
2005
;
19
(
1
):
31
6
.
You do not currently have access to this content.