Introduction: Distance or remote cognitive assessments, administered via phone or computer platforms, have emerged as possible alternatives to traditional assessments performed during office visits. Distance refers to any nontraditional assessment feature, not only or necessarily location. We conducted a systematic review to examine the psychometric soundness of these approaches. Method: We searched PubMed, PsycINFO, AgeLine, and Academic Search Premier for articles published between January 2008 and June 2020. Studies were included if participants were over the age of 50, a structured assessment of cognitive function in older adults was evaluated, the assessment method was deemed distant, and validity and/or reliability data were reported. Assessment distance was defined as having any of the following features: use of an electronic test interface, nonroutine test location (e.g., home), test self-administered, and test unsupervised. Distance was categorized as low, intermediate, or high. Results/Discussion: Twenty-six studies met inclusion criteria. Sample sizes ranged from n = 8 to 8,627, and the mean age ranged from 57 to 83. Assessments included screens, brief or full batteries, and were performed via videoconferencing, phone, smartphone, or tablet/computer. Ten studies reported on low distance, 11 on intermediate distance, and 5 studies for high distance assessments. Invalid performance data were observed with older age and cognitive impairment. Convergent validity data were reported consistently and suggested a decline with increasing distance: r = 0.52–0.80 for low, 0.49–0.75 for intermediate, and 0.41–0.53 for high distance. Diagnostic validity estimates presented a similar pattern. Reliability data were reported too inconsistently to allow evaluation. Conclusion: The validity of cognitive assessments with older adults appears supported at lower but not higher distance. Less is known about the reliability of such assessments. Future research should delineate the person and procedure boundaries for valid and reliable test results.

1.
Jack
CR
 Jr
,
Knopman
DS
,
Jagust
WJ
,
Shaw
LM
,
Aisen
PS
,
Weiner
MW
, et al.
Hypothetical model of dynamic biomarkers of the Alzheimer’s pathological cascade
.
Lancet Neurol
.
2010
;
9
(
1
):
119
28
. .
2.
Jacova
C
,
Peters
KR
,
Beattie
BL
,
Wong
E
,
Riddehough
A
,
Foti
D
, et al.
Cognitive impairment no dementia: neuropsychological and neuroimaging characterization of an amnestic subgroup
.
Dement Geriatr Cogn Disord
.
2008
;
25
(
3
):
238
47
. .
3.
Albert
MS
,
DeKosky
ST
,
Dickson
D
,
Dubois
B
,
Feldman
HH
,
Fox
NC
, et al.
The diagnosis of mild cognitive impairment due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease
.
Alzheimers Dement
.
2011
;
7
(
3
):
270
9
.
4.
Petersen
RC
,
Lopez
O
,
Armstrong
MJ
,
Getchius
TSD
,
Ganguli
M
,
Gloss
D
, et al.
Practice guideline update summary: mild cognitive impairment: report of the guideline development, dissemination, and implementation subcommittee of the American Academy of Neurology
.
Neurology
.
2018
;
90
(
3
):
126
35
. .
5.
Langa
KM
,
Larson
EB
,
Crimmins
EM
,
Faul
JD
,
Levine
DA
,
Kabeto
MU
, et al.
A comparison of the prevalence of dementia in the United States in 2000 and 2012
.
JAMA Intern Med
.
2017
;
177
(
1
):
51
8
. .
6.
Jessen
F
,
Amariglio
RE
,
Van Boxtel
M
,
Breteler
M
,
Ceccaldi
M
,
Chételat
G
, et al.
A conceptual framework for research on subjective cognitive decline in preclinical Alzheimer’s disease
.
Alzheimers Dement
.
2014
;
10
(
6
):
844
52
. .
7.
Sperling
RA
,
Aisen
PS
,
Beckett
LA
,
Bennett
DA
,
Craft
S
,
Fagan
AM
, et al.
Toward defining the preclinical stages of Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease
.
Alzheimers Dement
.
2011
;
7
(
3
):
280
92
.
8.
Mitchell
A
,
Beaumont
H
,
Ferguson
D
,
Yadegarfar
M
,
Stubbs
B
.
Risk of dementia and mild cognitive impairment in older people with subjective memory complaints: meta-analysis
.
Acta Psychiatr Scand
.
2014
;
130
(
6
):
439
51
.
9.
Sachdev
PS
,
Brodaty
H
,
Reppermund
S
,
Kochan
NA
,
Trollor
JN
,
Draper
B
, et al.
The Sydney Memory and Ageing Study (MAS): methodology and baseline medical and neuropsychiatric characteristics of an elderly epidemiological non-demented cohort of Australians aged 70–90 years
.
Int Psychogeriatr
.
2010
;
22
(
8
):
1248
64
. ..
10.
Olivari
BS
,
Baumgart
M
,
Lock
SL
,
Whiting
CG
,
Taylor
CA
,
Iskander
J
, et al.
CDC grand rounds: promoting well-being and independence in older adults
.
MMWR Morb Mortal Wkly Rep
.
2018
;
67
(
37
):
1036
. .
11.
Dubois
B
,
Padovani
A
,
Scheltens
P
,
Rossi
A
,
Dell’Agnello
G
.
Timely diagnosis for Alzheimer’s disease: a literature review on benefits and challenges
.
J Alzheimers Dis
.
2016
;
49
(
3
):
617
31
.
12.
McKhann
GM
,
Albert
MS
,
Sperling
RA
.
Changing diagnostic concepts of Alzheimer’s disease
. In:
Hampel
H
,
Carrillo
MC
, editors.
Alzheimer’s disease-modernizing concept, biological diagnosis and therapy
.
Basel, Switzerland
:
Karger Publishers
;
2012
. Vol.
28
; p.
115
21
.
13.
Sloane
PD
,
Zimmerman
S
,
Suchindran
C
,
Reed
P
,
Wang
L
,
Boustani
M
, et al.
The public health impact of Alzheimer’s disease, 2000–2050: potential implication of treatment advances
.
Annu Rev Public Health
.
2002
;
23
:
213
31
. ..
14.
Weimer
DL
,
Sager
MA
.
Early identification and treatment of Alzheimer’s disease: social and fiscal outcomes
.
Alzheimers Dement
.
2009
;
5
(
3
):
215
26
. ..
15.
Bunn
F
,
Goodman
C
,
Sworn
K
,
Rait
G
,
Brayne
C
,
Robinson
L
, et al.
Psychosocial factors that shape patient and carer experiences of dementia diagnosis and treatment: a systematic review of qualitative studies
.
PLoS Med
.
2012
;
9
(
10
):
e1001331
. ..
16.
Iliffe
S
,
Manthorpe
J
.
The recognition of and response to dementia in the community: lessons for professional development
.
Learn Health Soc Care
.
2004
;
3
(
1
):
5
16
. .
17.
Moyer
VA
.
Screening for cognitive impairment in older adults: US Preventive Services Task Force recommendation statement
.
Ann Intern Med
.
2014
;
160
(
11
):
791
7
.
18.
Borson
S
,
Frank
L
,
Bayley
PJ
,
Boustani
M
,
Dean
M
,
Lin
PJ
, et al.
Improving dementia care: the role of screening and detection of cognitive impairment
.
Alzheimers Dement
.
2013
;
9
(
2
):
151
9
. .
19.
Bradford
A
,
Kunik
ME
,
Schulz
P
,
Williams
SP
,
Singh
H
.
Missed and delayed diagnosis of dementia in primary care: prevalence and contributing factors
.
Alzheimer Dis Assoc Disord
.
2009
;
23
(
4
):
306
14
. ..
20.
Hanzevacki
M
,
Ozegovic
G
,
Simovic
I
,
Bajic
Z
.
Proactive approach in detecting elderly subjects with cognitive decline in general practitioners’ practices
.
Dement Geriatr Cogn Dis Extra
.
2011
;
1
(
1
):
93
102
. .
21.
Boustani
M
,
Perkins
AJ
,
Fox
C
,
Unverzagt
F
,
Austrom
MG
,
Fultz
B
, et al.
Who refuses the diagnostic assessment for dementia in primary care?
Int J Geriatr Psychiatry
.
2006
;
21
(
6
):
556
63
. ..
22.
Fowler
NR
,
Frame
A
,
Perkins
AJ
,
Gao
S
,
Watson
DP
,
Monahan
P
, et al.
Traits of patients who screen positive for dementia and refuse diagnostic assessment
.
Alzheimers Dement
.
2015
;
1
(
2
):
236
41
. .
23.
Fowler
NR
,
Perkins
AJ
,
Turchan
HA
,
Frame
A
,
Monahan
P
,
Gao
S
, et al.
Older primary care patients’ attitudes and willingness to screen for dementia
.
J Aging Res
.
2015
;
2015
:
423265
. ..
24.
Allard
M
,
Husky
M
,
Catheline
G
,
Pelletier
A
,
Dilharreguy
B
,
Amieva
H
, et al.
Mobile technologies in the early detection of cognitive decline
.
PLoS One
.
2014
;
9
(
12
):
e112197
. ..
25.
Martin-Khan
M
,
Flicker
L
,
Wootton
R
,
Loh
PK
,
Edwards
H
,
Varghese
P
, et al.
The diagnostic accuracy of telegeriatrics for the diagnosis of dementia via video conferencing
.
J Am Med Dir Assoc
.
2012
;
13
(
5
):
487
24
. .
26.
Cullum
C
,
Hynan
L
,
Grosch
M
,
Parikh
M
,
Weiner
M
.
Teleneuropsychology: evidence for video teleconference-based neuropsychological assessment
.
J Int Neuropsychological Soc
.
2014
;
20
(
10
):
1028
33
.
27.
Anderson
M
,
Perrin
A
.
Technology use among seniors
.
Washington, DC
:
Pew Research Center for Internet & Technology
;
2017
.
28.
Harrell
KM
,
Wilkins
SS
,
Connor
MK
,
Chodosh
J
.
Telemedicine and the evaluation of cognitive impairment: the additive value of neuropsychological assessment
.
J Am Med Dir Assoc
.
2014
;
15
(
8
):
600
6
. ..
29.
Koo
BM
,
Vizer
LM
.
Mobile technology for cognitive assessment of older adults: a scoping review
.
Innov Aging
.
2019
;
3
(
1
):
igy038
. .
30.
Hassenstab
J
,
Aschenbrenner
AJ
,
Balota
DA
,
McDade
E
,
Lim
Y
,
Fagan
AM
, et al.
O1-04-03: comparing smartphone-administered cognitive assessments with conventional tests and biomarkers in sporadic and dominantly inherited Alzheimer disease
.
Alzheimers Dement
.
2018
;
14
(
7S_Part_4
):
P224
5
. .
31.
Lathan
C
,
Wallace
AS
,
Shewbridge
R
,
Ng
N
,
Morrison
G
,
Resnick
HE
.
Cognitive health assessment and establishment of a virtual cohort of dementia caregivers
.
Dement Geriatr Cogn Dis Extra
.
2016
;
6
(
1
):
98
107
. .
32.
Rentz
DM
,
Dekhtyar
M
,
Sherman
J
,
Burnham
S
,
Blacker
D
,
Aghjayan
SL
, et al.
The feasibility of at-home iPad cognitive testing for use in clinical trials
.
J Prev Alzheimers Dis
.
2016
;
3
(
1
):
8
. .
33.
Sano
M
,
Egelko
S
,
Ferris
S
,
Kaye
J
,
Hayes
TL
,
Mundt
JC
, et al.
Pilot study to show the feasibility of a multicenter trial of home-based assessment of people over 75 years old
.
Alzheimer Dis Assoc Disord
.
2010
;
24
(
3
):
256
63
. .
34.
Cordell
CB
,
Borson
S
,
Boustani
M
,
Chodosh
J
,
Reuben
D
,
Verghese
J
, et al.
Alzheimer’s association recommendations for operationalizing the detection of cognitive impairment during the Medicare Annual Wellness Visit in a primary care setting
.
Alzheimers Dement
.
2013
;
9
(
2
):
141
50
. .
35.
Shore
JH
,
Yellowlees
P
,
Caudill
R
,
Johnston
B
,
Turvey
C
,
Mishkind
M
, et al.
Best practices in videoconferencing-based telemental health April 2018
.
Telemed J E Health
.
2018
;
24
(
11
):
827
32
. .
36.
Barth
J
,
Nickel
F
,
Kolominsky-Rabas
PL
.
Diagnosis of cognitive decline and dementia in rural areas: a scoping review
.
Int J Geriatr Psychiatry
.
2018
;
33
(
3
):
459
74
. ..
37.
Jacova
C
,
McGrenere
J
,
Lee
HS
,
Wang
WW
,
Huray
SL
,
Corenblith
EF
, et al.
C-TOC (cognitive testing on computer) investigating the usability and validity of a novel self-administered cognitive assessment tool in aging and early dementia
.
Alzheimer Dis Assoc Disord
.
2015
;
29
(
3
):
213
21
.
38.
Mielke
MM
,
Machulda
MM
,
Hagen
CE
,
Edwards
KK
,
Roberts
RO
,
Pankratz
V
, et al.
Performance of the CogState computerized battery in the Mayo Clinic Study on Aging
.
Alzheimers Dement
.
2015
;
11
(
11
):
1367
76
.
39.
Hansen
TI
,
Haferstrom
EC
,
Brunner
JF
,
Lehn
H
,
Håberg
AK
.
Initial validation of a web-based self-administered neuropsychological test battery for older adults and seniors
.
J Clin Exp Neuropsychol
.
2015
;
37
(
6
):
581
94
. .
40.
Mielke
MM
,
Machulda
MM
,
Hagen
CE
,
Edwards
KK
,
Roberts
RO
,
Pankratz
VS
, et al.
Performance of the CogState computerized battery in the Mayo Clinic Study on Aging
.
Alzheimers Dement
.
2015
;
11
(
11
):
1367
76
. .
41.
Tierney
MC
,
Naglie
G
,
Upshur
R
,
Moineddin
R
,
Charles
J
,
Jaakkimainen
RL
.
Feasibility and validity of the self-administered computerized assessment of mild cognitive impairment with older primary care patients
.
Alzheimer Dis Assoc Disord
.
2014
;
28
(
4
):
311
9
. ..
42.
Brandt
J
,
Sullivan
C
,
Burrell
LE
 II
,
Rogerson
M
,
Anderson
A
.
Internet-based screening for dementia risk
.
PLoS One
.
2013
;
8
(
2
):
e57476
. .
43.
Grosch
MC
,
Weiner
MF
,
Hynan
LS
,
Shore
J
,
Cullum
CM
.
Video teleconference-based neurocognitive screening in geropsychiatry
.
Psychiatry Res
.
2015
;
225
(
3
):
734
5
. ..
44.
Dougherty
JH
 Jr
,
Cannon
RL
,
Nicholas
CR
,
Hall
L
,
Hare
F
,
Carr
E
, et al.
The computerized self test (CST): an interactive, internet accessible cognitive screening test for dementia
.
J Alzheimers Dis
.
2010
;
20
(
1
):
185
95
. .
45.
Galusha-Glasscock
JM
,
Horton
DK
,
Weiner
MF
,
Cullum
CM
.
Video teleconference administration of the repeatable battery for the assessment of neuropsychological status
.
Arch Clin Neuropsychol
.
2016
;
31
(
1
):
8
11
. .
46.
Martin-Khan
M
,
Flicker
L
,
Wootton
R
,
Loh
PK
,
Edwards
H
,
Varghese
P
, et al.
The diagnostic accuracy of telegeriatrics for the diagnosis of dementia via video conferencing
.
J Am Med Dir Assoc
.
2012
;
13
(
5
):
487
24
. .
47.
Dubois
B
,
Feldman
HH
,
Jacova
C
,
DeKosky
ST
,
Barberger-Gateau
P
,
Cummings
J
, et al.
Research criteria for the diagnosis of Alzheimer’s disease: revising the NINCDS-ADRDA criteria
.
Lancet Neurol
.
2007
;
6
(
8
):
734
46
.
48.
Weintraub
S
,
Salmon
D
,
Mercaldo
N
,
Ferris
S
,
Graff-Radford
NR
,
Chui
H
, et al.
The Alzheimer’s disease centers’ uniform data set (UDS): the neuropsychological test battery
.
Alzheimer Dis Assoc Disord
.
2009
;
23
(
2
):
91
.
49.
de Jager
CA
,
Budge
MM
,
Clarke
R
.
Utility of TICS-M for the assessment of cognitive function in older adults
.
Int J Geriatr Psychiatry
.
2003
;
18
(
4
):
318
24
. ..
50.
Vacante
M
,
Wilcock
GK
,
de Jager
CA
.
Computerized adaptation of the Placing Test for early detection of both mild cognitive impairment and Alzheimer’s disease
.
J Clin Exp Neuropsychol
.
2013
;
35
(
8
):
846
56
. .
51.
Bauer
RM
,
Iverson
GL
,
Cernich
AN
,
Binder
LM
,
Ruff
RM
,
Naugle
RI
.
Computerized neuropsychological assessment devices: joint position paper of the American Academy of Clinical Neuropsychology and the National Academy of Neuropsychology
.
Clin Neuropsychol
.
2012
;
26
(
2
):
177
96
. .
52.
Brown
LJE
,
Adlam
T
,
Hwang
F
,
Khadra
H
,
Maclean
LM
,
Rudd
B
, et al.
Computer-based tools for assessing micro-longitudinal patterns of cognitive function in older adults
.
Age
.
2016
;
38
(
4
):
335
50
. .
53.
Trustram Eve
C
,
de Jager
CA
.
Piloting and validation of a novel self-administered online cognitive screening tool in normal older persons: the cognitive function test
.
Int J Geriatr Psychiatry
.
2014
;
29
(
2
):
198
206
. .
54.
Wesnes
KA
,
Brooker
H
,
Ballard
C
,
McCambridge
L
,
Stenton
R
,
Corbett
A
.
Utility, reliability, sensitivity and validity of an online test system designed to monitor changes in cognitive function in clinical trials
.
Int J Geriatr Psychiatry
.
2017
;
32
(
12
):
e83
92
. .
55.
Brehmer
M
,
McGrenere
J
,
Tang
C
,
Jacova
C
, editors.
Investigating interruptions in the context of computerised cognitive testing for older adults
.
Proceedings of the SIGCHI conference on human factors in computing systems
.
2012
.
56.
Sindi
S
,
Fiocco
AJ
,
Juster
RP
,
Pruessner
J
,
Lupien
SJ
.
When we test, do we stress? Impact of the testing environment on cortisol secretion and memory performance in older adults
.
Psychoneuroendocrinology
.
2013
;
38
(
8
):
1388
96
. .
57.
Wong
S
,
Jacova
C
.
Older adults’ attitudes towards cognitive testing: moving towards person-centeredness
.
Dement Geriatr Cogn Disorders Extra
.
2018
;
8
(
3
):
348
59
.
58.
Krohne
K
,
Slettebø
A
,
Bergland
A
.
Cognitive screening tests as experienced by older hospitalised patients: a qualitative study
.
Scand J Caring Sci
.
2011
;
25
(
4
):
679
87
. .
59.
Ahmed
S
,
De Jager
C
,
Wilcock
G
.
A comparison of screening tools for the assessment of mild cognitive impairment: Preliminary findings
.
Neurocase
.
2012
;
18
(
4
):
336
351
.
60.
Brouillette
RM
,
Foil
H
,
Fontenot
S
,
Correro
A
,
Allen
R
,
Martin
CK
, et al.
Feasibility, reliability, and validity of a smartphone based application for the assessment of cognitive function in the elderly
.
PLoS One
.
2013
;
8
(
6
). .
61.
Cook
SE
,
Marsiske
M
,
McCoy
KJM
.
The Use of the Modified Telephone Interview for Cognitive Status (TICS-M) in the Detection of Amnestic Mild Cognitive Impairment
.
J Geriatr Psychiatry Neurol
.
2009
;
22
(
2
):
103
109
.
62.
Darcy
S
,
Rapcan
V
,
Gail
A
,
Burke
N
,
O’Connell
GC
,
Robertson
IH
, et al.
A study into the automation of cognitive assessment tasks for delivery via the telephone: lessons for developing remote monitoring applications for the elderly
.
Technol Health Care
.
2013
;
21
(
4
):
387
396
.
63.
Duff
K
,
Tometich
D
,
Dennett
K
.
The modified Telephone Interview for Cognitive Status is more predictive of memory abilities than the Mini-Mental State Examination
.
J Geriatr Psychiatry Neurol
.
2015
;
28
(
3
):
193
197
.
64.
Kennedy
RE
,
Williams
CP
,
Sawyer
P
,
Allman
RA
,
Crowe
M
.
Comparison of in-person and telephone administration of the Mini-Mental State Examination in the University of Alabama at Birmingham Study of Aging
.
J Am Geriatr Soc
.
2014
;
62
(
10
):
1928
1932
.
65.
Knopman
DS
,
Roberts
RO
,
Geda
YE
,
Pankratz
VS
,
Christianson
TJ
,
Petersen
RC
, et al.
Validation of the telephone interview for cognitive status-modified in subjects with normal cognition, mild cognitive impairment, or dementia
.
Neuroepidemiology
.
2010
;
34
(
1
):
34
42
.
66.
Pendlebury
ST
,
Welch
SJ
,
Cuthbertson
FC
,
Mariz
J
,
Mehta
Z
,
Rothwell
PM
, et al.
Telephone assessment of cognition after transient ischemic attack and stroke: Modified telephone interview of cognitive status and telephone Montreal Cognitive Assessment versus face-to-face Montreal Cognitive Assessment and neuropsychological battery
.
Stroke
.
2013
;
44
(
1
):
227
229
.
67.
Pillemer
S
,
Papandonatos
GD
,
Crook
C
,
Ott
BR
,
Tremont
G
.
The modified telephone-administered Minnesota Cognitive Acuity Screen for mild cognitive impairment
.
J Geriatr Psychiatry Neurol
.
2018
;
31
(
3
):
123
128
.
68.
Reckess
GZ
,
Brandt
J
,
Luis
CA
,
Zandi
P
,
Martin
B
,
Breitner
JC
.
Screening by telephone in the Alzheimer’s disease anti-inflammatory prevention trial
.
J Alzheimers Dis
.
2013
;
36
(
3
):
433
443
.
69.
Saxton
J
,
Morrow
L
,
Eschman
A
,
Archer
G
,
Luther
J
,
Zuccolotto
A
.
Computer assessment of mild cognitive impairment
.
Postgrad Med
.
2009
;
121
(
2
):
177
185
.
70.
Tremont
G
,
Papandonatos
GD
,
Springate
B
,
Huminski
B
,
McQuiggan
MD
,
Grace
J
, et al.
Use of the telephone-administered Minnesota cognitive acuity screen to detect mild cognitive impairment
.
Am J Alzheimers Dis Other Demen
.
2011
;
26
(
7
):
555
562
.
71.
Solomon
TM
,
Barbone
JM
,
Feaster
HT
,
Miller
DS
,
DeBros
GB
,
Murphy
CA
, et al.
Comparing the Standard and Electronic Versions of the Alzheimer’s Disease Assessment Scale - Cognitive Subscale: A Validation Study
.
J Prev Alzheimers Dis
.
2019
;
6
(
4
):
237
241
.
Copyright / Drug Dosage / Disclaimer
Copyright: All rights reserved. No part of this publication may be translated into other languages, reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, microcopying, or by any information storage and retrieval system, without permission in writing from the publisher.
Drug Dosage: The authors and the publisher have exerted every effort to ensure that drug selection and dosage set forth in this text are in accord with current recommendations and practice at the time of publication. However, in view of ongoing research, changes in government regulations, and the constant flow of information relating to drug therapy and drug reactions, the reader is urged to check the package insert for each drug for any changes in indications and dosage and for added warnings and precautions. This is particularly important when the recommended agent is a new and/or infrequently employed drug.
Disclaimer: The statements, opinions and data contained in this publication are solely those of the individual authors and contributors and not of the publishers and the editor(s). The appearance of advertisements or/and product references in the publication is not a warranty, endorsement, or approval of the products or services advertised or of their effectiveness, quality or safety. The publisher and the editor(s) disclaim responsibility for any injury to persons or property resulting from any ideas, methods, instructions or products referred to in the content or advertisements.
You do not currently have access to this content.