Introduction: Executive function is responsive to exercise and predictive of subsequent falls. Minimal clinically important differences (MCIDs) are critical for understanding whether observed changes are meaningful. However, MCIDs of many cognitive measures are not established. We aimed to determine MCIDs of the Digit Symbol Substitution Test ([DSST] processing speed measure), Stroop (inhibition measure), and Trail Making Test B-A (TMT; set-shifting measure), using anchor- and distribution-based approaches in older adults who have fallen and received the Otago Exercise Program (OEP) relative to usual care only (CON). Our secondary aim was to establish construct (convergent and divergent) validity of these measures. Methods: Complete case analyses of cognitive outcomes (DSST, Stroop, TMT, and Montreal Cognitive Assessment [MoCA]) were acquired at baseline and 1 year (NCT01029171; NCT003235960); participants were randomized to the OEP (n = 114/172; Age: 80.6 ± 6.1 years; 64.9% Female) or CON (n = 128/172; Age: 82.3 ± 5.8 years; 71.9% Female)]. The MoCA was used as the anchor. We estimated MCIDs using anchor- and distribution-based approaches. Anchor-based executive function change differences ([CD] 1 year minus baseline) observed in participants with meaningful changes in the MoCA (≥3 or ≤ −3 points) receiving the OEP were subtracted from the CON. An anchor-based receiver operator characteristic (ROC) curve was employed to identify optimal cut-off scores of the 3 executive function measures. The distribution-based approach (DA) accounted for variability in baseline and follow-up data. MCID ranges were estimated using these approaches. We used Spearman’s correlations to explore convergent validity between executive function measures and other measures involving the same construct (DSST, Stroop, TMT, MoCA, and Mini-Mental State Examination), and divergent validity between executive function measures and variables reflecting different constructs (Geriatric Depression Scale, Instrumental Activities of Daily Living, sex, and body mass index). Results: Based on the 3 approaches, MCID improvement ranges were 3–5 symbols for the DSST (CD = 5; ROC = 2.5; DA = 3.3 symbols), and −11.5 to −26.0 s for the Stroop (CD = −26.0; ROC = −11.5; DA = −20.6 s). MCID decline ranges were −3 to −6 symbols for the DSST (CD = −5.2; ROC = −2.5; DA = −3.3 symbols) and 5.4–30.6 s for the Stroop (CD = 30.6; ROC = 5.4; DA = 20.6 s). MCIDs for the TMT were not meaningful due to high variability (Improvement: CD = −106.6; ROC = −18.4; DA = −69.1 s; Decline: CD = 69.1; ROC = 14.5; DA = 69.1 s). The executive function measures exhibited good convergent (r = −0.22 to r = 0.42) and divergent (r < −0.01 to r = 0.16) validity. Conclusions: These established MCIDs will allow clinicians to interpret meaningful changes in executive function following exercise amongst older adults who have fallen. The DSST, Stroop, and TMT demonstrated good construct validity, supporting their use in comprehensive fall-risk assessments in older adults who fall.

1.
Kearney
FC
,
Harwood
RH
,
Gladman
JR
,
Lincoln
N
,
Masud
T
.
The relationship between executive function and falls and gait abnormalities in older adults: a systematic review
.
Dement Geriatr Cogn Disord
.
2013
;
36
(
1–2
):
20
35
. .
2.
Handing
EP
,
Chen
H
,
Rejeski
WJ
,
Rosso
AL
,
Balachandran
AT
,
King
AC
,
Cognitive function as a predictor of major mobility disability in older adults: results from the LIFE Study
.
Innov Aging
.
2019
;
3
(
2
):
igz010
. .
3.
Fried
LP
,
Kronmal
RA
,
Newman
AB
,
Bild
DE
,
Mittelmark
MB
,
Polak
JF
,
Risk factors for 5-year mortality in older adults: the Cardiovascular Health Study
.
JAMA
.
1998
;
279
(
8
):
585
92
. .
4.
Suchy
Y
.
Executive functioning: overview, assessment, and research issues for non-neuropsychologists
.
Ann Behav Med
.
2009
;
37
(
2
):
106
16
. .
5.
Liu-Ambrose
T
,
Davis
JC
,
Falck
RS
,
Best
JR
.
Exercise, processing speed, and subsequent falls: a secondary analysis of a 12-month randomized controlled trial
.
J Gerontol A Biol Sci Med Sci
.
2021 Mar 31
;
76
(
4
):
675
82
.
6.
Benedict
RH
,
Cookfair
D
,
Gavett
R
,
Gunther
M
,
Munschauer
F
,
Garg
N
,
Validity of the minimal assessment of cognitive function in multiple sclerosis (MACFIMS)
.
J Int Neuropsychol Soc
.
2006
;
12
(
4
):
549
58
. .
7.
Benedict
RH
,
DeLuca
J
,
Phillips
G
,
LaRocca
N
,
Hudson
LD
,
Rudick
R
.
Validity of the symbol digit modalities test as a cognition performance outcome measure for multiple sclerosis
.
Mult Scler
.
2017
;
23
(
5
):
721
33
. .
8.
Periáñez
JA
,
Lubrini
G
,
García-Gutiérrez
A
,
Ríos-Lago
M
.
Construct validity of the stroop color-word test: influence of speed of visual search, verbal fluency, working memory, cognitive flexibility, and conflict monitoring
.
Arch Clin Neuropsychol
.
2021
;
36
(
1
):
99
111
. .
9.
Llinàs-Reglà
J
,
Vilalta-Franch
J
,
López-Pousa
S
,
Calvó-Perxas
L
,
Torrents Rodas
D
,
Garre-Olmo
J
.
The trail making test
.
Assessment
.
2017
;
24
(
2
):
183
96
. .
10.
Smith Watts
AK
,
Ahern
DC
,
Jones
JD
,
Farrer
TJ
,
Correia
S
.
Trail-making test part B: evaluation of the efficiency score for assessing floor-level change in veterans
.
Arch Clin Neuropsychol
.
2019
;
34
(
2
):
243
53
.
11.
Davis
JC
,
Bryan
S
,
Marra
CA
,
Hsiung
GY
,
Liu-Ambrose
T
.
Challenges with cost-utility analyses of behavioural interventions among older adults at risk for dementia
.
Br J Sports Med
.
2015
;
49
(
20
):
1343
7
. .
12.
Miyake
A
,
Friedman
NP
,
Emerson
MJ
,
Witzki
AH
,
Howerter
A
,
Wager
TD
.
The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: a latent variable analysis
.
Cogn Psychol
.
2000
;
41
(
1
):
49
100
. .
13.
Llinàs-Reglà
J
,
Vilalta-Franch
J
,
López-Pousa
S
,
Calvó-Perxas
L
,
Torrents Rodas
D
,
Garre-Olmo
J
,
The trail making test: association with other neuropsychological measures and normative values for adults aged 55 years and older from a Spanish-speaking population-based sample
.
Assessment
.
2017
;
24
(
2
):
183
96
.
14.
Revicki
D
,
Hays
RD
,
Cella
D
,
Sloan
J
.
Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes
.
J Clin Epidemiol
.
2008
;
61
(
2
):
102
9
. .
15.
Jaeschke
R
,
Singer
J
,
Guyatt
GH
.
Measurement of health status: ascertaining the minimal clinically important difference
.
Control Clin Trials
.
1989
;
10
(
4
):
407
15
.
16.
Wright
A
,
Hannon
J
,
Hegedus
EJ
,
Kavchak
AE
.
Clinimetrics corner: a closer look at the minimal clinically important difference (MCID)
.
J Man Manip Ther
.
2012
;
20
(
3
):
160
6
. .
17.
Guyatt
GH
,
Osoba
D
,
Wu
AW
,
Wyrwich
KW
,
Norman
GR
.
Methods to explain the clinical significance of health status measures
.
Mayo Clin Proc
.
2002
;
77
(
4
):
371
83
. .
18.
Revicki
DA
,
Erickson
PA
,
Sloan
JA
,
Dueck
A
,
Guess
H
,
Santanello
NC
.
Interpreting and reporting results based on patient-reported outcomes
.
Value Health
.
2007
;
10 Suppl 2
:
S116
24
. .
19.
Kon
SS
,
Dilaver
D
,
Mittal
M
,
Nolan
CM
,
Clark
AL
,
Canavan
JL
,
The clinical COPD questionnaire: response to pulmonary rehabilitation and minimal clinically important difference
.
Thorax
.
2014
;
69
(
9
):
793
8
. .
20.
Chan
ACM
,
Pang
MYC
,
Ouyang
H
,
Jehu
DAM
.
Minimal clinically important difference of four commonly used balance assessment tools in individuals after total knee arthroplasty: a prospective Cohort Study
.
PM R
.
2020 Mar
;
12
(
3
):
238
45
.
21.
Lin
KC
,
Hsieh
YW
,
Wu
CY
,
Chen
CL
,
Jang
Y
,
Liu
JS
.
Minimal detectable change and clinically important difference of the wolf motor function test in stroke patients
.
Neurorehabil Neural Repair
.
2009
;
23
(
5
):
429
34
. .
22.
Conti
J
,
Sterr
A
,
Brucki
SM
,
Conforto
AB
.
Diversity of approaches in assessment of executive functions in stroke: limited evidence?
eNeurologicalSci
.
2015
;
1
(
1
):
12
20
. .
23.
Campbell
DT
,
Fiske
DW
.
Convergent and discriminant validation by the multitrait-multimethod matrix
.
Psychol Bull
.
1959
;
56
(
2
):
81
105
. .
24.
Liu-Ambrose
T
,
Davis
JC
,
Best
JR
,
Dian
L
,
Madden
K
,
Cook
W
,
Effect of a home-based exercise program on subsequent falls among community-dwelling high-risk older adults after a fall: a randomized clinical trial
.
JAMA
.
2019
;
321
(
21
):
2092
100
. .
25.
Liu-Ambrose
T
,
Davis
JC
,
Hsu
CL
,
Gomez
C
,
Vertes
K
,
Marra
C
,
Action seniors! – secondary falls prevention in community-dwelling senior fallers: Study Protocol for a randomized controlled trial
.
Trials
.
2015
;
16
:
144
. .
26.
Bossuyt
PM
,
Reitsma
JB
,
Bruns
DE
,
Gatsonis
CA
,
Glasziou
PP
,
Irwig
L
,
STARD 2015: an updated list of essential items for reporting Diagnostic Accuracy Studies
.
BMJ
.
2015
;
351
:
h5527
. .
27.
Whitney
JC
,
Lord
SR
,
Close
JC
.
Streamlining assessment and intervention in a falls clinic using the timed up and go test and physiological profile assessments
.
Age Ageing
.
2005
;
34
(
6
):
567
71
. .
28.
Folstein
MF
,
Folstein
SE
,
McHugh
PR
.
“Mini-mental state.” A practical method for grading the cognitive state of patients for the clinician
.
J Psychiatr Res
.
1975
;
12
(
3
):
189
98
.
29.
Spreen
O
,
Strauss
E
.
A compendium of neurological tests
. 2nd ed.
New York
:
Oxford University Press, Inc
;
1998
.
30.
Davis
JC
,
Best
JR
,
Khan
KM
,
Dian
L
,
Lord
S
,
Delbaere
K
,
Slow processing speed predicts falls in older adults with a falls history: 1-year prospective Cohort Study
.
J Am Geriatr Soc
.
2017
;
65
(
5
):
916
23
. .
31.
Trenerry
MR
,
Crosson
B
,
DeBoe
J
,
Leber
WR
.
Stroop neuropsychological screening test manual
.
Lutz, FL
:
Psychological Assessment Resources
;
1989
.
32.
Nasreddine
ZS
,
Phillips
NA
,
Bédirian
V
,
Charbonneau
S
,
Whitehead
V
,
Collin
I
,
The montreal cognitive assessment, MoCA: a brief screening tool for mild cognitive impairment
.
J Am Geriatr Soc
.
2005
;
53
(
4
):
695
9
. .
33.
Gupta
M
,
Gupta
V
,
Nagar Buckshee
R
,
Sharma
V
.
Validity and reliability of hindi translated version of montreal cognitive assessment in older adults
.
Asian J Psychiatr
.
2019
;
45
:
125
8
.
34.
Gauthier
S
,
Reisberg
B
,
Zaudig
M
,
Petersen
RC
,
Ritchie
K
,
Broich
K
,
Mild cognitive impairment
.
Lancet
.
2006
;
367
(
9518
):
1262
70
. .
35.
Mai
LM
,
Sposato
LA
,
Rothwell
PM
,
Hachinski
V
,
Pendlebury
ST
.
A comparison between the MoCA and the MMSE visuoexecutive sub-tests in detecting abnormalities in TIA/stroke patients
.
Int J Stroke
.
2016
;
11
(
4
):
420
4
. .
36.
Hwang
S
,
Woo
Y
,
Kim
KH
,
Ki
KI
.
Effects of falls experience on cognitive functions and physical activities in community-dwelling individuals with chronic stroke
.
Int J Rehabil Res
.
2013
;
36
(
2
):
134
9
. .
37.
Khaligh-Razavi
SM
,
Habibi
S
,
Sadeghi
M
,
Marefat
H
,
Khanbagi
M
,
Nabavi
SM
,
Integrated cognitive assessment: speed and accuracy of visual processing as a reliable proxy to cognitive performance
.
Sci Rep
.
2019
;
9
(
1
):
1102
. .
38.
Wu
CY
,
Hung
SJ
,
Lin
KC
,
Chen
KH
,
Chen
P
,
Tsay
PK
.
Responsiveness, minimal clinically important difference, and validity of the MoCA in stroke rehabilitation
.
Occup Ther Int
.
2019
;
2019
:
2517658
. .
39.
Lim
PA
,
McLean
AM
,
Kilpatrick
C
,
DeForge
D
,
Iverson
GL
,
Silverberg
ND
.
Temporal stability and responsiveness of the montreal cognitive assessment following acquired brain injury
.
Brain Inj
.
2016
;
30
(
1
):
29
35
. .
40.
Yesavage
JA
,
Brink
TL
,
Rose
TL
,
Lum
O
,
Huang
V
,
Adey
M
,
Development and validation of a geriatric depression screening scale: a preliminary report
.
J Psychiatr Res
.
1982
;
17
(
1
):
37
49
. .
41.
Kadar
M
,
Ibrahim
S
,
Razaob
NA
,
Chai
SC
,
Harun
D
.
Validity and reliability of a Malay version of the lawton instrumental activities of daily living scale among the Malay speaking elderly in Malaysia
.
Aust Occup Ther J
.
2018
;
65
(
1
):
63
8
.
42.
Lord
SR
,
Menz
HB
,
Tiedemann
A
.
A physiological profile approach to falls risk assessment and prevention
.
Phys Ther
.
2003
;
83
(
3
):
237
52
. .
43.
American Geriatrics Society
;
British Geriatrics Society
;
American Academy of Orthopaedic Surgeons Panel on Falls Prevention
..
Guideline for the prevention of falls in older persons
.
J Am Geriatr Soc
.
2001
;
49
(
5
):
664
72
.
44.
Davis
JC
,
Dian
L
,
Parmar
N
,
Madden
K
,
Khan
KM
,
Chan
W
,
Geriatrician-led evidence-based falls prevention clinic: a prospective 12-month feasibility and acceptability Cohort Study among older adults
.
BMJ Open
.
2018
;
8
(
12
):
e020576
. .
45.
Gardner
MM
,
Buchner
DM
,
Robertson
MC
,
Campbell
AJ
.
Practical implementation of an exercise-based falls prevention programme
.
Age Ageing
.
2001
;
30
(
1
):
77
83
. .
46.
Campbell
AJ
,
Robertson
MC
,
Gardner
MM
,
Norton
RN
,
Tilyard
MW
,
Buchner
DM
.
Randomised controlled trial of a general practice programme of home based exercise to prevent falls in elderly women
.
BMJ
.
1997
;
315
(
7115
):
1065
9
. .
47.
Carter
JV
,
Pan
J
,
Rai
SN
,
Galandiuk
S
.
ROC-ing along: evaluation and interpretation of receiver operating characteristic curves
.
Surgery
.
2016
;
159
(
6
):
1638
45
. .
48.
Lydick
E
,
Epstein
RS
.
Interpretation of quality of life changes
.
Qual Life Res
.
1993
;
2
(
3
):
221
6
. .
49.
Coretti
S
,
Ruggeri
M
,
McNamee
P
.
The minimum clinically important difference for EQ-5D index: a critical review
.
Expert Rev Pharmacoecon Outcomes Res
.
2014
;
14
(
2
):
221
33
. .
50.
Norman
GR
,
Sloan
JA
,
Wyrwich
KW
.
Interpretation of changes in health-related quality of life: the remarkable universality of half a standard deviation
.
Med Care
.
2003
;
41
(
5
):
582
92
. .
51.
Osoba
D
,
Bezjak
A
,
Brundage
M
,
Zee
B
,
Tu
D
,
Pater
J
.
Analysis and interpretation of health-related quality-of-life data from clinical trials: basic approach of the national cancer institute of Canada Clinical Trials Group
.
Eur J Cancer
.
2005
;
41
(
2
):
280
7
. .
52.
Cohen
J
.
Statistical power analysis for the behavioral sciences
.
Academic Press
;
2013
.
53.
Yost
KJ
,
Eton
DT
.
Combining distribution- and anchor-based approaches to determine minimally important differences: the FACIT experience
.
Eval Health Prof
.
2005
;
28
(
2
):
172
91
. .
54.
Fu
C
,
Jin
X
,
Chen
B
,
Xue
F
,
Niu
H
,
Guo
R
,
Comparison of the mini-mental state examination and montreal cognitive assessment executive subtests in detecting post-stroke cognitive impairment
.
Geriatr Gerontol Int
.
2017
;
17
(
12
):
2329
35
. .
55.
Jehu
DA
,
Davis
JC
,
Falck
RS
,
Bennett
KJ
,
Tai
D
,
Souza
MF
,
Risk factors for recurrent falls in older adults: a systematic review with meta-analysis
.
Maturitas
.
2021
;
144
:
23
8
. .
56.
Lord
SR
,
Sherrington
C
,
Menz
HB
,
Close
JCT
.
Falls in older people: risk factors and strategies for prevention
. 2nd ed.
Cambridge, UK
:
Cambridge University Press
;
2007
.
Copyright / Drug Dosage / Disclaimer
Copyright: All rights reserved. No part of this publication may be translated into other languages, reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, microcopying, or by any information storage and retrieval system, without permission in writing from the publisher.
Drug Dosage: The authors and the publisher have exerted every effort to ensure that drug selection and dosage set forth in this text are in accord with current recommendations and practice at the time of publication. However, in view of ongoing research, changes in government regulations, and the constant flow of information relating to drug therapy and drug reactions, the reader is urged to check the package insert for each drug for any changes in indications and dosage and for added warnings and precautions. This is particularly important when the recommended agent is a new and/or infrequently employed drug.
Disclaimer: The statements, opinions and data contained in this publication are solely those of the individual authors and contributors and not of the publishers and the editor(s). The appearance of advertisements or/and product references in the publication is not a warranty, endorsement, or approval of the products or services advertised or of their effectiveness, quality or safety. The publisher and the editor(s) disclaim responsibility for any injury to persons or property resulting from any ideas, methods, instructions or products referred to in the content or advertisements.
You do not currently have access to this content.