Background: Delirium is a common and preventable geriatric syndrome. Moving beyond the binary classification of delirium present/absent, delirium severity represents a potentially important outcome for evaluating preventive and treatment interventions and tracking the course of patients. Although several delirium severity assessment tools currently exist, most have been developed in the absence of advanced measurement methodology and have not been evaluated with rigorous validation studies. Objective: We aimed to report our development of new delirium severity items and the results of item reduction and selection activities guided by psychometric analysis of data derived from a field study. Methods: Building on our literature review of delirium instruments and expert panel process to identify domains of delirium severity, we adapted items from existing delirium severity instruments and generated new items. We then fielded these items among a sample of 352 older hospitalized patients. Results: We used an expert panel process and psychometric data analysis techniques to narrow a set of 303 potential items to 17 items for use in a new delirium severity instrument. The 17-item set demonstrated good internal validity and favorable psychometric characteristics relative to comparator instruments, including the Confusion Assessment Method – Severity (CAM-S) score, the Delirium Rating Scale Revised 98, and the Memorial Delirium Assessment Scale. Conclusion: We more fully conceptualized delirium severity and identified characteristics of an ideal delirium severity instrument. These characteristics include an instrument that is relatively quick to administer, is easy to use by raters with minimal training, and provides a severity rating with good content validity, high internal consistency reliability, and broad domain coverage across delirium symptoms. We anticipate these characteristics to be represented in the subsequent development of our final delirium severity instrument.

1.
Engel
GL
,
Romano
J
.
Delirium, a syndrome of cerebral insufficiency
.
J Chronic Dis
.
1959
Mar
;
9
(
3
):
260
77
.
[PubMed]
0021-9681
2.
Leslie
DL
,
Marcantonio
ER
,
Zhang
Y
,
Leo-Summers
L
,
Inouye
SK
.
One-year health care costs associated with delirium in the elderly population
.
Arch Intern Med
.
2008
Jan
;
168
(
1
):
27
32
.
[PubMed]
0003-9926
3.
Morandi
A
,
Pozzi
C
,
Milisen
K
,
Hobbelen
H
,
Bottomley
JM
,
Lanzoni
A
, et al.
An interdisciplinary statement of scientific societies for the advancement of delirium care across Europe (EDA, EANS, EUGMS, COTEC, IPTOP/WCPT)
.
BMC Geriatr
.
2019
Sep
;
19
(
1
):
253
.
[PubMed]
1471-2318
4.
Krogseth
M
,
Wyller
TB
,
Engedal
K
,
Juliebø
V
.
Delirium is an important predictor of incident dementia among elderly hip fracture patients
.
Dement Geriatr Cogn Disord
.
2011
;
31
(
1
):
63
70
.
[PubMed]
1420-8008
5.
Wahlund
L
,
Björlin
GA
.
Delirium in clinical practice: experiences from a specialized delirium ward
.
Dement Geriatr Cogn Disord
.
1999
Sep-Oct
;
10
(
5
):
389
92
.
[PubMed]
1420-8008
6.
Hayden
KM
,
Inouye
SK
,
Cunningham
C
,
Jones
RN
,
Avidan
MS
,
Davis
D
, et al.
Reduce the burden of dementia now
.
Alzheimers Dement
.
2018
Jul
;
14
(
7
):
845
7
.
[PubMed]
1552-5260
7.
Eshmawey
M
,
Ledschbor-Frahn
C
,
Guenther
U
,
Popp
J
.
Preoperative depression and plasma cortisol levels as predictors of delirium after cardiac surgery
.
Dement Geriatr Cogn Disord
.
2020
;
•••
: ;
epub ahead of print
.
[PubMed]
1420-8008
8.
Altman
DG
,
Royston
P
.
The cost of dichotomising continuous variables
.
BMJ
.
2006
May
;
332
(
7549
):
1080
.
[PubMed]
0959-8138
9.
Adamis
D
,
Sharma
N
,
Whelan
PJ
,
Macdonald
AJ
.
Delirium scales: A review of current evidence
.
Aging Ment Health
.
2010
Jul
;
14
(
5
):
543
55
.
[PubMed]
1360-7863
10.
Schulman-Green
D
,
Schmitt
EM
,
Fong
TG
,
Vasunilashorn
SM
,
Gallagher
J
,
Marcantonio
ER
, et al.;
BASIL Study Group
.
Use of an expert panel to identify domains and indicators of delirium severity
.
Qual Life Res
.
2019
Sep
;
28
(
9
):
2565
78
.
[PubMed]
0962-9343
11.
Mokkink
LB
,
Terwee
CB
,
Patrick
DL
,
Alonso
J
,
Stratford
PW
,
Knol
DL
, et al.
The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes
.
J Clin Epidemiol
.
2010
Jul
;
63
(
7
):
737
45
.
[PubMed]
0895-4356
12.
de Vet
HC
,
Terwee
CB
,
Mokkink
LB
,
Knol
DL
.
Measurement in medicine: a practical guide
.
Cambridge University Press
;
2011
.
13.
Cella
D
,
Yount
S
,
Rothrock
N
,
Gershon
R
,
Cook
K
,
Reeve
B
, et al.;
PROMIS Cooperative Group
.
The Patient-Reported Outcomes Measurement Information System (PROMIS): progress of an NIH Roadmap cooperative group during its first two years
.
Med Care
.
2007
May
;
45
(
5
Suppl 1
):
S3
11
.
[PubMed]
0025-7079
14.
Cella
D
,
Nowinski
C
,
Peterman
A
,
Victorson
D
,
Miller
D
,
Lai
JS
, et al.
The neurology quality-of-life measurement initiative
.
Arch Phys Med Rehabil
.
2011
Oct
;
92
(
10
Suppl
):
S28
36
.
[PubMed]
0003-9993
15.
Streiner
DL
,
Kottner
J
.
Recommendations for reporting the results of studies of instrument and scale development and testing
.
J Adv Nurs
.
2014
Sep
;
70
(
9
):
1970
9
.
[PubMed]
0309-2402
16.
Inouye
SK
,
Kosar
CM
,
Tommet
D
,
Schmitt
EM
,
Puelle
MR
,
Saczynski
JS
, et al.
The CAM-S: development and validation of a new scoring system for delirium severity in 2 cohorts
.
Ann Intern Med
.
2014
Apr
;
160
(
8
):
526
33
.
[PubMed]
0003-4819
17.
Breitbart
W
,
Rosenfeld
B
,
Roth
A
,
Smith
MJ
,
Cohen
K
,
Passik
S
.
The Memorial Delirium Assessment Scale
.
J Pain Symptom Manage
.
1997
Mar
;
13
(
3
):
128
37
.
[PubMed]
0885-3924
18.
Trzepacz
PT
,
Mittal
D
,
Torres
R
,
Kanary
K
,
Norton
J
,
Jimerson
N
.
Validation of the Delirium Rating Scale-revised-98: comparison with the delirium rating scale and the cognitive test for delirium
.
J Neuropsychiatry Clin Neurosci
.
2001
;
13
(
2
):
229
42
.
[PubMed]
0895-0172
19.
Hshieh
TT
,
Fong
TG
,
Schmitt
EM
,
Marcantonio
ER
,
D’Aquila
ML
,
Gallagher
J
, et al.;
for the BASIL Study Group
.
The Better Assessment of Illness Study for Delirium Severity: Study Design, Procedures, and Cohort Description
.
Gerontology
.
2019
;
65
(
1
):
20
9
.
[PubMed]
0304-324X
20.
Inouye
SK
,
van Dyck
CH
,
Alessi
CA
,
Balkin
S
,
Siegal
AP
,
Horwitz
RI
.
Clarifying confusion: the confusion assessment method. A new method for detection of delirium
.
Ann Intern Med
.
1990
Dec
;
113
(
12
):
941
8
.
[PubMed]
0003-4819
21.
Harris
PA
,
Taylor
R
,
Thielke
R
,
Payne
J
,
Gonzalez
N
,
Conde
JG
.
Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support
.
J Biomed Inform
.
2009
Apr
;
42
(
2
):
377
81
.
[PubMed]
1532-0464
22.
Muthén
B
.
A general structural equation model with dichotomous, ordered categorical, and continuous latent variable indicators
.
Psychometrika
.
1984
;
49
(
1
):
115
32
. 0033-3123
23.
Birnbaum
A
. Chapter 17: Some latent trait models. In:
Lord
F
,
Novick
M
, editors
.
Statistical Theories of Mental Test Scores
.
Reading (MA)
:
Addison-Wesley
;
1968
. pp.
397
424
.
24.
Mellenbergh
GJ
.
Generalized linear item response theory
.
Psychol Bull
.
1994
;
115
(
2
):
300
300
. 0033-2909
25.
Lord
F
,
Novick
M
. Chapter 16: Latent traits and item characteristic functions.
Statistical Theories of Mental Test Scores
.
Reading (MA)
:
Addison-Wesley
;
1968
. pp.
358
93
.
26.
Bock
RD
,
Lieberman
M
.
Fitting a response model for n dichotomously scored items
.
Psychometrika
.
1970
;
35
(
2
):
179
97
. 0033-3123
27.
Mislevy
RJ
.
Recent developments in the factor analysis of categorical variables
.
J Educ Stat
.
1986
;
11
(
1
):
3
31
. 0362-9791
28.
Takane
Y
,
De Leeuw
J
.
On the relationship between item response theory and factor analysis of descretized variables
.
Psychometrika
.
1987
;
52
(
3
):
393
408
. 0033-3123
29.
Glockner-Rist
A
,
Hoijtink
H
.
The best of both worlds: factor analysis of dichotomous data using item response theory and structural equation modeling
.
Struct Equ Modeling
.
2003
;
10
(
4
):
544
65
. 1070-5511
30.
Muthén
B
.
Dichotomous factor analysis of symptom data
.
Sociol Methods Res
.
1989
;
18
(
1
):
19
65
. 0049-1241
31.
Holzinger
KJ
,
Swineford
F
.
The bi-factor method
.
Psychometrika
.
1937
;
2
(
1
):
41
54
. 0033-3123
32.
Gross
AL
,
Tommet
D
,
D’Aquila
M
,
Schmitt
E
,
Marcantonio
ER
,
Helfand
B
, et al.;
BASIL Study Group
.
Harmonization of delirium severity instruments: a comparison of the DRS-R-98, MDAS, and CAM-S using item response theory
.
BMC Med Res Methodol
.
2018
Sep
;
18
(
1
):
92
.
[PubMed]
1471-2288
33.
Halquist
M
: Mplus Automation. R package version 04-2
2011
.
34.
Muthén
B
.
Beyond SEM: general latent variable modeling
.
Behaviormetrika
.
2002
;
29
(
1
):
81
117
. 0385-7417
35.
Fisher
RA
:
On the mathematical foundations of theoretical statistics.
Philosophical Transactions of the Royal Society of London Series A, Containing Papers of a Mathematical or Physical Character
1922
, 222(594-604):309-368.
36.
Peters
GJ
.
The alpha and the omega of scale reliability and validity: why and how to abandon Cronbach’s alpha and the route towards more comprehensive assessment of scale quality
.
Eur Health Psychol
.
2014
;
16
(
2
):
56
69
.2225-6962
37.
Cronbach
LJ
.
Test reliability; its meaning and determination
.
Psychometrika
.
1947
Mar
;
12
(
1
):
1
16
.
[PubMed]
0033-3123
38.
Nunnally
JC
,
Bernstein
IH
.
Psychometric theory
. 3rd ed.
New York
:
McGraw-Hill College Division
;
1994
.
39.
Hu
L
,
Bentler
PM
.
Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives
.
Struct Equ Modeling
.
1999
;
6
(
1
):
1
55
. 1070-5511
41.
Jones
RN
,
Cizginer
S
,
Pavlech
L
,
Albuquerque
A
,
Daiello
LA
,
Dharmarajan
K
, et al.;
Better Assessment of Illness (BASIL) Study Group
.
Assessment of Instruments for Measurement of Delirium Severity: A Systematic Review
.
JAMA Intern Med
.
2019
Feb
;
179
(
2
):
231
9
.
[PubMed]
2168-6106
42.
Bandalos
DL
.
Is parceling really necessary? A comparison of results from item parceling and categorical variable methodology
.
Struct Equ Modeling
.
2008
;
15
(
2
):
211
40
. 1070-5511
43.
Kertesz
SG
,
Pollio
DE
,
Jones
RN
,
Steward
J
,
Stringfellow
EJ
,
Gordon
AJ
, et al.
Development of the Primary Care Quality-Homeless (PCQ-H) instrument: a practical survey of homeless patients’ experiences in primary care
.
Med Care
.
2014
Aug
;
52
(
8
):
734
42
.
[PubMed]
0025-7079
44.
Trzepacz
PT
,
Baker
RW
,
Greenhouse
J
.
A symptom rating scale for delirium
.
Psychiatry Res
.
1988
Jan
;
23
(
1
):
89
97
.
[PubMed]
0165-1781
45.
Neelon
VJ
,
Champagne
MT
,
Carlson
JR
,
Funk
SG
.
The NEECHAM Confusion Scale: construction, validation, and clinical testing
.
Nurs Res
.
1996
Nov-Dec
;
45
(
6
):
324
30
.
[PubMed]
0029-6562
46.
Albert
MS
,
Levkoff
SE
,
Reilly
C
,
Liptzin
B
,
Pilgrim
D
,
Cleary
PD
, et al.
The delirium symptom interview: an interview for the detection of delirium symptoms in hospitalized patients
.
J Geriatr Psychiatry Neurol
.
1992
Jan-Mar
;
5
(
1
):
14
21
.
[PubMed]
0891-9887
47.
de Jonghe
JF
,
Kalisvaart
KJ
,
Timmers
JF
,
Kat
MG
,
Jackson
JC
.
Delirium-O-Meter: a nurses’ rating scale for monitoring delirium severity in geriatric patients
.
Int J Geriatr Psychiatry
.
2005
Dec
;
20
(
12
):
1158
66
.
[PubMed]
0885-6230
48.
Schmitt
EM
,
Gallagher
J
,
Albuquerque
A
,
Tabloski
P
,
Lee
HJ
,
Gleason
L
, et al.
Perspectives on the delirium experience and its burden: common themes among older patients, their family caregivers, and nurses
.
Gerontologist
.
2019
Mar
;
59
(
2
):
327
37
.
[PubMed]
0016-9013
49.
Feinstein
AR
.
Multi-item “instruments” vs Virginia Apgar’s principles of clinimetrics
.
Arch Intern Med
.
1999
Jan
;
159
(
2
):
125
8
.
[PubMed]
0003-9926
50.
Katz
S
,
Ford
AB
,
Moskowitz
RW
,
Jackson
BA
,
Jaffe
MW
.
Studies of illness in the aged. The index of ADL: A standardized measure of biological and psychosocial function
.
JAMA
.
1963
Sep
;
185
(
12
):
914
9
.
[PubMed]
0098-7484
51.
Morita
T
,
Tsunoda
J
,
Inoue
S
,
Chihara
S
,
Oka
K
.
Communication Capacity Scale and Agitation Distress Scale to measure the severity of delirium in terminally ill cancer patients: a validation study
.
Palliat Med
.
2001
May
;
15
(
3
):
197
206
.
[PubMed]
0269-2163
52.
Otter
H
,
Martin
J
,
Bäsell
K
,
von Heymann
C
,
Hein
OV
,
Böllert
P
, et al.
Validity and reliability of the DDS for severity of delirium in the ICU
.
Neurocrit Care
.
2005
;
2
(
2
):
150
8
.
[PubMed]
1541-6933
53.
McCusker
J
,
Cole
MG
,
Dendukuri
N
,
Belzile
E
.
The delirium index, a measure of the severity of delirium: new findings on reliability, validity, and responsiveness
.
J Am Geriatr Soc
.
2004
Oct
;
52
(
10
):
1744
9
.
[PubMed]
0002-8614
54.
Meagher
D
,
Moran
M
,
Raju
B
,
Leonard
M
,
Donnelly
S
,
Saunders
J
, et al.
A new data-based motor subtype schema for delirium
.
J Neuropsychiatry Clin Neurosci
.
2008
;
20
(
2
):
185
93
.
[PubMed]
0895-0172
55.
Schuurmans
MJ
,
Shortridge-Baggett
LM
,
Duursma
SA
.
The Delirium Observation Screening Scale: a screening instrument for delirium
.
Res Theory Nurs Pract
.
2003
;
17
(
1
):
31
50
.
[PubMed]
1541-6577
56.
O’Keeffe
ST
.
Rating the severity of delirium: the Delirium Assessment Scale
.
Int J Geriatr Psychiatry
.
1994
;
9
(
7
):
551
6
. 0885-6230
57.
Viosca
E
,
Martínez
JL
,
Almagro
PL
,
Gracia
A
,
González
C
.
Proposal and validation of a new functional ambulation classification scale for clinical use
.
Arch Phys Med Rehabil
.
2005
Jun
;
86
(
6
):
1234
8
.
[PubMed]
0003-9993
58.
Giladi
N
,
Shabtai
H
,
Simon
ES
,
Biran
S
,
Tal
J
,
Korczyn
AD
.
Construction of freezing of gait questionnaire for patients with Parkinsonism
.
Parkinsonism Relat Disord
.
2000
Jul
;
6
(
3
):
165
70
.
[PubMed]
1353-8020
59.
Eastlack
ME
,
Arvidson
J
,
Snyder-Mackler
L
,
Danoff
JV
,
McGarvey
CL
.
Interrater reliability of videotaped observational gait-analysis assessments
.
Phys Ther
.
1991
Jun
;
71
(
6
):
465
72
.
[PubMed]
0031-9023
60.
Bergeron
N
,
Dubois
MJ
,
Dumont
M
,
Dial
S
,
Skrobik
Y
.
Intensive Care Delirium Screening Checklist: evaluation of a new screening tool
.
Intensive Care Med
.
2001
May
;
27
(
5
):
859
64
.
[PubMed]
0342-4642
61.
Jette
AM
,
Haley
SM
,
Coster
WJ
,
Kooyoomjian
JT
,
Levenson
S
,
Heeren
T
, et al.
Late life function and disability instrument: I. Development and evaluation of the disability component
.
J Gerontol A Biol Sci Med Sci
.
2002
Apr
;
57
(
4
):
M209
16
.
[PubMed]
1079-5006
62.
Newell
AM
,
VanSwearingen
JM
,
Hile
E
,
Brach
JS
.
The modified Gait Efficacy Scale: establishing the psychometric properties in older adults
.
Phys Ther
.
2012
Feb
;
92
(
2
):
318
28
.
[PubMed]
0031-9023
63.
Champagne
M
,
Neelon
V
,
McConnell
E
,
Funk
S
.
The NEECHAM Confusion Scale: assessing acute confusion in the hospitalized and nursing home elderly
.
Gerontologist
.
1987
;
27
4A
:
473
80
.0016-9013
64.
Cummings
JL
,
Mega
M
,
Gray
K
,
Rosenberg-Thompson
S
,
Carusi
DA
,
Gornbein
J
.
The Neuropsychiatric Inventory: comprehensive assessment of psychopathology in dementia
.
Neurology
.
1994
Dec
;
44
(
12
):
2308
14
.
[PubMed]
0028-3878
65.
NINDS
.
User manual for the quality of life in neurological disorders (Neuro-QoL) measures (version 2)
.
National Institute of Neurological Disorders and Stroke
;
2015
.
66.
Gaudreau
JD
,
Gagnon
P
,
Harel
F
,
Roy
MA
.
Impact on delirium detection of using a sensitive instrument integrated into clinical practice
.
Gen Hosp Psychiatry
.
2005
May-Jun
;
27
(
3
):
194
9
.
[PubMed]
0163-8343
67.
Tieges
Z
,
McGrath
A
,
Hall
RJ
,
Maclullich
AM
.
Abnormal level of arousal as a predictor of delirium and inattention: an exploratory study
.
Am J Geriatr Psychiatry
.
2013
Dec
;
21
(
12
):
1244
53
.
[PubMed]
1064-7481
68.
Bellelli
G
,
Speciale
S
,
Morghen
S
,
Torpilliesi
T
,
Turco
R
,
Trabucchi
M
.
Are fluctuations in motor performance a diagnostic sign of delirium?
J Am Med Dir Assoc
.
2011
Oct
;
12
(
8
):
578
83
.
[PubMed]
1525-8610
69.
Fong
TG
,
Tulebaev
SR
,
Inouye
SK
.
Delirium in elderly adults: diagnosis, prevention and treatment
.
Nat Rev Neurol
.
2009
Apr
;
5
(
4
):
210
20
.
[PubMed]
1759-4758
70.
Godfrey
A
,
Conway
R
,
Leonard
M
,
Meagher
D
,
Ólaighin
G
.
A classification system for delirium subtyping with the use of a commercial mobility monitor
.
Gait Posture
.
2009
Aug
;
30
(
2
):
245
52
.
[PubMed]
0966-6362
71.
Salzman
B
.
Gait and balance disorders in older adults
.
Am Fam Physician
.
2010
Jul
;
82
(
1
):
61
8
.
[PubMed]
1532-0650
Copyright / Drug Dosage / Disclaimer
Copyright: All rights reserved. No part of this publication may be translated into other languages, reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, microcopying, or by any information storage and retrieval system, without permission in writing from the publisher.
Drug Dosage: The authors and the publisher have exerted every effort to ensure that drug selection and dosage set forth in this text are in accord with current recommendations and practice at the time of publication. However, in view of ongoing research, changes in government regulations, and the constant flow of information relating to drug therapy and drug reactions, the reader is urged to check the package insert for each drug for any changes in indications and dosage and for added warnings and precautions. This is particularly important when the recommended agent is a new and/or infrequently employed drug.
Disclaimer: The statements, opinions and data contained in this publication are solely those of the individual authors and contributors and not of the publishers and the editor(s). The appearance of advertisements or/and product references in the publication is not a warranty, endorsement, or approval of the products or services advertised or of their effectiveness, quality or safety. The publisher and the editor(s) disclaim responsibility for any injury to persons or property resulting from any ideas, methods, instructions or products referred to in the content or advertisements.
You do not currently have access to this content.