Background: Screening for major depression with the Patient Health Questionnaire-9 (PHQ-9) can be done using a cutoff or the PHQ-9 diagnostic algorithm. Many primary studies publish results for only one approach, and previous meta-analyses of the algorithm approach included only a subset of primary studies that collected data and could have published results. Objective: To use an individual participant data meta-analysis to evaluate the accuracy of two PHQ-9 diagnostic algorithms for detecting major depression and compare accuracy between the algorithms and the standard PHQ-9 cutoff score of ≥10. Methods: Medline, Medline In-Process and Other Non-Indexed Citations, PsycINFO, Web of Science (January 1, 2000, to February 7, 2015). Eligible studies that classified current major depression status using a validated diagnostic interview. Results: Data were included for 54 of 72 identified eligible studies (n participants = 16,688, n cases = 2,091). Among studies that used a semi-structured interview, pooled sensitivity and specificity (95% confidence interval) were 0.57 (0.49, 0.64) and 0.95 (0.94, 0.97) for the original algorithm and 0.61 (0.54, 0.68) and 0.95 (0.93, 0.96) for a modified algorithm. Algorithm sensitivity was 0.22–0.24 lower compared to fully structured interviews and 0.06–0.07 lower compared to the Mini International Neuropsychiatric Interview. Specificity was similar across reference standards. For PHQ-9 cutoff of ≥10 compared to semi-structured interviews, sensitivity and specificity (95% confidence interval) were 0.88 (0.82–0.92) and 0.86 (0.82–0.88). Conclusions: The cutoff score approach appears to be a better option than a PHQ-9 algorithm for detecting major depression.

1.
Raffle
A
,
Gray
M
.
Screening: evidence and practice
.
London, UK
:
Oxford University Press
;
2007
.
2.
Wilson
JM
,
Jungner
G
.
Principles and practices of screening for disease
.
Geneva
:
World Health Organization
;
1968
.
3.
Fava
GA
,
Tomba
E
,
Sonino
N
.
Clinimetrics: the science of clinical measurements
.
Int J Clin Pract
.
2012
Jan
;
66
(
1
):
11
5
.
[PubMed]
1368-5031
4.
Fava
GA
,
Carrozzino
D
,
Lindberg
L
,
Tomba
E
.
The clinimetric approach to psychological assessment: a tribute to Per Bech, MD (1942-2018)
.
Psychother Psychosom
.
2018
;
87
(
6
):
321
6
.
[PubMed]
0033-3190
5.
Tomba
E
,
Bech
P
.
Clinimetrics and clinical psychometrics: macro- and micro-analysis
.
Psychother Psychosom
.
2012
;
81
(
6
):
333
43
.
[PubMed]
0033-3190
6.
Thombs
BD
,
Ziegelstein
RC
.
Does depression screening improve depression outcomes in primary care?
BMJ
.
2014
Feb
;
348
feb04 2
:
g1253
.
[PubMed]
0959-8138
7.
Thombs
BD
,
Coyne
JC
,
Cuijpers
P
,
de Jonge
P
,
Gilbody
S
,
Ioannidis
JP
, et al.
Rethinking recommendations for screening for depression in primary care
.
CMAJ
.
2012
Mar
;
184
(
4
):
413
8
.
[PubMed]
0820-3946
8.
Siu
AL
,
Bibbins-Domingo
K
,
Grossman
DC
,
Baumann
LC
,
Davidson
KW
,
Ebell
M
, et al.;
US Preventive Services Task Force (USPSTF)
.
Screening for Depression in Adults: US Preventive Services Task Force Recommendation Statement
.
JAMA
.
2016
Jan
;
315
(
4
):
380
7
.
[PubMed]
0098-7484
9.
Joffres
M
,
Jaramillo
A
,
Dickinson
J
,
Lewin
G
,
Pottie
K
,
Shaw
E
, et al.;
Canadian Task Force on Preventive Health Care
.
Recommendations on screening for depression in adults
.
CMAJ
.
2013
Jun
;
185
(
9
):
775
82
.
[PubMed]
0820-3946
10.
Allaby
M
.
Screening for depression: A report for the UK National Screening Committee (Revised report)
.
London, United Kingdom
:
UK National Screening Committee
;
2010
.
11.
Kroenke
K
,
Spitzer
RL
,
Williams
JB
.
The PHQ-9: validity of a brief depression severity measure
.
J Gen Intern Med
.
2001
Sep
;
16
(
9
):
606
13
.
[PubMed]
0884-8734
12.
Kroenke
K
,
Spitzer
RL
.
The PHQ-9: a new depression diagnostic and severity measure
.
Psychiatr Ann
.
2002
;
32
(
9
):
1
7
. 0048-5713
13.
Spitzer
RL
,
Kroenke
K
,
Williams
JB
;
Primary Care Evaluation of Mental Disorders
.
Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. Primary Care Evaluation of Mental Disorders. Patient Health Questionnaire
.
JAMA
.
1999
Nov
;
282
(
18
):
1737
44
.
[PubMed]
0098-7484
14.
Maurer
DM
,
Raymond
TJ
,
Davis
BN
.
Depression: screening and Diagnosis
.
Am Fam Physician
.
2018
Oct
;
98
(
8
):
508
15
.
[PubMed]
1532-0650
15.
Diagnostic and statistical manual of mental disorders: DSM-III
. 3rd ed, revised.
Washington (DC)
:
American Psychiatric Association
;
1987
.
16.
Diagnostic and statistical manual of mental disorders: DSM-IV
. 4th ed.
Washington (DC)
:
American Psychiatric Association
;
1994
.
17.
Diagnostic and statistical manual of mental disorders: DSM-IV 4th ed, text revised. Washington, DC: American Psychiatric Association
2000
.
18.
American Academy of Family Physicians [internet]. Depression. [cited 2019 Feb 20]. Avaliable from: https://www.aafp.org/patient-care/clinical-recommendations/all/depression.html
19.
Lichtman
JH
,
Bigger
JT
 Jr
,
Blumenthal
JA
,
Frasure-Smith
N
,
Kaufmann
PG
,
Lespérance
F
, et al.;
American Heart Association Prevention Committee of the Council on Cardiovascular Nursing
;
American Heart Association Council on Clinical Cardiology
;
American Heart Association Council on Epidemiology and Prevention
;
American Heart Association Interdisciplinary Council on Quality of Care and Outcomes Research
;
American Psychiatric Association
.
Depression and coronary heart disease: recommendations for screening, referral, and treatment: a science advisory from the American Heart Association Prevention Committee of the Council on Cardiovascular Nursing, Council on Clinical Cardiology, Council on Epidemiology and Prevention, and Interdisciplinary Council on Quality of Care and Outcomes Research: endorsed by the American Psychiatric Association
.
Circulation
.
2008
Oct
;
118
(
17
):
1768
75
.
[PubMed]
0009-7322
20.
Levis
B
,
Benedetti
A
,
Thombs
BD
;
DEPRESsion Screening Data (DEPRESSD) Collaboration
.
Accuracy of Patient Health Questionnaire-9 (PHQ-9) for screening to detect major depression: individual participant data meta-analysis
.
BMJ
.
2019
Apr
;
365
:
l1476
.
[PubMed]
0959-8138
21.
Manea
L
,
Gilbody
S
,
McMillan
D
.
A diagnostic meta-analysis of the Patient Health Questionnaire-9 (PHQ-9) algorithm scoring method as a screen for depression
.
Gen Hosp Psychiatry
.
2015
Jan-Feb
;
37
(
1
):
67
75
.
[PubMed]
0163-8343
22.
Moriarty
AS
,
Gilbody
S
,
McMillan
D
,
Manea
L
.
Screening and case finding for major depressive disorder using the Patient Health Questionnaire (PHQ-9): a meta-analysis
.
Gen Hosp Psychiatry
.
2015
Nov-Dec
;
37
(
6
):
567
76
.
[PubMed]
0163-8343
23.
Thombs
BD
,
Arthurs
E
,
El-Baalbaki
G
,
Meijer
A
,
Ziegelstein
R
,
Steele
R
.
Risk of bias from inclusion of already diagnosed or treated patients in diagnostic accuracy studies of depression screening tools: A systematic review
.
BMJ
.
2011
;
343
:
d4825
.
[PubMed]
0959-8138
24.
Rice
DB
,
Thombs
BD
.
Risk of bias from inclusion of currently diagnosed or treated patients in studies of depression screening tool accuracy: A cross-sectional analysis of recently published primary studies and meta-analyses
.
PLoS One
.
2016
Feb
;
11
(
2
):
e0150067
.
[PubMed]
1932-6203
25.
Levis
B
,
Benedetti
A
,
Riehm
KE
,
Saadat
N
,
Levis
AW
,
Azar
M
, et al.
Probability of major depression diagnostic classification using semi-structured versus fully structured diagnostic interviews
.
Br J Psychiatry
.
2018
Jun
;
212
(
6
):
377
85
.
[PubMed]
0007-1250
26.
Riley
RD
,
Lambert
PC
,
Abo-Zaid
G
.
Meta-analysis of individual participant data: rationale, conduct, and reporting
.
BMJ
.
2010
Feb
;
340
feb05 1
:
c221
.
[PubMed]
0959-8138
27.
Thombs
BD
,
Benedetti
A
,
Kloda
LA
,
Levis
B
,
Nicolau
I
,
Cuijpers
P
, et al.
The diagnostic accuracy of the Patient Health Questionnaire-2 (PHQ-2), Patient Health Questionnaire-8 (PHQ-8), and Patient Health Questionnaire-9 (PHQ-9) for detecting major depression: protocol for a systematic review and individual patient data meta-analyses
.
Syst Rev
.
2014
Oct
;
3
(
1
):
124
.
[PubMed]
2046-4053
28.
McInnes
MD
,
Moher
D
,
Thombs
BD
,
McGrath
TA
,
Bossuyt
PM
,
Clifford
T
, et al.;
the PRISMA-DTA Group
.
Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies: the PRISMA-DTA Statement
.
JAMA
.
2018
Jan
;
319
(
4
):
388
96
.
[PubMed]
0098-7484
29.
Stewart
LA
,
Clarke
M
,
Rovers
M
,
Riley
RD
,
Simmonds
M
,
Stewart
G
, et al.;
PRISMA-IPD Development Group
.
Preferred Reporting Items for Systematic Review and Meta-Analyses of individual participant data: the PRISMA-IPD Statement
.
JAMA
.
2015
Apr
;
313
(
16
):
1657
65
.
[PubMed]
0098-7484
30.
The ICD-10 Classifications of Mental and Behavioural Disorder
.
Clinical Descriptions and Diagnostic Guidelines Geneva
.
World Health Organization
;
1992
.
31.
PRESS – Peer Review of Electronic Search Strategies
:
2015
Guideline Explanation and Elaboration (PRESS E&E). Ottawa: CADTH; 2016 Jan.
32.
United Nations
. [Internet]. International Human Development Indicators[cited 2019 Feb 20]. Avaliable from: http://hdr.undp.org/en/countries
33.
Whiting
PF
,
Rutjes
AW
,
Westwood
ME
,
Mallett
S
,
Deeks
JJ
,
Reitsma
JB
, et al.;
QUADAS-2 Group
.
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
.
Ann Intern Med
.
2011
Oct
;
155
(
8
):
529
36
.
[PubMed]
0003-4819
34.
First
MB
.
Structured clinical interview for the DSM (SCID)
.
John Wiley & Sons, Inc.
;
1995
.
35.
World Health Organization
.
Schedules for Clinical Assessment in Neuropsychiatry: manual
.
Amer Psychiatric Pub Inc.
;
1994
.
36.
Freedland
KE
,
Skala
JA
,
Carney
RM
,
Raczynski
JM
,
Taylor
CB
,
Mendes de Leon
CF
, et al.
The Depression Interview and Structured Hamilton (DISH): rationale, development, characteristics, and clinical validity
.
Psychosom Med
.
2002
Nov-Dec
;
64
(
6
):
897
905
.
[PubMed]
0033-3174
37.
Robins
LN
,
Wing
J
,
Wittchen
HU
,
Helzer
JE
,
Babor
TF
,
Burke
J
, et al.
The Composite International Diagnostic Interview. An epidemiologic Instrument suitable for use in conjunction with different diagnostic systems and in different cultures
.
Arch Gen Psychiatry
.
1988
Dec
;
45
(
12
):
1069
77
.
[PubMed]
0003-990X
38.
Lewis
G
,
Pelosi
AJ
,
Araya
R
,
Dunn
G
.
Measuring psychiatric disorder in the community: a standardized assessment for use by lay interviewers
.
Psychol Med
.
1992
May
;
22
(
2
):
465
86
.
[PubMed]
0033-2917
39.
Robins
LN
,
Helzer
JE
,
Croughan
J
,
Ratcliff
KS
.
National Institute of Mental Health Diagnostic Interview Schedule. Its history, characteristics, and validity
.
Arch Gen Psychiatry
.
1981
Apr
;
38
(
4
):
381
9
.
[PubMed]
0003-990X
40.
Lecrubier
Y
,
Sheehan
DV
,
Weiller
E
,
Amorim
P
,
Bonora
I
,
Harnett Sheehan
K
, et al.
The Mini International Neuropsychiatric Interview (MINI). A short diagnostic structured interview: reliability and validity according to the CIDI
.
Eur Psychiatry
.
1997
;
12
(
5
):
224
31
. 0924-9338
41.
Sheehan
DV
,
Lecrubier
Y
,
Sheehan
KH
, et al.
The validity of the Mini International Neuropsychiatric Interview (MINI) according to the SCID-P and its reliability
.
Eur Psychiatry
.
1997
;
12
(
5
):
232
41
. 0924-9338
42.
Brugha
TS
,
Jenkins
R
,
Taub
N
,
Meltzer
H
,
Bebbington
PE
.
A general population comparison of the Composite International Diagnostic Interview (CIDI) and the Schedules for Clinical Assessment in Neuropsychiatry (SCAN)
.
Psychol Med
.
2001
Aug
;
31
(
6
):
1001
13
.
[PubMed]
0033-2917
43.
Brugha
TS
,
Bebbington
PE
,
Jenkins
R
.
A difference that matters: comparisons of structured and semi-structured psychiatric diagnostic interviews in the general population
.
Psychol Med
.
1999
Sep
;
29
(
5
):
1013
20
.
[PubMed]
0033-2917
44.
Nosen
E
,
Woody
SR
. Chapter 8: Diagnostic Assessment in Research.
McKay D. Handbook of research methods in abnormal and clinical psychology
.
Sage
;
2008
.
45.
Kurdyak
PA
,
Gnam
WH
.
Small signal, big noise: performance of the CIDI depression module
.
Can J Psychiatry
.
2005
Nov
;
50
(
13
):
851
6
.
[PubMed]
0706-7437
46.
Riley
RD
,
Dodd
SR
,
Craig
JV
,
Thompson
JR
,
Williamson
PR
.
Meta-analysis of diagnostic test studies using individual patient data and aggregate data
.
Stat Med
.
2008
Dec
;
27
(
29
):
6111
36
.
[PubMed]
0277-6715
47.
van der Leeden
R
,
Busing
FM
,
Meijer
E
.
Bootstrap methods for two-level models. Technical Report PRM 97-04
.
Leiden, The Netherlands
:
Leiden University, Department of Psychology
;
1997
.
48.
van der Leeden
R
,
Meijer
E
,
Busing
FM
. Chapter 11: Resampling multilevel models. In:
Leeuw
J
,
Meijer
E
, editors
.
Handbook of multilevel analysis New York
.
NY
:
Springer
;
2008
. pp.
401
33
.
49.
Higgins
JP
,
Thompson
SG
.
Quantifying heterogeneity in a meta-analysis
.
Stat Med
.
2002
Jun
;
21
(
11
):
1539
58
.
[PubMed]
0277-6715
50.
Lambert
SD
,
Clover
K
,
Pallant
JF
,
Britton
B
,
King
MT
,
Mitchell
AJ
, et al.
Making sense of variations in prevalence estimates of depression in Cancer: a co-calibration of commonly used depression scales using Rasch analysis
.
J Natl Compr Canc Netw
.
2015
Oct
;
13
(
10
):
1203
11
.
[PubMed]
1540-1405
51.
Thombs
BD
,
Ziegelstein
RC
,
Roseman
M
,
Kloda
LA
,
Ioannidis
JP
.
There are no randomized controlled trials that support the United States Preventive Services Task Force Guideline on screening for depression in primary care: a systematic review
.
BMC Med
.
2014
Jan
;
12
(
1
):
13
.
[PubMed]
1741-7015
52.
Christensen
KS
,
Oernboel
E
,
Zatzick
D
,
Russo
J
.
Screening for depression: rasch analysis of the structural validity of the PHQ-9 in acutely injured trauma survivors
.
J Psychosom Res
.
2017
Jun
;
97
:
18
22
.
[PubMed]
0022-3999
53.
Amoozegar
F
,
Patten
SB
,
Becker
WJ
,
Bulloch
AG
,
Fiest
KM
,
Davenport
WJ
, et al.
The prevalence of depression and the accuracy of depression screening tools in migraine patients
.
Gen Hosp Psychiatry
.
2017
Sep
;
48
:
25
31
.
[PubMed]
0163-8343
54.
Dejesus
RS
,
Vickers
KS
,
Melin
GJ
,
Williams
MD
.
A system-based approach to depression management in primary care using the Patient Health Questionnaire-9
.
Mayo Clin Proc
.
2007
Nov
;
82
(
11
):
1395
402
.
[PubMed]
0025-6196
55.
Kroenke
K
,
Spitzer
RL
,
Williams
JB
.
The Patient Health Questionnaire-2: validity of a two-item depression screener
.
Med Care
.
2003
Nov
;
41
(
11
):
1284
92
.
[PubMed]
0025-7079
56.
Bech
P
,
Rasmussen
NA
,
Olsen
LR
,
Noerholm
V
,
Abildgaard
W
.
The sensitivity and specificity of the Major Depression Inventory, using the Present State Examination as the index of diagnostic validity
.
J Affect Disord
.
2001
Oct
;
66
(
2-3
):
159
64
.
[PubMed]
0165-0327
57.
Bech
P
,
Timmerby
N
,
Martiny
K
,
Lunde
M
,
Soendergaard
S
.
Psychometric evaluation of the Major Depression Inventory (MDI) as depression severity scale using the LEAD (Longitudinal Expert Assessment of All Data) as index of validity
.
BMC Psychiatry
.
2015
Aug
;
15
(
1
):
190
.
[PubMed]
1471-244X
58.
Bech
P
,
Christensen
EM
,
Vinberg
M
,
Østergaard
SD
,
Martiny
K
,
Kessing
LV
.
The performance of the revised Major Depression Inventory for self-reported severity of depression—implications for the DSM-5 and ICD-11
.
Psychother Psychosom
.
2013
;
82
(
3
):
187
8
.
[PubMed]
0033-3190
59.
Christensen
KS
,
Sokolowski
I
,
Olesen
F
.
Case-finding and risk-group screening for depression in primary care
.
Scand J Prim Health Care
.
2011
Jun
;
29
(
2
):
80
4
.
[PubMed]
0281-3432
60.
Nielsen
MG
,
Ørnbøl
E
,
Bech
P
,
Vestergaard
M
,
Christensen
KS
.
The criterion validity of the web-based Major Depression Inventory when used on clinical suspicion of depression in primary care
.
Clin Epidemiol
.
2017
Jul
;
9
:
355
65
.
[PubMed]
1179-1349
Copyright / Drug Dosage / Disclaimer
Copyright: All rights reserved. No part of this publication may be translated into other languages, reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, microcopying, or by any information storage and retrieval system, without permission in writing from the publisher.
Drug Dosage: The authors and the publisher have exerted every effort to ensure that drug selection and dosage set forth in this text are in accord with current recommendations and practice at the time of publication. However, in view of ongoing research, changes in government regulations, and the constant flow of information relating to drug therapy and drug reactions, the reader is urged to check the package insert for each drug for any changes in indications and dosage and for added warnings and precautions. This is particularly important when the recommended agent is a new and/or infrequently employed drug.
Disclaimer: The statements, opinions and data contained in this publication are solely those of the individual authors and contributors and not of the publishers and the editor(s). The appearance of advertisements or/and product references in the publication is not a warranty, endorsement, or approval of the products or services advertised or of their effectiveness, quality or safety. The publisher and the editor(s) disclaim responsibility for any injury to persons or property resulting from any ideas, methods, instructions or products referred to in the content or advertisements.
You do not currently have access to this content.