Abstract
Background: Clinical lung ultrasound (LUS) is a fast bedside diagnostic tool which can assist clinicians in decisions regarding the treatment and monitoring of patients with respiratory symptoms. LUS training and education differ widely, and is often done in a clinical setting, with potential risks for patients if decisions are made based on the wrong interpretations. No clear guidelines or recommendations for objective and standardized assessment of LUS skills exist, and those that do are often based on a fixed time-frame or an arbitrary number of examinations performed; this does not ensure adequate competencies. Objectives: The study aimed to develop and gather validity evidence for a practical, simulation-based test in LUS. Methods: Nine cases were developed in collaboration with 3D Systems Healthcare, Littleton, CO, USA, representing the most common diagnosis and sonographic findings in patients with respiratory symptoms. Thirty-six participants with different levels of competence in LUS, completed the test. The participants were divided into groups, i.e., novices, intermediates, and experienced, according to their experience with LUS, the number of examinations they had performed, and any research they had conducted. Their answers were used for item analyses. Results: The intraclass correlation coefficient, Cronbachs’ α, was 0.69 summarized, and there was a statistically significant difference (p < 0.001) between the novices and the trained participants (intermediates and experienced). A pass/fail score of 16 points was calculated according to the contrasting-groups method. Conclusion: We developed a test for the assessment of clinical competencies in LUS. The test proved solid validity evidence, and a pass/fail standard without any false-negatives, and only 2 explained false-positives.
References
1.
Mac Sweeney
R
, McAuley
DF
, Matthay
MA
. Acute lung failure
. Semin Respir Crit Care Med
. 2011
Oct
;32
(5
):607
–25
.
[PubMed]
1069-34242.
Ray
P
, Birolleau
S
, Lefort
Y
, Becquemin
MH
, Beigelman
C
, Isnard
R
, et al Acute respiratory failure in the elderly: etiology, emergency diagnosis and prognosis
. Crit Care
. 2006
;10
(3
):R82
.
[PubMed]
1364-85353.
Collins
SP
, Lindsell
CJ
, Storrow
AB
, Abraham
WT
; ADHERE Scientific Advisory Committee, Investigators and Study Group
. Prevalence of negative chest radiography results in the emergency department patient with decompensated heart failure
. Ann Emerg Med
. 2006
Jan
;47
(1
):13
–8
.
[PubMed]
0196-06444.
Leuppi
JD
, Dieterle
T
, Koch
G
, Martina
B
, Tamm
M
, Perruchoud
AP
, et al Diagnostic value of lung auscultation in an emergency room setting
. Swiss Med Wkly
. 2005
Sep
;135
(35-36
):520
–4
.
[PubMed]
1424-78605.
Laursen
CB
, Sloth
E
, Lambrechtsen
J
, Lassen
AT
, Madsen
PH
, Henriksen
DP
, et al Focused sonography of the heart, lungs, and deep veins identifies missed life-threatening conditions in admitted patients with acute respiratory symptoms
. Chest
. 2013
Dec
;144
(6
):1868
–75
.
[PubMed]
0012-36926.
McGaghie
WC
. Mastery learning: it is time for medical education to join the 21st century
. Acad Med
. 2015
Nov
;90
(11
):1438
–41
.
[PubMed]
1040-24467.
Cook
DA
, Brydges
R
, Zendejas
B
, Hamstra
SJ
, Hatala
R
. Mastery learning for health professionals using technology-enhanced simulation: a systematic review and meta-analysis
. Acad Med
. 2013
Aug
;88
(8
):1178
–86
.
[PubMed]
1040-24468.
Oveland
NP
, Lossius
HM
, Aagaard
R
, Connolly
J
, Sloth
E
, Knudsen
L
. Animal laboratory training improves lung ultrasound proficiency and speed
. J Emerg Med
. 2013
Sep
;45
(3
):e71
–8
.
[PubMed]
0736-46799.
Schroeder
KM
, Ramamoorthy
J
, Galgon
RE
. An easily made, low-cost phantom for ultrasound airway exam training and assessment
. Indian J Anaesth
. 2013
Jan
;57
(1
):31
–4
.
[PubMed]
0019-504910.
See
KC
, Ong
V
, Wong
SH
, Leanda
R
, Santos
J
, Taculod
J
, et al Lung ultrasound training: curriculum implementation and learning trajectory among respiratory therapists
. Intensive Care Med
. 2016
Jan
;42
(1
):63
–71
.
[PubMed]
0342-464211.
Scalese
RJ
, Obeso
VT
, Issenberg
SB
. Simulation technology for skills training and competency assessment in medical education
. J Gen Intern Med
. 2008
Jan
;23
(S1
Suppl 1
):46
–9
.
[PubMed]
0884-873412.
Konge
L
, Albrecht-Beste
E
, Nielsen
MB
. Virtual-reality simulation-based training in ultrasound
. Ultraschall Med
. 2014
Apr
;35
(2
):95
–7
.
[PubMed]
0172-461413.
McGaghie
WC
, Issenberg
SB
, Petrusa
ER
, Scalese
RJ
. A critical review of simulation-based medical education research: 2003-2009
. Med Educ
. 2010
Jan
;44
(1
):50
–63
.
[PubMed]
0308-011014.
Downing
SM
. Assessment in Health Professions Education
. 1st ed. 2009
.15.
Downing
SM
. Validity: on meaningful interpretation of assessment data
. Med Educ
. 2003
Sep
;37
(9
):830
–7
.
[PubMed]
0308-011016.
Havelock
T
, Teoh
R
, Laws
D
, Gleeson
F
; BTS Pleural Disease Guideline Group
. Pleural procedures and thoracic ultrasound: British Thoracic Society Pleural Disease Guideline 2010
. Thorax
. 2010
Aug
;65
Suppl 2
:ii61
–76
.
[PubMed]
0040-637617.
Lichtenstein
D
. FALLS-protocol: lung ultrasound in hemodynamic assessment of shock
. Heart Lung Vessel
. 2013
;5
(3
):142
–7
.
[PubMed]
2282-841918.
EFSUMB
. Minimum training requirements for the practice of medical ultrasound in Europe. In: Biology EFoSfUiMa ed, Building a European Ultrasound Community. Appendix 11: Thoracic Ultrasound ed; 2009
19.
Barsuk
JH
, Cohen
ER
, Feinglass
J
, McGaghie
WC
, Wayne
DB
. Residents’ Procedural Experience Does Not Ensure Competence: A Research Synthesis
. J Grad Med Educ
. 2017
Apr
;9
(2
):201
–8
.
[PubMed]
1949-834920.
Leung
WC
. Competency based medical training: review
. [review]
. BMJ
. 2002
Sep
;325
(7366
):693
–6
.
[PubMed]
0959-813821.
ten Cate
O
, Scheele
F
. Competency-based postgraduate training: can we bridge the gap between theory and clinical practice?
Acad Med
. 2007
Jun
;82
(6
):542
–7
.
[PubMed]
1040-244622.
Griswold-Theodorson
S
, Ponnuru
S
, Dong
C
, Szyld
D
, Reed
T
, McGaghie
WC
. Beyond the simulation laboratory: a realist synthesis review of clinical outcomes of simulation-based mastery learning
. Acad Med
. 2015
Nov
;90
(11
):1553
–60
.
[PubMed]
1040-244623.
Validity
SM
. 3rd edn ed. New York: Americanb Council on Education and Macmillan; 1989
24.
Cook
DA
, Lineberry
M
. Consequences Validity Evidence: Evaluating the Impact of Educational Assessments
. Acad Med
. 2016
Jun
;91
(6
):785
–95
.
[PubMed]
1040-244625.
Trovato
GM
, Sperandeo
M
. Sounds, ultrasounds, and artifacts: which clinical role for lung imaging?
Am J Respir Crit Care Med
. 2013
Apr
;187
(7
):780
–1
.
[PubMed]
1073-449X26.
[Anonymous]
. ERS Monograph 2018: Thoracic Ultrasound; 201827.
Society
ER
. ERS skills course: Thoracic Ultrasound
. European Respiratory Society
; 2018
.28.
Gargani
L
, Volpicelli
G
. How I do it: lung ultrasound
. Cardiovasc Ultrasound
. 2014
Jul
;12
(1
):25
.
[PubMed]
1476-712029.
Jensen
JK
, Dyre
L
, Jørgensen
ME
, Andreasen
LA
, Tolsgaard
MG
. Collecting Validity Evidence for Simulation-Based Assessment of Point-of-Care Ultrasound Skills
. J Ultrasound Med
. 2017
Dec
;36
(12
):2475
–83
.
[PubMed]
0278-429730.
Tolsgaard
MG
, Ringsted
C
, Dreisler
E
, Klemmensen
A
, Loft
A
, Sorensen
JL
, et al Reliable and valid assessment of ultrasound operator competence in obstetrics and gynecology
. Ultrasound Obstet Gynecol
. 2014
Apr
;43
(4
):437
–43
.
[PubMed]
0960-769231.
Østergaard
ML
, Nielsen
KR
, Albrecht-Beste
E
, Konge
L
, Nielsen
MB
. Development of a reliable simulation-based test for diagnostic abdominal ultrasound with a pass/fail standard usable for mastery learning
. Eur Radiol
. 2018
Jan
;28
(1
):51
–7
.
[PubMed]
0938-799432.
Konge
L
, Annema
J
, Clementsen
P
, Minddal
V
, Vilmann
P
, Ringsted
C
. Using virtual-reality simulation to assess performance in endobronchial ultrasound
. Respiration
. 2013
;86
(1
):59
–65
.
[PubMed]
1423-035633.
Tolsgaard
MG
, Todsen
T
, Sorensen
JL
, Ringsted
C
, Lorentzen
T
, Ottesen
B
, et al International multispecialty consensus on how to evaluate ultrasound competence: a Delphi consensus survey
. PLoS One
. 2013
;8
(2
):e57687
.
[PubMed]
1932-620334.
Thomsen
AS
, Kiilgaard
JF
, Kjaerbo
H
, la Cour
M
, Konge
L
. Simulation-based certification for cataract surgery
. Acta Ophthalmol
. 2015
Aug
;93
(5
):416
–21
.
[PubMed]
1755-375X35.
Konge
L
, Vilmann
P
, Clementsen
P
, Annema
JT
, Ringsted
C
. Reliable and valid assessment of competence in endoscopic ultrasonography and fine-needle aspiration for mediastinal staging of non-small cell lung cancer
. Endoscopy
. 2012
Oct
;44
(10
):928
–33
.
[PubMed]
0013-726X36.
WH E.
Motor Learning
and Control: From Theory to Practise: Yolando Cossio; 2011
37.
Taylor
JA
, Ivry
RB
. The role of strategies in motor learning
. Ann N Y Acad Sci
. 2012
Mar
;1251
(1
):1
–12
.
[PubMed]
0077-892338.
Madsen
ME
, Konge
L
, Nørgaard
LN
, Tabor
A
, Ringsted
C
, Klemmensen
AK
, et al Assessment of performance measures and learning curves for use of a virtual-reality ultrasound simulator in transvaginal ultrasound examination
. Ultrasound Obstet Gynecol
. 2014
Dec
;44
(6
):693
–9
.
[PubMed]
0960-769239.
Konge
L
, Clementsen
PF
, Ringsted
C
, Minddal
V
, Larsen
KR
, Annema
JT
. Simulator training for endobronchial ultrasound: a randomised controlled trial
. Eur Respir J
. 2015
Oct
;46
(4
):1140
–9
.
[PubMed]
0903-193640.
Thomsen
AS
, Kiilgaard
JF
, la Cour
M
, Brydges
R
, Konge
L
. Is there inter-procedural transfer of skills in intraocular surgery? A randomized controlled trial
. Acta Ophthalmol
. 2017
Dec
;95
(8
):845
–51
.
[PubMed]
1755-375X© 2018 S. Karger AG, Basel
2018
Copyright / Drug Dosage / Disclaimer
Copyright: All rights reserved. No part of this publication may be translated into other languages, reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, microcopying, or by any information storage and retrieval system, without permission in writing from the publisher.
Drug Dosage: The authors and the publisher have exerted every effort to ensure that drug selection and dosage set forth in this text are in accord with current recommendations and practice at the time of publication. However, in view of ongoing research, changes in government regulations, and the constant flow of information relating to drug therapy and drug reactions, the reader is urged to check the package insert for each drug for any changes in indications and dosage and for added warnings and precautions. This is particularly important when the recommended agent is a new and/or infrequently employed drug.
Disclaimer: The statements, opinions and data contained in this publication are solely those of the individual authors and contributors and not of the publishers and the editor(s). The appearance of advertisements or/and product references in the publication is not a warranty, endorsement, or approval of the products or services advertised or of their effectiveness, quality or safety. The publisher and the editor(s) disclaim responsibility for any injury to persons or property resulting from any ideas, methods, instructions or products referred to in the content or advertisements.
You do not currently have access to this content.
