Background: The aim of this study is to systematically review the literature to summarize the evidence surrounding the clinical utility of artificial intelligence (AI) in the field of mammography. Databases from PubMed, IEEE Xplore, and Scopus were searched for relevant literature. Studies evaluating AI models in the context of prediction and diagnosis of breast malignancies that also reported conventional performance metrics were deemed suitable for inclusion. From 90 unique citations, 21 studies were considered suitable for our examination. Data was not pooled due to heterogeneity in study evaluation methods. Summary: Three studies showed the applicability of AI in reducing workload. Six studies demonstrated that AI can aid in diagnosis, with up to 69% reduction in false positives and an increase in sensitivity ranging from 84 to 91%. Five studies show how AI models can independently mark and classify suspicious findings on conventional scans, with abilities comparable with radiologists. Seven studies examined AI predictive potential for breast cancer and risk score calculation. Key Messages: Despite limitations in the current evidence base and technical obstacles, this review suggests AI has marked potential for extensive use in mammography. Additional works, including large-scale prospective studies, are warranted to elucidate the clinical utility of AI.

1.
Nystrom
L
,
Andersson
I
,
Bjurstam
N
,
Frisell
J
,
Nordenskjold
B
,
Rutqvist
LE
.
Long-term effects of mammography screening: updated overview of the Swedish randomized trials
.
Lancet
.
2002
;
359
:
909
19
.
2.
Duffy
SW
,
Tabar
L
,
Vitak
B
,
Day
NE
,
Smith
RA
,
Chen
HH
, et al.
The relative contributions of screen-detected in situ and invasive breast carcinomas in reducing mortality from the disease
.
Eur J Cancer
.
2003
;
39
(
12
):
1755
60
. .
3.
Duffy SW, Tabár L, Chen HH, Holmqvist M, Yen MF, Abdsalah S, et al. The impact of organized mammography service screening on breast carcinoma mortality in seven Swedish counties. Cancer. 2002 Aug 1;95(3):458-69.
4.
Tabar
L
,
Vitak
B
,
Chen
HH
,
Yen
MF
,
Duffy
SW
,
Smith
RA
.
Beyond randomized controlled trials: organized mammographic screening substantially reduces breast carcinoma mortality
.
Cancer
.
2001
;
91
:
1724
31
.
5.
Nelson
HD
,
Fu
R
,
Cantor
A
,
Pappas
M
,
Daeges
M
,
Humphrey
L
.
Effectiveness of breast cancer screening: systematic review and meta-analysis to update the 2009 U.S. Preventive Services Task Force Recommendation
.
Ann Intern Med
.
2016
;
164
(
4
):
244
55
. .
6.
Hubbard
RA
,
Kerlikowske
K
,
Flowers
CI
,
Yankaskas
BC
,
Zhu
W
,
Miglioretti
DL
.
Cumulative probability of false-positive recall or biopsy recommendation after 10 years of screening mammography: a cohort study
.
Ann Intern Med
.
2011
;
155
(
8
):
481
92
. .
7.
Braithwaite
D
,
Zhu
W
,
Hubbard
RA
,
O'Meara
ES
,
Miglioretti
DL
,
Geller
B
, et al.
Breast Cancer Surveillance Consortium. Screening outcomes in older US women undergoing multiple mammograms in community practice: does interval, age, or comorbidity score affect tumor characteristics or false positive rates?
J Natl Cancer Inst
.
2013
;
105
:
334
41
.
8.
Ong
MS
,
Mandl
KD
.
National expenditure for false-positive mammograms and breast cancer overdiagnoses estimated at $4 billion a year
.
Health Aff (Millwood)
.
2015
;
34
(
4
):
576
83
. .
9.
Nelson
HD
,
Pappas
M
,
Cantor
A
,
Griffin
J
,
Daeges
M
,
Humphrey
L
.
Harms of Breast Cancer Screening: Systematic Review to Update the 2009 U.S. Preventive Services Task Force Recommendation
.
Ann Intern Med
.
2016
;
164
(
4
):
256
67
. .
10.
Huynh
PT
,
Jarolimek
AM
,
Daye
S
.
The false-negative mammogram
.
Radiographics
.
1998
;
18
(
5
):
1137
4
. .
11.
Nelson
HD
,
O'Meara
ES
,
Kerlikowske
K
,
Balch
S
,
Miglioretti
D
.
Factors Associated With Rates of False-Positive and False-Negative Results From Digital Mammography Screening: An Analysis of Registry Data
.
Ann Intern Med
.
2016
;
164
(
4
):
226
. .
12.
Linden
OE
,
Hayward
JH
,
Price
ER
,
Kelil
T
,
Joe
BN
,
Lee
AY
.
Utility of Diagnostic Mammography as the Primary Imaging Modality for Palpable Lumps in Women With Almost Entirely Fatty Breasts
.
AJR Am J Roentgenol
.
2020
;
214
(
4
):
938
44
. .
13.
Charniak
E
,
McDermott
D
.
Introduction to Artificial Intelligence
.
Reading, MA
:
Addison-Wesley
;
1985
.
14.
Buchanan
BG
,
Shortliffe
EH
.
Rule Based Expert Systems: The MYCIN Experiments of the Stanford Heuristic Programming Project
.
Reading, MA
:
Addison-Wesley
;
1984
.
15.
Rowlands
CF
,
Baralle
D
,
Ellingford
JM
.
Machine Learning Approaches for the Prioritization of Genomic Variants Impacting Pre-mRNA Splicing
.
Cells
.
2019
;
8
(
12
):
1513
. .
16.
Lehman
CD
,
Wellman
RD
,
Buist
DS
,
Kerlikowske
K
,
Tosteson
AN
,
Miglioretti
DL
.
Breast Cancer Surveillance Consortium. Diagnostic Accuracy of Digital Screening Mammography With and Without Computer-Aided Detection
.
JAMA Intern Med
.
2015
;
175
:
1828
37
.
17.
Rodriguez-Ruiz
A
,
Lång
K
,
Gubern-Merida
A
,
Teuwen
J
,
Broeders
M
,
Gennaro
G
, et al.
Can we reduce the workload of mammographic screening by automatic identification of normal exams with artificial intelligence? A feasibility study
.
Eur Radiol
.
2019
;
29
(
9
):
4825
32
. .
18.
Watanabe
AT
,
Lim
V
,
Vu
HX
,
Chim
R
,
Weise
E
,
Liu
J
, et al.
Improved Cancer Detection Using Artificial Intelligence: a Retrospective Evaluation of Missed Cancers on Mammography
.
J Digit Imaging
.
2019
;
32
(
4
):
625
37
. .
19.
Bishop
CM
.
Pattern Recognition and Machine Learning
.
New York
:
Springer
;
2006
.
20.
Yala
A
,
Schuster
T
,
Miles
R
,
Barzilay
R
,
Lehman
C
.
A Deep Learning Model to Triage Screening Mammograms: A Simulation Study
.
Radiology
.
2019
;
293
(
1
):
38
46
. .
21.
McKinney
SM
,
Sieniek
M
,
Godbole
V
,
Godwin
J
,
Antropova
N
,
Ashrafian
H
, et al.
International evaluation of an AI system for breast cancer screening
.
Nature
.
2020
;
577
(
7788
):
89
94
. .
22.
Rodríguez-Ruiz
A
, et al.
Detection of Breast Cancer with Mammography: Effect of an Artificial Intelligence Support System
.
Radiology
.
2019 Feb
;
290
(
2
):
305
14
.
23.
Mayo
RC
,
Kent
D
,
Sen
LC
,
Kapoor
M
,
Leung
JWT
,
Watanabe
AT
.
Reduction of False-Positive Markings on Mammograms: a Retrospective Comparison Study Using an Artificial Intelligence-Based CAD
.
J Digit Imaging
.
2019
;
32
(
4
):
618
24
. .
24.
Hmida
M
,
Hamrouni
K
,
Solaiman
B
,
Boussetta
S
.
Mammographic mass segmentation using fuzzy contours
.
Comput. Methods Programs Biomed.
2018
;
164
:
131
42
. .
25.
Sapate
SG
,
Mahajan
A
,
Talbar
SN
,
Sable
N
,
Desai
S
,
Thakur
M
.
Radiomics based detection and characterization of suspicious lesions on full field digital mammograms
.
Comput Methods Programs Biomed
.
2016
;
163
:
1
20
.
26.
Zeng J, Gimenez F, Burnside ES, Rubin DL, Shachter R. A Probabilistic Model to Support Radiologists’ Classification Decisions in Mammography Practice. Med Decis Making. 2019 Apr;39(3):208–16.
27.
Cowell
RG
,
Dawid
P
,
Lauritzen
SL
,
Spiegelhalter
DJ
.
Probabilistic Networks and Expert Systems
.
New York
:
Springer
;
1999
.
28.
Rodriguez-Ruiz
A
,
Lång
K
,
Gubern-Merida
A
,
Broeders
M
,
Gennaro
G
,
Clauser
P
, et al.
Stand-Alone Artificial Intelligence for Breast Cancer Detection in Mammography: Comparison With 101 Radiologists
.
J Natl Cancer Inst
.
2019 Sep 1
;
111
(
9
):
916
22
. .
29.
Agnes
SA
,
Anitha
J
,
Pandian
SIA
,
Peter
JD
.
Classification of Mammogram Images Using Multiscale all Convolutional Neural Network (MA-CNN)
.
J Med Syst
.
2020
;
44
(
1
):
30
. .
30.
Al-Antari
MA
,
Al-Masni
MA
,
Kim
TS
.
Deep Learning Computer-Aided Diagnosis for Breast Lesion in Digital Mammogram
.
Adv Exp Med Biol
.
2020;1213:59–72
.
31.
Aboutalib
SS
,
Mohamed
AA
,
Berg
WA
,
Zuley
ML
,
Sumkin
JH
,
Wu
S
.
Deep Learning to Distinguish Recalled but Benign Mammography Images in Breast Cancer Screening
.
Clin Cancer Res.
2018
;
24
(
23
):
5902
9
. .
32.
Zhang
X
,
Zhang
Y
,
Han
EY
,
Jacobs
N
,
Han
Q
,
Wang
X
, et al.
Classification of whole mammogram and tomosynthesis images using deep convolutional neural networks
.
IEEE Trans Nanobioscience
.
2018
;
17
(
3
):
237
42
. .
33.
Gao
F
,
Wu
T
,
Li
J
,
Zheng
B
,
Ruan
L
,
Shang
D
, et al.
SD-CNN: A shallow-deep CNN for improved breast cancer diagnosis
.
Comput Med Imaging Graph
.
2018
;
70
:
53
62
. .
34.
Claus
EB
,
Risch
N
,
Thompson
WD
.
The calculation of breast cancer risk for women with a first degree family history of ovarian cancer
.
Breast Cancer Res Treat
.
1993
;
28
(
2
):
115
20
. .
35.
Tyrer
J
,
Duffy
SW
,
Cuzick
J
.
A breast cancer prediction model incorporating familial and personal risk factors
.
Stat Med
.
2004
;
23
(
7
):
1111
30
. .
36.
Kerlikowske
K
,
Zhu
W
,
Tosteson
AN
,
Sprague
BL
,
Tice
JA
,
Lehman
CD
, et al.
Identifying women with dense breasts at high risk for interval Cancer: a cohort study
.
Ann Intern Med
.
2015
;
162
(
10
):
673
81
. .
37.
Tyrer
J
,
Duffy
SW
,
Cuzick
J
.
A breast cancer prediction model incorporating familial and personal risk factors
.
Stat Med
.
2004
;
23
(
7
):
1111
30
. .
38.
Sprague
BL
,
Conant
EF
,
Onega
T
,
Garcia
MP
,
Beaber
EF
,
Herschorn
SD
, et al.
Variation in mammographic breast density assessments among radiologists in clinical practice: a multicenter observational study
.
Ann Intern Med
.
2016
;
165
(
7
):
457
64
. .
39.
Debrower
K
,
Liu
Y
,
Azizpour
H
,
Eklund
M
,
Smith
K
,
Lindholm
P
, et al.
Comparison of a Deep Learning Risk Score and Standard Mammographic Density Score for Breast Cancer Risk Prediction
.
Radiology
.
2020 Feb;294(2):265–72
.
40.
Ha
R
,
Chang
P
,
Karcich
J
,
Mutasa
S
,
Pascual Van Sant
E
,
Liu
MZ
, et al.
Convolutional neural network based breast cancer risk stratification using a mammographic dataset
.
Acad Radiol.
2019
;
26
(
4
):
544
9
. .
41.
Arefan
D
,
Mohamed
AA
,
Berg
WA
,
Zuley
ML
,
Sumkin
JH
,
Wu
S
.
Deep learning modeling using normal mammograms for predicting breast cancer risk
.
Med Phys
.
2020
;
47
(
1
):
110
8
. .
42.
Carney
PA
,
Steiner
E
,
Goodrich
ME
,
Dietrich
AJ
,
Kasales
CJ
,
Weiss
JE
, et al.
Discovery of breast cancers within 1 year of a normal screening mammogram: how are they found?
Ann Fam Med
.
2006 Nov-Dec
;
4
(
6
):
512
8
.
43.
Hinton
B
,
Ma
L
,
Mahmoudzadeh
AP
,
Malkov
S
,
Fan
B
,
Greenwood
H
, et al.
Deep learning networks find unique mammographic differences in previous negative mammograms between interval and screen-detected cancers: a case-case study
.
Cancer Imaging
.
2019
;
19
(
1
):
41
. .
44.
Akselrod
BA
,
Chorev
M
,
Shoshan
Y
,
Spiro
A
,
Hazan
A
,
Melamed
R
, et al.
Predicting Breast Cancer by Applying Deep Learning to Linked Health Records and Mammograms
.
Radiology
.
2019
;
292
:
331
42
.
45.
Yala
A
,
Lehman
C
,
Schuster
T
,
Portnoi
T
,
Barzilay
R
.
A Deep Learning Mammography-based Model for Improved Breast Cancer Risk Prediction
.
Radiology
.
2019
;
292
(
1
):
60
6
. .
46.
Allen
B
, Jr
,
Seltzer
SE
,
Langlotz
CP
,
Dreyer
KP
,
Summers
RM
,
Petrick
N
, et al.
A road map for translational research on artificial intelligence in medical imaging: from the 2018 National Institutes of Health/RSNA/ACR/The Academy Workshop
.
J Am Coll Radiol
.
2019 Sep
;
16
(
9 Pt A
):
1179
89
. .
47.
Mendelson
EB
.
Artificial Intelligence in Breast Imaging: Potentials and Limitations
.
AJR Am J Roentgenol
.
2019
;
212
(
2
):
293
9
. .
48.
Geis
JR
,
Brady
AP
,
Wu
CC
,
Spencer
J
,
Ranschaert
E
,
Jaremko
JL
, et al.
Ethics of Artificial Intelligence in Radiology: Summary of the Joint European and North American Multisociety Statement
.
Can Assoc Radiol J
.
2019
;
70
(
4
):
329
34
. .
49.
Rajkomar
A
,
Hardt
M
,
Howell
MD
,
Corrado
G
,
Chin
MH
.
Ensuring fairness in machine learning to advance health equity
.
Ann Intern Med
.
2018
;
169
(
12
):
866
. .
50.
Lee
CI
,
Houssami
N
,
Elmore
JG
,
Buist
DSM
.
Pathways to breast cancer screening artificial intelligence algorithm validation
.
Breast
.
2020 Aug
;
52
:
146
9
.
51.
Geras KJ, Mann RM, Moy L. Artificial Intelligence for Mammography and Digital Breast Tomosynthesis: Current Concepts and Future Perspectives. Radiology. 2019 Nov;293(2):246–59
52.
Redberg
RF
,
Dhruva
SS
.
Moving from substantial equivalence to substantial improvement for 510(k) devices
.
J Am Med Assoc
.
2019 Sep 10
;
322
(
10
):
927
8
.
53.
Pangalos
G
,
Gritzalis
D
,
Khair
M
,
Bozios
L
.
Improving the security of medical database systems
. In:
Eloff
JHP
,
von Solms
SH
, editors.
Information Security – the Next Decade. IFIP Advances in Information and Communication Technology
.
Boston, MA
:
Springer
;
1995
.
54.
Patel
V
.
A framework for secure and decentralized sharing of medical imaging data via blockchain consensus
.
Health Informatics J
.
2019 Dec
;
25
(
4
):
1398
411
. .
55.
Becker
AS
,
Jendele
L
,
Skopek
O
,
Berger
N
,
Ghafoor
S
,
Marcon
M
, et al.
Injecting and removing suspicious features in breast imaging with CycleGAN: A pilot study of automated adversarial attacks using neural networks on small images
.
Eur J Radiol
.
2019
;
120
:
108649
. .
Copyright / Drug Dosage / Disclaimer
Copyright: All rights reserved. No part of this publication may be translated into other languages, reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, microcopying, or by any information storage and retrieval system, without permission in writing from the publisher.
Drug Dosage: The authors and the publisher have exerted every effort to ensure that drug selection and dosage set forth in this text are in accord with current recommendations and practice at the time of publication. However, in view of ongoing research, changes in government regulations, and the constant flow of information relating to drug therapy and drug reactions, the reader is urged to check the package insert for each drug for any changes in indications and dosage and for added warnings and precautions. This is particularly important when the recommended agent is a new and/or infrequently employed drug.
Disclaimer: The statements, opinions and data contained in this publication are solely those of the individual authors and contributors and not of the publishers and the editor(s). The appearance of advertisements or/and product references in the publication is not a warranty, endorsement, or approval of the products or services advertised or of their effectiveness, quality or safety. The publisher and the editor(s) disclaim responsibility for any injury to persons or property resulting from any ideas, methods, instructions or products referred to in the content or advertisements.
You do not currently have access to this content.