Introduction: The pathological grading of pancreatic neuroendocrine neoplasms (pNENs) is an independent predictor of survival and indicator for treatment. Deep learning (DL) with a convolutional neural network (CNN) may improve the preoperative prediction of pNEN grading. Methods: Ninety-three pNEN patients with preoperative contrast-enhanced computed tomography (CECT) from Hospital I were retrospectively enrolled. A CNN-based DL algorithm was applied to the CECT images to obtain 3 models (arterial, venous, and arterial/venous models), the performances of which were evaluated via an eightfold cross-validation technique. The CECT images of the optimal phase were used for comparing the DL and traditional machine learning (TML) models in predicting the pathological grading of pNENs. The performance of radiologists by using qualitative and quantitative computed tomography findings was also evaluated. The best DL model from the eightfold cross-validation was evaluated on an independent testing set of 19 patients from Hospital II who were scanned on a different scanner. The Kaplan-Meier (KM) analysis was employed for survival analysis. Results: The area under the curve (AUC; 0.81) of arterial phase in validation set was significantly higher than those of venous (AUC 0.57, p = 0.03) and arterial/venous phase (AUC 0.70, p = 0.03) in predicting the pathological grading of pNENs. Compared with the TML models, the DL model gave a higher (although insignificantly) AUC. The highest OR was achieved for the p ratio <0.9, the AUC and accuracy for diagnosing G3 pNENs were 0.80 and 79.1% respectively. The DL algorithm achieved an AUC of 0.82 and an accuracy of 88.1% for the independent testing set. The KM analysis showed a statistical significant difference between the predicted G1/2 and G3 groups in the progression-free survival (p = 0.001) and overall survival (p < 0.001). Conclusion: The CNN-based DL method showed a relatively robust performance in predicting pathological grading of pNENs from CECT images.

1.
Halfdanarson
TR
,
Rabe
KG
,
Rubin
J
,
Petersen
GM
.
Pancreatic neuroendocrine tumors (PNETs): incidence, prognosis and recent trend toward improved survival
.
Ann Oncol
.
2008
Oct
;
19
(
10
):
1727
33
.
[PubMed]
0923-7534
2.
Kloppel
G.
.
Classification and pathology of gastroenteropancreatic neuroendocrine neoplasms.
Endocr Relat Cancer
2011
;18 Suppl 1(S1):S1-16.
3.
Klimstra
DS
,
Modlin
IR
,
Coppola
D
,
Lloyd
RV
,
Suster
S
.
The pathologic classification of neuroendocrine tumors: a review of nomenclature, grading, and staging systems
.
Pancreas
.
2010
Aug
;
39
(
6
):
707
12
.
[PubMed]
0885-3177
4.
Lloyd
RV
,
Osamura
RY
,
Klöppel
G
,
Rosai
J
.
WHO Classification of Tumours of Endocrine Organs
. 4th ed.
Lyon, France
:
IARC Press
;
2017
.
5.
Basturk
O
,
Yang
Z
,
Tang
LH
,
Hruban
RH
,
Adsay
V
,
McCall
CM
, et al.
.
The high-grade (WHO G3) pancreatic neuroendocrine tumor category is morphologically and biologically heterogenous and includes both well differentiated and poorly differentiated neoplasms
.
Am J Surg Pathol
.
2015
May
;
39
(
5
):
683
90
.
[PubMed]
0147-5185
6.
Plöckinger
U
,
Rindi
G
,
Arnold
R
,
Eriksson
B
,
Krenning
EP
,
de Herder
WW
, et al.;
European Neuroendocrine Tumour Society
.
Guidelines for the diagnosis and treatment of neuroendocrine gastrointestinal tumours. A consensus statement on behalf of the European Neuroendocrine Tumour Society (ENETS)
.
Neuroendocrinology
.
2004
;
80
(
6
):
394
424
.
[PubMed]
0028-3835
7.
Smith
JK
,
Ng
SC
,
Hill
JS
,
Simons
JP
,
Arous
EJ
,
Shah
SA
, et al.
.
Complications after pancreatectomy for neuroendocrine tumors: a national study
.
J Surg Res
.
2010
Sep
;
163
(
1
):
63
8
.
[PubMed]
0022-4804
8.
Rossi
S
,
Viera
FT
,
Ghittoni
G
,
Cobianchi
L
,
Rosa
LL
,
Siciliani
L
, et al.
.
Radiofrequency ablation of pancreatic neuroendocrine tumors: a pilot study of feasibility, efficacy, and safety
.
Pancreas
.
2014
Aug
;
43
(
6
):
938
45
.
[PubMed]
0885-3177
9.
Luo
Y
,
Dong
Z
,
Chen
J
,
Chan
T
,
Lin
Y
,
Chen
M
, et al.
.
Pancreatic neuroendocrine tumours: correlation between MSCT features and pathological classification
.
Eur Radiol
.
2014
Nov
;
24
(
11
):
2945
52
.
[PubMed]
0938-7994
10.
Kim
DW
,
Kim
HJ
,
Kim
KW
,
Byun
JH
,
Song
KB
,
Kim
JH
, et al.
.
Neuroendocrine neoplasms of the pancreas at dynamic enhanced CT: comparison between grade 3 neuroendocrine carcinoma and grade 1/2 neuroendocrine tumour
.
Eur Radiol
.
2015
May
;
25
(
5
):
1375
83
.
[PubMed]
0938-7994
11.
Liang
W
,
Yang
P
,
Huang
R
,
Xu
L
,
Wang
J
,
Liu
W
, et al.
.
A combined nomogram model to preoperatively predict histologic grade in pancreatic neuroendocrine tumors
.
Clin Cancer Res
.
2019
Jan
;
25
(
2
):
584
94
.
[PubMed]
1078-0432
12.
Canellas
R
,
Burk
KS
,
Parakh
A
,
Sahani
DV
.
Prediction of pancreatic neuroendocrine tumor grade based on CT features and texture analysis
.
AJR Am J Roentgenol
.
2018
Feb
;
210
(
2
):
341
6
.
[PubMed]
0361-803X
13.
Wu
G
,
Chen
Y
,
Wang
Y
,
Yu
J
,
Lv
X
,
Ju
X
, et al.
.
Sparse Representation-Based Radiomics for the Diagnosis of Brain Tumors
.
IEEE Trans Med Imaging
.
2018
Apr
;
37
(
4
):
893
905
.
[PubMed]
0278-0062
14.
Lakhani
P
,
Sundaram
B
.
Deep learning at chest radiography: automated classification of pulmonary tuberculosis by using convolutional neural networks
.
Radiology
.
2017
Aug
;
284
(
2
):
574
82
.
[PubMed]
0033-8419
15.
Yasaka
K
,
Akai
H
,
Abe
O
,
Kiryu
S
.
Deep learning with convolutional neural network for differentiation of liver masses at dynamic contrast-enhanced CT: a preliminary study
.
Radiology
.
2018
Mar
;
286
(
3
):
887
96
.
[PubMed]
0033-8419
16.
Ehteshami Bejnordi
B
,
Veta
M
,
Johannes van Diest
P
,
van Ginneken
B
,
Karssemeijer
N
,
Litjens
G
, et al.;
the CAMELYON16 Consortium
.
Diagnostic assessment of deep learning algorithms for detection of lymph node metastases in women with breast cancer
.
JAMA
.
2017
Dec
;
318
(
22
):
2199
210
.
[PubMed]
0098-7484
17.
Chang
K
,
Bai
HX
,
Zhou
H
,
Su
C
,
Bi
WL
,
Agbodza
E
, et al.
.
Residual convolutional neural network for the determination of IDH status in low- and high-grade gliomas from MR imaging
.
Clin Cancer Res
.
2018
Mar
;
24
(
5
):
1073
81
.
[PubMed]
1078-0432
18.
Esteva
A
,
Kuprel
B
,
Novoa
RA
,
Ko
J
,
Swetter
SM
,
Blau
HM
, et al.
.
Dermatologist-level classification of skin cancer with deep neural networks
.
Nature
.
2017
Feb
;
542
(
7639
):
115
8
.
[PubMed]
0028-0836
19.
Tamburrino
D
,
Spoletini
G
,
Partelli
S
,
Muffatti
F
,
Adamenko
O
,
Crippa
S
, et al.
.
Surgical management of neuroendocrine tumors
.
Best Pract Res Clin Endocrinol Metab
.
2016
Jan
;
30
(
1
):
93
102
.
[PubMed]
1521-690X
20.
Crippa
S
,
Zerbi
A
,
Boninsegna
L
,
Capitanio
V
,
Partelli
S
,
Balzano
G
, et al.
Surgical management of insulinomas: short- and long-term outcomes after enucleations and pancreatic resections. Archives of surgery (Chicago, Ill : 1960)
2012
;147(3):261-6.
21.
He
K
,
Zhang
X
,
Ren
S
,
Sun
J
.
Deep residual learning for image recognition
.
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
,
2016
; p.
770
-
8
.
22.
Eisenhauer
EA
,
Therasse
P
,
Bogaerts
J
,
Schwartz
LH
,
Sargent
D
,
Ford
R
, et al.
.
New response evaluation criteria in solid tumours: revised RECIST guideline (version 1.1)
.
Eur J Cancer
.
2009
Jan
;
45
(
2
):
228
47
.
[PubMed]
0959-8049
23.
Li
R
,
Zhang
W
,
Suk
HI
,
Wang
L
,
Li
J
,
Shen
D
, et al.
.
Deep learning based imaging data completion for improved brain disease diagnosis
.
International Conference on Medical Image Computing and Computer-Assisted Intervention: Springer
,
2014
; p.
305
-
12
.
24.
Ertosun
MG
,
Rubin
DL
.
Automated grading of gliomas using deep learning in digital pathology images: A modular approach with ensemble of convolutional neural networks
.
AMIA Annual Symposium Proceedings: American Medical Informatics Association
,
2015
; p.
1899
.
25.
Yasaka
K
,
Akai
H
,
Kunimatsu
A
,
Kiryu
S
,
Abe
O
.
Deep learning with convolutional neural network in radiology
.
Jpn J Radiol
.
2018
Apr
;
36
(
4
):
257
72
.
[PubMed]
1867-1071
26.
Yasaka
K
,
Akai
H
,
Kunimatsu
A
,
Abe
O
,
Kiryu
S
.
Liver fibrosis: deep convolutional neural network for staging by using gadoxetic acid–enhanced hepatobiliary phase MR images
.
Radiology
.
2018
Apr
;
287
(
1
):
146
55
.
[PubMed]
0033-8419
27.
Wu
G
,
Chen
Y
,
Wang
Y
,
Yu
J
,
Lv
X
,
Ju
X
, et al.
.
Sparse Representation-Based Radiomics for the Diagnosis of Brain Tumors
.
IEEE Trans Med Imaging
.
2018
Apr
;
37
(
4
):
893
905
.
[PubMed]
0278-0062
28.
Zhang
Y
,
Lobo-Mueller
E M
,
Karanicolas
P
,
Gallinger
S
,
Haider
M A
,
Khalvati
F.
Improving Prognostic Value of CT Deep Radiomic Features in Pancreatic Ductal Adenocarcinoma Using Transfer Learning. arXiv.
2019
:1905.09888.
29.
Hussein
S
,
Kandel
P
,
Bolan
CW
,
Wallace
MB
,
Bagci
U
.
Lung and pancreatic tumor characterization in the deep learning era: novel supervised and unsupervised learning approaches
.
IEEE Trans Med Imaging
.
2019
Aug
;
38
(
8
):
1777
87
.
[PubMed]
0278-0062
30.
Jardim-Perassi
BV
,
Huang
S
,
Dominguez-Viqueira
W
,
Poleszczuk
J
,
Budzevich
MM
,
Abdalah
MA
, et al.
.
Multiparametric MRI and Coregistered Histology Identify Tumor Habitats in Breast Cancer Mouse Models
.
Cancer Res
.
2019
Aug
;
79
(
15
):
3952
64
.
[PubMed]
0008-5472
You do not currently have access to this content.