Background: In the face of rapid technological advances in computational cytology including artificial intelligence (AI), optimization of its application to clinical practice would benefit from reflection on the lessons learned from the decades-long journey in the development of computer-assisted Pap test screening. Summary: The initial driving force for automated screening in cytology was the overwhelming number of Pap tests requiring manual screening, leading to workflow backlogs and incorrect diagnoses. Several companies invested resources to address these concerns utilizing different specimen processing techniques and imaging systems. However, not all companies were commercially prosperous. Successful implementation of this new technology required viable use cases, improved clinical outcomes, and an acceptable means of integration into the daily workflow of cytopathology laboratories. Several factors including supply and demand, Food and Drug Administration (FDA) oversight, reimbursement, overcoming learning curves and workflow changes associated with the adoption of new technology, and cytologist apprehension, played a significant role in either promoting or preventing the widespread adoption of automated screening technologies. Key Messages: Any change in health care, particularly those involving new technology that impacts clinical workflow, is bound to have its successes and failures. However, perseverance through learning curves, optimizing workflow processes, improvements in diagnostic accuracy, and regulatory and financial approval can facilitate widespread adoption of these technologies. Given their history with successfully implementing automated Pap test screening, cytologists are uniquely positioned to not only help with the development of AI technology for other areas of pathology, but also to guide how they are utilized, regulated, and managed.

1.
Centers for Disease Control and Prevention
.
National ambulatory medical care survey: 2016 national summary tables
.
2.
Spencer
CC
,
Bostrom
RC
.
Performance of the cytoanalyzer in recent clinical trials
.
J Natl Cancer Inst
.
1962
;
29
:
267
76
.
3.
Bengtsson
E
,
Malm
P
.
Screening for cervical cancer using automated analysis of PAP-smears
,
Comput Math Methods Med
.
2014
;
2014
:
842037
.
4.
Wied
Gl
,
Bartels
PH
,
Bahr
GF
,
Oldfield
DG
.
Taxonomic intra-cellular analytic system (TIICAS) for cell identification
.
Acta Cytol
.
1968
;
12
(
3
):
180
204
,
208–217, 393–412
.
5.
Bacus
JW
,
Bacus
JV
.
Quality control in image cytometry: DNA ploidy
.
J Cell Biochem Suppl
.
1994
;
19
:
153
64
6.
Wheeless
LL
 Jr
,
Reeder
JE
,
O’Connell
MJ
.
Slit-scan flow analysis of cytologic specimens from the female genital tract
.
Methods Cell Biol
.
1990
;
33
:
501
7
.
7.
Wilbur
DC
.
Dr. Bibbo’s presidential address on automation in cytology: were her predictions right, wrong, or somewhere in the middle?
Acta Cytol
.
2017
;
61
(
4–5
):
345
58
.
8.
Koss
LG
,
Lin
E
,
Schreiber
K
,
Elgert
P
,
Mango
L
.
Evaluation of the PAPNET cytologic screening system for quality control of cervical smears
.
Am J Clin Pathol
.
1994
;
101
(
2
):
220
9
9.
Pattern
SF
 Jr
,
Lee
JS
,
Nelson
AC
.
NeoPath, Inc. NeoPath AutoPap 300 automatic pap screener system
.
Acta Cytol
.
1996
;
40
:
45
52
.
10.
Oud
PS
,
Zahniser
DJ
,
Haag
DJ
,
van Boekel
MC
,
Hermkens
HG
,
Herman
CJ
,
A new disaggregation device for cytology specimens
.
Cytometry
.
1984
;
5
(
5
):
509
14
.
11.
Hutchinson
ML
,
Isenstein
LM
,
Goodman
A
,
Hurley
AA
,
Douglass
KL
,
Mui
KK
,
Homogeneous sampling accounts for the increased diagnostic accuracy using the ThinPrep Processor
.
Am J Clin Pathol
.
1994
;
101
(
2
):
215
9
.
12.
Marshall
CJ
,
Rowe
L
,
Bentz
JS
.
Improved quality-control detection of false-negative Pap smears using the Autopap 300 QC system
.
Diagn Cytopathol
.
1999
;
20
(
3
):
170
4
.
13.
Mango
LJ
,
Radensky
P
.
Neural network-assisted (“NNA”) analysis of cervical smears: pooled effectiveness results and economic analysis
.
Prim Care Update Ob Gyns
.
1998
;
5
(
4
):
162
3
.
14.
Troni
GM
,
Cipparrone
I
,
Cariaggi
MP
,
Ciatto
S
,
Miccinesi
G
,
Zappa
M
,
Detection of false-negative Pap smears using the PAPNET system
.
Tumori
.
200
;
86
(
6
):
455
7
.
15.
Mitchell
H
,
Medley
G
.
Detection of laboratory false negative smears by the PAPNET cytologic screening system
.
Acta Cytol
.
1998
;
42
(
1
):65
70
.
16.
Brotzman
GL
,
Kretzchmar
S
,
Ferguson
D
,
Gottlieb
M
,
Stowe
C
.
Costs and outcomes of PAPNET secondary screening technology for cervical cytologic evaluation. A community hospital’s experience
.
Arch Fam Med
.
1999
;
8
(
1
):
52
5
.
17.
Wilbur
DC
,
Bonfiglio
TA
,
Rutkowski
MA
,
Atkison
KM
,
Richart
RM
,
Lee
JS
,
Sensitivity of the AutoPap 300 QC System for cervical cytologic abnormalities. Biopsy data confirmation
.
Acta Cytol
.
1996
;
40
(
1
):
127
32
.
18.
Wilbur
DC
.
Automated cervical cancer screening: apprehension or logic: which will it be?
Diagn Cytopathol
.
1999
;
21
(
4
):
235
7
.
19.
Wilbur
DC
,
Cibas
ES
,
Merritt
S
,
James
LP
,
Berger
BM
,
Bonfiglio
TA
.
ThinPrep processor. Clinical trials demonstrate an increased detection rate of abnormal cervical cytologic specimens
.
Am J Clin Pathol
.
1994
;
101
(
2
):
209
,
14
.
20.
Tench
W
.
Preliminary assessment of the AutoCyte PREP. Direct-to-vial performance
.
J Reprod Med
.
2000
;
45
(
11
):
912
6
.
21.
Biscotti
CV
,
Dawson
AE
,
Dziura
B
,
Galup
L
,
Darragh
T
,
Rahemtulla
A
,
Assisted primary screening using the automated ThinPrep Imaging System
.
Am J Clin Pathol
.
2005
;
123
(
2
):
281
7
.
22.
Wilbur
DC
,
Black-Schaffer
WS
,
Luff
RD
,
Abraham
KP
,
Kemper
C
,
Molina
JT
,
The Becton Dickinson FocalPoint GS Imaging System: clinical trials demonstrate significantly improved sensitivity for the detection of important cervical lesions
.
Am J Clin Pathol
.
2009
;
132
(
5
):
767
75
.
23.
Wong
R
,
Levi
AW
,
Harigopal
M
,
Schofield
K
,
Chhieng
DC
.
The positive impact of simultaneous implementation of the BD FocalPoint GS Imaging System and lean principles on the operation of gynecologic cytology
.
Arch Pathol Lab Med
.
2012
;
136
(
2
):
183
9
.
24.
Dziura
B
,
Quinn
S
,
Richard
K
.
Performance of an imaging system vs. manual screening in the detection of squamous intraepithelial lesions of the uterine cervix
.
Acta Cytol
.
2006
;
50
(
3
):
309
11
.
25.
Chivukula
M
,
Saad
RS
,
Elishaev
E
,
White
S
,
Mauser
N
,
Dabbs
DJ
.
Introduction of the Thin Prep Imaging System (TIS): experience in a high volume academic practice
.
Cytojournal
.
2007
;
4
:
6
.
26.
Duby
JM
,
DiFurio
MJ
.
Implementation of the ThinPrep Imaging System in a tertiary military medical center
.
Cancer
.
2009
;
117
(
4
):
264
70
.
27.
Pacheco
MC
,
Conley
RC
,
Pennington
DW
,
Bishop
JW
.
Concordance between original screening and final diagnosis using imager vs. manual screen of cervical liquid-based cytology slides
.
Acta Cytol
.
2008
;
52
(
5
):
575
8
.
28.
Davey
E
,
d’Assuncao
J
,
Irwig
L
,
Macaskill
P
,
Chan
SF
,
Richards
A
,
Accuracy of reading liquid based cytology slides using the ThinPrep Imager compared with conventional cytology: prospective study
.
BMJ
.
2007
;
335
(
7609
):
31
.
29.
Pantanowtiz
L
,
Bui
MM
.
Computer-assisted pap test screening
. In:
Bui
MM
,
Pantanowitz
L
, editors.
Modern techniques in cytopathology
.
Monogr Clin Cytol
.
Basel, Switzerland
:
Karger
;
2020
. Vol. 25; p.
67
74
.
30.
Alaghehbandan
R
.
Performance of the CellSolutions Glucyte liquid-based cytology in comparison with the ThinPrep and SurePath methods
.
Acta Cytol
.
2013
;
57
(
2
):
189
97
.
31.
Delga
A
,
Goffin
F
,
Kridelka
F
,
Maree
R
,
Lambart
C
,
Delvenne
P
.
Evaluations of CellSolutions BestPrep automated thin-layer liquid based cytology Papanicolaou slide preparations and BestCyte cell sorter imaging system
.
Acta Cytol
.
2015
;
58
(
5
):
469
77
.
32.
Cibas
ES
,
Alonzo
TA
,
Austin
RM
,
Bolick
DR
,
Glant
MD
,
Henry
MR
,
The MonoPrep Pap test for the detection of cervical cancer and its precursors. Part I: results of a multicenter clinical trial
.
Am J Clin Pathol
.
2008
;
129
(
2
):
193
201
.
33.
Sweeney
BJ
,
Wilbur
DC
.
Effects on cervical cytology screening productivity associated with implementation of the BD FocalPoint™ Guided Screener Imaging System
.
Acta Cytol
.
2013
;
57
(
2
):
147
52
.
34.
Dawson
AE
.
Can we change the way we screen?: the ThinPrep Imaging System
.
Cancer
.
2004
;
102
(
6
):
340
4
.
35.
Schledermann
D
,
Hyldebrandt
T
,
Ejersbo
D
,
Hoelund
B
,
Automated screening versus manual screening: a comparison of the ThinPrep imaging system and manual screening in a time study
.
Diagn Cytopathol
.
2007
;
35
(
6
):
348
52
.
36.
Bolger
N
,
Heffron
C
,
Regan
I
,
Sweeney
M
,
Kinsella
S
,
McKeown
M
,
Implementation and evaluation of a new automated interactive image analysis system
.
Acta Cytol
.
2006
;
50
(
5
):
483
91
.
37.
Cengel
KA
,
Day
SJ
,
Davis-Devine
S
,
Adams
CL
,
Madison-Henness
D
,
Hartman
ME
,
Effectiveness of the SurePath liquid-based Pap test in automated screening and in detection of HSIL
.
Diagn Cytopathol
.
2003
;
29
(
5
):
250
5
.
38.
Limaye
A
,
Connor
AJ
,
Huang
X
,
Luff
R
.
Comparative analysis of conventional Papanicolaou tests and a fluid-based thin-layer method
.
Arch Pathol Lab Med
.
2003
;
127
(
2
):
200
4
.
39.
Keyhani-Rofagha
S
,
Vesey-Shecket
M
.
Diagnostic value, feasibility, and validity of preparing cell blocks from fluid-based gynecologic cytology specimens
.
Cancer
.
2002
;
96
(
4
):
204
9
.
40.
Beck
AH
,
Sangoi
AR
,
Leung
S
,
Marinelli
RJ
,
Nielsen
TO
,
van de Vijver
MJ
,
Systematic analysis of breast cancer morphology uncovers stromal features associated with survival
.
Sci Transl Med
.
2011
;
3
(
108
):
108ra113
.
41.
Saslow
D
,
Solomon
D
,
Lawson
HW
,
Killackey
M
,
Kulasingam
SL
,
Cain
J
,
American Cancer Society, American Society for Colposcopy and Cervical Pathology, and American Society for Clinical Pathology screening guidelines for the prevention and early detection of cervical cancer
.
Am J Clin Pathol
.
2012
;
137
(
4
):
516
42
.
42.
Cuzick
J
,
Clavel
C
,
Petry
KU
,
Meijer
CJ
,
Hoyer
H
,
Ratnam
S
,
Overview of the European and North American studies on HPV testing in primary cervical cancer screening
.
Int J Cancer
.
2006
;
119
(
5
):
1095
101
.
43.
Naucler
P
,
Ryd
W
,
Törnberg
S
,
Strand
A
,
Wadell
G
,
Elfgren
K
,
Human papillomavirus and Papanicolaou tests to screen for cervical cancer
.
N Engl J Med
.
2007
;
357
(
16
):
1589
97
.
44.
Bulkmans
NW
,
Berkhof
J
,
Rozendaal
L
,
van Kemenade
FJ
,
Boeke
AJ
,
Bulk
S
,
Human papillomavirus DNA testing for the detection of cervical intraepithelial neoplasia grade 3 and cancer: 5-year follow-up of a randomised controlled implementation trial
.
Lancet
.
2007
;
370
(
9601
):
1764
72
.
45.
Castle
PE
,
Stoler
MH
,
Wright
TC
 Jr
,
Sharma
A
,
Wright
TL
,
Behrens
CM
.
Performance of carcinogenic human papillomavirus (HPV) testing and HPV16 or HPV18 genotyping for cervical cancer screening of women aged 25 years and older: a subanalysis of the ATHENA study
.
Lancet Oncol
.
2011
;
12
(
9
):
880
90
.
46.
Stoler
MH
.
HPV for cervical cancer screening: is the era of the molecular pap smear upon us?
J Histochem Cytochem
.
2001
;
49
(
9
):
1197
8
.
47.
Carozzi
FM
,
Del Mistro
A
,
Confortini
M
,
Sani
C
,
Puliti
D
,
Trevisan
R
,
Reproducibility of HPV DNA testing by hybrid capture 2 in a screening setting
.
Am J Clin Pathol
.
2005
;
124
(
5
):
716
21
.
48.
Kelly
RS
,
Patnick
J
,
Kitchener
HC
,
Moss
SM
.
HPV testing as a triage for borderline or mild dyskaryosis on cervical cytology: results from the Sentinel Sites study
.
Br J Cancer
.
2011
;
105
(
7
):
983
8
.
49.
Huh
WK
,
Ault
KA
,
Chelmow
D
,
Davey
DD
,
Goulart
RA
,
Garcia
FA
,
Use of primary high-risk human papillomavirus testing for cervical cancer screening: interim clinical guidance
.
Gynecol Oncol
.
2015
;
136
(
2
):
178
82
.
50.
Chrysostomou
AC
,
Stylianou
DC
,
Constantinidou
A
,
Kostrikis
LG
.
Cervical cancer screening Programs in Europe: the transition towards HPV vaccination and population-based HPV testing
.
Viruses
.
2018
;
10
(
12
):
729
.
51.
Sun
H
,
Masand
RP
,
Patel
SJ
,
Padmanabhan
V
.
High grade squamous intraepithelial lesion on high-risk HPV negative patients: why we still need the Pap test
.
Diagn Cytopathol
.
2018
;
46
(
11
):
908
13
.
52.
Schiffman
M
,
Yu
K
,
Zuna
R
,
Terence Dunn
S
,
Zhang
H
,
Walker
J
,
Proof-of-principle study of a novel cervical screening and triage strategy: computer-analyzed cytology to decide which HPV-positive women are likely to have ≥CIN2
.
Int J Cancer
.
2017
;
140
(
3
):
718
25
.
53.
Khorrami
M
,
Prasanna
P
,
Gupta
A
,
Patil
P
,
Velu
PD
,
Thawani
R
,
Changes in CT radiomic features associated with lymphocyte distribution predict overall survival and response to immunotherapy in non-small cell lung cancer
.
Cancer Immunol Res
.
2020
;
8
(
1
):
108
19
.
54.
Crowell
EF
,
Bazin
C
,
Saunier
F
,
Brixtel
R
,
Caillot
Y
,
Lesner
B
,
CytoProcessorTM: a new cervical cancer screening system for remote diagnosis
.
Acta Cytol
.
2019
;
63
(
3
):
215
23
.
55.
Crowell
EF
,
Bazin
C
,
Thurotte
V
,
Elie
H
,
Jitaru
L
,
Olivier
G
,
Adaptation of cytoProcessor for cervical cancer screening of challenging slides
.
Diagn Cyto
.
2019
;
47
:
890
7
.
56.
Mulford
DK
.
Alternatives to the traditional Papanicolaou (pap) smear: liquid based cytology (LBC)
.
Lab Med
.
2003
;
34
(
2
):
129
31
.
57.
Malle
D
,
Pateinakis
P
,
Chakka
E
,
Destouni
C
.
Experience with a thin-layer, liquid-based cervical cytologic screening method
.
Acta Cytol
.
2003
;
47
(
2
):
129
34
.
58.
Wilbur
DC
,
Dubeshter
B
,
Angel
C
,
Atkison
KM
.
Use of thin-layer preparations for gynecologic smears with emphasis on the cytomorphology of high-grade intraepithelial lesions and carcinomas
.
Diagn Cytopathol
.
1996
;
14
(
3
):
201
11
.
59.
Singh
VB
,
Gupta
N
,
Nijhawan
R
,
Srinivasan
R
,
Suri
V
,
Rajwanshi
A
.
Liquid-based cytology versus conventional cytology for evaluation of cervical Pap smears: experience from the first 1000 split samples
.
Indian J Pathol Microbiol
.
2015
;
58
(
1
):
17
21
.
60.
Azlin
T
,
Smith
S
,
Lambird
PA
.
A comparison study of gynecologic specimens using the Roche Cyto-Rich monolayer Papanicolaou smear and the conventional Papanicolaou smear methods
.
Acta Cytol
.
1994
;
38
:
805
.
61.
Bolick
DR
,
Hellman
DJ
.
Laboratory implementation and efficacy assessment of the ThinPrep cervical cancer screening system
.
Acta Cytol
.
1993
;
42
(
1
):
209
13
.
62.
Marino
JF
,
Fremont-Smith
M
.
Direct-to-vial experience with AutoCyte PREP in a small New England regional cytology practice
.
J Reprod Med
.
2001
;
46
(
4
):
353
8
.
63.
Evans
AJ
,
Bauer
TW
,
Bui
MM
,
Cornish
TC
,
Duncan
H
,
Glassy
EF
,
US food and drug administration approval of whole slide imaging for primary diagnosis: a key milestone is reached and new questions are raised
.
Arch Pathol Lab Med
.
2018
;
142
(
11
):
1383
7
.
64.
Imaging Technology News
.
Leica biosystems received FDA clearance for aperio AT2 DX digital pathology system
.
Published May 29, 2019
.
65.
Elsheikh
TM
,
Kirkpatrick
JL
,
Cooper
MK
,
Johnson
ML
,
Hawkins
AP
,
Renshaw
AA
.
Increasing cytotechnologist workload above 100 slides per day using the ThinPrep Imaging System leads to significant reductions in screening accuracy
.
Cancer Cytopathol
.
2010
:
118
(
2
):
75
82
.
66.
Levi
AW
,
Galullo
P
,
Gordy
K
,
Mikolaiski
N
,
Schofield
K
,
Elsheikh
TM
,
Increasing cytotechnologist workload above 100 slides per day using the BD FocalPoint GS imaging system negatively affects screening performance
.
Am J Clin Pathol
.
2012
;
138
(
6
):
811
5
.
67.
American Medical Association
.
RVUS update committee (RUC)
.
. [cited 2020 Feb 23]. Available from:
https://www.ama-assn.org/about/rvs-update-committee-ruc.
68.
Obermeyer
Z
,
Emanuel
EJ
.
Predicting the future: big data, machine learning, and clinical medicine
.
N Engl J Med
.
2016
;
375
(
13
):
1216
9
.
69.
Ardila
D
,
Kiraly
AP
,
Bharadwaj
S
,
Choi
B
,
Reicher
JJ
,
Peng
L
,
End-to-end lung cancer screening with three-dimensional deep learning on low-dose chest computed tomography
.
Nat Med
.
2019
;
25
(
6
):
954
61
.
70.
Rodriguez-Ruiz
A
,
Lång
K
,
Gubern-Merida
A
,
Broeders
M
,
Gennaro
G
,
Clauser
P
,
Stand-alone artificial intelligence for breast cancer detection in mammography: comparison with 101 radiologists
.
Jorn Nat Can Inst
.
2019
;
111
(
9
):
916
22
.
71.
Esteva
A
,
Kuprel
B
,
Novoa
RA
,
Ko
J
,
Swetter
SM
,
Blau
HM
,
Dermatologist-level classification of skin cancer with deep neural networks
.
Nature
.
2017
;
542
(
7639
):
115
8
.
72.
Saidi
O
,
Cordon-Cardo
C
,
Costa
J
.
Technology insight: will systems pathology replace the pathologist?
Nat Clin Pract Urol
.
2007
;
4
(
1
):
39
45
.
73.
Doyle
S
,
Feldman
M
,
Tomaszewski
J
,
Madabhushi
A
.
A boosted Bayesian multiresolution classifier for prostate cancer detection from digitized needle biopsies
.
IEEE Trans Biomed Eng
.
2012
;
59
(
5
):
1205
18
.
74.
Hipp
J
,
Flotte
T
,
Monaco
J
,
Cheng
J
,
Madabhushi
A
,
Yagi
Y
,
Computer aided diagnostic tools aim to empower rather than replace pathologists: lessons learned from computational chess
.
J Pathol Inform
.
2011
;
2
:
25
.
Copyright / Drug Dosage / Disclaimer
Copyright: All rights reserved. No part of this publication may be translated into other languages, reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, microcopying, or by any information storage and retrieval system, without permission in writing from the publisher.
Drug Dosage: The authors and the publisher have exerted every effort to ensure that drug selection and dosage set forth in this text are in accord with current recommendations and practice at the time of publication. However, in view of ongoing research, changes in government regulations, and the constant flow of information relating to drug therapy and drug reactions, the reader is urged to check the package insert for each drug for any changes in indications and dosage and for added warnings and precautions. This is particularly important when the recommended agent is a new and/or infrequently employed drug.
Disclaimer: The statements, opinions and data contained in this publication are solely those of the individual authors and contributors and not of the publishers and the editor(s). The appearance of advertisements or/and product references in the publication is not a warranty, endorsement, or approval of the products or services advertised or of their effectiveness, quality or safety. The publisher and the editor(s) disclaim responsibility for any injury to persons or property resulting from any ideas, methods, instructions or products referred to in the content or advertisements.
You do not currently have access to this content.