Objectives: To establish the reliability of three cytopathologists for cytological diagnosis of primary bladder tumors. Methods: Preoperative voided urine specimens of 71 patients with bladder cancer and 55 noncancer controls were retrospectively and blindly reviewed by 3 independent cytologists, and their results compared. The estimation of the interobserver agreement was calculated using the weighted κ coefficient. A multivariate analysis was carried out to identify the factors associated with the disagreement between the three observers. The sensitivity and specificity for each of the participants was calculated in order to clearly identify the origin of the disagreement, in terms of the performance of the diagnostic test in the hands of each observer. A comparison of the overall diagnostic performance was made by plotting sensitivity versus 1-specificity. Results: The weighted κ coefficient among the 3 observers was 0.46. The multivariate analysis did not identify any variable that could have caused such disagreement. Vast differences in sensitivity and specificity were detected between observer 1 (sens. 0.90, spec. 0.45) and observers 2 (sens. 0.67, spec. 0.72) and 3 (sens. 0.71, spec. 0.80), but the overall diagnostic performance (sensitivity vs. 1-specificity) was superimposable in the 3 cases (p = NS). Conclusions: Simple, reproducible and agreed-on-diagnostic criteria should be established to yield reliable results in a group of cytologists. The consideration of individual diagnostic performances can give a false idea of homogeneity between observers. In this field, concordance analysis makes quality control reliable and should be a routine procedure of any pathology department.

Keywords:
Bladder neoplasms, Transitional cell, Urinary cytology
1.
Koss LG, Deitch D, Ramanathan R, Sherman AB: Diagnostic value of cytology of voided urine. Acta Cytol 1985;29:810–816.
2.
Cant JD, Murphy WM, Soloway MS: Prognostic significance of urine cytology on initial follow-up after intravesical mitomicyn for superficial bladder cancer. Cancer 1986;57:2119–2122.
3.
Kern WH: The grade and pathologic stage of bladder cancer. Cancer 1984;53:1185–1189.
4.
Raab SS, Lenel JC, Cohen MB: Low-grade transitional cell carcinoma of the bladder. Cancer 1994;74:1621–1626.
5.
Sack MJ, Artymyshyn RL, Tomaszewski JE, Gupta PK: Diagnostic value of bladder wash cytology, with special, reference to low-grade urothelial neoplasms. Acta Cytol 1995;39:187–194.
6.
Tanaka K, Takashi M, Sahashi M, Shimoji T, Miyake K: Clinical study of urinary cytology in bladder tumors: Analysis of factor related with positivity of urinary cytology. Acta Urol Jpn 1990;36:7–11.
7.
Amberson JB, Laino JP: Image cytometric deoxyribonucleic acid analysis of urine specimens as an adjunct to visual cytology in the detection of urothelial cell carcinoma. J Urol 1993;149:42–45.
8.
Johnston B, Morales A, Emerson L, Lundie M: Rapid detection of bladder cancer: A comparative study of point of care tests. J Urol 1997;158:2098–2101.
9.
Koss LG: Tumors of the urinary tract and prostate; in Diagnostic Cytology and Its Histopathologic Basis, ed 4. Philadelphia, Lippincott, 1992, pp 934–999.
10.
Kannan V: Low-grade transitional cell carcinoma and instrument artifact. A challenge in urinary cytology. Acta Cytol 1993;37:899–902.
11.
Landis JR, Koch GG: The measurement of observer agreement for categorical data. Biometrics 1977;33:159–165.
12.
El-Zimaity HMT, Graham DY, Al-Assi MT, Malaty H, Karttunen TJ, Graham DP, Huberman RM, Genta RM: Interobserver variation in the histopathological assessment of Helicobacter pylori gastritis. Hum Pathol 1996;27:35–41.
13.
Dawson A, Ibrahim NB, Gibbs AR: Observer variation in the histopathological classification of thymoma: Correlation with prognosis. J Clin Pathol 1994;47:519–523.
14.
Sørensen JB, Hirsch FR, Gazdar A, Olsen JE: Interobserver variability in histopathological subtyping and grading of pulmonary adenocarcinoma. Cancer 1993;71:2971–2976.
15.
Stoddard AM: Automatic classification of biomedical information when classification error is unknown. Stat Med 1984;3:261–271.
16.
Giard RW, Hermans J, Ruiter DJ, Hoedemaeker PJ: Variations in histopathological evaluation of non-neoplastic colonic mucosal abnormalities: Assessment and clinical significance. Histopathology 1995;9:535–541.
17.
Xakellis GC, Frantz RA, Arteaga M, Nguyen M, Lewis A: A comparison of patient risk for pressure ulcer development with nursing use of preventive interventions. J Am Geriatr Soc 1992;40:1250–1254.
18.
Goldin RD, Goldin JG, Burt AD, Dhillon PA, Hubscher S, Wyatt J, Patel N: Intra-observer and inter-observer variation in the histopathological assessment of chronic viral hepatitis. J Hepatol 1996;25:649–654.
19.
Smith DS, Catalona WJ: Interexaminer variability of digital rectal examination in detecting prostate cancer. Urology 1995;45:70–74.
20.
Herranz F, Verdú F, Dıez JMa, Saiz A, Hernández C, Bueno G, y Lledó E: Variabilidad del tacto rectal de la próstata entre distintos grupos de observadores. Actas Urol Esp 1996;20:873–876.
21.
Van de Beek C, Stoevelaar HJ, McDonnell J, Nijs HG, Casparie AF, Janknegt RA: Interpretation of uroflowmetry curves by urologists. J Urol 1997;157:164–168.
22.
Heenan PJ, Matz LR, Blackwell JB, Kelsall GR, Singh A, ten-Seldam RE, Holman CD: Inter-observer variation between pathologists in the classification of cutaneous malignant melanoma in Western Australia. Histopathology 1984;8:717–729.
23.
Sherman AB, Koss LG, Adams SE: Interobserver and intraobserver differences in the diagnosis of urothelial cells. Comparison with classification by computer. Anal Quant Cytol 1984;6:112–120.
24.
Olsen LH, Overgaard S, Frederiksen P, Ladefoged C, Ludwigsen E, Petri J, Poulsen JT: The reliability of staging and grading of bladder tumours. Impact of misinformation on the pathologist’s diagnosis. Scand J Urol Nephrol 1993;27:349–353.
25.
Andrion A, Gaglio A, Zai G, Zanin A, Boffetta P: II grading tumorale in citologia urinaria. Studio della correlazione cito-istologica con valutazione del kappa statistico per la concordanza. Pathologica 1991;83:111–117.
26.
Husain O, Butler EB, Woodford FP: Combined external quality assessment of cytology and histology opinions: A pilot scheme for a cluster of five laboratories. J Clin Pathol 1984;37:993–1001.
1999
Copyright / Drug Dosage / Disclaimer
Copyright: All rights reserved. No part of this publication may be translated into other languages, reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, microcopying, or by any information storage and retrieval system, without permission in writing from the publisher.
Drug Dosage: The authors and the publisher have exerted every effort to ensure that drug selection and dosage set forth in this text are in accord with current recommendations and practice at the time of publication. However, in view of ongoing research, changes in government regulations, and the constant flow of information relating to drug therapy and drug reactions, the reader is urged to check the package insert for each drug for any changes in indications and dosage and for added warnings and precautions. This is particularly important when the recommended agent is a new and/or infrequently employed drug.
Disclaimer: The statements, opinions and data contained in this publication are solely those of the individual authors and contributors and not of the publishers and the editor(s). The appearance of advertisements or/and product references in the publication is not a warranty, endorsement, or approval of the products or services advertised or of their effectiveness, quality or safety. The publisher and the editor(s) disclaim responsibility for any injury to persons or property resulting from any ideas, methods, instructions or products referred to in the content or advertisements.
You do not currently have access to this content.