Background/Aims: Acute kidney injury (AKI) is associated with high mortality. Multiple AKI severity scores have been derived to predict patient outcome. We externally validated new AKI severity scores using the Japanese Society for Physicians and Trainees in Intensive Care (JSEPTIC) database. Methods: New AKI severity scores published in the 21st century (Mehta, Stuivenberg Hospital Acute Renal Failure (SHARF) II, Program to Improve Care in Acute Renal Disease (PICARD), Vellore and Demirjian), Liano, Simplified Acute Physiology Score (SAPS) II and lactate were compared using the JSEPTIC database that collected retrospectively 343 patients with AKI who required continuous renal replacement therapy (CRRT) in 14 intensive care units. Accuracy of the severity scores was assessed by the area under the receiver-operator characteristic curve (AUROC, discrimination) and Hosmer-Lemeshow test (H-L test, calibration). Results: The median age was 69 years and 65.8% were male. The median SAPS II score was 53 and the hospital mortality was 58.6%. The AUROC curves revealed low discrimination ability of the new AKI severity scores (Mehta 0.65, SHARF II 0.64, PICARD 0.64, Vellore 0.64, Demirjian 0.69), similar to Liano 0.67, SAPS II 0.67 and lactate 0.64. The H-L test also demonstrated that all assessed scores except for Liano had significantly low calibration ability. Conclusions: Using a multicenter database of AKI patients requiring CRRT, this study externally validated new AKI severity scores. While the Demirjian's score and Liano's score showed a better performance, further research will be required to confirm these findings.

Keywords:
Acute kidney injury, Severity score, Validation
1.
Bagshaw SM, George C, Dinu I, Bellomo R: A multi-centre evaluation of the RIFLE criteria for early acute kidney injury in critically ill patients. Nephrol Dial Transplant 2008;23:1203-1210.
2.
Uchino S, Kellum JA, Bellomo R, Doig GS, Morimatsu H, Morgera S, Schetz M, Tan I, Bouman C, Macedo E, Gibney N, Tolwani A, Ronco C: Acute renal failure in critically ill patients: a multinational, multicenter study. JAMA 2005;294:813-818.
3.
Liangos O, Wald R, O'Bell JW, Price L, Pereira BJ, Jaber BL: Epidemiology and outcomes of acute renal failure in hospitalized patients: a national survey. Clin J Am Soc Nephrol 2006;1:43-51.
4.
Nash K, Hafeez A, Hou S: Hospital-acquired renal insufficiency. Am J Kidney Dis 2002;39:930-936.
5.
VA/NIH Acute Renal Failure Trial Network, Palevsky PM, Zhang JH, O'Connor TZ, Chertow GM, Crowley ST, Choudhury D, Finkel K, Kellum JA, Paganini E, Schein RM, Smith MW, Swanson KM, Thompson BT, Vijayan A, Watnick S, Star RA, Peduzzi P: Intensity of renal support in critically ill patients with acute kidney injury. N Engl J Med 2008;359:7-20.
6.
Metnitz PG, Krenn CG, Steltzer H, Lang T, Ploder J, Lenz K, Le Gall JR, Druml W: Effect of acute renal failure requiring renal replacement therapy on outcome in critically ill patients. Crit Care Med 2002;30:2051-2058.
7.
Knaus WA, Draper EA, Wagner DP, Zimmerman JE: APACHE II: a severity of disease classification system. Crit Care Med 1985;13:818-829.
8.
Knaus WA, Wagner DP, Draper EA, Zimmerman JE, Bergner M, Bastos PG, Sirio CA, Murphy DJ, Lotring T, Damiano A, et al: The APACHE III prognostic system. Risk prediction of hospital mortality for critically ill hospitalized adults. Chest 1991;100:1619-1636.
9.
Zimmerman JE, Kramer AA, McNair DS, Malila FM: Acute physiology and chronic health evaluation (APACHE) IV: hospital mortality assessment for today's critically ill patients. Crit Care Med 2006;34:1297-1310.
10.
Le Gall JR, Lemeshow S, Saulnier F: A new simplified acute physiology score (SAPS II) based on a European/North American multicenter study. JAMA 1993;270:2957-2963.
11.
Moreno RP, Metnitz PG, Almeida E, Jordan B, Bauer P, Campos RA, Iapichino G, Edbrooke D, Capuzzo M, Le Gall JR; SAPS 3 Investigators: Saps 3 - from evaluation of the patient to evaluation of the intensive care unit. Part 2: development of a prognostic model for hospital mortality at ICU admission. Intensive Care Med 2005;31:1345-1355.
12.
Higgins TL, Teres D, Copes WS, Nathanson BH, Stark M, Kramer AA: Assessing contemporary intensive care unit outcome: an updated mortality probability admission model (MPM0-III). Crit Care Med 2007;35:827-835.
13.
Douma CE, Redekop WK, van der Meulen JH, van Olden RW, Haeck J, Struijk DG, Krediet RT: Predicting mortality in intensive care patients with acute renal failure treated with dialysis. J Am Soc Nephrol 1997;8:111-117.
14.
Mehta RL, Pascual MT, Gruta CG, Zhuang S, Chertow GM: Refining predictive models in critically ill patients with acute renal failure. J Am Soc Nephrol 2002;13:1350-1357.
15.
Costa e Silva VT, de Castro I, Liaño F, Muriel A, Rodriguez-Palomares JR, Yu L: Performance of the third-generation models of severity scoring systems (APACHE IV, SAPS 3 and MPM-III) in acute kidney injury critically ill patients. Nephrol Dial Transplant 2011;26:3894-3901.
16.
Rasmussen HH, Pitt EA, Ibels LS, McNeil DR: Prediction of outcome in acute renal failure by discriminant analysis of clinical variables. Arch Intern Med 1985;145:2015-2018.
17.
Lohr JW, McFarlane MJ, Grantham JJ: A clinical index to predict survival in acute renal failure patients requiring dialysis. Am J Kidney Dis 1988;11:254-259.
18.
Schaefer JH, Jochimsen F, Keller F, Wegscheider K, Distler A: Outcome prediction of acute renal failure in medical intensive care. Intensive Care Med 1991;17:19-24.
19.
Liaño F, Gallego A, Pascual J, García-Martín F, Teruel JL, Marcén R, Orofino L, Orte L, Rivera M, Gallego N, et al: Prognosis of acute tubular necrosis: an extended prospectively contrasted study. Nephron 1993;63:21-31.
20.
Paganini EP, Halstenberg WK, Goormastic M: Risk modeling in acute renal failure requiring dialysis: the introduction of a new model. Clin Nephrol 1996;46:206-211.
21.
Chertow GM, Lazarus JM, Paganini EP, Allgren RL, Lafayette RA, Sayegh MH: Predictors of mortality and the provision of dialysis in patients with acute tubular necrosis. The Auriculin Anaritide Acute Renal Failure Study Group. J Am Soc Nephrol 1998;9:692-698.
22.
Kolhe NV, Stevens PE, Crowe AV, Lipkin GW, Harrison DA: Case mix, outcome and activity for patients with severe acute kidney injury during the first 24 hours after admission to an adult, general critical care unit: application of predictive models from a secondary analysis of the ICNARC case mix programme database. Crit Care 2008;12(suppl 1):S2.
23.
Uchino S, Bellomo R, Morimatsu H, Morgera S, Schetz M, Tan I, Bouman C, Macedo E, Gibney N, Tolwani A, Doig GS, Oudemans van Straaten H, Ronco C, Kellum JA; Beginning and Ending Supportive Therapy for the Kidney (B.E.S.T. Kidney) Investigators: External validation of severity scoring systems for acute renal failure using a multinational database. Crit Care Med 2005;33:1961-1967.
24.
Lins RL, Elseviers MM, Daelemans R, Arnouts P, Billiouw JM, Couttenye M, Gheuens E, Rogiers P, Rutsaert R, Van der Niepen P, De Broe ME: Re-evaluation and modification of the stuivenberg hospital acute renal failure (SHARF) scoring system for the prognosis of acute renal failure: an independent multicentre, prospective study. Nephrol Dial Transplant 2004;19:2282-2288.
25.
Dharan KS, John GT, Antonisamy B, Kirubakaran MG, Jacob CK: Prediction of mortality in acute renal failure in the tropics. Ren Fail 2005;27:289-296.
26.
Chertow GM, Soroko SH, Paganini EP, Cho KC, Himmelfarb J, Ikizler TA, Mehta RL: Mortality after acute renal failure: models for prognostic stratification and risk adjustment. Kidney Int 2006;70:1120-1126.
27.
Demirjian S, Chertow GM, Zhang JH, O'Connor TZ, Vitale J, Paganini EP, Palevsky PM; VA/NIH Acute Renal Failure Trial Network: Model to predict mortality in critically ill adults with acute kidney injury. Clin J Am Soc Nephrol 2011;6:2114-2120.
28.
d'Avila DO, Cendoroglo Neto M, dos Santos OF, Schor N, Poli de Figueiredo CE: Acute renal failure needing dialysis in the intensive care unit and prognostic scores. Ren Fail 2004;26:59-68.
29.
Kawarazaki H, Uchino S, Tokuhira N, Ohnuma T, Namba Y, Katayama S, Toki N, Takeda K, Yasuda H, Izawa J, Uji M, Nagata I; JSEPTIC (Japanese Society for Physicians Trainees in Intensive Care) Clinical Trial Group: Who may not benefit from continuous renal replacement therapy in acute kidney injury? Hemodial Int 2013;17:624-632.
30.
Uchino S, Toki N, Takeda K, Ohnuma T, Namba Y, Katayama S, Kawarazaki H, Yasuda H, Izawa J, Uji M, Tokuhira N, Nagata I; Japanese Society for Physicians and Trainees in Intensive Care (JSEPTIC) Clinical Trial Group: Validity of low-intensity continuous renal replacement therapy*. Crit Care Med 2013;41:2584-2591.
31.
Yasuda H, Uchino S, Uji M, Ohnuma T, Namba Y, Katayama S, Kawarazaki H, Toki N, Takeda K, Izawa J, Tokuhira N, Nagata I; Japanese Society for Physicians and Trainees in Intensive Care Clinical Trial Group: The lower limit of intensity to control uremia during continuous renal replacement therapy. Crit Care 2014;18:539.
32.
Hanley JA, McNeil BJ: The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 1982;143:29-36.
33.
Lemeshow S, Hosmer DW Jr: A review of goodness of fit statistics for use in the development of logistic regression models. Am J Epidemiol 1982;115:92-106.
34.
Aduen J, Bernstein WK, Khastgir T, Miller J, Kerzner R, Bhatiani A, Lustgarten J, Bassin AS, Davison L, Chernow B: The use and clinical importance of a substrate-specific electrode for rapid determination of blood lactate concentrations. JAMA 1994;272:1678-1685.
35.
Jansen TC, van Bommel J, Mulder PG, Rommes JH, Schieveld SJ, Bakker J: The prognostic value of blood lactate levels relative to that of vital signs in the pre-hospital setting: a pilot study. Crit Care 2008;12:R160.
36.
Lins RL, Elseviers M, Daelemans R, Zachée P, Zachée P, Gheuens E, Lens S, De Broe ME: Prognostic value of a new scoring system for hospital mortality in acute renal failure. Clin Nephrol 2000;53:10-17.
37.
Zhu BP, Lemeshow S, Hosmer DW, Klar J, Avrunin J, Teres D: Factors affecting the performance of the models in the mortality probability model II system and strategies of customization: a simulation study. Crit Care Med 1996;24:57-63.
38.
Costa e Silva VT, de Castro I, Liaño F, Muriel A, Rodríguez-Palomares JR, Yu L: Sequential evaluation of prognostic models in the early diagnosis of acute kidney injury in the intensive care unit. Kidney Int 2009;75:982-986.
39.
Kramer AA, Zimmerman JE: Assessing the calibration of mortality benchmarks in critical care: the Hosmer-Lemeshow test revisited. Crit Care Med 2007;35:2052-2056.
© 2015 S. Karger AG, Basel
2015
Copyright / Drug Dosage / Disclaimer
Copyright: All rights reserved. No part of this publication may be translated into other languages, reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, microcopying, or by any information storage and retrieval system, without permission in writing from the publisher.
Drug Dosage: The authors and the publisher have exerted every effort to ensure that drug selection and dosage set forth in this text are in accord with current recommendations and practice at the time of publication. However, in view of ongoing research, changes in government regulations, and the constant flow of information relating to drug therapy and drug reactions, the reader is urged to check the package insert for each drug for any changes in indications and dosage and for added warnings and precautions. This is particularly important when the recommended agent is a new and/or infrequently employed drug.
Disclaimer: The statements, opinions and data contained in this publication are solely those of the individual authors and contributors and not of the publishers and the editor(s). The appearance of advertisements or/and product references in the publication is not a warranty, endorsement, or approval of the products or services advertised or of their effectiveness, quality or safety. The publisher and the editor(s) disclaim responsibility for any injury to persons or property resulting from any ideas, methods, instructions or products referred to in the content or advertisements.
You do not currently have access to this content.