Introduction: Reports of consensus conferences are usually valued less than reports of clinical trials even when rigorous methodology is used. However, limited data are available comparing the impact of these 2 methods of shaping clinical practice. Objective: Compare the publication impact of consensus conferences and clinical trials. Methods: Consensus publications from the Acute Disease Quality Initiative (ADQI) from 2002 through 2017 were identified and classified by subject matter. Randomized trials were identified in the same publication year and subject in journals, starting with the highest impact factor. Both publication types were matched, and total citations were determined for each using Google Scholar. A secondary analysis compared total costs for each publication type. Results and Conclusions: Seventeen ADQI consensus conference reports and 17 randomized trials were identified. ADQI reports received a similar number of citations per paper (median, interquartile range) compared to randomized trials (132, 54–228; vs. 159, 60–340, p = ns). Similarly, 10 (58.8%) ADQI reports and 10 randomized trials were cited >100 times. On average, ADQI reports appeared in journals with lower impact factors compared to clinical trials (5.4 ± 4.6 vs. 25.4 ± 27.1; p < 0.01). The median cost per citation (USD 2017) for ADQI reports was USD 606.01 compared to almost twice this figure, USD 1,182.59, for clinical trials on the same topics (p = 0.09). Despite being published in lower impact factor journals, consensus reports on topics in critical care nephrology, received similar citations to randomized controlled trials published the same year.

Keywords:
Acute kidney injury, Continuous renal replacement therapy, Fluids, Sepsis, Cardiorenal syndrome
1.
Harris RP, Helfand M, Woolf SH, Lohr KN, Mulrow CD, Teutsch SM, et al.; Methods Work Group, Third US Preventive Services Task Force. Current methods of the US Preventive Services Task Force: a review of the process.
Am J Prev Med
. 2001 Apr;20(3 Suppl):21–35.
2.
Black N. Why we need observational studies to evaluate the effectiveness of health care.
BMJ
. 1996 May;312(7040):1215–8.
3.
Sanson-Fisher RW, Bonevski B, Green LW, D’Este C. Limitations of the randomized controlled trial in evaluating population-based health interventions.
Am J Prev Med
. 2007 Aug;33(2):155–61.
4.
Kellum JA, Bellomo R, Ronco C. Acute Dialysis Quality Initiative (ADQI): methodology.
Int J Artif Organs
. 2008 Feb;31(2):90–3.
5.
Ioannidis JP, Baas J, Klavans R, Boyack KW. A standardized citation metrics author database annotated for scientific field.
PLoS Biol
. 2019 Aug;17(8):e3000384.
6.
Kellum JA, Mehta RL, Angus DC, Palevsky P, Ronco C.; ADQI Workgroup. The first international consensus conference on continuous renal replacement therapy.
Kidney Int
. 2002 Nov;62(5):1855–63.
7.
Bellomo R, Ronco C, Kellum JA, Mehta RL, Palevsky P; Acute Dialysis Quality Initiative workgroup. Acute renal failure - definition, outcome measures, animal models, fluid therapy and information technology needs: the Second International Consensus Conference of the Acute Dialysis Quality Initiative (ADQI) Group.
Crit Care
. 2004 Aug;8(4):R204–12.
8.
Kellum JA, Bellomo R, Ronco C, Mehta R, Clark W, Levin NW. The 3rd International Consensus Conference of the Acute Dialysis Quality Initiative (ADQI).
Int J Artif Organs
. 2005 May;28(5):441–4.
9.
Kellum JA, Ronco C, Mehta R, Bellomo R. Consensus development in acute renal failure: The Acute Dialysis Quality Initiative.
Curr Opin Crit Care
. 2005 Dec;11(6):527–32.
10.
Kellum JA, Cerda J, Kaplan LJ, Nadim MK, Palevsky PM. Fluids for prevention and management of acute kidney injury.
Int J Artif Organs
. 2008 Feb;31(2):96–110.
11.
Schetz M, Bove T, Morelli A, Mankad S, Ronco C, Kellum JA. Prevention of cardiac surgery-associated acute kidney injury.
Int J Artif Organs
. 2008 Feb;31(2):179–89.
12.
Bagshaw SM, Cruz DN, Aspromonte N, Daliento L, Ronco F, Sheinfeld G, et al.; Acute Dialysis Quality Initiative Consensus Group. Epidemiology of cardio-renal syndromes: workgroup statements from the 7th ADQI Consensus Conference.
Nephrol Dial Transplant
. 2010 May;25(5):1406–16.
13.
Wong F, Nadim MK, Kellum JA, Salerno F, Bellomo R, Gerbes A, et al. Working Party proposal for a revised classification system of renal dysfunction in patients with cirrhosis.
Gut
. 2011 May;60(5):702–9.
14.
Lavergne V, Nolin TD, Hoffman RS, Roberts D, Gosselin S, Goldfarb DS, et al. The EXTRIP (EXtracorporeal TReatments In Poisoning) workgroup: guideline methodology.
Clin Toxicol (Phila)
. 2012 Jun;50(5):403–13.
15.
Murray PT, Mehta RL, Shaw A, Ronco C, Endre Z, Kellum JA, et al.; ADQI 10 workgroup. Potential use of biomarkers in acute kidney injury: report and summary of recommendations from the 10th Acute Dialysis Quality Initiative consensus conference.
Kidney Int
. 2014 Mar;85(3):513–21.
16.
McCullough PA, Kellum JA, Haase M, Müller C, Damman K, Murray PT, et al. Pathophysiology of the cardiorenal syndromes: executive summary from the eleventh consensus conference of the Acute Dialysis Quality Initiative (ADQI).
Contrib Nephrol
. 2013;182:82–98.
17.
Hoste EA, Maitland K, Brudney CS, Mehta R, Vincent JL, Yates D, et al.; ADQI XII Investigators Group. Four phases of intravenous fluid therapy: a conceptual model.
Br J Anaesth
. 2014 Nov;113(5):740–7.
18.
Basile DP, Bonventre JV, Mehta R, Nangaku M, Unwin R, Rosner MH, et al.; ADQI XIII Work Group. Progression after AKI: Understanding Maladaptive Repair Processes to Predict and Identify Therapeutic Treatments.
J Am Soc Nephrol
. 2016 Mar;27(3):687–97.
19.
Ince C, Mayeux PR, Nguyen T, Gomez H, Kellum JA, Ospina-Tascón GA, et al.; ADQI XIV Workgroup. The Endothelium in Sepsis.
Shock
. 2016 Mar;45(3):259–70.
20.
Hoste EA, Kashani K, Gibney N, Wilson FP, Ronco C, Goldstein SL, et al.; 15 ADQI Consensus Group. Impact of electronic-alerting of acute kidney injury: workgroup statements from the 15(th) ADQI Consensus Conference.
Can J Kidney Health Dis
. 2016 Feb;3:10.
21.
Chawla LS, Bellomo R, Bihorac A, Goldstein SL, Siew ED, Bagshaw SM, et al.; Acute Disease Quality Initiative Workgroup 16. Acute kidney disease and renal recovery: consensus report of the Acute Disease Quality Initiative (ADQI) 16 Workgroup.
Nat Rev Nephrol
. 2017 Apr;13(4):241–57.
22.
Ostermann M, Joannidis M, Pani A, Floris M, De Rosa S, Kellum JA, et al.; 17th Acute Disease Quality Initiative (ADQI) Consensus Group. Patient Selection and Timing of Continuous Renal Replacement Therapy.
Blood Purif
. 2016;42(3):224–37.
23.
Moore TJ, Zhang H, Anderson G, Alexander GC. Estimated Costs of Pivotal Trials for Novel Therapeutic Agents Approved by the US Food and Drug Administration, 2015-2016.
JAMA Intern Med
. 2018 Nov;178(11):1451–7.
24.
Ronco C, Brendolan A, Lonnemann G, Bellomo R, Piccinni P, Digito A, et al. A pilot study of coupled plasma filtration with adsorption in septic shock.
Crit Care Med
. 2002 Jun;30(6):1250–5.
25.
Merten GJ, Burgess WP, Gray LV, Holleman JH, Roush TS, Kowalchuk GJ, et al. Prevention of contrast-induced nephropathy with sodium bicarbonate: a randomized controlled trial.
JAMA
. 2004 May;291(19):2328–34.
26.
Peng Y, Yuan Z, Li H. Removal of inflammatory cytokines and endotoxin by veno-venous continuous renal replacement therapy for burned patients with sepsis.
Burns
. 2005 Aug;31(5):623–8.
27.
Bove T, Landoni G, Calabrò MG, Aletti G, Marino G, Cerchierini E, et al. Renoprotective action of fenoldopam in high-risk patients undergoing cardiac surgery: a prospective, double-blind, randomized clinical trial.
Circulation
. 2005 Jun;111(24):3230–5.
28.
Fan SL, Pile T, Punzalan S, Raftery MJ, Yaqoob MM. Randomized controlled study of biocompatible peritoneal dialysis solutions: effect on residual renal function.
Kidney Int
. 2008 Jan;73(2):200–6.
29.
Sisillo E, Ceriani R, Bortone F, Juliano G, Salvi L, Veglia F, et al. N-acetylcysteine for prevention of acute renal failure in patients with chronic renal insufficiency undergoing cardiac surgery: a prospective, randomized, clinical trial.
Crit Care Med
. 2008 Jan;36(1):81–6.
30.
Massie BM, O’Connor CM, Metra M, Ponikowski P, Teerlink JR, Cotter G, et al.; PROTECT Investigators and Committees. Rolofylline, an adenosine A1-receptor antagonist, in acute heart failure.
N Engl J Med
. 2010 Oct;363(15):1419–28.
31.
Boyer TD, Sanyal AJ, Garcia-Tsao G, Regenstein F, Rossaro L, Appenrodt B, et al.; Terlipressin Study Group. Impact of liver transplantation on the survival of patients treated for hepatorenal syndrome type 1.
Liver Transpl
. 2011 Nov;17(11):1328–32.
32.
Skinner CG, Chang AS, Matthews AS, Reedy SJ, Morgan BW. Randomized controlled study on the use of multiple-dose activated charcoal in patients with supratherapeutic phenytoin levels.
Clin Toxicol (Phila)
. 2012 Sep;50(8):764–9.
33.
Gallagher SM, Jones DA, Kapur A, Wragg A, Harwood SM, Mathur R, et al. Remote ischemic preconditioning has a neutral effect on the incidence of kidney injury after coronary artery bypass graft surgery.
Kidney Int
. 2015 Feb;87(2):473–81.
34.
Chen HH, Anstrom KJ, Givertz MM, Stevenson LW, Semigran MJ, Goldsmith SR, et al.; NHLBI Heart Failure Clinical Research Network. Low-dose dopamine or low-dose nesiritide in acute heart failure with renal dysfunction: the ROSE acute heart failure randomized trial.
JAMA
. 2013 Dec;310(23):2533–43.
35.
Yealy DM, Kellum JA, Huang DT, Barnato AE, Weissfeld LA, Pike F, et al.; ProCESS Investigators. A randomized trial of protocol-based care for early septic shock.
N Engl J Med
. 2014 May;370(18):1683–93.
36.
Gaudry S, Hajage D, Schortgen F, Martin-Lefevre L, Pons B, Boulet E, et al.; AKIKI Study Group. Initiation Strategies for Renal-Replacement Therapy in the Intensive Care Unit.
N Engl J Med
. 2016 Jul;375(2):122–33.
37.
Park JT, Lee H, Kee YK, Park S, Oh HJ, Han SH, et al.; HICORES Investigators. High-Dose Versus Conventional-Dose Continuous Venovenous Hemodiafiltration and Patient and Kidney Survival and Cytokine Removal in Sepsis-Associated Acute Kidney Injury: A Randomized Controlled Trial.
Am J Kidney Dis
. 2016 Oct;68(4):599–608.
38.
Wilson FP, Shashaty M, Testani J, Aqeel I, Borovskiy Y, Ellenberg SS, et al. Automated, electronic alerts for acute kidney injury: a single-blind, parallel-group, randomised controlled trial.
Lancet
. 2015 May;385(9981):1966–74.
39.
Meersch M, Küllmar M, Schmidt C, Gerss J, Weinhage T, Margraf A, et al. Long-Term Clinical Outcomes after Early Initiation of RRT in Critically Ill Patients with AKI.
J Am Soc Nephrol
. 2018 Mar;29(3):1011–9.
40.
Besnard N, Serveaux M, Machado S, Daubin D, Brunot V, Amigues L, et al. Electrolytes-Enriched Hemodiafiltration Solutions for Continuous Renal Replacement Therapy in Acute Kidney Injury: A Crossover Study.
Blood Purif
. 2016;42(1):18–26.
© 2020 S. Karger AG, Basel
2020
Copyright / Drug Dosage / Disclaimer
Copyright: All rights reserved. No part of this publication may be translated into other languages, reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying, recording, microcopying, or by any information storage and retrieval system, without permission in writing from the publisher.
Drug Dosage: The authors and the publisher have exerted every effort to ensure that drug selection and dosage set forth in this text are in accord with current recommendations and practice at the time of publication. However, in view of ongoing research, changes in government regulations, and the constant flow of information relating to drug therapy and drug reactions, the reader is urged to check the package insert for each drug for any changes in indications and dosage and for added warnings and precautions. This is particularly important when the recommended agent is a new and/or infrequently employed drug.
Disclaimer: The statements, opinions and data contained in this publication are solely those of the individual authors and contributors and not of the publishers and the editor(s). The appearance of advertisements or/and product references in the publication is not a warranty, endorsement, or approval of the products or services advertised or of their effectiveness, quality or safety. The publisher and the editor(s) disclaim responsibility for any injury to persons or property resulting from any ideas, methods, instructions or products referred to in the content or advertisements.
You do not currently have access to this content.