Abstract
Background: Whether chronic kidney disease (CKD) recognition in an electronic health record (EHR) problem list improves processes of care or clinical outcomes of end-stage renal disease (ESRD) and death is unclear. Methods: We identified patients who had at least 1 year of follow-up (2005-2009) in our EHR-based CKD registry (n = 25,742). CKD recognition was defined by having ICD-9 codes for CKD, diabetic kidney disease, or hypertensive kidney disease in the problem list. We calculated proportions of patients with and without CKD recognition and examined differences by demographics, clinical factors, and development of ESRD or mortality. We evaluated differences in the proportion of patients with CKD-specific laboratory results checked before and after recognition among cases and propensity-matched controls. Results: Only 11% (n = 2,735) had CKD recognition in the problem list and they were younger (68 vs. 71 years), a higher proportion were male (61 vs. 37%) and African-American (21 vs. 10%) compared to those unrecognized. CKD-specific laboratory results for patients with estimated glomerular filtration rate (eGFR) 30-59 including intact parathyroid hormone (23 vs. 6%), vitamin D (22 vs. 18%), phosphorus (29 vs. 7%), and a urine check for proteinuria (55 vs. 36%) were significantly more likely to be done among those with CKD recognition (all p < 0.05). Similar results were found for eGFR <30 except for proteinuria and in our propensity score-matched control analysis. There was no independent association of CKD recognition with ESRD or mortality. Conclusions: CKD recognition in the EHR problem list was low, but translated into more CKD-specific processes of care; however ESRD or mortality were not affected.
Introduction
Chronic kidney disease (CKD) awareness is low among patients and providers [1]. This is of concern because CKD is increasing [2] and may progress to advanced CKD or end-stage renal disease (ESRD) requiring costly dialysis and/or transplantation care [3]. CKD is a public health concern given its association with comorbid conditions, such as diabetes, hypertension, cardiovascular disease, and increased risk of death [3,4,5,6,7,8].
The National Kidney Foundation published Kidney Disease Outcome Quality Initiative (KDOQI) guidelines to provide a framework for the diagnosis and clinical management of patients with CKD [3], and additional guidelines to address the global impact of CKD have been developed [9]. National efforts to increase recognition of CKD have been underway with the hope they will lead to wider adoption of evidence-based CKD care and, accordingly, better health outcomes in patients with CKD.
An expectation is that with expansion in electronic health record (EHR) usage, which has been propelled by the passage of legislation, the Health Information Technology for Economic and Clinical Health (HITECH) Act in 2009 and meaningful use incentives from Centers for Medicare and Medicaid Services [10], quality of care will improve. Studies have shown a benefit of EHRs on quality of care and increased adherence to guideline-based care for some health conditions [11,12,13]. However, while processes of care have been shown to improve with EHRs, other quality measures are not always improved and clinical outcomes may not change [14,15,16,17]. Nonetheless, EHRs are or will soon be used at most institutions and so their evaluation and impact on clinical medicine is important.
Our objectives were to determine CKD recognition prevalence in an EHR problem list among a large CKD cohort, examine whether differences in processes of care, development of ESRD or mortality were associated with CKD recognition, and investigate the independent effect of CKD recognition on processes of care.
Methods
CCF CKD Registry
The development and validation of our EHR-based CKD registry has been described [18]. Our parent CKD registry included 49,663 patients who had two estimated glomerular filtration rate (eGFR) readings <60 ml/min/1.73 m2 using the 4-variable Modification of Diet in Renal Disease (MDRD) equation more than 90 days apart between January 1, 2005 and September 15, 2009. We chose the MDRD equation because it was used for automated eGFR reporting within the EHR of our health system during the time period studied, so available to clinicians.
Study Group
We included patients from the parent CKD registry with at least 1 year follow-up in our registry with a Cleveland Clinic primary care provider (PCP) listed in the EHR or had seen a Cleveland Clinic nephrologist up to 1 year after the confirmatory eGFR for CKD. We excluded patients who developed ESRD during the first year of follow-up.
Renal Function
All creatinine measurements were performed by the modified kinetic Jaffe reaction, using a Hitachi 747-200 Chemistry Analyzer (1996-2001) or a Hitachi D 2400 Modular Chemistry Analyzer thereafter (Roche Diagnostics, Indianapolis, Ind., USA).
CKD Recognition
CKD recognition was defined by having at least one noted diagnosis of CKD in the EHR problem list. We used the following ICD-9 codes: chronic kidney disease (585, 585.1, 585.2, 585.3, 585.4, 585.5, 585.6, 585.9), diabetic nephropathy (250.4, 250.40, 250.41, 250.42, 250.43), unspecified renal failure (586), and hypertensive kidney disease (403). CKD recognition could occur as late as 365 days after the date of the second eGFR <60 ml/min/1.73 m2, allowing up to 1 year to have CKD be put into the EHR problem list. Any healthcare provider can update the EHR problem list and while our EHR is not linked to any CKD-specific decision support, there are health maintenance reminders or flags for things such as having an annual urine albumin check among patients with diabetes. Conversely, the EHR problem list might have contained CKD prior to the second confirmatory eGFR <60 ml/min/1.73 m2. For the analysis on change in processes of care pre-/post-recognition only, we selected patients with no recognition prior to second confirmatory eGFR <60, and looked for the first instance of recognition during follow-up, even beyond 1 year post-confirmatory eGFR.
Demographics and Comorbid Conditions
Demographics were extracted from the EHR. We present data for those patients identified as Caucasian, African-American, or neither of those categories and for the purpose of our study are categorized as Other. Insurance was categorized as Medicare, Medicaid, and Other which includes any non-Medicare/Medicaid health insurance. Diabetes, hypertension, hyperlipidemia, and other comorbid conditions were identified using validated ICD-9 codes and augmented in some cases with medications, vitals and laboratory results [18].
Outcome Measures
Processes of Care/Quality of Care
Nephrology visit was defined as a completed office visit with a nephrology provider within 12 months of entry into the CKD registry. ACE/ARB, statin and metformin use were extracted from the EHR using the noted start and end dates to ascertain the period of use and including any medication active within 12 months of entry into the CKD registry. Metformin use was only evaluated for diabetic CKD patients.
We chose processes of care that are more CKD-specific to assess what impact CKD recognition may have on guideline concordant care. We looked at each process of care individually and then as a composite outcome. We assessed whether patients had an outpatient intact parathyroid hormone (iPTH), 25[OH] vitamin D, or phosphorus level measured, and any urine test to check for proteinuria or albuminuria within 12 months of entry into the CKD registry. The urine test to check for proteinuria included any of the following: urine albumin, urine microalbumin, urine albumin/creatinine ratio, and urine microalbumin/creatinine ratio.
Development of End-Stage Renal Disease
We obtained United States Renal Data System (USRDS) data up to September 15, 2009. Our patients that were not observed to develop ESRD during follow-up were censored on September 15, 2009.
All-Cause Mortality
The CKD registry was linked to the Social Security Death Index. For mortality, analysis patients were followed from their date of inclusion in the registry until death or censorship on October 31, 2011.
Statistical Analysis
We calculated the proportion of patients who had CKD recognized in the EHR problem list. Next we compared demographics, insurance at the time of data extraction, the average number of office visits per year of follow-up in the EHR, and eGFR and comorbidities at the time of confirmatory eGFR <60, between those patients with and without CKD recognition using χ2 and t tests for categorical and continuous variables respectively. Additionally, we calculated the proportion of patients who had CKD recognized in the EHR problem list by CKD stage, gender, and race. Then we compared the proportion of processes of care for patients with and without recognition in the year following confirmatory eGFR for CKD using χ2 tests.
To assess independent associations, we fit a logistic regression model with CKD recognition as the outcome including the following covariates selected a priori: age, sex, race, insurance, eGFR, diabetes, hypertension, coronary artery disease, heart failure, hyperlipidemia and cerebrovascular disease. In separate models including the same variables previously mentioned and eGFR <30 instead of continuous eGFR, we tested two-way interaction between eGFR <30 versus eGFR >30 and each of the following: age, gender, race, diabetes, hypertension and cerebrovascular disease.
To evaluate whether CKD recognition was associated with development of ESRD and mortality, we fit separate Cox proportional hazard models for each of those outcomes with inception time being 365 days after the date of the second eGFR <60 ml/min/1.73 m2. We adjusted for covariates defined at the time of model inception. We developed several models by incrementally adding covariates to understand the impact of these factors on time to ESRD and mortality. First we fit an unadjusted model and then adjusted for age, sex, and race. Next we added insurance, and then eGFR and the aforementioned co-morbidities. We did not have proteinuria data in all patients, however we conducted a sensitivity analysis fitting the full model plus proteinuria among the subset of patients with available data.
To evaluate whether patients who got CKD added to their EHR problem list had more processes of care after CKD recognition, we examined a subset of patients with CKD recognition occurring after the second confirmatory eGFR for CKD and who also had outpatient care starting at least 1 year prior to CKD recognition and ending at least 1 year after CKD recognition. To evaluate patients without CKD recognition as potential controls, we created a time point comparable to the recognition time, adding the average number of days to recognition to the date of confirmatory eGFR and checked for outpatient care 1 year before and 1 year after. Then we built a propensity score model of CKD recognition using the following variables: eGFR, age, African-American race, gender, average number of yearly visits, diabetes, coronary artery disease, congestive heart failure, cerebrovascular disease, and within the prior year had a nephrology visit, vitamin D, iPTH, phosphorus, and proteinuria checked. Patients were matched on propensity score with 0.1 caliper width by greedy matching [19]. We then evaluated the proportion of patients who had the CKD-specific processes of care individually and as a summary measure before and after CKD recognition (or analogous time if no recognition occurred) with McNemar's test separately for recognized and unrecognized patients.
For analyses we used Unix SAS version 9.2 (SAS Institute, Cary, N.C., USA) and for graphs we used R 2.12.2 (The R Foundation for Statistical Computing, Vienna, Austria). Greedy matching was done with the %gmatch macro [19]. This study was approved by Cleveland Clinic Institutional Review Board.
Results
From our CKD registry of 49,663 patients, 54% (n = 26,657) had at least 1 year of follow-up and a Cleveland Clinic PCP or nephrologist. However, 650 were excluded because they were missing an entry date for CKD in their problem list. Additionally, 265 patients developed ESRD within 1 year of confirmatory eGFR and were excluded. This left us with 25,742 patients who constituted our study population. Mean age was 70.7 years (SD = 12.5), 40% were male, and 11% African-American. Strikingly, only 11% (n = 2,735) had CKD recognition.
Patients with CKD recognized were significantly younger, more likely to be male, African-American, and have more comorbidities (table 1; fig. 1). CKD recognition differed by stage of CKD, with patients who had more advanced CKD being more likely to be recognized (table 1). Differences existed for CKD recognition by gender and race among CKD stages (fig. 1).
CKD recognition in the EHR problem list by (a) gender and (b) race stratified by eGFR (n = 25,742).
CKD recognition in the EHR problem list by (a) gender and (b) race stratified by eGFR (n = 25,742).
During the year following confirmatory eGFR for CKD, patients with CKD recognition had more nephrology visits, more ACE/ARB and statin prescriptions, less inappropriate use of metformin among diabetics with CKD, and more recommended laboratory results measured than those without CKD recognition, both among patients with eGFR 30-59 and eGFR <30 (table 2).
Processes of care measured within a year after confirmatory eGFR for CKD among those with and without CKD recognition in the EHR problem list stratified by eGFR level

Older age and higher eGFR were independently associated with significantly lower CKD recognition, while African-American race, diabetes, hypertension, and cerebrovascular disease were independently associated with significantly higher CKD recognition (table 3). We found significant interactions between eGFR <30 and gender, diabetes and hypertension. The interactions showed lower eGFR was significantly associated with higher odds of recognition in all groups but the strength of the association varied in different groups. The strength of association between gender and CKD recognition was lower in patients with GFR <30 (male vs. female: OR 1.93, 95% CI 1.56, 2.39) than in patients with GFR ≥30 (OR 3.03, 95% CI 2.70, 3.33). Likewise, the associations between diabetes and hypertension and CKD recognition were lower in patients with GFR <30 than in GFR ≥30 (respectively OR 1.33, 95% CI 1.06-1.67 vs. OR 1.93, 95% CI 1.74-2.14 for diabetes, and OR 1.26, 95% CI 1.04-1.52 vs. OR 2.43, 95% CI 1.65-3.57 for hypertension).
Among our study population, 4,638 (18%) patients died. 21,068/25,742 (82%) had confirmatory eGFR before September 15, 2008 and were included in the ESRD model (to allow for CKD recognition up to 1 year post-confirmation in the ESRD model). Patients entered into the registry before September 15, 2008 were significantly older, more African-American, had lower eGFR, less hypertension, more CAD, more CHF, less hyperlipidemia, more CVD and more diabetes but the differences were mostly small. 416 (2%) developed ESRD. The median mortality follow-up was 3.3 years and the median ESRD follow-up was 1.9 years. In Cox proportional hazards models, CKD recognition was significantly associated with higher hazard of mortality and ESRD in the unadjusted and partially adjusted models, but the association was not statistically significant for either outcome after adjustment for all covariates including eGFR and co-morbidities (table 4). Similar results were found in the sensitivity analysis adjusted for proteinuria.
Propensity Score-Matched Control Analysis
For cases, there were 2,587 patients who had CKD recognized for the first time at some point during follow-up and who also had care 1 year before and 1 year after recognition. For controls, there were 13,638 potential unrecognized patients with care 1 year before and 1 year after the time point equivalent to recognition. We were able to match 1,896/2,587 (73%) on propensity score with 0.1 caliper width. All propensity-matched variables had standardized differences below 10% after the match. Only hypertension (89 vs. 92%, p < 0.001) and nephrology visit in the prior year (17 vs. 14%, p = 0.01) were slightly different. Age was similar between the patients whose CKD was recognized and the matched controls (70.4 ± 12 vs. 71 ± 12 years, p = 0.11). Likewise, comparing patients in the CKD recognition group versus the matched controls, 52 vs. 54% were males (p = 0.40), 14% were African-Americans in both groups (p = 0.23), and 33% vs. 35% had diabetes (p = 0.26). Table 5 shows the proportion that had nephrology visits, ACE/ARB, statins, and CKD-specific processes of care individually and as summary measures obtained in the year before recognition and after recognition for matched recognized and unrecognized patients. Nephrology visits went up among recognized patients after EHR recognition (to 21.7%) while they decreased among non-recognized patients (to 10.1%). Patients with CKD recognition in the EHR problem list had increased post-CKD recognition of CKD-specific processes of care compared to propensity score-matched controls.
Discussion
Although documentation of CKD in the EHR problem list was low, recognition of CKD by providers was associated with increased CKD-specific processes of care and medication usage but ESRD and mortality rates were not affected. Males, African-Americans, and those with more advanced CKD were more likely to have CKD documented in the EHR problem list. We found an association of increased quality of care as defined by having had processes of care undertaken per current CKD guidelines among those that had CKD recognition compared to those who did not. This relationship held true for our subset of patients whom we did a propensity score-matched control analysis looking before and after CKD recognition among patients having CKD included in their EHR problem list or not.
Others have found under-documentation of CKD in the EHR [20,21,22,23]. Among a multispecialty group practice of 15 health centers, about 25% of the 12,000 patients with CKD had it listed in the problem list [22]. In an urban setting with a high-risk population, nearly 50% of the 300 patients with CKD had ICD-9 coding documentation [23]. Through chart review of nearly 900 patients with an eGFR <60 being cared for in rural practices, a study found less than 50% with documented CKD, even among those with high-risk conditions such as hypertension and diabetes [24]. Similar to our finding of increased recognition with advanced CKD, a PCP practice-based research network with nearly 35,000 CKD patients found very low documentation of diagnosis among early CKD eGFR 45-59 (<10%), but higher documentation among CKD eGFR 30-44 (54%) and eGFR 15-29 (54%) [25]. Unlike our study, they did not report processes of care nor ESRD or mortality rates.
Better problem list documentation has been associated with a higher quality of care and greater adherence to guidelines among patients with heart failure [26]. Likewise, meaningful use of EHRs was associated with significantly higher achievement and greater improvement in diabetes quality of care [13]. Documentation of CKD by ICD-9 coding has been shown to be associated with more statin or ACE/ARB use and less non-steroidal anti-inflammatory use [20]. In contrast, under-documentation of patients with CKD led to less CKD guideline-recommended care [21]. Consistent with these findings, in our study the proportion that had CKD-specific processes of care obtained in the year before recognition and after recognition increased for matched recognized and essentially stayed the same for unrecognized patients.
Our study is unique because in addition to looking at CKD-specific processes of care, we were able to study associations of EHR problem list documentation on important clinical outcomes such as development of ESRD and death. While we found a strong unadjusted association of increase ESRD risk among those with CKD recognition, with adjustment for potential confounders, the association declined and in the fully adjusted as well as proteinuria-sensitivity analysis no statistically significant relationship was found. We had hypothesized that having CKD recognition may lead to more co-management between primary care and specialists, more coordination of care perhaps leading to those patients having an arteriovenous fistula placed in a timely fashion before dialysis, preparation for dialysis, or better control of risk factors such as anemia, metabolic bone disease, and cardiovascular disease. While we were unable to capture in our dataset all the details of co-management, CKD recognition did not reduce ESRD rates in our study. Likewise, we found an unadjusted association of increased mortality risk with CKD recognition which was no longer significant in the fully adjusted models.
EHRs are here to stay and so it is essential to understand the importance of them in enhancing clinical practice in chronic disease over all [27] and specifically among the CKD population [28]. A proactive collaborative approach between specialty care and primary care for a CKD population in Hawaii led to more patients starting dialysis with arteriovenous fistulas and less referrals of low-risk CKD patients to nephrology [29]. While their intermediate outcomes did not change, an intervention at an urban Veteran's Affairs clinic provided education, academic detailing, and access to a CKD registry did show improvement in adherence to guideline-associated CKD processes of care [30]. It remains to be seen if tailored awareness to PCPs through use of quick reference guide, practice facilitation, and collaborative learning groups will make a difference [31,32], but there is evidence that a chronic care or integrated patient-centered approach will work [33,34].
This study has major strengths including many patients, a diverse population, and national database dialysis and mortality data for the study cohort. Nonetheless, there are important limitations. We were unable to account for or control for who entered CKD in the EHR problem list. Previous literature has suggested that PCPs are responsible for the majority of problem documentation in the EHR [35]. We attempted to control for many potential factors, however, as with all observational studies, we cannot account for residual confounding and true severity of illness. We had a relatively short follow-up time for the ESRD outcome (median of 1.9 years) and perhaps a longer follow-up time is needed to demonstrate the impact of changes in healthcare processes. As well, we are an open health system and cannot account for care that was obtained outside of our system which may account for some of the discrepancies in the pre- and post-recognition period. However, to attempt to minimize this, we limited our study to patients with at least 1 year follow-up in our health system and who had a Cleveland Clinic PCP listed in the EHR or had seen a Cleveland Clinic nephrologist up to 1 year after the confirmatory eGFR for CKD, yet some of the effects seen may be mediated by seeing a nephrologist. Likewise, how best to define CKD-specific performance measures and ultimately value in providing care to patients with CKD has not been established [36].
In summary, CKD recognition was low among our cohort of patients in a large EHR-based CKD registry and it was associated with lesser processes of care. We need to examine the long-term impact of CKD recognition and transition to dialysis. Further, we need to understand how to best increase CKD awareness, use patient-centered team-based approaches, use technology such as personalized health records and mobile applications to empower patients, and test clinical decision supports to help guide optimal CKD care. These will be important topics as we move to population management in the era of healthcare reform, and more are at risk and/or will have CKD.
Acknowledgements
Supported by National Institutes of Health (NIH) grants 1K23DK091363 (S.E.J.), RR024990 (S.D.N.), and R34DK094112 (J.V.N.). The creation of the registry was funded by an unrestricted grant from Amgen, Inc. to the Department of Nephrology and Hypertension Research and Education Fund.
Disclosure Statement
The authors have no conflicts of interest to disclose.
References
Portions of this article were presented as a poster (TH-PO341) at ASN Renal Week 2011, Philadelphia, Pa., USA.