| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Renal insufficiency after cardiac surgery is associated with increased mortality, morbidity, and length of intensive care unit stay. A convenient surrogate measure would facilitate the evaluation of renal-protective therapies. We evaluated two measures: the 72-h change in serum creatinine (Cr) ( Cr72h) and the percentage 72-h change in calculated (Cockcroft-Gault equation) Cr clearance (% CrCl72h). We randomly selected 2000 individuals who underwent aortocoronary bypass, valve surgery, or both at the Toronto General Hospital between May 1999 and August 2000. The variables were analyzed with frequency histograms and normal probability plots. Their association with dialysis, mortality, and prolonged intensive care unit stay was determined by using receiver operating characteristic (ROC) curves. Cr72h was skewed to the right, whereas % CrCl72h was normally distributed. ROC curve areas showed Cr72h to be a good predictor of dialysis (0.98), death (0.83), and prolonged hospitalization (0.74). % CrCl72h had similar ROC curve areas for predicting dialysis (0.97), death (0.82), and prolonged hospitalization (0.74). ROC curve areas did not differ significantly with respect to mortality (P = 0.89), dialysis (P = 0.49), or prolonged hospitalization (P = 0.85). Both variables were correlated with patient-relevant outcomes. Mathematical transformation of Cr72h to % CrCl72h results in a normal distribution that is amenable to parametric statistical tests. Cr72h and % CrCl72h may be used as surrogate outcomes in future trials. IMPLICATIONS: A convenient surrogate measure of renal function is needed for evaluating renal-protective therapies in cardiac surgery. We evaluated the performance of serum creatinine concentration and calculated creatinine clearance for predicting dialysis, mortality, and prolonged hospitalization. Both measures were correlated with clinical outcomes. Creatinine clearance had the advantage of a distribution suitable for parametric statistical tests.
Renal insufficiency after cardiac surgery is associated with increased mortality, morbidity, and intensive care unit (ICU) stay (1,2). The preoperative predictors of postoperative dialysis have been identified in large studies that encompassed up to 43,000 patients (1,2). In contrast, research into strategies to prevent renal insufficiency has been limited. An important reason for this discrepancy is the infrequent incidence of postoperative dialysis (1% to 2%) in this patient population (1,2). Clinical trials therefore require large sample sizes to detect changes in dialysis rates with adequate power. Surrogate measures of perioperative renal dysfunction are therefore needed for the preliminary evaluation of new renal-protective therapies using feasible sample sizes. The ideal surrogate measure should be easily measured and correlate with patient-relevant outcomes. It should also have distributional properties suited to parametric statistical tests, which are generally more powerful than nonparametric equivalents (3). If a therapy beneficially alters an ideal surrogate measure, there is justification for then studying its effects on patient-relevant outcomes (dialysis, mortality, and length of stay) in an adequately powered larger study. The surrogate measures presently in use include urinary protein markers, serum creatinine (Cr) concentration, and Cr clearance (CrCl) (measured and calculated).
Urinary levels of Serum Cr concentration has been used as a measure of overall renal function. It is easily measured and has a small interassay coefficient of variation (<5% at our institution). However, Cr concentrations are affected by factors aside from renal function, namely, sex, age, and muscle mass (6). Investigators have usually either used Cr concentration as a continuous variable or dichotomized it to define clinically significant changes in renal function. Definitions of clinically significant perioperative changes in Cr concentration have been largely arbitrary. The most common definition, an increase more than 44.2 µmol/L (0.5 mg/dL) over 48 to 72 h (7,8), was obtained from the contrast-induced nephropathy literature (9). The significance of a 44.2 µmol/L perioperative increase in serum Cr is unknown. Measured CrCl has been used to estimate glomerular filtration rate (GFR), but its accuracy and precision have generally been low (10). Other disadvantages include increased personnel time and costs that are needed for accurate collection of timed urine samples. The shorter collection times used in perioperative trials (11) may further magnify inaccuracies in urine volume measurement. GFR can also be estimated by calculated CrCl. The latter estimates GFR through an equation that accounts for an individuals age, sex, weight, and serum Cr (12). It has advantages over both measured Cl and serum Cr. Calculated Cl estimates GFR and measured Cl in critically ill patients admitted to medical and cardiac surgical ICUs (13,14), even during conditions of changing renal function (14). Furthermore, calculated Cl does not require the collection of cumbersome timed urine samples. Cr concentrations and calculated CrCl are convenient, reproducible, and inexpensive surrogate mea-sures. However, the prognostic significance and distributional properties of perioperative changes in these measures remain unclear. We therefore evaluated the surrogate measures in 2000 patients undergoing coronary artery bypass grafting, valve surgery, or both. We also sought to identify the appropriate perioperative changes in Cr and CrCl for defining clinically significant changes in renal function. We limited postoperative measurements of renal function to the 72 h after surgery, a previously defined period (15) that would capture changes in function attributable to surgery itself. We used the percentage change in CrCl to better relate the perioperative change in Cl to preoperative renal function.
Preoperative, intraoperative, and postoperative information is prospectively collected for patients undergoing cardiac surgery at the Toronto General Hospital (TGH) (Toronto, ON, Canada). Documented information includes weight (kg), postoperative dialysis, in-hospital mortality, and ICU length of stay. This database has previously been described (16). Variables are defined in Appendix 1. We identified all individuals who underwent coronary artery bypass grafting, valve surgery, or both between May 1, 1999, and August 31, 2000. Patients were excluded if they required dialysis before surgery or died during surgery. Assuming a dialysis rate of 0.75%, the sample size of 2000 was estimated to provide sufficient outcomes (death or dialysis) for logistic regression modeling (i.e., 10 outcomes per independent variable) (17) and 95% confidence intervals (CI) more precise than ±0.10 during receiver operating characteristic (ROC) curve analysis. CIs were calculated by using the methods of Hanley and McNeil (18), assuming a ROC curve area of 0.90. The sample size was also deemed to be feasible for manual retrieval of laboratory data. We randomly selected 2000 individuals from the 3077 patients identified previously, by using a computer-generated random-number table (SAS 8.02; SAS Institute, Cary, NC). The Cr concentrations of patients undergoing cardiac surgery at TGH are routinely measured before surgery (within 30 days) and then daily after surgery until discharge or the fifth postoperative day. After obtaining approval from the TGH Research Ethics Board, we manually reviewed medical charts to obtain these results. The preoperative Cr concentration (Crpreop) was defined as the value recorded closest to surgery but not on the day of the procedure itself. The maximal 72-h Cr concentration (Cr72hmax) was defined as the largest postoperative measurement between Days 0 and 3. All in-hospital measurements were performed at Toronto Medical Laboratories (Toronto, ON, Canada) with the Bayer Advia 1650 autoanalyzer (Bayer Inc., Tarrytown, NY), which has an interassay coefficient of variation <5%. Of Crpreop measurements, 97% were measured at Toronto Medical Laboratories. The overall results were not qualitatively altered when we excluded the 3% with preoperative measurements at facilities other than Toronto Medical Laboratories. Preoperative measurements were performed on the day before surgery for 63% (n = 1267) of the study sample. The duration between the preoperative measurement and surgery ranged from 1 to 27 days (mean, 5 days; 25th percentile, 1 day; 75th percentile, 11 days).
The 72-h change in Cr concentration (
Units for age, weight, and Cr were years, kilograms, and micromoles per liter, respectively. The Cockcroft-Gault equation was selected given its superior performance relative to other equations (19). The absolute 72-h change in CrCl ( Patients who needed postoperative dialysis received either intermittent hemodialysis or continuous venovenous hemodialysis. Decisions on implementing dialysis were made by a consulting nephrologist. Analyses were performed with SAS 8.02. All tests of significance were two tailed, with P values less than 0.05 considered statistically significant.
The distributions of
ROC curves (18) were plotted for the relationship of
We developed several alternative definitions of clinically significant changes in perioperative renal function by dichotomizing
We also measured the correlation of
The effect of perioperative changes on renal function may be affected by the presence of preoperative renal dysfunction. We therefore determined the predictive performance of
The study sample (Table 1) had an in-hospital mortality rate of 1.1% (n = 21). The median ICU length of stay was 1 day (25th percentile, 1 day; 75th percentile, 2 days). The incidence of postoperative dialysis and prolonged ICU stay was 1.0% (n = 20) and 6.3% (n = 126), respectively.
The distribution of Cr72h (Fig. 1) was skewed to the right (median, 3 µmol/L; 25th percentile, -5 µmol/L; 75th percentile, 14 µmol/L). The variable was not normally distributed on a normal probability plot. The transformation to % Cr (median, 3%; 25th percentile, -5%; 75th percentile, 15%) was also skewed to the right and not normally distributed. Transformation of Cr72h to the difference between the reciprocals of preoperative and postoperative Cr concentrations (1/Crpreop - 1/Cr72hmax) resulted in a more symmetric, bell-shaped distribution.
Cr72h was correlated with postoperative dialysis (ROC area, 0.98; 95% CI, 0.941.00), mortality (ROC area, 0.83; 95% CI, 0.720.94), and prolonged ICU stay (ROC area, 0.74; 95% CI, 0.690.79). The sensitivity, specificity, and prevalence of several cut-points in Cr72h are presented in Table 2. The cut-point that resulted in the optimal balance of sensitivity and specificity was an increase in Cr concentration more than 50 µmol/L, which had a prevalence of 5.5%. Cr72h was also associated with clinical outcomes in univariate logistic regression models (Table 3). All models had good discrimination (Table 3). The models were also well calibrated, aside from the model predicting prolonged ICU stay (Table 3).
The % CrCl72h used here was a mathematical transformation of Cr72h. The distribution of % CrCl72h (Fig. 1) was approximately normal (mean, -5.1%; SD, 16.4%). The distribution of the absolute change in CrCl, CrCl72h, was more symmetric and bell shaped than that of Cr72h. However, normal probability plots showed that the transformation of CrCl72h to % CrCl72h resulted in a closer approximation to the normal distribution.
%
%
The area under the ROC curve relating CrClpreop and postoperative dialysis was 0.77 (95% CI, 0.650.90). The optimal definition of preoperative renal dysfunction was a CrCl <60 mL/min, which had a prevalence of 27% (n = 538). The relative risk for dialysis among individuals with preoperative renal dysfunction was 5.0 (95% CI, 2.012.6; P = 0.0001). The ROC curves relating
For individuals with normal preoperative renal function, the ROC curve areas relating dialysis with Cr72h and % CrCl72h were 0.99 (95% CI, 0.951.00) and 0.99 (95% CI, 0.941.00), respectively. An increase in Cr concentration more than 50 µmol/L, which had a prevalence of 4% (n = 53), was associated with a sensitivity and specificity for dialysis of 97% and 100%, respectively. By comparison, a decrease in CrCl larger than 25%, which had a prevalence of 9% (n = 127), had a sensitivity of 92% and specificity of 100%.
The ROC curve areas relating postoperative dialysis with
We evaluated the performance of two simple surrogate measures that can be readily used in clinical trials: the 72-hour changes in Cr concentration and calculated CrCl. Both were highly correlated with postoperative dialysis, death, and prolonged ICU stay. ROC analysis did not demonstrate any significant differences between the measures with regard to predicting clinical outcomes. Their performance was similar regardless of whether preoperative renal function was normal or abnormal. Preexisting renal dysfunction, as defined by CrCl less than 60 mL/min, itself increased the risk of postoperative dialysis fivefold; these findings mirror those of other investigators (1). Calculated CrCl is a mathematical transformation of Cr concentration. Nonetheless, this transformation resulted in a normally distributed and clinically meaningful variable that retained high correlation with patient-relevant outcomes. The other mathematical transformation that resulted in a symmetric, bell-shaped distribution was the difference between the reciprocals of preoperative and postoperative Cr concentrations. This alternative transformation is difficult to interpret. We suspect that clinicians will more readily interpret 95% CI for a proportionate change in calculated CrCl than for a difference in reciprocals.
Both Cr concentrations and calculated CrCl may be used as continuous outcome variables. In this situation, CrCl has an important advantage over Cr concentration. Parametric statistical tests (e.g., Students t-tests and analysis of variance) all assume that the outcome variable conforms to an approximately normal distribution. Whereas CrCl has a symmetric, bell-shaped distribution, serum Cr has a skewed distribution. The symmetric distribution of CrCl did not simply reflect its use as a percentage. The percentage change in Cr concentration (% Both Cr and CrCl can also be dichotomized to define clinically significant changes in perioperative renal function. We analyzed the most common definition of perioperative renal dysfunction, a 0.5 mg/dL (44 µmol/L) increase in serum Cr, and determined its predictive performance for dialysis (sensitivity, 95.0%; specificity, 61.9%), mortality (sensitivity, 61.9%; specificity, 94.1%), and prolonged ICU stay (sensitivity, 37.3%; specificity, 95.6%). ROC analysis suggested that a clinically significant change in renal function should be defined as either an increase in serum Cr concentration more than 50 µmol/L or a decrease in CrCl more than 25%. The latter definition is more conveniently used during clinical trials because of its higher prevalence (10.2% vs 5.5%). A clinical trial that defines clinically significant renal dysfunction as a decrease in CrCl more than 25% would therefore need only half as many patients to develop statistical power equivalent to that in a trial that defines clinically significant dysfunction as an increase in serum Cr more than 50 µmol/L. There is limited prior information on surrogate measures of perioperative renal function. Charlson et al. (24) used ROC analysis to evaluate the performance of changes in serum Cr concentrations. However, they related changes in Cr to postoperative measured CrCl, not clinical end-points (e.g., death, dialysis, or prolonged ICU stay). There are several limitations to this study. First, postoperative CrCl was calculated by using preoperative weights. Given that the Cockcroft-Gault equation uses weight to estimate muscle mass, our calculations assumed that muscle mass did not significantly change over the first 72 postoperative hours. However, surgical stress increases protein catabolism. The urinary excretion of 3-methylhistidine, a marker of skeletal muscle protein catabolism, increases up to 40% in the early postoperative period after elective surgery (25). Nonetheless, it is unlikely that remeasuring weight on each postoperative day would have significantly improved the accuracy of our results. Immediate postoperative weight increases above preoperative values because of IV fluid administration. The Cockcroft-Gault equation would interpret this additional weight as increased muscle mass, when muscle mass is likely to have decreased. Using preoperative weights will therefore lead to less overestimation of postoperative GFR than using serial postoperative weights. Second, these results demonstrate a close statistical association of these outcome measures with dialysis, death, and prolonged ICU stay. Although the relationship has biological plausibility, a cause-effect relationship must be validated prospectively. Future clinical trials of interventions that alter Cr or CrCl must also demonstrate similar changes in these clinical outcomes. In conclusion, both Cr concentration and calculated CrCl are surrogate measures of perioperative renal function that are convenient, inexpensive, and highly correlated with patient-relevant clinical outcomes (mortality, dialysis, and prolonged hospitalization). Other surrogate outcomes now in use (e.g., measured CrCl and urinary protein markers) do not share all these characteristics. CrCl has the additional advantage of a symmetric, bell-shaped distribution amenable to parametric statistical tests. Either measure may be used to define a clinically significant change in perioperative renal function. The most appropriate definitions appear to be either an increase in serum Cr concentration >50 µmol/L or a decrease in CrCl more than 25%. We propose that that Cr concentration and calculated CrCl be used as surrogate measures of renal function during initial clinical trials of novel renal-protective drugs. Demonstration of the benefit of such drugs on these surrogate measures is necessary before progressing to the large studies needed for evaluating effects on the outcomes themselves.
The authors acknowledge the superb data collection and management of Susan Collins at the University Health Network.
Dr. Wijeysundera is the recipient of the Allan K. Laws Clinician Scientist Fellowship from the University of Toronto. Presented in part at the meeting of the Canadian Cardiovascular Congress, Edmonton, AB, Canada, October 27, 2002.
This article has been cited by other articles:
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|