| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
The German Society of Anesthesiology and Intensive Care Medicine evaluates the standardized and routine reporting of perioperative anesthesia-related incidents, events, and complications (IEC). As part of the long-term projects definitions, IECs are graded according to severity and to their clinical consequence on further postanesthesia monitoring and treatment demands. The adult study population of our department comprised 37,079 patients recovering from anesthesia in a tertiary university hospital from July 1992 through June 1997. Cardiac, obstetric, craniotomy, thoracotomy, laparotomy, and emergency operations were excluded. Multivariate regression statistics were used to calibrate the impact of minor graded IECs on necessary postanesthesia care unit (PACU) utilization. Minor and severe IECs appeared in 22.1% and 0.2% of the patients. A minor IEC occurrence was a statistically significant (P < 0.001) predictor of PACU utilization in a multivariate regression model. The mean difference of PACU length of stay for patients with minor IECs was prolonged by a range of 6%26% when adjusted for coexisting severity features such as age, gender, ASA physical status, and type and duration of anesthesia and surgery. We conclude that the IEC methodology integrates epidemiologic information about perioperative anesthesia outcome. Minor but frequently occurring IECs have an impact on PACU utilization and are thus important to measure and follow. Implications: It is desirable to know how anesthesia-related incidents, events, and complications influence postanesthesia care. Analyses of standardized and routine perioperative outcome data, as proposed by the German anesthesia quality project, can show that even minor events consume relevant resources and are thus important to measure and follow.
Within the constraints of todays cost-conscious clinical healthcare environment, the effective utilization of expensive resources is mandatory. Although this is true for the perioperative anesthesia process as a whole (1), the allocation of postanesthesia care unit (PACU) services is a particular economic challenge (2). Individual patient condition, as well as type of anesthesia and surgery, dictates requirements for postanesthesia treatment and monitoring (3,4). In addition, it is appealing to measure the impact of immediate anesthesia-related adverse events. For this purpose, all irregularities must be addressed; not only major and fatal events, but especially minor and frequent everyday occurrences. It would also be desirable to know which incidents, events, and complications (IECs) are trivial and without consequence to further therapy and observation, and minor IECs that frequently and significantly consume anesthesia department capacities. Following the quality assurance and cost-containment regulations imposed by German healthcare law, the German Society of Anesthesiology and Intensive Care Medicine (Deutsche Gesellschaft für Anästhesiologie und Intensivmedizin [DGAI]) has launched a long-term study project (5). The aim of the project is to implement and evaluate a methodology for the standardized routine reporting of perioperative anesthesia-related IECs. Starting in 1992, our department was one of the first volunteer centers in this nationwide program. In this article, we attempt to (a) describe results from measuring distinct minor and severe outcome characteristics of the immediate perioperative anesthesia patient care process; and (b) calibrate minor IECs as a significant source of PACU utilization requirement and validate the IEC severity grading against the DGAI project definitions.
In 1991, a uniform anesthesia record system for every monitored anesthetic procedure was established (6). This paper-based, computer-readable system was applied in all anesthetic locations throughout the hospital. During the whole anesthesia course, IECs were recorded using the DGAI definitions. An IEC is defined as an incident that (a) occurs in the perioperative period, i.e., from induction of anesthesia until discharge of the patient to the ward or the intensive care unit (ICU), either from the PACU or directly from the operation room (OR); and (b) leads to specific interventions by the anesthetist; and (c) has caused or could have caused morbidity or mortality. All three conditions had to be fulfilled to qualify for an IEC. IECs were coded in 63 categories with respect to the respiratory/airway, cardiovascular, or central nervous system; systemic reactions; laboratory variables; equipment failure; and lesions. IECs were graded in ascending order of severity for their clinical consequences (Table 1). Before storing data in the database, every record set was validated in four different ways and corrected if necessary. Consultant anesthetists in charge at the point of care reviewed each record set for clinical correctness and completeness (usually at the end of the daily routine schedule). Documentation clerks checked each record set for technical errors to guarantee proper scanning of the paper. Plausibility rules implemented in the database system checked each record set for completeness, consistency, and plausibility. If there were any doubts in the second or third step of the validating system, the anesthesiologists in charge of the documentation work group (BS or UB) were asked for assistance. If necessary, the anesthetist who had performed the anesthetic was asked to complete the data.
The study was executed at a tertiary university teaching center completing approximately 18,000 anesthetics per year. The case mix covered patients from urban and rural areas, as the university surgical clinics function both as a city hospital and a tertiary referral center. After implementation of the IEC methodology, our regular documentation activity started in July 1992. Analyses for the current study included all database record sets (n = 37,079) from July 1992 through June 1997. Exclusion criteria for individual cases were set to prevent extreme influences on the estimations from rather specific conditions, which cannot be generalized to a comprehensive population (Table 2). General anesthesia, usually as a balanced anesthesia, was facilitated under controlled or assisted ventilation with endotracheal intubation, face mask, or laryngeal mask. Regional anesthesia was usually performed as spinal anesthesia (discontinuous), epidural anesthesia (continuous, lumbar catheter), or major peripheral nerve blocks (brachial plexus, sciatic nerve, and femoral three-in-one nerve block). Anesthesia was administered according to our institutional practice guidelines (7) and the national guidelines issued by the DGAI.
The operative locations of our hospital are distributed among several buildings, but each is equipped with a local PACU operated by staff anesthesiologists. They provide basic and extended invasive monitoring and ventilator therapy if necessary. PACUs are staffed by anesthesiology nurses and a permanent physician or a responsible physician on demand. The PACU nurse-to-patient ratio is usually approximately 1:3. Patients can bypass the PACU after surgery under two conditions: (a) if no further anesthetic coverage is anticipated e.g., after a very short procedure with short-acting anesthesia; or (b) after long and extended procedures when patients are typically transferred either extubated to an intermediate care unit (operated by surgeons) or possibly endotracheally intubated for further ventilatory and intensive care treatment on an ICU (operated by anesthesiologists). Patients can be dismissed from the PACU to the intermediate care unit or general ward if they are awake, fully conscious, hemodynamically and respiratory stable, and have adequate treatment for analgesia, nausea, and vomiting. For patients who have undergone regional anesthesia, a sufficient reduction in the level of the neurologic blockade must be discernible before transfer. Vital signs are continuously monitored with central alarming and supplemental oxygen, but no ventilator therapy is usually available in the intermediate care unit. In the patient rooms on the general wards, nurses perform intermittent monitoring of vital signs (heart rate, blood pressure, and body temperature); there is usually no supplemental oxygen, no oximetry, and no continuous electrocardiograph monitoring available.
Bivariate statistics for categorical data were computed by using the Pearson
From the entire population of 90,404 anesthetic procedures in the specified 5-yr time interval, 53,180 adhered to the inclusion criteria. Forty-seven data sets had one or more missing values in the assessed variables. Outlier identification revealed 4,953 procedures; 11,731 patients bypassed the PACU; and 37,079 patients treated in the PACU were included in the time analyses. Mean (± SD) patient age was 48.3 ± 19.5 yr. Mean duration of anesthesia and PACU length of stay were 100.0 ± 50.8 min and 78.9 ± 49.5 min, respectively. After removal of outliers, data were assumed to fulfill requirements for parametric statistics. For patients treated in the PACU, mild (I or II), moderate (III), and severe (IV or V) IECs occurred in 13.8%, 1.9%, and 1.2% of patients, respectively. For patients treated in the PACU, mild, moderate, and severe IECs occurred in 20.5%, 1.6%, and 0.2% of patients, respectively. As a first step, possible confounding of IEC incidence and PACU length of stay with additional risk and case severity variables (covariables) was considered. Therefore, bivariate analyses with contingency tables were performed in two dimensions: (a) between the maximal grade of IEC occurring in each procedure and all covariables and (b) between the PACU length of stay and all covariables. Figures 1 and 2 summarize the associations broken down into distinct categories of the covariables as included in the study scheme (Table 2).
Bivariate statistical association of all covariables was significant ( 2 test: P < 0.001) with the incidence of IECs (Figure 1), except for patient gender (P = 0.29). Bivariate statistical association of all covariables was significant (P < 0.001) with PACU length of stay (Figure 2). Thus, all covariables had to be considered as confounders for which a multivariate approach must be used. For all procedures with minor IECs (grades IIII), a multiple linear regression model was built with PACU length of stay as the dependent variable. In addition to the continuous variables, discrete data were coded and entered as dummy variables (1 = present, 0 = not present) representing all categories. All covariables of the assessment scheme were found to be significant predictors, except for the patients age and ASA physical status II being indistinguishable from ASA physical status I. Thus, ASA physical status I and II were combined to form one reference category. Estimation and significance of the regression model is shown in Figure 3, in which the regression coefficient value of a dummy variable can be interpreted as the mean difference of PACU length of stay of that category against a zero reference category. In addition, mean difference estimates were adjusted for the level of all covariables in the model. Occurrence of an IEC grade I thus predicts a significant but clinically short prolongation (6%) of mean PACU length of stay, whereas IEC grades II and III indicate significant and more relevant prolongation (26% and 23%) of mean PACU length of stay compared with the overall mean PACU length of stay.
In addition to finding single significant dummy predictor variables in the regression modeling process, it is important to test the whole construct consisting of all three IEC severity grades. This was accomplished by comparing models with and without the construct variables by using an F-test procedure (8). We saw a significant reduction of the multiple R value from 0.405 to 0.390 (F change: P < 0.001). This indicates that, when correcting for the influences of all severity covariables in the model, the concept of minor IEC occurrence significantly explains variability in PACU utilization.
In this article, we describe the feasibility of measuring distinct minor and severe routine outcome characteristics in the immediate perioperative anesthesia care period. Coding and grading of IECs was accomplished by using methodology recommended by a nationwide DGAI project. The results indicate that minor but frequently occurring IECs are significant and quantifiable predictors of postanesthesia care utilization in terms of PACU length of stay. In particular, the results can be used to calibrate the three-step model of reporting minor IECs as defined by the DGAI. Research in anesthesiology has always been concerned with severe or fatal perioperative events such as death, myocardial infarction, or pulmonary embolism. Although severe events are also covered by the IEC definitions, the projects scope has been particularly broadened to study minor events. Minor events may better reflect the everyday challenge of anesthesia practice and the ability of the provider to meet the demands of a heterogeneous real-life patient population. There is growing experience that the traditional approach of conducting morbidity and mortality studies, which only investigate severe events, is not a sufficient outcome quality measure in anesthesia today. Minor IECs happen frequently and, therefore, probably have significant implications for anesthesia economics. However, the project has not advanced to the stage of directly associating IECs and costs. After collecting data from more than 100 sites in a national database, the nationwide IEC project has entered the phase of intersite comparisons. These data are not yet ready for publication. Our article is a first analysis of the data collected by our department. We studied the utilization of PACU services in regard to length of patient stay, which seemed to be more directly measurable than costs. Fleisher et al. (9) explained the opportunities and limitations of conducting observational studies. Although these types of studies are supposed to present weaker evidence for particular questions, compared with randomized controlled trials, they fill knowledge gaps where information is not otherwise available. They better serve to generate hypotheses than to infer biological causality. If we discover, however, which variables are associated with better or worse outcomes, it might be worthwhile to consider changes in the long and complex chain of process steps in healthcare to improve outcomes. Constant evaluation, however, is essential to monitor outcome changes. In addition, focused clinical trials may still be applied to scrutinize new hypotheses. We certainly never see the ideal "randomized" patient in practice, and we certainly never will have a totally uniform, standardized system for healthcare professionals to practice medicine, despite all guideline and practice policy efforts. Outcome quality studies must embrace the huge disparity of practice among healthcare professionals and the uniqueness of each patients condition. Their purpose is to detect problems not yet perceived or anticipated. New methods in epidemiology and medical informatics are required to process observable empirical data to extract new and relevant knowledge. Therefore, outcome quality research today is quite different from experimental research, in which conditions are strictly controllable and populations are highly constrained. There is no general agreement on defining criteria for IECs, e.g., for hypotension. One could try to extract rules from dozens of pages of standard anesthesia textbooks. In practice, however, it still takes the complex interpretation of an experienced anesthesiologist to perceive a blood pressure problem in the clinical context. Therefore, the definitions of IECs are not simply related to numeric thresholds or measurements. Technical measurements, if available, certainly help to characterize the problem, but many problems cannot be measured with instruments at all (e.g., intubation problems). Thus, the ultimate classification of an IEC is solely based on its clinical consequence and is a product of the reasoning and decision-making process of the responsible clinician. That is why assessing interobserver agreement on IEC on those grounds is difficult.
We applied the proposed severity coding system to a five-year patient population with respect to the consumption of treatment and monitoring time in the PACU. The results suggest that PACU time prolongation due to grade I IECs, although statistically significant for a large population, is probably not clinically relevant given the small amount of the mean difference ( In an earlier phase of the DGAI project, our study group demonstrated the epidemiology of risk features and IEC incidence (12). We evaluated the phenomenon of IEC occurrence in populations at high risk (13,14) and studied the association of quality of process variables as viewed by an anesthesiologist versus outcome variables and satisfaction as perceived by the patient (15). In addition, we addressed the possibility of a broad perioperative risk assessment (16). In a recent study, we evaluated the long-term stability and documentation discipline of the IEC reporting process (17). The current study is a further step in validating the IEC methodology. There is still a controversial and primarily nonacademic discussion about the perioperative outcome project in Germany. One opinion is that it is not necessary for an anesthesiologist to report complications, especially minor ones that do not lead to a definite unwanted outcome. The results of this study suggest the opposite. If we can show, and possibly predict, which patients are prone to IECs, and if we can quantify the impact of IECs on postanesthesia treatment requirements, we may have a better basis with which to make management and allocation decisions. This methodology operates on an aggregate or "macro" level (e.g., department or hospital staffing and reimbursement), whereas other methods address PACU utilization more directly, such as daily PACU staffing needs (2). There is continuing research on how particular conditions or procedures affect PACU utilization (3,4). Postoperative pain, nausea and vomiting, regional anesthesia, anesthesia with short-acting anesthetics, or rearrangements of OR schedules and PACU admissions (18) are only the most eminent examples. In contrast, the aim of the IEC methodology was twofold: (a) to document perioperative problems and their consequences on a comprehensive real-life population in a single institution and (b) to compare the results across different institutions. With respect to the first, the definitions of the IECs are quite similar to those of other anesthesia outcome research projects (1921). After the first attempts to benchmark 70 national anesthesia departments, adjusting for provider levels of service proved to be a difficult task (22). Designing and evaluating interventions for quality improvement still lie ahead. At this point, the database may best be used for basic epidemiologic and economic associations. Classic scientific medicine has always been driven by an ethical imperative to improve outcomes. Today, the paradigm seems to be shifted to the least expensive treatment option while hopefully not degrading outcomes. There is not much doubt about the benefits of the routine services of a PACU. However, highly equipped facilities and specifically trained personnel are inevitably expensive. Thus, anesthesiologists must sustain and provide data on outcomes when cost-reductions take place. The IEC methodology intends to provide routine means for doing this. We conclude that the proposed methodology facilitates integration of epidemiologic information about perioperative outcome from individual routine anesthesia procedures. The results of this study indicate that minor but frequently occurring adverse events significantly affect postanesthesia care utilization and are thus important to measure and follow. Assessment of minor IECs is possible and worthwhile, and it provides valuable information about the perioperative anesthesia process outcome.
Supported in part by a research fellowship sponsored by the Deutsche Forschungsgemeinschaft, Bonn, Germany. We thank Susan D. Horn, PhD, and Reed M. Gardner, PhD, of Medical Informatics, University of Utah, for their help in critically discussing and improving the manuscript. In particular, we thank all our anesthesiology department staff and documentation team for assessing and validating a myriad of protocols.
Presented in part at the 10th European Congress of Anesthesiology, Frankfurt, Germany, July 2, 1998.
This article has been cited by other articles:
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|