| ||||||||||||||
|
|
|||||||||||||

*Departments of Anesthesia and Health Research and Policy Stanford University Medical Center, Stanford; and
Department of Anesthesiology, University of California San Diego and the San Diego Veterans Affairs Healthcare System, San Diego, California
Address correspondence to Alex Macario MD, MBA, Department of Anesthesia (H3580), Stanford University Medical Center, Stanford, CA 94305-5640. Address e-mail to amaca{at}leland.stanford.edu
| Abstract |
|---|
|
|
|---|
Implications: Expert anesthesiologists reached a consensus on which low-morbidity clinical outcomes are common and important to the patient. The outcomes identified may be reasonable choices to be monitored as part of ambulatory anesthesia clinical quality improvement efforts.
| Introduction |
|---|
|
|
|---|
The clinical anesthesia outcomes deserving highest priority for monitoring and improvement are unknown. Physicians make most medical care decisions; thus, their opinions on clinical anesthesia outcomes are integral to the quality improvement process. Therefore, we were interested in identifying which anesthesia outcomes associated with routine outpatient surgery anesthesiologists believe occur frequently and which outcomes they believe that patients would most want to avoid. The importance of these outcomes could then be studied further in patients. In fact, the occurrence of minor adverse events leads to patient dissatisfaction with anesthesia (4). For example, avoiding postoperative nausea is reported to be high among patient concerns (6).1 However, patients may not fully understand or be able to judge the care (and outcomes) that they receive. This is, in part, due to the finding that the interpersonal characteristics of care (i.e., how nice the staff is to the patient) are often indistinguishable to the patient from the clinical outcomes of care (7,8).
Because patients may have difficulty identifying which common, less morbid clinical anesthesia outcomes are most important to them, the goal of this study was to poll expert anesthesiologists (using a modified Delphi technique) (9) to quantify which clinical anesthesia outcomes they judged to occur frequently and to be important to avoid (from a patient's perspective). Given the large number of possible outcomes, the challenge was to find a meaningful rationale that can be used to develop a selection process. Expert panels convened around medical practice are used to attain consensus about specific clinical issues (10). By allowing anesthesiologists to identify key patient end points associated with outpatient surgery, anesthesiologists (instead of health maintenance organization administrators, for example) can define which outcomes should be measured during quality improvement processes. Once these highly rated clinical outcomes are identified, physicians can work together to reduce their incidence and severity.
| Methods |
|---|
|
|
|---|
A comprehensive list of clinical anesthesia outcomes was developed from a computerized literature search (MEDLINE) for 19861997 using the term "anesthetic outcome, complications." This yielded >100 published studies (a sample of these studies includes References (1118), which were read by AM to generate a list of clinical anesthesia outcomes associated with routine outpatient surgery. Death was included, in part, to test whether panel members correctly understood and completed the questionnaire (we expected death to be rated very important and very infrequent). The list of outcomes was reviewed to focus on outcomes that were associated with low morbidity, were applicable in the ambulatory surgery setting, and were likely to be noticed by patients. We edited (i.e., duplicative outcomes were eliminated) the list to a total of 33 items with the assistance of four senior, board-certified anesthesiologists in the Stanford anesthesia department to ensure that significant elements of care were not excluded. A pilot study of 97 surgical patients (19) was completed to ascertain which outcomes patients actually value. In the patient survey, patients were asked whether there were any other outcomes not mentioned in the survey that were important to them. All of the outcomes that were spontaneously identified by patients in this study were included in the final list of outcomes. Thus, the survey items had content validity to patients.
The eligible population of anesthesiologists included members of three different 1998 ASA committees (Quality Improvement, Value-Based Anesthesia Care, and Patient Safety) with expertise in anesthesia outcomes and a list of investigators in the field of anesthesia outcomes generated from a computerized literature search (MEDLINE) for 19861997 with the keyword "anesthesia outcome." Using a random number generator and an 80% sampling fraction of all members of the committees and all authors of the articles, 72 possible respondents were included in the panel for this study.
Rather than convening the panel members in one location, we mailed a survey instrument (available from the authors) to each physician on this panel. If a panel member failed to respond after 1 mo, a second request letter and questionnaire were mailed to the panel member's home address.
The instrument was organized into three parts: preoperative, intraoperative, and postoperative outcomes. The written questionnaire instructed anesthesiologists to judge (on a 5-point Likert scale) the frequency and the importance to the patient (as perceived by the anesthesiologist) of 33 clinical anesthesia outcomes associated with routine outpatient surgery. Panel physicians were given the following instructions.
"The following list includes many possible outcomes of anesthesia for patients having routine surgery. For patients undergoing routine anesthetics, please rate each of the items based on your perception of the incidence of these events on a scale of 15, with 1 corresponding to "very infrequent" and 5 corresponding to "very common.
"Then, rate the outcomes you think are most important to avoid from an educated patient's perspective using a scale of 15, with 1 corresponding to "no importance to avoiding" and 5 corresponding to "very important to avoid."
The Delphi method was developed in the 1950s to obtain consensus among a group of experts by using a series of questionnaires interspersed with feedback (20). The theory behind Delphi is that the aggregate of a group will provide judgment that is superior to that of most individuals of the group. Features of the Delphi method include anonymity of the participants, iterative adjustment of members' responses to permit them to change their opinions, and a final group response expressed, when appropriate (as in this study), as a ranking of outcomes (21).
Each panel member's survey was returned, together with the tabulated group responses. Physicians were asked to review their individual responses in relation to the collective (group) data and to indicate any changes that they wanted to make. This feedback was used to gain consensus among the experts. The data used in this study are from responses that were reviewed and confirmed by the physicians who provided them. Thus, having passed the scrutiny of expert panel members, the model has face validity. Outcomes were ranked according to their mean score. The Spearman correlation coefficient was computed for pairs of outcomes that seemed to be clinically associated.
To obtain a final qualitative ranking of the outcomes, and understanding the limitations of noncontinuous Likert scales, importance and frequency scores were combined. A combined score was computed for each outcome by combining (multiplying) importance and fre-quency mean scores (weighted equally) to rank order the outcomes. An additive (importance and frequency scores were summed) model was also used to assure that the results were robust to choices of the qualitative model.
| Results |
|---|
|
|
|---|
|
Incisional pain received the highest frequency score. Death received the highest score for importance to avoid (Tables 24).
|
|
|
|
|
|
| Discussion |
|---|
|
|
|---|
Although there are numerous outcomes to monitor, the results of this anesthesiology expert panel, which used a modified Delphi process to gain consensus, suggest that clinicians judge the top five clinical anesthesia outcomes associated with ambulatory anesthesia to be (in order) incisional pain, nausea, vomiting, preoperative anxiety, and discomfort from insertion of the IV catheter (when weighted equally for importance and frequency). Once these outcomes are tracked over time, unnecessary variation in their occurrence can be detected, and efforts to systematically improve these clinical end points can be made (22). However, before assessing whether there are differences in these outcomes among clinicians and institutions, issues of differing case mixes and imprecise definitions must be addressed.
Patient satisfaction as measured in most anesthesia surveys may not be a fine enough measure of quality of care because patients have different expectations about the anesthesia experience, the validity of surveys has not been established, and nonmedical factors may affect a patient's satisfaction with care (23). The unstandardized, simple ratings of patient satisfaction used in most anesthesia surveys are inadequate to address the complexity of measuring satisfaction (24). For example, in the setting of perceived risk (anesthesia), satisfaction ratings may be dominated by a sense of relief.
Monitoring clinical anesthesia outcomes, instead of measuring patient satisfaction, may be a more useful indicator of quality. In this study, we focused on clinical anesthesia outcomes associated with routine outpatient surgery, rather than other aspects of care, such as customer service (e.g., the effect of care or how nice providers are to patients) or the timeliness of care (does surgery start on time?). In fact, these other aspects of care may be more noticeable and important to patient satisfaction than are the clinical outcomes about which physicians may be concerned. For example, one study suggested that friendliness of the operating room staff is the primary determinant of patient satisfaction with outpatient surgery (25). In a study of how surgeons prioritize different aspects of anesthesia service, we found that surgeons (another important customer of the anesthesia service) rank timeliness of care (e.g., time that the first case of the day starts) as a key item in improvement in the quality and function of the anesthesia service (26). Like surgeons, patients may perceive nonclinical issues to be important in evaluating anesthesia care.
The outcomes deemed important and frequent in this study are consistent with the findings of other investigators (46,1119). Although major morbidity is uncommon after ambulatory surgery, symptom distress and reduced function are common 7 days postoperatively (27). Investigators are continuing to determine how the results of this study compare with patients' actual perceptions regarding which clinical anesthesia outcomes are important to avoid (19). In a pilot study of 97 patients, we found that although there was a substantial variability in patient preferences for postoperative outcomes, patients ranked vomiting, gagging on the endotracheal tube, and pain as their three least desirable outcomes.
There are several potential limitations to the study. Of the respondents, 70% were in academic practice, which may bias the results. However, subgroup analysis (academic versus community practice) showed no difference in rankings of outcomes. With any survey-based study, the results may be affected by a variety of cognitive biases or response bias (28). The possibility of response bias is somewhat diminished by the response rate in this study of 78%. In addition, there may be an interaction (i.e., scales are not independent) between importance and frequency scales, in that clinical outcomes judged to be frequent may be judged to be important to avoid because they occur frequently. Furthermore, the consensus of a panel does not mean that the correct answer has been found, and it is not a substitute for rigorous scientific review (29).
Panel members were asked to list other outcomes that should be included that were not on the questionnaire. No one clinical outcome was suggested by more than one respondent. Thus, it seems that our study did not miss any important outcomes. The generalizability of these consensus data to all North American anesthesia providers is supported because the panel population was comprised of practitioners from 26 American states and Canadian provinces. However, it is possible that opinion in other parts of the world could differ considerably.
| Conclusion |
|---|
|
|
|---|
| Acknowledgments |
|---|
| Footnotes |
|---|
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
A. Rochette, A. F. Hocquet, C. Dadure, D. Boufroukh, O. Raux, J. F. Lubrano, S. Bringuier, and X. Capdevila Avoiding propofol injection pain in children: a prospective, randomized, double-blinded, placebo-controlled study Br. J. Anaesth., September 1, 2008; 101(3): 390 - 394. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. Salzwedel, C. Petersen, I. Blanc, U. Koch, A. E. Goetz, and M. Schuster The Effect of Detailed, Video-Assisted Anesthesia Risk Education on Patient Anxiety and the Duration of the Preanesthetic Interview: A Randomized Controlled Trial Anesth. Analg., January 1, 2008; 106(1): 202 - 209. [Abstract] [Full Text] [PDF] |
||||
![]() |
J.-R. Lee, C.-W. Jung, and Y.-H. Lee Reduction of pain during induction with target-controlled propofol and remifentanil Br. J. Anaesth., December 1, 2007; 99(6): 876 - 880. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. T. Aouad, S. M. Siddik-Sayyid, A. A. Al-Alami, and A. S. Baraka Multimodal Analgesia to Prevent Propofol-Induced Pain: Pretreatment with Remifentanil and Lidocaine Versus Remifentanil or Lidocaine Alone Anesth. Analg., June 1, 2007; 104(6): 1540 - 1544. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. Cucchiaro, S. N. Adzick, J. B. Rose, L. Maxwell, and M. Watcha A comparison of epidural bupivacaine-fentanyl and bupivacaine-clonidine in children undergoing the Nuss procedure. Anesth. Analg., August 1, 2006; 103(2): 322 - 7, table of contents. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Carvalho, S. E. Cohen, S. S. Lipman, A. Fuller, A. D. Mathusamy, and A. Macario Patient Preferences for Anesthesia Outcomes Associated with Cesarean Delivery Anesth. Analg., October 1, 2005; 101(4): 1182 - 1187. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Agarwal, P. K. Sinha, M. Tandon, S. Dhiraaj, and U. Singh Evaluating the Efficacy of the Valsalva Maneuver on Venous Cannulation Pain: A Prospective, Randomized Study Anesth. Analg., October 1, 2005; 101(4): 1230 - 1232. [Abstract] [Full Text] [PDF] |
||||
![]() |
W. S. Yew, S. Y. Chong, K. H. Tan, and M. H. Goh The Effects of Intravenous Lidocaine on Pain During Injection of Medium- and Long-Chain Triglyceride Propofol Emulsions Anesth. Analg., June 1, 2005; 100(6): 1693 - 1695. [Abstract] [Full Text] [PDF] |
||||
![]() |
Y. Fujii and M. Nakayama A lidocaine/metoclopramide combination decreases pain on injection of propofol: [Une combinaison de lidocaine/metoclopramide diminue la douleur a l'injection de propofol] Can J Anesth, May 1, 2005; 52(5): 474 - 477. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Lee, T. Gin, A. S. C. Lau, and F. F. Ng A Comparison of Patients' and Health Care Professionals' Preferences for Symptoms During Immediate Postoperative Recovery and the Management of Postoperative Nausea and Vomiting Anesth. Analg., January 1, 2005; 100(1): 87 - 93. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Agarwal, M. Raza, S. Dhiraaj, R. Pandey, D. Gupta, C. K. Pandey, P. K Singh, and U. Singh Pain During Injection of Propofol: The Effect of Prior Administration of Butorphanol Anesth. Analg., July 1, 2004; 99(1): 117 - 119. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. J. Gan, D. A. Lubarsky, E. M. Flood, T. Thanh, J. Mauskopf, T. Mayne, and C. Chen Patient preferences for acute pain treatment{dagger} Br. J. Anaesth., May 1, 2004; 92(5): 681 - 688. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Pierre, G. Corno, H. Benais, and C. C. Apfel A risk score-dependent antiemetic approach effectively reduces postoperative nausea and vomiting - a continuous quality improvement initiative: [Un traitement antiemetique relie au score de risque reduit efficacement les nausees et les vomissements postoperatoires - une initiative d'amelioration continue de la qualite] Can J Anesth, April 1, 2004; 51(4): 320 - 325. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Agarwal, S. Dhiraj, M. Raza, R. Pandey, C. K. Pandey, P. K. Singh, U. Singh, and D. Gupta Vein pretreatment with magnesium sulfate to prevent pain on injection of propofol is not justified: [Un pretraitement veineux au sulfate de magnesium n'est pas justifie pour prevenir la douleur causee par l'injection de propofol] Can J Anesth, February 1, 2004; 51(2): 130 - 133. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Kogan, L. A. Eidelman, E. Raanani, B. Orlov, O. Shenkin, and B. A. Vidne Nausea and vomiting after fast-track cardiac anaesthesia Br. J. Anaesth., August 1, 2003; 91(2): 214 - 217. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. Kranke, L. H. Eberhart, N. Roewer, and M. R. Tramer Pharmacological Treatment of Postoperative Shivering: A Quantitative Systematic Review of Randomized Controlled Trials Anesth. Analg., February 1, 2002; 94(2): 453 - 460. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Macario and F. Dexter What are the Most Important Risk Factors for a Patient's Developing Intraoperative Hypothermia? Anesth. Analg., January 1, 2002; 94(1): 215 - 220. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. E. McCann and Z. N. Kain The Management of Preoperative Anxiety in Children: An Update Anesth. Analg., July 1, 2001; 93(1): 98 - 105. [Full Text] [PDF] |
||||
![]() |
Z. N. Kain, S.-M. Wang, L. C. Mayes, D. M. Krivutza, and B. A. Teague Sensory Stimuli and Anxiety in Children Undergoing Surgery: A Randomized, Controlled Trial Anesth. Analg., April 1, 2001; 92(4): 897 - 903. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Macario and A. Vasanawala Improving quality of anesthesia care: opportunities for the new decade/Ameliorer les soins anesthesiques : perspectives de la prochaine decennie Can J Anesth, January 1, 2001; 48(1): 6 - 11. [Full Text] [PDF] |
||||
![]() |
P. Picard and M. R. Tramer Prevention of Pain on Injection with Propofol: A Quantitative Systematic Review Anesth. Analg., April 1, 2000; 90(4): 963 - 969. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|