| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
We apply data envelopment analysis to discharge data from the 115 hospitals in the rural state of a study hospital to answer three questions. We use a case study to investigate the usefulness and limitations of data envelopment analysis for assessing three common questions regarding hospital market capture for elective inpatient surgery. (i) The hospital studied in this paper performs 40% of the neurosurgery and 25% of the inpatient urology surgery in its state. Workloads are twice that of the hospitals with the next largest workloads. In contrast, the hospital performs 9% of its states cardiac surgery and has a workload half that of the largest volume hospital. The cardiac surgeons want more operating room time, faster turnovers, and capital investment for minimally invasive equipment. Controlling for the distance patients would need to travel for care, would increasing capacity likely increase cardiac surgery workload? (ii) The study hospital has fewer hospitalizations for thoracic surgery than for any other specialty. Is thoracic surgery inpatient workload of 121 lung resections large or small compared with those of orthopedics 213 hip replacements, urologys 132 nephrectomies, and cardiac surgerys 304 coronary artery bypass grafts? (iii) The hospitals busiest specialty by discharges is orthopedics. How sensitive is the hospitals orthopedic workload to changes in decision making at nearby competing hospitals? IMPLICATIONS: We apply data envelopment analysis to measure market capture of elective inpatient surgery for all hospitals in a state. We evaluate the usefulness of the data envelopment analysis by focusing on one hospital and its competitors.
We use a case study to investigate how to answer three common questions regarding hospital market capture for elective inpatient surgery. (i) The hospital studied in this paper performs 40% of the neurosurgery and 25% of the inpatient urology surgery in its rural state. Workloads for those specialties are more than twice that of the next largest workload hospitals. In contrast, the hospital performs 9% of its states cardiac surgery and has a workload half that of the hospital with the largest cardiac workload. The cardiac surgeons want more operating room (OR) time, faster turnovers, and capital investment for minimally invasive equipment. Controlling for the distance patients would need to travel for care, would increasing capacity likely increase cardiac surgery workload by a financially important amount? (ii) The study hospital has fewer thoracic surgery hospitalizations than for any other surgical specialty. The Chief of Surgery asks the Chief of Anesthesia about support for recruiting another thoracic surgeon. Is the current inpatient workload for thoracic surgery (121 lung resections) large or small compared with those of orthopedics (213 hip replacements), urology (132 nephrectomies), and cardiac surgery (304 coronary artery bypass grafts, CABG)? (iii) The study hospitals busiest specialty by discharges is orthopedics. The anesthesia group may recruit another anesthesiologist who is subspecialty trained in regional anesthesia. However, a decrease in orthopedic workload would likely cause frustration and disrupt the anesthesiology group. How sensitive is the study hospitals orthopedic workload to changes in decision making at nearby competing hospitals? In this paper, we apply the technique of data envelopment analysis (DEA) to measure market capture of elective inpatient surgery for all hospitals in a state (see Methods for description and Appendix for equations). Market capture is predicted by DEA, applied to hospital discharge data, using both the relationships between input model variables and overall surgical workload and the correlations among different specialties workloads (1). We confirm that caseloads for the eight common procedures (1) studied predict inpatient hospital workload for each procedures specialty. We evaluate the usefulness of the DEA by performing a case study to answer the above three questions for the study hospital.
Outputs Studied Discharge data from one United States (US) rural state were studied for the 115 non-federal hospitals that performed at least 10 cases of at least one of the eight studied procedures in 2001 (Table 1). The rationale and validation for using the studied procedures was described previously (1).
The number of hospital discharges for craniotomy in adults, not for trauma, was determined by counting discharge abstracts with Centers for Medicare and Medicaid Services (CMS) Diagnosis Related Groups (DRG) value of one (FY0001 and FY0102). The number of hospital discharges for the other seven procedures was determined using the six International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) procedure codes in each discharge abstract. The combinations of ICD-9-CM procedure codes encompassing each studied procedure were derived from the Agency for Healthcare Research and Qualitys (AHRQ) Clinical Classifications Software aggregation of ICD-9-CM (1).
Inputs Studied "Beds" were defined as the number of staffed acute care beds as reported in the annual survey of the American Hospital Association. We did not use surgical beds or ORs because it is the number of acute care beds that predicts hospital visibility and the number of discharges (2). The number of beds is a surrogate for the physical size and visibility of the hospital, as relevant for marketing to potential patients. "Surgeons" was measured as the number of physicians at the hospital admitting at least three patients undergoing one of the eight studied procedures, as listed in the discharge abstract. "Technology" was measured as the number of the following services provided by the hospital: ORs (every hospital studied had this), cardiac catheterization, cardiac surgery, shock-wave urological lithotripsy, megavoltage radiation therapy, magnetic resonance imaging, organ transplantation, neonatal intensive care, and trauma care (5,6). The presence of each service was determined by there being at least one discharge from the hospital with relevant DRG and ICD-9-CM. "Weighted county discharges" were calculated by taking, for the residents of each county, the sum of the number of each of the studied procedures multiplied by the corresponding DRG weight of the procedure. The weight used was the modal DRG weight among all discharges in the state with that procedure (1). CMS uses the resource-intensity weights to estimate hospital resource use. For example, suppose that among patients living in an artificially small county of a hospital, there were 4 colorectal resections and 2 hysterectomies but none of the other six procedures listed in Table 1. The modal DRG weight for colorectal resection was 3.4 and for hysterectomy was 0.8. Thus, the weighted county discharges would be 15.2, where 15.2 = 4 x 3.4 + 2 x 0.8. "Contiguous county surgical discharges" were measured as for county demand, except that the geographic area included the hospitals county and those counties sharing a common border with the hospitals county.
Calculating Gaps in Procedure Caseloads Using DEA Figure 1 shows the number of CABG discharges at each hospital in the state plotted versus the weighted surgical discharges among patients from each hospitals county. The least squares regression line gives the average increase in the output (CABG per year) for each unit increase in the input (county weighted discharges). In contrast, DEAs efficient frontier is composed of the collection of hospitals providing for the maximum increase in the output achievable for a given level of input (1) (Appendix).
The study hospital S defines the efficient frontier. Every other hospital is inefficient versus this benchmark hospital, including the hospital performing the most CABG per year (Inefficient I). Because hospital I is above the regression line, hospital I performs more CABG than expected. Still, in this example with one output and input, it is inefficient at market capture for surgery relative to the benchmark hospital. DEA identified inefficiency that was missed by regression. We next envision DEA using the same input but with two outputs: craniotomy and nephrectomy (Fig. 2). To present this graphically in two dimensions we divide each hospitals procedure count by the weighted discharges among patients from the hospitals county. We show data for 9 of the 10 hospitals in the state with at least 10 discharges for both procedures. The study hospital is the one excluded. We label three hospitals A, B, and I.
Hospital I is an inefficient hospital in Figure 2. We project point I onto the efficient frontier, thereby obtaining a point on the figure labeled I, representing a virtual hospital. The efficiency score for hospital I equals the distance between (0,0) and the point on the figure labeled I divided by the distance between (0,0) and point on the figure labeled I. This ratio equals 0.30. Hospital I has 30% efficiency for surgical market capture versus its benchmark hospitals A and B. The efficiency score represents differences among hospitals in all procedures simultaneously (Appendix). Figure 2 also shows relative caseloads of nephrectomies and craniotomies. Points I and I have the same ratio of nephrectomies to craniotomies. The projection of point I onto the efficient frontier (i.e., point I) falls between the benchmark hospitals A and B. The efficient frontier line between A and B defines the range of best practice for the ratios of caseloads for nephrectomy and craniotomy. Hospital I is equally inefficient at market capture of both nephrectomies and craniotomies. Figure 3 uses the same hospitals as Figure 2 but considers a different inefficient hospital C, which performs equal numbers of nephrectomies and craniotomies. The efficient frontier between A and B shows that best practice is more craniotomies performed than nephrectomies. Thus, hospital C has a relative lack of craniotomies. The gap in craniotomies per weighted discharge equals the distance between point C and point A multiplied by hospital Cs efficiency score. The efficiency equals 32%, the distance between (0,0) and point C divided by the distance between (0,0) and point C. Figure 4 shows the efficient frontier of Figure 3 multiplied by 0.32, contracted to the scale of Hospital C.
In Figure 4, A equals 32% of A and B equals 32% of B. Hospital Cs gap in craniotomies expressed on a per county weighted discharge basis equals the distance between point C and point A. Thus, hospital Cs gap in craniotomies equals (C to A) multiplied by hospital Cs countys weighted discharges. In a short-term, 1-yr period, hospitals I and C are unlikely to change their overall efficiency of market capture for surgery substantively, as that would involve increasing all outputs. However, hospital C has the potential for simpler interventions such as recruiting another neurosurgeon. The DEA estimates the potential increase in craniotomies from publicly available state and provincial data. Thus, the DEA results are both relevant and available not just to physicians and administrators at hospital C but at other hospitals in proximity to hospital C. Their neurosurgical workloads are at risk for short-term strategic decisions by Hospital C. The gaps provide this information (Appendix). If a hospital does not perform a given procedure, by definition it has a gap in that procedure. This result is of no value to the hospital, as obviously it decided to not do the procedure. In addition, such gap values should not count toward the at-risk caseload for that procedure at other hospitals. Doing otherwise would neglect the expensive fixed costs and long set-up time required to add a surgical specialty at a hospital. Consequently, we apply thresholds for the analysis (1). Gaps are considered zero for hospitals with fewer than 10 discharges per year of abdominal aortic aneurysm, craniotomy, lung resection, or nephrectomy. Gaps are considered zero for hospitals with fewer than 20 discharges per year of CABG, colorectal resection, hip replacement, and hysterectomy. Using Figures 2 through 4, we showed how to calculate gaps for inefficient hospitals. We use the analogous method, known as the super-efficient model, to calculate gaps for the efficient hospitals (1,5,7). We previously performed several evaluations showing that the gaps predict hospitals relative deficits for specific procedures (1).
Applying DEA to Each Hospital When the DEA is scaled from the few dimensions of the figures to eight outputs and five inputs, the efficiency score for market capture of surgery contains a numerator and a denominator. The denominator of the efficiency score is a linear combination of the five input variables. In Figures 1 through 4, the weights equaled zero for all inputs but county weighted discharges. In reality, some hospitals efficiency scores are maximized by having all five weights non-zero. DEA automatically assigns each hospital the unique set of weights that maximizes its efficiency score. DEA thereby models physicians and administrators strategic decision-making based on the hospitals local marketplace, including the characteristics and number of nearby hospitals. For example, hospital I appears to be inefficient in Figures 2 and 3 because those figures use the weights chosen by DEA for study hospital S, with the only non-zero input weight being for county weighted discharges. Provided administrators and physicians at hospital I make strategic decisions based on maximizing market capture, then hospital I is efficient (Fig. 5). Hospital I competes effectively with the other three large hospitals in its city by offering the maximum high-tech services.
The numerator of the efficiency score is a linear combination of the caseload of each of the eight studied procedures. DEA assigns each hospital the unique set of weights that maximizes its efficiency score. DEA thereby models physicians and administrators preferential focus on those surgical specialties at which the hospital excels. Even if a hospital does not perform a procedure, the hospital may still be efficient by capturing the surgical market for the procedures it does perform.
Interpreting Caseload for the Eight Common Procedures
Predicting DEA Results Using Less Than Full Information A hospital may not have ready access to its states or provinces hospital discharge data, and want to avoid purchasing the data. An analyst who has worked with data from one state may want to apply it to a hospital in another state to get quick, "close enough," answers. We assessed the efficiency of Pennsylvania hospitals using a jackknife method, in which each studied Pennsylvania hospital (1) was modeled using all of the hospitals from the rural state. Estimates of the gaps were compared.
The study hospitals efficiency score was maximized using one input (county weighted discharges) and two outputs (nephrectomy and craniotomy). Figure 6 shows Figures 2 through 4 plus the study hospital S.
The binding constraint on the study hospitals market capture was the number of weighted discharges among people living in the hospitals county. This makes intuitive sense because its hospital beds are 100% of maximum (i.e., more than any other hospital in the state), surgeons 75% of maximum, technology index 100% of maximum, and region weighted discharges 63% of maximum, whereas county weighted discharges are only 18% of maximum. This answers the first question in the Introduction. Although the hospitals cardiac surgery workload is half that of hospital I with the largest workload, on a per county weighted discharge basis the study hospital is efficient (Fig. 1). Already the percentages of patients having surgery at the study hospital that were not from the hospitals county were 98% for nephrectomy and 94% for craniotomy and CABG. Neither adding OR time, reducing turnovers, nor buying more equipment is likely to increase cardiac surgery workload substantively. The second question in the Introduction is answered by the finding of zero gaps for all procedures. The thoracic surgeons are doing as much surgery as expected based on the hospitals visibility in the marketplace and its countys and regions weighted discharges. There is another hospital in the study hospitals county (Table 2)(11). That hospital is also efficient at market capture for elective inpatient surgery, has zero gaps for the eight studied procedures, and has county weighted discharges as its binding constraint on surgical workload. Aligning hospital discharge and Census 2000 data, county weighted discharges may be relatively small because the countys population is 30% of maximum and weighted discharges on a per capita basis is 38% of maximum.
The study hospitals county has the smallest per capita population of Medicare eligible patients of all counties in the state. If 2 hospitals have equal market visibility, but 1 is 10 miles further away from the residence of a Medicare beneficiary, the odds are <50% that the patient will choose the hospital that is further away (4). Thus, the surgical workloads at both the study hospital and the other hospital in its county are sensitive to the degree to which retirement communities are established within their county, thereby affecting the number of local residents who are likely to need surgery. The third question in the Introduction is answered by reviewing gaps of hospitals with market areas for orthopedics that overlap with the market area of the study hospital (Table 2). The study hospitals orthopedic workload is highly sensitive to changes in decision making at nearby competing hospitals. For example, in counties contiguous to the study hospitals county, one of the six hospitals puts surgical workload at the study hospital at risk. That hospitals gap in orthopedic surgery equals 40% of the current orthopedic workload at the study hospital. In the broader market area, gaps of other hospitals total 124% of the current orthopedic workload at the study hospital. Performing DEA for hospitals in the market area of the study hospital reveals which specialties workloads at the study hospital are relatively secure from other hospitals short-term strategic decisions. Those specialties are vascular, cardiac, and neurological surgery (Table 2). Workloads in thoracic and urological surgery are potentially sensitive to decisions by one hospital. Workloads of gynecological surgery at the study hospital may be highly at risk.
Predicting DEA Results Using Less Than Full Information
Hospital characteristics alone require less processing of hospital discharge data. For the rural state, 6% of hospitals would get erroneous results. As a comparison, 15% would be erroneous for the studied Pennsylvania hospitals (Table 3). Each hospital can readily obtain its own data from internal sources. Its gap could be calculated using data from hospitals in other states or provinces. The DEA automatically finds similar hospitals. However, the performance was very poor in that erroneous results were obtained for 98% of hospitals (Table 3).
We previously showed the validity of using DEA to determine by how much hospitals can increase elective inpatient surgical workloads for each specialty (1). Results for the study hospital in this paper illustrate the usefulness and limitations of applying DEA to assess hospital market capture for surgery. The case study shows that DEA may be of value to heads of anesthesia groups in recruitment decisions. The DEA may also be useful for OR managers and surgical services committees, with discretion in how increases in operational budgets are allocated and how capital purchases are chosen. Equivalently, the method provides analysis that may be useful for presenting the rationale for increases in operational budgets and/or capital purchases to a hospitals larger budget committee. A foundation to applying DEA to estimate market capture for inpatient surgery is the automatic evaluation of the correlations in different specialties workloads (Appendix). The fundamental reason why the DEA works (1) is that a hospitals orthopedic workload is predicted well by the hospitals workloads of other specialties. Generally, big hospitals do many cases of all types of surgery. However, some hospitals officially or practically specialize in some surgical specialties. The DEA considers this automatically by creating a separate model for each hospital. This is markedly different from how multivariate regression analysis functions, using the same model for all hospitals. Data need to be obtained from the studied state or province (Table 3). All the studied input variables need to be included in the DEA. There does not appear to be a simplification to doing the full analysis. As found previously (1), there was strong correlation between caseloads of the studied procedures and their specialties inpatient workloads (Table 1). Caseload is a reliable surrogate for inpatient surgical workload. Perfect correlations should not be expected because the workload of a specialty is poorly defined, incomplete, and prone to measurement error. This is why we apply DEA to procedure counts (1). Similar analyses can be applied to any state, region, or organization that collects discharge data. In 2003, 30 states participated in data collection for the State Inpatient Databases as part of AHRQs Healthcare Cost and Utilization Project. However, only a few states record outpatient surgery, and some that do so focus only on specific populations such as children. Although we foresee no theoretical reason why the DEA model would not work for freestanding ambulatory surgery centers, because of these data limitations, the DEA can only be applied, currently, to assess inpatient surgery. In the previous article (1) and in the current one, we used "County demand" and "Contiguous county demand" to describe regional differences in surgical caseloads. In metropolitan areas (>1 million people), differences among zip codes may be more appropriate. The rural state studied in this paper had no metropolitan areas. We do not know whether the DEA would be useful for describing market capture of patients who have a choice of many hospitals in a metropolitan area. When a gap is positive, there is potential for the hospital to increase the specialtys workload. That does not mean that increasing workload would benefit the hospital financially. In practice, the opposite may occur. In addition, there may not be sufficient operational capacity to recruit another surgeon. These issues should be considered when interpreting DEA results. Doing so is not limiting because financial assessment for different surgical specialties, including consideration of capacity constraints, is well developed (8). Political issues may prevent direct reduction of workload in a given subspecialty, even though the contribution margin per OR hour is much less for that subspecialty versus other subspecialties that are eager for more resources. In that situation, having the subspecialtys workload being at risk from another hospital may be a blessing for administrators. Workload at risk is not necessarily disadvantageous. The need for considering DEA results with a simultaneous financial analysis does not apply to professional groups making hiring decisions. The danger to them is in recruiting physicians and staff without achieving an increased workload. The gaps alone address this problem. The alternative approach is to perform a retrospective analysis (e.g., using the previous 48 weeks of surgical specialties OR workloads) (9) and to adjust staffing accordingly (10). The gaps provide additional information because they assess the effect of potential decisions made by nearby hospitals.
We use the following notation. There are n hospitals, k = 1, 2,..., n, each producing p surgical procedures, p = 1, 2,..., 8. The outputs (i.e., number of discharges) for the rth procedure at the kth hospital equals Yr,k, r = 1,..., p. There are m input factors that determine a hospitals potential elective surgical workload, with m = 5 for this study. The ith strategic (input) factor at the kth hospital equals Xi,k, i = 1,..., m. The efficiency score of the kth hospital is 1/ k. Slacks in the outputs and inputs for the kth hospital are represented by Sr,kout and Si,kin, respectively. Gaps in the outputs are represented by gr,kout. .
Using linear programming, solve (1,7):
The estimate of the efficient frontier is the piecewise linear convex combination of all hospitals with efficiency scores 1/
Equations 1 through 3 can be shown to be identical to:
The above equations are derived from the Output-Oriented CCR DEA model (12). Because the
Dr. Dexter is Director of the Division of Management Consulting, which is a Division of the Department of Anesthesia, analogous to the Division of Obstetrical Anesthesia. He receives no funds personally other than his salary from the State of Iowa, including no travel expenses or honorarium, and has tenure with no incentive program.
Presented, in part, at the American Association of Clinical Directors and the American Society of Anesthesiologists meetings in San Francisco, California, October, 2003, and at the Society for Technology in Anesthesia meeting in Albuquerque, New Mexico, January, 2004.
This article has been cited by other articles:
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|