Richard T. Meenan, Ph.D., M.P.H.a; Craig Fleming, M.D.a; Evelyn P. Whitlock, M.D., M.P.H.a; Tracy L. Beil, M.S.a; Paula Smith, B.S.N.a
The authors of this article are responsible for its contents, including any clinical or treatment recommendations. No statement in this article should be construed as an official position of the Agency for Healthcare Research and Quality, the Centers for Disease Control and Prevention, or the U.S. Department of Health and Human Services.
Address correspondence to: Richard T. Meenan, Ph.D., M.P.H., Oregon Evidence-based Practice Center, Kaiser Permanente Center for Health Research, 3800 North Interstate Avenue, Portland, Oregon 97227. Phone: (503) 335-2400. Fax: (503) 335-2424. E-mail: Richard.Meenan@kpchr.org.
Select for copyright information.
Background
Methods
Results
Conclusions
Acknowledgments
References
Notes
In 1996, the U.S. Preventive Services Task Force (USPSTF) found insufficient evidence to recommend for or against routine screening of asymptomatic adults for abdominal aortic aneurysm (AAA) either with abdominal palpation or ultrasonography. The USPSTF did recognize that selective screening of high-risk patients might be beneficial, for example, in men with other risk factors such as peripheral vascular disease or a family history of AAA. However, the USPSTF stated clearly that there was no direct evidence that screening for AAA reduces mortality or morbidity in any population.
In 2002, the Research Triangle Institute-University of North Carolina (RTI-UNC) Evidence-based Practice Center (EPC) performed a topic review of AAA screening. The USPSTF used this review to prioritize AAA screening as a topic requiring an update. Two key developments were cited in prioritizing AAA screening as a topic to be updated in an evidence synthesis:
In 2003-04, the Oregon EPC conducted an evidence synthesis of AAA screening, which was led by researchers at the Kaiser Permanente Center for Health Research in Portland, Oregon. Within the overall scope of this update, which was to focus primarily on effectiveness, the Oregon EPC was also charged with evaluating the feasibility of integrating published evidence on the cost-effectiveness of AAA screening. Many factors related to AAA screening will have differential effects on the costs and yields of screening asymptomatic adults for AAA. Economic evaluations and cost-effectiveness analyses (CEA), in particular, can summarize the expected benefits, harms, and costs of screening asymptomatic adults.
Therefore, in conjunction with the evidence synthesis,1 we also conducted a systematic review of published CEAs to evaluate the costs and benefits of screening asymptomatic adults for AAA. This ancillary CEA review was intended to inform the deliberations of the USPSTF regarding the overall appropriateness of AAA screening.
To guide our search, our first task was to develop a preliminary set of key questions around the cost-effectiveness of population-based AAA screening. Subsequent consultation with members of the USPSTF helped us refine the key questions into their final form.
Our set of key questions initially included 2 questions on endovascular AAA repair (EVAR). However, discussions with experts on the USPSTF led us to conclude that data on the effectiveness of EVAR were too preliminary to meaningfully inform the cost-effectiveness issues surrounding population-based AAA screening.
In our literature search, we sought studies that reported both costs and health outcomes of population-based screening programs for AAA. We searched MEDLINE®, the Cochrane Central Register of Controlled Trials, and the National Health Service Economic Evaluation Database; we limited our search of each database to publication dates between 1994 and 2004. Search strategies were organized using a combination of controlled vocabulary terms, where available, and free text terms (Appendix 1). These strategies were subsequently combined with those designed for identification of effectiveness studies in each database. The final search was conducted in April 2004. To identify studies not captured in our database searches, we manually searched reference lists of retrieved articles and solicited input from experts on the USPSTF.
One author (Meenan) reviewed identified abstracts for potentially eligible articles, which were then retrieved for full review. Based on information within the abstracts, we sought studies that addressed both the costs and health outcomes of population-based AAA screening.
We excluded studies that were:
For each included study, we extracted and summarized selected elements into 2 evidence tables (Tables 1 and 2): authors, publication date, screening intervention, screening interval, study time horizon, baseline group, AAA size motivating treatment, prevalence of AAA, AAA-specific mortality, operative mortality rates (elective and emergency), AAA rupture rate, analytic approach (trial-based vs non-trial-based), study perspective, data sources, utility measures (if any), discount rate, cost measures, cost-effectiveness results, and sensitivity analyses.
We abstracted relevant data from each study into a Microsoft® Access database developed in 1997 for use by the Committee on Clinical Prevention Priorities.2,3
We then organized the included studies by key question (allowing studies to address more than 1 key question) and evaluated the quality of each against the following 13 criteria based on those presented in Saha,4 and which themselves are based on recommendations of the Panel on Cost-Effectiveness in Health and Medicine.5
We used these criteria to guide our categorization of studies as good, fair, or poor. Quality grades were assigned based on a subjective assessment of study design and quality of data inputs. The intent of our review was to focus on good quality studies, with fair quality studies also considered as appropriate. Poor quality studies were excluded from further review. (Our definition of fatal study flaws that would lead to a poor quality rating is provided in Appendix 2.) The goals of our systematic CEA review were to identify the best available evidence regarding a particular key question, and to critically review and synthesize that evidence to answer the question in an evidence-based way.
We initially reviewed the abstracts of 241 studies and identified 25 definite or possible economic evaluations, for which we reviewed the full articles. We determined that 4 were relevant to 1 or more key questions. The other 21 articles were excluded from further analysis, either because they were not a CEA (or other form of economic evaluation such as a cost-benefit analysis) or were not relevant to any key question. Where necessary, we converted results reported in non-U.S. currency to U.S. dollars, and used the Medical Care component of the Consumer Price Index to convert all results to 2003 dollars.
We determined that 1 good-quality study (the Multicentre Aneurysm Screening Study6 [MASS]) and 2 fair-quality studies7-8 addressed the primary key question regarding the overall cost-effectiveness of population-based AAA screening. MASS6 was trial-based; the others were based on published literature and/or data from a single hospital or health system.
As will be discussed further, the superior quality of its effectiveness data distinguished MASS from "fair" studies such as those conducted by Lee, et al., and Frame, et al. In addition, we believe that the detailed micro-costing approach used in the MASS CEA, as well as its use of probabilistic sensitivity analysis, mitigated its being set outside the United States (it was conducted in the United Kingdom) and justified a "good" quality rating. "Fair" quality ratings were assigned to studies based primarily on the uncertain quality of their effectiveness and/or cost data, even if most other favorable design characteristics were present. Poor studies combined lower-quality effectiveness and/or cost data with an absence of most other favorable design characteristics—e.g., no downstream costs, no health state utilities. No study (including MASS) was conducted from the societal perspective.
Each study considered population-based screening of adult males by ultrasonography compared with no screening, although screening protocols differed:
The studies also used different time horizons:
Over 4 years in the MASS6 trial, AAA screening generated an "incremental" cost-effectiveness ratio (ICER) of $57,000/life-years (LY), $72,000/QALY (quality-adjusted life-years) relative to no screening. (It must be emphasized that these ratios are not truly "incremental" because no study compared population-based screening with targeted screening, a more meaningful comparison, but rather only to the absence of screening.)
When life savings were projected out 6 years for a total 10-year time horizon, the ICER for screening dropped to $16,000/LY (approximately $20,000/QALY). This latter estimate is similar to Lee, et al.'s baseline ICER for screening of $14,000/QALY.7 However, Frame, et al.8 obtained a significantly higher ICER of $72,000/LY for onetime ultrasonography screening ($50,000/LY for physical exam plus ultrasonography for positives).
Each study used a different base case discount rate:
The use of different discount rates in MASS6 is not currently recommended practice, although proponents argue that it is appropriate if one believes that the value of health increases over time.9 In any case, it introduces bias in favor of screening—i.e., lower ICERs—by raising the value of benefits relative to costs. In a sensitivity analysis, MASS6 applied a 3-percent discount rate to both costs and benefits, which raised the ICER for AAA screening over 4 years to approximately $62,000/LY ($78,000/QALY).
Next, we discuss aspects of each model that we believe influenced their specific results:
These authors applied detailed micro-costing to both the screening process itself and the surgical procedures, and included downstream costs related to post-surgical life expectancy. This was also the only study of those we reviewed to use probabilistic sensitivity analysis. The authors also acknowledged that the focus of the MASS trial was AAA-specific mortality; univariate sensitivity analysis suggested that focusing on all-cause mortality would lower the ICER of screening by over half ($26,000/LY) relative to the 4-year estimate of $57,000/LY. The authors did not explain their calculations; we inferred that the lower ICER using all-cause mortality results from the greater absolute number of deaths prevented over the 4-year trial period (105 [all-cause mortality] vs 48 [AAA-specific mortality]).
Micro-cost estimates for screening and treatment (from the health system perspective) came from a literature review and a single hospital (New York Presbyterian). Disease-specific long-term cost and quality-of-life estimates were included for renal failure, stroke, major amputation (related to diabetes), and myocardial infarction. Univariate sensitivity analyses were conducted focusing on AAA prevalence in the screened population, annual incidental detection rate in the unscreened group, and age at initial screening.
Cost data came from a systematic review by the Canadian Task Force on the Periodic Health Examination, MEDLINE®, and article bibliographies. Gross-cost values from the health system perspective for surgery, ultrasonography tests, and followup office visits were taken from earlier literature. This study's estimates of surgical costs ($46,000 for elective and $90,000 for emergency surgery in year 2003 dollars) were significantly larger than estimates in most subsequent studies. Downstream costs post-treatment were included. The only sensitivity analyses presented varied parameters simultaneously between their most and least favorable values for screening. Frame, et al.8 also found that for both screening protocols, a second screen 5 years after the first generated ICERs that were quite large ($1.5 million/LY relative to a single ultrasonography and $1.3 million/LY relative to abdominal palpation with an ultrasonography for positive results).
Two fair-quality studies, by Lee, et al.,7 and Soisalon-Soininen, et al.,15 addressed the cost-effectiveness of selective screening for patients with higher rupture risk. Lee, et al.7 examined the effects of age at initial screening and AAA prevalence at initial screening, which served as a proxy for specific risk factors: sex (7 percent males, 1 percent females, 4 percent females > age 60), circulatory disease (9-12 percent), smoking history (17 percent), or family history of AAA (19 percent). Soisalon-Soininen, et al.15 examined selective screening of male relatives > age 50 of AAA patients. Life-expectancy was modeled using all-cause mortality over a 17-year time horizon. Both studies compared targeted screening with no screening; neither compared routine, but systematic, population-based screening with targeted screening.
Lee, et al.7 found that screening males beginning at age 60 (vs age 70 at baseline) lowers the ICER from $14,000/QALY to approximately $5,000/QALY. In generating the latter result, Lee, et al.7 maintained the baseline AAA prevalence estimate of 7 percent. By age 83, the ICER rises to $60,000/QALY. AAA prevalence at initial screening of 2 percent or higher generates an ICER of $10,000/QALY or below—e.g., a 19-percent prevalence (proxy for family history of AAA) generates an ICER of $8,460/QALY.
In Soisalon-Soininen, et al.15 screening male relatives > age 50 generates an ICER of $8,900/LY; note that their denominator does not include quality adjustments, so their ICER in terms of QALYs would be somewhat higher than reported. However, also note that Soisalon-Soininen et al.'s cohort is younger than Lee, et al.'s (age 50 vs 70), and has a much lower AAA prevalence than Lee et al.'s (8.2 percent based on their own data vs 19 percent from the literature).
One might expect that using comparable ages would tend to widen the gap between the ICER estimates, but that using comparable prevalence values would tend to bring them closer together.
No identified study addressed the specific issue of periodic surveillance vs one-time screening.
No identified study addressed the specific issue of targeting persons without AAA on initial screening for subsequent re-screening.
Only MASS6 addressed differences in treatment effectiveness on the cost-effectiveness of AAA screening. MASS6 focused on AAA-specific mortality—i.e., "survival free from mortality related to abdominal aortic aneurysms for each individual up to 4 years," and including 30-day peri-operative mortality. In sensitivity analyses, the authors substituted all-cause mortality from the trial for AAA-related mortality, and found that the ICER for screening fell by roughly half ($26,000/LY). The authors acknowledged that the trial was not powered to detect changes in all-cause mortality, and the difference between screening and no screening for such mortality was not significant. Extending the time horizon from 4 to 10 years lowered the baseline ICER (again, in terms of AAA-specific mortality) from $57,000/LY to $16,000/LY.
Existing evidence—e.g., MASS6, Lee, et al.7— points to a cost-effectiveness ratio for population-based AAA screening (compared with no screening) that lies in the range of $14,000 to $20,000/QALY. The much higher ICER obtained by Frame, et al.8 is explained at least in part because of relatively higher surgical cost estimates, which are no longer appropriate. Applying current discounting practice to the MASS results would raise its estimated ICER above $20,000/QALY, although how much is uncertain. In any case, no study compared population-based screening with targeted screening, which would be a more appropriate comparison.
These results rely on the quality of the effectiveness estimates, which is an open question based on our associated systematic review. Each effectiveness model review showed, at best, modest gains in life expectancy ranging from 2 days to 4 months favoring screening vs no screening, and immediate repair vs surveillance for moderate-sized AAAs. In each case, concerns regarding the structure or assumptions of the models indicate that even these modest gains may be overstated. Our assessment is supported by the results of clinical trials examining both screening and management of moderate-sized AAAs that show no differences in all-cause mortality.
In any case, current evidence addressing the cost-effectiveness of population-based AAA screening is extremely limited. Although more recent trial data on mass screening have been generated, to date only MASS has produced a CEA based on such data. Also, our evidence synthesis1 concluded that evidence of the effectiveness of EVAR, especially over the longer term, did not yet exist; therefore, we chose early on to exclude EVAR from our review process. Evidence that addresses important economic dimensions of screening—e.g., effectiveness (and appropriate targets) of selective screening, surveillance of small AAAs, re-screening of individuals without AAA, appropriate effectiveness measures—is nearly non-existent. The quality of cost data varies significantly. All analyses reviewed were conducted from the health system perspective. None considered patient-incurred burdens of time and money related to AAA screening and treatment. It is unknown whether their inclusion would alter policy implications about the cost-effectiveness of AAA screening, but valid measures of them would be helpful.
CEA of AAA screening would benefit considerably from more extensive sensitivity analyses. A general limitation across studies is a focus on univariate sensitivity analysis without consideration of plausible connections between parameters—e.g., age and rupture risk. MASS6 provides a framework for the future application of probabilistic sensitivity analysis, which could inform CEA users of the likely robustness of ICER estimates based on changes in AAA-related mortality.
Also, most studies took the design of the screening program as given, especially the screening interval. Future analyses should explore implications of variations in the interval of screening—e.g., semi-annual vs annual vs bi-annual. Furthermore, as we have noted, comparisons were made between a screening program and usual care (no screening), which tends to bias results toward screening. In cases where a targeted screening program is of interest, it would be useful to compare the targeted program with a systematic population-based program as well as, or in lieu of, usual care.
In conclusion, currently available evidence suggests that population-based AAA screening may have the potential to produce a year of life at reasonable cost, but new CEAs based on recently completed screening trials are needed before formal policy recommendations will be appropriate.
Additional members of the Oregon EPC project team include Daphne Plaut, M.L.S., research librarian. Members of the USPSTF who served as leads for this project include Ned Calonge, M.D., M.P.H.; Russell Harris, M.D., M.P.H.; Mark S. Johnson, M.D., M.P.H.; Diana B. Petitti, M.D., M.P.H.; and Steven M. Teutsch, M.D., M.P.H.. The authors would like to thank David Ballard, M.D., Ph.D., and the other reviewers for their contributions to this project. Finally, the authors thank Joanna Siegel, Sc.D., and Gurvaneet Randhawa, M.D., M.P.H., of AHRQ, for their many cogent observations throughout the course of the project.
This study was conducted by the Oregon Evidence-based Practice Center under AHRQ contract No. 290-97-0018, Task Order No. 2, Rockville, MD.
1. Fleming C, Whitlock EP, Beil T, Lederle F. Primary Care Screening for Abdominal Aortic Aneurysm. Evidence Synthesis No. 35 (Prepared by the Oregon Evidence-based Practice Center under Contract No. 290-02-0024.) Rockville, MD: Agency for Healthcare Research and Quality. February 2005. (Available on the AHRQ Web site at: www.ahrq.gov/clinic/serfiles.htm.)
2. Maciosek MV, Coffield AB, McGinnis JM, et al. Methods for priority setting among clinical preventive services. Am J Prev Med 2001;21(1):10-9.
3. Coffield AB, Maciosek MV, McGinnis JM, et al. Priorities among recommended clinical preventive services. Am J Prev Med 2001;21(1):1-9.
4. Saha S, Hoerger TJ, Pignone MP, Teutsch SM, Helfand M, Mandelblatt JS; Cost Work Group, Third U.S. Preventive Services Task Force. The art and science of incorporating cost effectiveness into evidence-based recommendations for clinical preventive services. Am J Prev Med 2001;20(3 Suppl):36-43.
5. Gold MR, Siegel JE, Russell LB, Weinstein MC. Cost-effectiveness in Health and Medicine. New York: Oxford University Press, 1996.
6. Multicentre Aneurysm Screening Study Group. Multicentre aneurysm screening study (MASS): cost effectiveness analysis of screening for abdominal aortic aneurysms based on four year results from a randomised controlled trial. BMJ 2002;325:1135-8.
7. Lee TY, Korn P, Heller JA, et al. The cost-effectiveness of a "quick-screen" program for abdominal aortic aneurysms. Surgery 2002;132(2):399-407.
8. Frame PS, Fryback DG, Patterson C. Screening for abdominal aortic aneurysm in men ages 60 to 80 years. A cost-effectiveness analysis. Ann Intern Med 1993;119(5):411-6.
9. Gravelle H, Smith D. Discounting for health effects in cost-benefit and cost-effectiveness analysis. Health Econ 2001;10(7):587-600.
10. Ashton HA, Buxton MJ, Day NE, et al. The Multicentre Aneurysm Screening Study (MASS) into the effect of abdominal aortic aneurysm screening on mortality in men: a randomised controlled trial. Lancet 2002;360(9345):1531-9.
11. Harris RP, Helfand M, Woolf SH, et al. Methods Work Group, Third U.S. Preventive Services Task Force. Current methods of the U.S. Preventive Services Task Force: a review of the process. Am J Prev Med 2001 Apr;20(3 Suppl):21-35.
12. Lederle FA, Johnson GR, Wilson SE, et al. Prevalence and associations of abdominal aortic aneurysm detected through screening. Aneurysm Detection and Management (ADAM) Veterans Affairs Cooperative Study Group. Ann Intern Med 1997;126(6):441-9.
13. Lederle FA, Wilson SE, Johnson GR, et al. Immediate repair compared with surveillance of small abdominal aortic aneurysms. N Engl J Med 2002;346(19):1437-44.
14. United Kingdom Small Aneurysm Trial Participants. Mortality results for randomized controlled trial of early elective surgery or ultrasonographic surveillance for small abdominal aortic aneurysms. Lancet 1998;352(9141):1649-55.
15. Soisalon-Soininen S, Rissanen P, Pentikäinen T, Mattila T, Salo JA. Cost-effectiveness of screening for familial abdominal aortic aneurysms. VASA 2001;30:262-70.
[a] Meenan, Fleming, Whitlock, Beil, Smith: Oregon Evidence-based Practice Center, Center for Health Research, Kaiser Permanente, Portland, Oregon.
This document is in the public domain within the United States. For information on reprinting, contact Randie Siegel, Director, Division of Printing and Electronic Publishing, Agency for Healthcare Research and Quality, Suite 501, 2101 East Jefferson Street, Rockville, MD, 20852.
Requests for linking or to incorporate content in electronic resources should be sent to: info@ahrq.gov.
AHRQ Publication No. 05-0569-C
Current as of February 2005
Internet Citation:
Meenan RT, Fleming C, Whitlock EP, et al. Cost-Effectiveness Analyses of Population-Based Screening for Abdominal Aortic Aneurysm. Evidence Synthesis. AHRQ Publication No. 05-0569-C, February 2005. Agency for Healthcare Research and Quality, Rockville, MD. http://www.ahrq.gov/clinic/uspstf05/aaascr/aaacost.htm
USPSTF Topic Index
USPSTF Clinical Categories
U.S. Preventive Services Task Force (USPSTF)
Clinical Information
AHRQ Home Page