Online Performance Appendix: Performance Detail (by Activity) Budget Estimates for Appropriations Committees, Fiscal Year 2011This appendix provides more detailed performance information for all HHS measures related to the Agency for Healthcare Research and Quality's budget. Patient-Centered Health ResearchThe Effective Health Care Program, launched in September 2005, supports the development of new scientific information through patient-centered health research on the outcomes of health care services and therapies, including drugs. By reviewing and synthesizing published and unpublished scientific studies, as well as identifying important issues where existing evidence is insufficient and undertaking new research, the program helps provide providers, clinicians, policymakers, and consumers with better information for making informed health care treatment decisions. In this program, AHRQ seeks an emphasis on timely and usable findings, building on the thoroughness and unbiased reliability that have been hallmarks of efforts so far. Equally important is broad ongoing consultation with stakeholders, which helps ensure that the program responds to issues most pressing for health care decisionmakers. Collaboration is also a key principle of the program and AHRQ works closely with many agencies of the Department of Health and Human Services (HHS) to identify topics for research under the program and to communicate findings, including identified research gaps.One measure the Effective Health Care Program uses to evaluate its success is the amount of evidence made available to the public. In FY 2006, the program released four systematic reviews and one summary guide. In FY 2007, the program released four systematic reviews and eight summary guides. Four new research reports, including a user's guide to registries evaluating patient outcomes and a Medical Care journal supplement on emerging methods in comparative effectiveness and safety, were also released. In FY 2008, the program released 7 systematic reviews and 12 summary guides including 2 guides that were translated into Spanish. In FY 2009, the program released 6 systematic reviews, 16 new research and 13 summary guides with audio files and translated into Spanish. This information is reported in key output #4.4.5 in section D, Outputs and Outcomes Tables. Because the FY 2010 non-Recovery act appropriation did not include funding for systematic reviews or their translation, the related output in FY 2010 and FY 2011 is expected to be greatly diminished. However, in FY 2010 $25 million in Recovery Act funds will support increased production of systematic reviews which are reflected in Recovery Act performance measure AHRQ ARRA 1 on page 9 of the 2011 AHRQ Congressional Justification published at http://www.ahrq.gov/about/cj2011/cjweb11.htm.The Effective Health Care Program produces a variety of information products to help patients and their families understand the effectiveness and risks of different treatment options while allowing for choices based on the circumstances of the individual patients. Key output measures #4.4.5 and #1.3.25 focus on the production and dissemination of the information products, systematic reviews and summary guides. The program also produces new research reports, clinical research studies that draw on health care databases, electronic patient registries, and other scientific approaches to explore practical questions about the effectiveness, safety and appropriateness of treatments. AHRQ is working to further develop key output measures #4.4.5 and #1.3.25 in order to capture data on the production and dissemination of all information products produced by the Effective Health Care Program that could help us meet our long-term objective to improve patients' quality of care and health outcomes through informed decisionmaking by patients, providers, and policymakers.All reports produced by the program are available on the Effective Health Care Web site, http://www.EffectiveHealthCare.ahrq.gov. In FY 2009, the Web site was significantly enhanced to improve usability. The Web site also includes features for the public to participate in the Effective Health Care Program. Users can sign up to receive notification when new reports are available. They can also be notified when draft key questions for research, draft reports, and other features are posted for comment, and comments can be submitted through the Web site. The public is also invited to use the Web site to nominate topics for research by the Effective Health Care Program. The priority conditions which guide the work of the program are targeted to Medicaid, Medicare, and SCHIP (State Children's Health Insurance Program) beneficiaries (see text box).Effective Health Care Priority ConditionsArthritis and non-traumatic joint disordersCancerCardiovascular disease, including stroke and hypertensionDementia, including Alzheimer DiseaseDepression and other mental health disordersDevelopmental delays, attention-deficit hyperactivity disorder, and autismDiabetes MellitusFunctional limitations and disabilityInfectious diseases including HIV/AIDSObesityPeptic ulcer disease and dyspepsiaPregnancy including pre-term birthPulmonary disease/AsthmaSubstance abuseThere is growing interest in, and attention to, enhancing the role of the Effective Health Care Program's research in our health care system. For example:Consumer Reports Best Buy Drugs, a public education product of Consumers Union, uses findings from the program to help clinicians and patients determine which drugs and other medical treatments work best for certain health conditions. Over the course of the project, more than 1 million reports have been downloaded. In addition to the consumer materials and reports being disseminated via the Web site, they are disseminated by a Best Buy Drugs outreach program that links to existing groups with statewide reach and credibility throughout the medical community.The National Business Group on Health also uses findings from the Effective Health Care Program in their Evidence-based Benefit Design initiative to provide employers and their employees' best available evidence for designing benefits and making treatment choices.Omnicare, Inc., a leading provider of pharmaceutical car7e for the elderly, uses Effective Health Care Program summary guides as a tool for its consultant pharmacists and facilities, which are primarily nursing homes. Omnicare serves approximately 1.4 million residents in more than 15,000 long-term care facilities in 47 States, Washington, DC, and Canada.Su Clinica Familiar, a multi-office health clinic in south Texas, uses AHRQ's Effective Health Care Program summary guides for clinicians and patients to better address concerns of patients and as teaching resources for patients.Medscape and the American Academy of Family Physicians offers continuing medical education (CME) based on research reviews, and numerous other organizations use the findings in their deliberations on patient care, formulary design, and areas for needed research.AHRQ executed an agreement with AARP in 2009 that provides for the co-branding of Effective Health Care consumer summary guides on five different topics—treatments for depression, gastroesophageal reflux disease (GERD), osteoarthritis, hypertension, and osteoporosis. AARP has agreed to offer the publications on the "Know Your Rx Options"page of the AARP Web site and on its printed publications order form that is distributed via AARP state offices. The co-branded guides would also be promoted through AARP's employer outreach program. Further promotion may occur through AARP's nationwide "bus tour" co-sponsored by Walgreen's.The Society for Academic Continuing Medical Education (SACME) devoted a session of its 2009 annual meeting to comparative effectiveness and Effective Health Care. The session was promoted in SACME's newsletter, INTERCOM. SACME's meeting prompted medical school CME directors, deans, professors and others to order 11,036 copies of clinician guides on insulin analogs and treatments for osteoarthritis of the knee. Among those placing orders were Duke, University of Pennsylvania, University of Virginia, Dartmouth and University of California, San Francisco. The organization subsequently coordinated with AHRQ to distribute Effective Health Care summary guides and promotional materials to its 300 members through a direct mailing effort in 2009.In 2009, the Johns Hopkins Office of Continuing Medical Education sent E-mails highlighting the Effective Health Care Program to more than 100,000 physicians, nurses, physician assistants, and others who have participated in Hopkins' CME activities. The E-mails, also sent to Hopkins faculty, included promotional information and links to announcements that encourage clinicians to access Effective Health Care summary guides on osteoarthritis and Type 2 diabetes medications. Hopkins has added the Effective Health Care Program link to its resource page.The American Osteopathic Association (AOA) place half-page ads in their April and May 2009 editions of their professional journal. The May ad encourages clinicians to order up to 200 free copies of summary guides. The circulation of the Journal of the American Osteopathic Association is about 65,000. The AOA has also promoted Effective Health Care Program materials through several other channels, including the AOA Executive Director's daily blog and the AOA Web site.Winn-Dixie, a grocery chain based in Florida, has agreed to distribute several CE consumer brochures as part of its grassroots community wellness initiative to underserved populations. The brochures on pain medicine for osteoarthritis, antidepressants, and pills for type 2 diabetes also may be part of an in-store giveaway at Winn-Dixie in 2010.The New Mexico Medical Society has agreed to place an Effective Health Care program newsletter announcement, an ad in an upcoming membership publication, and a link on its Web site to announce the availability of clinician summary guides. The society encouraged its 3,000 members, who represent 85 percent of the practicing physicians in the State, to order the guides. In addition, the National Hispanic Medical Association, which represents 36,000 Hispanic physicians in the United States, has alerted its members via E-mail in 2009 that the Effective Health Care program now has Spanish-language consumer guides available on nine topics.These examples of organizations disseminating evidence from the Effective Health Care Program to their constituents are directly linked to key output (#1.3.25) listed in section D, Output and Outcomes Tables.Key output #1.3.26 in section D, Outputs and Outcomes Tables, increases the amount of evidence from the PCHR portfolio that policymakers use as a foundation for population-based policies and helps guide our relationship with the AHRQ-sponsored Medicaid Medical Director's Learning Network. Twenty three State Medicaid Medical Directors report that they use Effective Health Care Program resources in a variety of ways. For example, they are incorporated into clinical guidelines created and disseminated by the States, incorporated into health plan educations materials, and used to inform coverage decisions and to set criteria for prior authorization.As written, key output #1.3.26 focuses on one stakeholder group of importance to the Effective Health Care Program. Since AHRQ's long-term objective is to improve decisionmaking by patients, providers, and policymakers, we are working to further develop and expand this measure so that we can capture data on how other important stakeholder groups, specifically clinicians, are using the program's materials to help inform decisions.Developmental measure #1.3.24 is to decrease mortality from and increase receipt of recommended care for subset of diseases measured and reported on in the National Health Care Quality Report. In the process of developing this measure, AHRQ had been working to identify measures from the National Health Care Quality Report (NHQR) and limit them to a ~3 based on priority conditions to track over time. AHRQ is in the process of determining whether these measures will accurately capture the work and impact of the Effective Health Care Program. In addition, AHRQ is exploring whether the data as currently exists will provide robust data on which to chart this measure. During the FY 2010 and FY 2011 the program will explore the development of an alternate measure to more accurately measure the program's impact on improving patients' quality of care and health outcomes through informed decision making.A new measure is under development, #1.3.55, which will track the use of Effective Health Care findings in clinical decision making. Possible data sources for this measure we are exploring are AHRQ's National Guideline Clearinghouse™ and National Quality Measures Clearinghouse™.Long-Term Objective: Improve patients' quality of care and health outcomes through informed decisionmaking by patients, providers, and policymakers.MeasureFYTargetResult4.4.5: Increase the number of Effective Health Care (EHC) Program products available for use by clinicians, consumers, and policymakers1(Output)20111 SRs2 SGs7 EHC Research ReportOct 31, 201120103 SRs6 SGs14 EHC Research ReportsOct 31, 2010200910 SR 22 SG6 SRs13 SGs16 EHC Research Reports(Target Met)20087 SR 8 SG7 SR 12 SG (includes 2 SG translated into Spanish)(Target Met)2007N/A4 SR 8 SG(Target Met)2006N/A4 SR 1SG(Target Met)1.3.24: Decrease mortality from and increase receipt of recommended care for subset of diseases measured and reported on in the National Health Care Quality Report (Developmental)(Interim Output)2011Set BaselineDec 31, 20112010Initiate development ofalternate measure to moreaccurately measure theprogram goalsDec 31, 201020091st and 2nd Qtr Obtainbaseline measures3rd and 4th Qtr Set targetsfor FY 2010 2019Continued work with contractors to develop the measure2008Identify measures and limitto a subset based onpriority conditions; work withAHRQ's planning,evaluation, and analysiscontractors to limit to ~3metrics to be trackedMeasures identified and a subset based on priority conditions has been analyzed2007N/AAHRQ created new Comparative Effectiveness Portfolio2006N/AAHRQ launched new Effective Health Care Program1.3.25: Increase the dissemination of Effective Health Care (EHC) Program products to clinicians, consumers, and policymakers to promote the communication of evidence about the comparative effectiveness of different medical interventions1(Output)20111030 OrdersOct 31, 20112010981 OrdersOct 31, 201020091st and 2nd Qtr Obtain baseline data for this performance measure 3rd and 4th Quarter Set targets for FY 2010 2019934Baseline(Orders for 50+ copies of EHC Program products)2008Work with AHRQ Effective Health Care's Eisenberg Center, Scientific Resource Center, and Stakeholder Group to identify methods for systematically identifying organizations that are disseminating SR and SGHave not completed identifying methods for systematically identifying organizations that are disseminating SR and SG(Target Met)2007N/AN/A2006N/AN/A1.3.26: Increase the percentage of stakeholders who report they use Effective Health Care (EHC) Program products as a resource1( Output)201124%Oct 31, 2011201022%Oct 31, 201020091st and 2nd Qtr Obtain baseline data for this performance measure3rd and 4th Qtr Set targets for FY 2010 201920%Baseline2008Work with the Medicaid Medical Directors (AHRQ Learning Network) and Health Plans to identify methods for systematically reviewing policy decisions for references to evidence from the PortfolioWorked with Medicaid Medical Directors Learning Network to develop process for identifying how CE Portfolio products are used by these State clinical policymakers (Target Met)2007N/AN/A2006N/AN/A1.3.55: Increase the use of Effective Health Care (EHC) Program products in evidence-based clinical practice guidelines, quality measures, and measure sets in EHC priority areas to enhance decision making (Developmental)2011Establish TargetsDec 31, 20112010Set BaselineDec 31, 20102009N/AN/A2008N/AN/A2007N/AN/A2006N/AN/A1 FY 2010 targets reflect activities associated with annually-appropriated dollars. Please go to "Recovery Act Obligations and Performance" on page 9 of the 2011 Congressional Justification published at http://www.ahrq.gov/about/cj2011/cjweb11.htm for additional performance targets related to this portfolio using Recovery Act funds.MeasureData SourceData Validation4.5.4All AHRQ systematic reviews and summary guides are entered into a database, which is used to populate the AHRQ Effective Health Care Program Web site, http://effectivehealthcare.ahrq.gov/.Effective Health Care Program staff will develop and document a methodology that will be used annually to check data1.3.24National Healthcare Quality Report (NHQR) Appendix A: Data Sources provide information about each database analyzed for the NHQR, including data type, sample design, and primary content.Data are validated annually by Federal public release data source NHQR. Data are analyzed, synthesized, and reported using established methodology1.3.25Requests for copies of AHRQ publications (ordered by title and publication number) are made to the AHRQ Publications Clearinghouse. Data will be provided bi-annually from the Publications Clearinghouse on the number of organizations requesting more than 50 copies of AHRQ comparative effectiveness research reports and summary guides.Effective Health Care Program staff will develop and document a methodology that will be used annually to check data1.3.26Data from this output is available from AHRQ's Medicaid Medical Director's Learning Network (MMDLN). At an annual meeting, members of MMDLN report on how they use AHRQ's comparative effectiveness research reports and summary guides.MMDLN members report their usage in a written document and AHRQ staff follow-up with members to verify information provided1.3.55DTBDTBDReturn to ContentsProceed to Next Section Current as of February 2010 Internet Citation: Online Performance Appendix: Performance Detail (by Activity): Budget Estimates for Appropriations Committees, Fiscal Year 2011. February 2010. Agency for Healthcare Research and Quality, Rockville, MD. http://www.ahrq.gov/about/mission/budget/2011/opa3.html