Online Performance Appendix: Performance Detail, Program Support

Budget Estimates for Appropriations Committees, Fiscal Year 2011

This appendix provides more detailed performance information for all HHS measures related to the Agency for Healthcare Research and Quality's budget.

This budget activity supports the strategic direction and overall management of the AHRQ, including funds for salary and benefits of 315 FTEs.

Program Support

Program support activities for the agency include operational support costs such as salaries and benefits, rent, supplies, travel, transportation, communications, printing and other reproduction costs, contractual services, taps and assessments, supplies, equipment, and furniture. Most AHRQ staff divide their time between multiple portfolios, which is why AHRQ's staff and overhead costs are shown centralized in Program Support, instead of within the relevant research portfolio or MEPS. Formerly, the majority of these costs were shown within HQCO's Crosscutting Activities portfolio.

Strategic Direction

Strategic Management of Human Capital

AHRQ participated in the Federal Human Capital Survey (FHCS) and is assessing the impact of the results at the Office/Center levels and communicating this information to staff. Additionally, Agency staff involved in the Making AHRQ Great Initiative (MAG) has been called upon to foster solutions and ensure issues on a large scale are resolved (e.g., themes which cut across AHRQ). An action plan is currently being developed which will address issues and concerns that were revealed through the survey.

Recently, AHRQ conducted forums to assess the current Performance Management Appraisal Program system (PMAP) and provided responses to the Department suggesting changes to the existing policy. In an effort to ensure full and open conversations, forums and questionnaires were utilized to obtain feedback from managers and employees. Notable suggestions included weighting of the performance elements and implementation of a five tiered appraisal system. AHRQ recently engaged in testing of the new automated performance management application and conducted a pilot test with a small group of staff in the Agency. AHRQ continues to support workforce development programs and initiatives through competency assessment, development and implementation for mission critical activities. The Agency identified a need for, and implemented mandatory Project Management training for all AHRQ staff and participated in the Department-wide effort to identify and establish core competencies across OPDIVs/StaffDIVs. Finally, AHRQ continues to strive towards meeting the OPM 45-day timeline for hiring and notifying applicants to SES and non-SES vacancies. We are working in collaboration with the Rockville Human Resources Center to ensure timelines are met and we consistently inform selecting officials of this requirement through the issuance of action due dates upon release of certificates identifying eligible applicants.

In response to the Department's workforce and succession planning initiative, AHRQ began working on several analyses and reports to gain a better understanding of the Agency's workforce needs and required skill sets. As part of this Initiative, the Agency's Senior Leadership Team were polled about their current and anticipated workforce needs. Additionally, an analysis was completed on the Agency's senior positions to determine potential competency loss due to upcoming retirements or departures in programmatic and management positions and the state of succession planning activities in order to mitigate or greatly reduce a disruption to AHRQ programs and services. Results of these two separate activities were incorporated into the Agency's succession plan and presented to Departmental officials in August, 2009.

Improve Financial Performance

AHRQ is working to demonstrate to the Office of Finance at HHS effective use of financial information to drive results in key areas of operations and to develop and implement a plan to continuously expand the scope to additional areas of operations. AHRQ has completed the review and updating of all internal controls in light of the transition to an integrated, department-wide financial management solution—the Unified Financial Management System (UFMS). In addition, AHRQ continued to participate in the Department's A-123 internal control efforts and implemented all corrective actions for deficiencies reported as a result of the FMFIA/A-123 internal control processes identified in FY 2009. In FY 2010, AHRQ will update all internal controls based on the transition to the HHS Consolidated Acquisition Solution (HCAS). HCAS is the standardized acquisition system that will be used across multiple OPDIVs, including AHRQ. Finally, AHRQ continues to maintain a low-risk status for improper payments.

Electronic Government

AHRQ's current activities include:

  • Ongoing development of policies and procedures that link AHRQ's IT initiatives directly to the mission and performance goals of the Agency. Our governance structure ensures that all IT initiatives are not undertaken without the consent and approval of AHRQ Senior Management and prioritized based upon the strategic goals and research priorities of the agency.
  • Ensuring AHRQ's IT initiatives are aligned with departmental and agency enterprise architectures. Utilizing HHS defined FHA and HHS Enterprise Architectures, AHRQ ensures that all internal and contracted application initiatives are consistent with the technologies and standards and adopted by HHS as well as OMB directives. This uniformity improves application integration (leveraging of existing systems) as well as reducing cost and development time.
  • Providing quality customer service and operations support to AHRQ's centers, offices and outside stakeholders. This objective entails providing uniform tools, methods, processes, practices and standards to ensure all projects and programs are effectively managed utilizing industry best practices. These practices include PMI (PMBOK, EVM), RUP (SDLC), CPIC, and EA. These practices have appreciably improved AHRQ's ability to satisfy project objectives to include cost and schedule.
  • Ensuring the protection of AHRQ data; commensurate with current and future legislation and OMB directives. AHRQ's security program goals focus on executing the defined goals developed in our strategic and tactical plans which are targeted at three key areas: People, Process and Technology. These goals include but are not limited to: implementation of LOB Information and Security and Privacy Awareness training, System Development Life Cycle and FIPS 140-2 compliant encryption solutions. AHRQ continues to ensure 98 percent or higher of AHRQ's employees will complete the LOB Information Security and Privacy Awareness training. AHRQ will continue to follow the modified systems development life-cycle to ensure that security is addressed throughout each project phase. The Agency will deploy encryption solutions for mobile devices, removable media, and data and will ensure FDCC settings are applied to all desktops, laptops, and ensure servers are deployed with departmental approved standard security settings.

Please note: AHRQ's FY 2011 OMB Circular A-11, Exhibit 300: Capital Asset Plan and Business Case Summaries can be found at http://it.usaspending.gov.

Performance Improvement

General program direction is accomplished through the collaboration of the Office of the Director and the offices and centers that have programmatic responsibility for portions of the Agency's research portfolio. AHRQ created a framework to provide a more thoughtful and strategic alignment of its activities. This framework represents the Agency's collaborative efforts on strategic opportunities for growth and synergy. As the result of increased emphasis on strategic planning, the Agency continues the shift from a focus on output and process measurement to a focus on outcome measures where feasible. These outcome measures cascade down from our strategic goal areas of safety/quality, effectiveness, efficiency and organizational excellence. Portfolios of work (combinations of activities that make up the bulk of our investments) support the achievement of our highest-level outcomes.

Performance data will be tracked electronically using the Agency's electronic performance tracking system and published as soon as it becomes available. Also, work will continue with program staff to establish and display a close alignment of projects and how they support AHRQ's performance measures and the Department's strategic goal areas. All of AHRQ's performance measures are displayed in AHRQ's On-Line Performance Appendix (available at http://www.ahrq.gov/about/budgtix.htm).

In FY 2008 and FY 2009, AHRQ continued the implementation of strong budget and performance integration practices through the use of structured Project Management processes. AHRQ has begun a campaign to design and implement a quality improvement process for managing major programs that support the Agency's strategic goals and Departmental strategic goals and specific objectives.

AHRQ has successfully completed comprehensive program assessments on six key programs within the Agency: The Medical Expenditure Panel Survey (MEPS); the Healthcare Cost and Utilization Project (HCUP); the Consumer Assessment of Healthcare Plans Survey (CAHPS®); the Patient Safety portfolio; the former Pharmaceutical Outcomes portfolio; and most recently the Health Information Technology portfolio. These reviews provide the basis for the Agency to move forward in more closely linking high quality outcomes with associated costs of programs. Over the next few years, the Agency will focus on fully integrating financial management of these programs with their performance.

Long-Term Objective: Improve performance in all areas of Program Support

MeasureFYTargetResult
5.1.1: Improve AHRQ's strategic management of human capital
(Output)
2011Upon Department approval, fully implement the new HHS-wide automated performance management systemOct 31, 2011
2010Fully comply with all Departmental procedures for HR managementOct 31, 2010
2009Fully implement Departmental LMS for training and development needsComplied with all Departmental procedures for HR management.

Completed report on workforce needs and required skill sets.
(Target Met)

2008Develop core competencies for selected Agency staff and develop strategies for implementationCore competencies developed and implementation strategies completed
(Target Met)
2007Implement HHS Performance Improvement InitiativeCompleted implementation of HHS Performance Improvement Initiative
(Target Met)
2006Assess core competency and leadership models

Identify strategies to infuse new talent into AHRQ

Completed assessment of core competency and leadership models
Identified strategies to infuse new talent into AHRQ
(Target Met)
5.1.2: Maintain a low-risk improper payment risk status
(Output)
2011Update the IPIA Risk Assessment of HCQO and continue to participate in the Department's A-123 Internal Control effortsOct 31, 2011
2010Complete updating of all internal controls following AHRQ's conversion to HCASOct 31, 2010
2009Complete updating of all internal controls following AHRQ's conversion to the Uniform Financial Management System (UFMS)Met all requirements for Department's A-123 Internal Control fforts
(Target Met)
2008Complete all requirements related to OMB revised Circular A-123

Begin to update internal controls following AHRQ's conversion to UFMS
Requirements related to OMB revised Circular

Continued to update internal controls
(Target Met)
2007Continue to participate in Department A-123 Internal Control effortsContinued to participate in Department A-123 Internal Control efforts
(Target Met)
2006Participate in Department A-123 Internal Control efforts related to improper paymentsParticipated in Department A-123 Internal Control efforts related to improper payments
(Target Met)
5.1.3: Expand E-government by increasing IT organizational capability (Output)2011Continue develop internal IT program management policies and procedures in line with guidance being issued by HHSOct 31, 2011
2010Continue develop internal IT program management policies and procedures in line with guidance being issued by HHSOct 31, 2010
2009Continue develop internal IT program management policies and procedures in line with guidance being issued by HHSSAS 70 Reviews, A-123 Reviews, and A-133 audits completed
(Target Met)
2008Extend Project Management Office (PMO) operations and concepts to AHRQ IT investmentsOngoing
(Target Met)
2007Develop fully integrated PMO with standardized processes and artifactOngoing
(Target Met)
2006N/ACompleted level 3 maturity in EA as directed by HHS
(Target Met)
5.1.4: Improve IT Security/Privacy Output
(Output)
2011Implement a FIPS 140-2 compliant email encryption solutionOct 31, 2011
2010Fully implement FDCC and standard security configurations of all systems

Implement FIPS 140-2 encryption solution on all systems to protect sensitive information

Oct 31, 2010
2009Integrate and align AHRQ's security program with HHS's Secure One security programIntegrated and aligned AHRQ's security program with HHS's Secure One security program
(Target Met)
2008Certify and accredit all Level 3 information systems

Review and update security program to reflect current guidance and mandates
Certified and accredited all Level 3 information systems

Reviewed and updated security program
(Target Met)
2007Certify and accredit all Level 2 information systems

Begin implementation of Public Key Infrastructure with applications
Certified and accredited all Level 2 information systems

Began implementation of Public Key Infrastructure with applications
(Target Met)
2006Perform required testing to insure maintenance and security levelPerformed required testing to insure maintenance of security level
(Target Met)
5.1.5: Establish IT Enterprise Architecture
(Output)
2011Comply with HHS EA requirements for FY 2011Oct 31, 2010
2010Comply with HHS EA requirements for FY 2010Oct 31, 2010
2009Comply with HHS EA requirementsComplied with EA activity set forth by HHS
(Target Met)
2008Implement Level 3 EA plan

Comply with EA activity as defined by HHS
Implemented Level 3 EA plan
Continued to comply with EA activity set forth by HHS
(Target Met)
2007Continue Level 3 EA planCompleted Level 3 EA plan
(Target Met)
2006N/ABegan work towards Level 3 maturity in EA as defined by HHS
(Target Met)
5.1.6: Get to Green and maintain status for Performance
(Output)
2011Comply with HHS performance and budget integration requirements for 2011Oct 31, 2011
2010Comply with HHS performance and budget integration requirements for 2010Oct 31, 2010
2009Continue implementation of software within the portfoliosCompleted implementation
(Target Met)
2008Continue implementation of software within the portfoliosContinued implementation of software within the portfolios
(Target Met)
2007Begin implementation of software within the portfolios of work to help facilitate budget and performance integration

Conduct internal alignment of measures by strategic goal areas
Began to implement software with the portfolios

Completed internal alignment of measures
(Target Met)
2006N/AVisual Performance Suite software designed and piloted
(Target Met)

 

MeasureData SourceData Validation
5.1.1Departmental quarterly updatesAs the beta site for the Department's Performance Management Appraisal Program (PMAP), AHRQ was required to complete the Performance Appraisal Assessment Tool (PAAT). Out of 100 total points possible, the Agency scored an 87 which, according to OPM, is considered as having "effectiveness characteristics present"—the highest level possible under this rating system.
5.1.2Departmental quarterly updates; UFMS, IMPAC II, and Payment Management SystemSAS 70 Reviews, A-123 reviews, and A-133 audits
5.1.3
5.1.4
5.1.5
Departmental quarterly updatesCompliance with Departmental standards
5.1.6Departmental quarterly updatesCompliance with Departmental standards; AHRQ logic models and Portfolio plans

Return to Contents
Proceed to Next Section

Current as of February 2010
Internet Citation: Online Performance Appendix: Performance Detail, Program Support: Budget Estimates for Appropriations Committees, Fiscal Year 2011. February 2010. Agency for Healthcare Research and Quality, Rockville, MD. http://www.ahrq.gov/about/mission/budget/2011/opa13.html