Figure 1. Numeric Scoring for Evaluation Criteria

Environmental Scan of Measures for Medicaid Title XIX Home and Community-Based Services Measure Scan as of July 5, 2007

Scientific Evidence (Psychometric Testing)

HCBS Populations of Interest

Feasibility of Data Collection (Data Source and Data Collection Methods)

Prevalence of Use by the States

  1. No documented evidence of psychometric testing.
  2. Content validity: Documented evidence (in the public domain) that the measure was developed in collaboration with stakeholders (without any of the below testing performed).
  3. Evidence of some instrument testing. This could include focus groups, or cognitive-, pilot- or pretesting the instrument with respondents (no quantifiable statistical measure of testing results reported). Evidence of testing documented in the public domain.
  4. Reliability and/or validity testing: Testing results reported as a quantifiable statistical measure. Documented evidence of testing in public domain or provided to AHRQ in response to AHRQ's Call for Measures. Documented in the public domain includes a peer-reviewed journal or in a technical report available on the Web for public review. If this type of testing was conducted, but the actual statistical measure was not reported, it would be coded to the previous category.
  1. Designed/tested for persons receiving institutional care (nursing home, inpatient hospital, etc.).
  2. Designed/tested for community dwelling non-HCBS-specific population (e.g., a National Committee for Quality Assurance health plan measure or one for home health, physical therapy, rehabilitation).
  3. Designed/tested for one low-prevalence HCBS population (i.e., substance abuse, HIV, chronically mentally ill, children, or traumatic brain injury).
  4. Designed/tested for one high-prevalence HCBS population (individuals with intellectual and/or developmental disabilities or older adults or individuals with physical disabilities).
  5. Designed/tested for more than one HCBS population (i.e., two or more of the populations referenced in categories 3 or 4).
  1. Requires survey data collection from multiple respondents (to construct the measure about a single beneficiary).
  2. Requires administrative data from multiple organizational sources.
  3. Requires survey data collection from a single survey respondent.
  4. Requires administrative data collection from single organizational source (e.g., claims, hospital discharge, critical event reporting systems).
  1. No indication of use by any State program providing (or financing) community-based services to people with disabilities.
  2. Used in multiple clinical settings; use is documented in the public domain.
  3. Used in one State only.
  4. Used in 2-4 States.
  5. Used by 5 or more States or (a) used by the National Committee for Quality Assurance for a health plan measure or (b) used by a Federal Government agency across multiple States.

Documented in the public domain includes a peer-reviewed journal or a technical report available on the Web for public review or provided to AHRQ in response to the Call for Measures.

Scores highlighted in bold were those AHRQ considered to meet the threshold for inclusion in the final set of candidate measures. Measures had to meet the threshold in all four categories in order to be included in Tables A.V.1b, A.V.2b, or A.V.3b.

Return to Document

Page last reviewed June 2010
Internet Citation: Figure 1. Numeric Scoring for Evaluation Criteria: Environmental Scan of Measures for Medicaid Title XIX Home and Community-Based Services Measure Scan as of July 5, 2007. June 2010. Agency for Healthcare Research and Quality, Rockville, MD. http://www.ahrq.gov/professionals/systems/long-term-care/resources/hcbs/hcbsreport/hcbsfig1.html