Figure 1. Numeric Scoring for Evaluation Criteria
Scientific Evidence (Psychometric Testing)
HCBS Populations of Interest
Feasibility of Data Collection (Data Source and Data Collection Methods)
Prevalence of Use by the States
- No documented evidence of psychometric testing.
- Content validity: Documented evidence (in the public domain) that the measure was developed in collaboration with stakeholders (without any of the below testing performed).
- Evidence of some instrument testing. This could include
focus groups, or cognitive-, pilot- or pretesting the instrument with
respondents (no quantifiable statistical measure of testing results
reported). Evidence of testing documented in the public domain.
- Reliability and/or validity testing: Testing results
reported as a quantifiable statistical measure. Documented evidence of
testing in public domain or provided to AHRQ in response to AHRQ's Call for
Measures. Documented in the public domain includes a peer-reviewed
journal or in a technical report available on the Web for public
review. If this type of testing was
conducted, but the actual statistical measure was not reported, it would be
coded to the previous category.
for persons receiving institutional care (nursing home, inpatient hospital,
- Designed/tested for community dwelling non-HCBS-specific population (e.g., a National Committee for Quality Assurance health plan measure or one for home health, physical therapy, rehabilitation).
- Designed/tested for one low-prevalence HCBS population
(i.e., substance abuse, HIV, chronically mentally ill, children, or
traumatic brain injury).
- Designed/tested for one high-prevalence HCBS population
(individuals with intellectual and/or developmental disabilities or older
adults or individuals with physical disabilities).
- Designed/tested for more than one HCBS population (i.e.,
two or more of the populations referenced in categories 3 or 4).
- Requires survey
data collection from multiple respondents (to construct the measure about a
- Requires administrative data from multiple
- Requires survey data collection from a single survey
- Requires administrative data collection from single
organizational source (e.g., claims, hospital discharge, critical event
- No indication of use by any State program providing (or financing) community-based services to people with disabilities.
- Used in multiple clinical settings; use is documented in
the public domain.
- Used in one State only.
- Used in 2-4 States.
- Used by 5 or more States or (a) used by the National
Committee for Quality Assurance for a health plan measure or (b) used by a
Federal Government agency across multiple States.
Documented in the public domain includes a
peer-reviewed journal or a technical report available on the Web for public
review or provided to AHRQ in response to the Call for Measures.
Scores highlighted in bold were those AHRQ
considered to meet the threshold for inclusion in the final set of
candidate measures. Measures had to meet the threshold in all four
categories in order to be included in Tables A.V.1b, A.V.2b, or A.V.3b.
Return to Document