Review Process
All submissions will be reviewed by at least two individuals who will score them based on the assessment criteria and provide a brief comment about the submission.
The scores/comments on Phase 1 and Phase 2 submissions will be compiled, and a ranked summary provided to AHRQ staff. AHRQ will select winners based on quantitative and qualitative assessments.
Assessment Criteria for Phase 1 TeamSTEPPS Video Proposal
Compliance (pass/fail)—Does the Phase 1 proposal adequately address required compliance standards (WCAG 2.0 and Section 508)?
Overall Approach (40 pts)—Does the proposal sufficiently describe why a particular TeamSTEPPS video has been chosen for updating? Does the proposal clearly, concisely, and adequately describe the approach chosen to update the TeamSTEPPS video? Does the proposal describe how the new video would be effective in augmenting the TeamSTEPPS program to train healthcare team members on communication and collaboration, and does it describe how the video will address equity, cultural sensitivity, and health literacy? Does the proposal include a sample of past video work completed by the Challenge participants? Does the proposal include conducting audience testing?
Impact (20 pts)—Does the proposal tell a compelling and impactful story to demonstrate how the new production would be aligned with the current healthcare landscape to fully support the TeamSTEPPS training program?
Innovation and Creativity (25 pts)—Does the proposal include innovative and appropriate methods for adult learning? Does the proposal use creative ways to update the existing TeamSTEPPS videos? Does the proposal include new insight and approaches to broadening diversity in TeamSTEPPS?
Healthcare needs (15 pts)—Does the approach clearly address healthcare needs, current issues, approaches to improve patient safety (e.g., patient family engagement), changes in HIPAA laws and healthcare settings, and/or emerging trends (e.g., artificial intelligence in healthcare, telemedicine)?
Assessment Criteria for Phase 2 TeamSTEPPS Video Product
Compliance (pass/fail)—Does the completed Phase 2 video meet the compliance standards?
Approach (30 pts)—Does the production clearly follow the approach in the proposal? Is the message consistent with the proposal? Does the production clearly communicate the content/theme? Is it focused on the topic and organized? Is it captivating and edifying?
Content (30 pts)—Is it appropriate for healthcare? Does it address diversity, equity, and inclusion? Is it tailored to diverse audiences from cultural, technological, and healthcare setting perspectives?
Creativity (20 pts)—How creatively does the new product convey the message? Is it innovative? Is it well designed?
Quality (20 pts)—How is the quality of the production? Are the lighting, sound, editing, and contrast appropriate? Is the dialogue clear and easy to understand? Is it visually appealing and effective? Is the captioning accurate?
