Use, Continuing Evaluation, and Maintenance

Overview of the Measure Use, Continuing Evaluation and Maintenance Phase of Measure Development

Measure Use, Continuing Evaluation & Maintenance ensures that the measure continues to add value to quality reporting measurement programs and that its construction continues to be sound. Developers monitor and measure the use of quality measures to ensure that they continue to support the quality programs they were designed to support, and identify opportunities to tweak or repurpose measures to improve reporting and the increase the value of quality program measurement results. Measure use, continuing evaluation and maintenance tasks include:

  • Collect and review measure data for the various quality programs
  • Aggregate measure data and create reports
  • Assess impact, effectiveness, and efficiency
  • Publish measure reports and quality program assessments for public review
  • Evaluate reports and assessments to determine if any changes could be made to improve quality measure reporting or quality program results
  • Submit recommendations to CMS for consideration of new or revised quality measures or programs


Once a measure is in use, data for the measure is collected, calculated, and publicly reported. The party responsible for the measure should continue environmental scans of the literature about the measure as new studies may be published that address the soundness of the measure. It is also important to monitor for unintended consequences the measure might have on clinical practice or outcomes.

The process of measure production and monitoring varies significantly from one measure set to another depending on factors, which may include, but are not limited to:

  • Scope of measure implementation.
  • Healthcare provider being measured.
  • Data collection processes.
  • Ultimate use of the measure (e.g., quality improvement, public reporting, pay-for-reporting, or value-based purchasing).
  • Program in which the measure is used.

Measure production and monitoring are reported via three basic types of measure maintenance reviews: annual updates, comprehensive reevaluations, and ad hoc reviews, with stakeholder inputs being a critical component of this review process. The primary steps for monitoring are:

  • Conduct data collection and ongoing surveillance
  • Respond to questions about the measure
  • Produce preliminary reports
  • Report measure results
  • Monitor and analyze the measure rates and audit findings
  • Perform measure maintenance or ad hoc review, when appropriate
  • Provide information that CMS can use in measure priorities planning

Blueprint Resources (PDF):

Section 2 (The Measure Lifecycle):

  • Continuing Evaluation
  • Measure Maintenance
  • Measure Production and Monitoring
  • Measure Maintenance Reviews
  • Stakeholder Engagement

Section 3 (In-Depth Topics):

  • NQF Endorsement and Maintenance
  • Measure Production and Monitoring
  • Measure Maintenance Reviews

Section 4 (Forms and Templates):

  • Measure Information Form Instructions
  • Measure Information Template
  • Measure Justification Form Instructions
  • Measure Justification Form Template
  • Measure Evaluation Criteria and Instructions
  • Measure Evaluation Report Template

Other Resources:

NQF Measure Maintenance -- website [ASPX]

Measure Evaluation: Overview – webinar [PPTX] (PPTX)

Measure Development: Measure Use, Continuing Re-Evaluation, and Maintenance – webinar [ZIP]

Final Phase

Return to Measure Development by Phase

Page Last Modified:
05/06/2019 02:12 PM