Methods Of Evaluation - (Rev. 1, 05-23-03)

15230 - Methods Of Evaluation - (Rev. 1, 05-23-03) Substantial elements of QIO contracts are performance-based, where a QIO is assessed relative to specific performance measures established in the contract. Performance on these measures can be used to objectively make determinations about non-competitive renewals and/or be used as objective criteria in competitive procurements. Additionally, ROs assess QIO performance based on on-site visits, regularly scheduled teleconferences, data analysis, and off-site reviews of QIOs. Specifically, the on-site visit permits the RO POs and/or Scientific Officers (SOs) to have a face-to-face meeting and allow CMS an opportunity to understand all of the QIO activities within the context of their state. This process entails the evaluation of QIO project activities and data reports, interviews with QIO staff, and an examination of other pertinent records. Ongoing monitoring will be accomplished by telephone and videoconferencing between the PO and the QIO, on-site visits and analysis of information reported in project plans, routine written reports, and review of contract deliverables. The findings that result from on-site visits are compiled into formal summaries that describe the QIO’s progress and performance. If the PO identifies major deficiencies, a Performance Improvement Plan (PIP) will be requested. In the event a QIO is unsuccessful at correcting the deficiencies contained in the PIP, CMS will consider terminating the contract. RO POs would continue to perform ongoing monitoring of other aspects of the contract. These include:  QIO proposed information collection activities (e.g., surveys), abstracts or articles submitted to non-CMS sponsored peer reviewed publications or meetings;  Subcontract arrangements;  QIOs' internal quality control process;  QIOs’ case review requirements;  Communication requirements (Web site, physician/provider outreach, annual reports, etc.);  Requests related to quality improvement projects (including ad hoc data requests, CDAC requests, and approval of locally developed projects);  Confidentiality requirements;  Board membership and structure; and  QIO resource allocation/utilization and management (and other financial information).