COVID-19 vaccine post-introduction evaluation (cPIE) guide, revised 10 October 2023

Overview

Following new vaccine introduction into a routine immunization programme, the purpose of a post-introduction vaccine evaluation (PIE) is to evaluate the impact of the vaccine introduction on the country’s immunization programme and to rapidly identify problems needing correction as vaccination expands in country. The evaluation can not only lead to improvements in the implementation of the new vaccine and overall immunization programme but can also provide valuable lessons for other countries for future vaccine introductions.

After COVID-19 vaccine introduction, in the mid- to long-term phase (between 6–18 months after introduction), a classic or full COVID-19 vaccine PIE (cPIE) is recommended. This evaluation may be compared to the lighter, more flexible mini-cPIE (also known as COVID-19 vaccination intra-action review (IAR)) recommended 2-6 months post introduction. The classic cPIE includes comprehensive tools to address key programmatic vaccine introduction activities at all levels of the immunization system including national, subnational and vaccination facility/site levels. Site visits that include observation of vaccination sessions, observation of vaccine storage facilities, and interviews with health workers and other priority groups receiving COVID-19 vaccine are an important component of the evaluation. As with PIEs for other vaccines, the country should review and adapt tools to the country context.

The cPIE tools have been revised to the current version (October 2023) based on feedback from countries and partners. Although the recommended timeframe to conduct a cPIE has passed, some countries may be interested in conducting this evaluation later depending on ongoing challenges or changes to their COVID-19 vaccination programme. The tools may also be referenced and adapted to use as part of broader or multi-antigen immunization review activities.

For countries interested in implementing the classic cPIE, please refer to the cPIE Guide document and the following web annexes:

Web annex A.  cPIE questionnaires

Web annex B.  cPIE questionnaire summary tables

Web annex C.  cPIE country presentation template

Web annex D.  cPIE example figures for presentation