Review
Abstract
Background: To address the global challenge of vaccine hesitancy, the Strategic Advisory Group of Experts on Immunization strongly promotes vaccination reminder and recall interventions. Coupled with the new opportunities presented by scientific advancements, these measures are crucial for successfully immunizing target population groups.
Objective: This systematic review and meta-analysis aims to assess the effectiveness of various interventions in increasing vaccination coverage compared with standard or usual care. The review will cover all vaccinations recommended for different age groups.
Methods: In February 2022, 2 databases were consulted, retrieving 1850 studies. Following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, 79 manuscripts were included after the assessment phase. These comprised 46 trials/randomized controlled trials (RCTs) and 33 before-after studies. A meta-analysis using a random-effects model was performed with STATA software (version 14.1.2). The selected outcome was the risk ratio (RR) of vaccination coverage improvement effectiveness. Additionally, meta-regression analyses were conducted for the included manuscripts.
Results: The analyses showed an overall efficacy of RR 1.22 (95% CI 1.19-1.26) for RCTs and RR 1.70 (95% CI 1.54-1.87) for before-after studies when considering all interventions cumulatively. Subgroup analyses identified multicomponent interventions (RR 1.58, 95% CI 1.36-1.85) and recall clinical interventions (RR 1.24, 95% CI 1.17-1.32) as the most effective in increasing vaccination coverage for RCTs. By contrast, educational interventions (RR 2.13, 95% CI 1.60-2.83) and multicomponent interventions (RR 1.61, 95% CI 1.43-1.82) achieved the highest increases for before-after studies. Meta-regression analyses indicated that the middle-aged adult population was associated with a higher increase in vaccination coverage (RCT: coefficient 0.54, 95% CI 0.12-0.95; before-after: coefficient 1.27, 95% CI 0.70-1.84).
Conclusions: Community, family, and health care–based multidimensional interventions, as well as education-based catch-up strategies, effectively improve vaccination coverage. Therefore, their systematic implementation is highly relevant for targeting undervaccinated population groups. This approach aligns with national vaccination schedules and aims to eliminate or eradicate vaccine-preventable diseases.
doi:10.2196/52926
Keywords
Introduction
The immunization programs are specifically designed to maximize the health benefits for the population by offering the most appropriate vaccinations for different age groups and types of patients [
]. The effectiveness of vaccination programs is based on a high uptake level. In addition to providing direct protection for vaccinated individuals, these programs offer indirect protection to the community by decreasing the risk of infection [ ].Although vaccination is one of the most successful public health interventions, global immunization coverage rates remain unsatisfactory. In 2021, nearly 25 million children under the age of 1 year missed their routine diphtheria-tetanus-pertussis vaccinations. Additionally, human papillomavirus (HPV) vaccination coverage among girls in the least developed countries was only 15% [
]. Undervaccination can be attributed to a lack of health services available to the population, lower availability of vaccines for mass immunization programs, and difficulties in accessing these services in terms of both space and time [ ]. Insufficient budgets are one of the main barriers preventing health governments from providing access to mass vaccination in low-income countries [ ].Although the health governments of the most developed countries are strongly implementing national immunization programs, introducing new vaccines, and expanding vaccination offers, coverage rates are still far from desirable targets. This shortfall has resulted in outbreaks of vaccine-preventable diseases, leading to hospitalizations and, in some cases, death [
, ]. The literature examining the acceptance of routine vaccinations for adolescents (such as the HPV vaccine) and vaccines recommended for older adults or those with chronic and disabling conditions (such as influenza, pneumococcal, and herpes zoster vaccines) indicates critical issues with uptake [ , ].Vaccine hesitancy, defined as “the reluctance or refusal to vaccinate despite vaccine availability,” has gained recognition as a top threat to global health because it could undermine successful and cost-effective vaccination programs worldwide [
]. The main factors contributing to vaccine hesitancy are a lack of awareness about the benefits of vaccination, concerns regarding short- or long-term side effects of vaccines, general distrust in immunization practices, and doubts about the high number of vaccines administered according to schedules [ ]. Furthermore, the growing complexity of vaccination programs, with the introduction of new vaccines and the high number of recommended booster doses, could represent an obstacle to achieving optimal coverage. This complexity can cause difficulties in adherence and delays in vaccinating the target population [ ].The decline in vaccinations threatens to strain health systems with outbreaks of vaccine-preventable diseases. Several attempts have been made to identify approaches that increase immunization coverage, such as vaccine information campaigns, promotional and educational messages for patients and health care professionals, and the use of reminders and various mobile apps [
, ]. Active vaccine catch-up interventions can be an extremely useful tool for improving adherence to vaccination practices. Experience and research can help identify the most effective vaccination strategies.This systematic review and meta-analysis aims to evaluate vaccine adherence across various catch-up methods targeting different age groups. Additionally, we aimed to identify the most effective vaccination recall strategies compared with standard or usual care procedures, based on randomized controlled trials (RCTs) and before-after studies.
Methods
Study Guidelines
For this systematic review, we followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analysis;
) statement guidelines [ ] to ensure transparency and thorough reporting of both the review process and results. The review protocol was registered on PROSPERO under the registration number CRD42022307311 and it can be accessed online [ ].Search Strategy and Selection Criteria
Two literature databases, PubMed/MEDLINE and Scopus, were utilized for this review. The literature search commenced on February 14, 2022, using a combination of free-text words and Medical Subject Headings (MeSH). The search strategy incorporated general terms such as “vaccine,” “effectiveness,” and “improvement,” along with specific terms related to catch-up intervention implementation. The search strings obtained are detailed in
.The Population, Intervention, Comparison, Outcomes and Study (PICOS) criteria were applied to select studies, encompassing populations of all ages without restrictions on country or length of follow-up. Eligible participants were those eligible for vaccination and receiving a catch-/mop-/keep-up intervention involving reminders or recalls. The objective was to evaluate the intervention-dependent vaccination coverage improvement effectiveness (VCIE), which is a composite outcome created by assessing both the improvement in vaccination coverage and the completion of vaccination series, in comparison to standard vaccination practices. During both the screening and assessment phases, authors excluded research articles based on the following criteria: if the topic or outcome did not align with the review’s objective, if the study did not use an RCT or before-after study design, if the studies lacked vaccination coverage data, or if there were insufficient data regarding the “before” or “control” group or description of catch-up/recall intervention. Furthermore, non-English manuscripts and articles whose full texts were unavailable were excluded.
During the screening phase, a total of 6 reviewers applied the inclusion criteria (AF, WP, AC, PF, VP, and VR). This process involved 3 pairs of independent reviewers, each consisting of 2 reviewers. These pairs evaluated the title and abstract of each identified article. Subsequently, the same pairs performed the assessment phase by evaluating the full text of the selected articles. In case of disagreements or doubts, a formal reconciliation process was undertaken to reach a consensus among the reviewers. If needed, the intervention of another reviewer was sought to resolve the issue and make a final decision.
Data Analysis
For studies that met the inclusion criteria, a full-text review and data extraction were conducted using a standardized template. This template included outcome measures and demographics of the study population, such as study design, country, study recruitment range, follow-up time, primary objective, outcome, intervention type, number of patients enrolled, gender distribution, age range, and gross national income (GNI). The variable “follow-up time since intervention” was categorized as follows: 0 to <6 months (short), 6 to <12 months (medium), and more than 12 months (long).
Furthermore, given the study’s objective to detail the effectiveness of various types of catch-up reminder or recall vaccination interventions on coverage rates, the variable “intervention type” was further classified based on an existing reference [
]. The intervention categories were delineated as follows: “remind” studies were divided into clinical, messaging, web, active calls, and object; “reward” studies; and “educational” studies. In cases where multiple types of vaccination interventions were combined and administered, they were classified under the category of “multicomponent” interventions.According to the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) classification [
], bodies of evidence from RCTs are a priori regarded as “high”-quality evidence, whereas evidence from observational studies starts as “low”-quality evidence. To further define and assess the risk of bias in each included study, 2 quality assessment score tools specific to the study designs were utilized. For RCTs, the assessment tool shown in [ ] was used, and for before-after studies, the tool in [ ] was used. The Duval and Tweedie nonparametric trim-and-fill method was used to adjust for the effect of publication bias. This method is utilized to account for hypothetical small missing null or negative studies, thereby providing a more balanced assessment of the data.Study-level data were recorded in Excel spreadsheets (Microsoft Excel 2010). Risk ratios (RRs) and corresponding 95% CIs of VCIE were directly calculated to evaluate the effect of different intervention types on the receipt of immunizations. Separate analyses were conducted for RCTs and before-after studies. If data on the main outcome (VCIE) were available from more than 1 study, a random effects model meta-analysis was used to pool the data. The results were stratified based on the “intervention category” variable, and pooled RRs and risk differences were computed for each intervention category. These analyses were conducted using STATA software (version 14.2.1; StataCorp). Between-study variation was estimated by comparing each study’s result with a Mantel-Haenszel fixed-effect meta-analysis. The extent of heterogeneity was quantified using I2. Testing for publication bias was conducted separately for RCTs and before-after studies for the main outcome. Additionally, meta-regression analyses were performed using the following summary measures: an estimate of between-study variance (tau), the proportion of between-study variance (adjusted R2), the percentage of residual variation due to heterogeneity (I2), and a joint test for all covariates (model F) with Knapp-Hartung modification (prob>F).
Results
Overview
A total of 1869 research articles were identified from the literature databases, with 1784 (94.45%) retrieved from the PubMed/MEDLINE platform and 85 (4.55%) from Scopus. After removing duplicates (n=22), 1847 records underwent screening based on titles and abstracts. Among these, 239 full-text articles were assessed for eligibility, and ultimately, 79 studies were included in the data extraction and qualitative synthesis. Specifically, 46 (58%) of these studies were RCTs, and 33 (42%) were before-after studies included in the meta-analysis. The main reasons for excluding studies were as follows: outcomes not aligned with the review’s interest (n=56) and studies not utilizing an RCT or before-after study design (n=29). A summary of the screening process and exclusions is depicted in the PRISMA flow diagram (
).Characteristics, Quality Score, and Results of Meta-Analysis and Meta-Regression for RCT Studies
Of the included RCTs, 20 studies (43%) were conducted in the American continent, with 18 of them (39%) in the United States. Additionally, 11 studies (24%) were conducted in Asia and 9 studies (20%) in Europe. Only 5 studies (11%) were conducted in Africa and 1 study was conducted in Australia. Regarding the age groups targeted by the interventions, the studies were most frequently focused on the “infant-preschool” category in 46% of cases (n=21), followed closely by the “child-adolescent” category in 43% of cases (n=20). The “middle-aged adult” category was addressed in 15% of studies (n=7). According to the classification of intervention types, “multicomponent” studies were identified most frequently, accounting for 48% (n=22) of the total. Following this, “educational” studies comprised 24% (n=11) of the included studies. The “reward” category was the least represented, with only 4% (n=2) of the studies falling under this category. Among the reminder interventions, the “clinical” and “messaging” subcategories were the most populated, accounting for 22% (n=10) and 28% (n=13) of the included studies, respectively (
).The quality score evaluation of the included RCT studies revealed that 2 studies [
, ] received the maximum score of 5. Several studies were assigned a score of 1 point, including 8 “multicomponent” studies [ - ], 5 “educational” studies [ , - ], 3 “reminder” studies [ - ], and 2 “reward” studies [ , ]. Only 2 studies [ , ] received the minimum score of 0. Adequacy of randomization was found in 27 studies (59%), while blinding was reported in only 2 studies (4%) out of the 46 included studies ( ).The overall results of meta-analyses for all RCT studies demonstrated an RR of 1.22 (P<.001), indicating an increase in VCIE across all types of interventions included in the RCT sample. Further details on heterogeneity and significance tests for all intervention categories are provided in
. The most effective interventions are extensively detailed in , which includes the forest plot of RCTs. The highest efficacy was reported for “multicomponent” interventions, with a risk ratio (RR) of 1.58 (P<.001) (see Figure S1A in ), followed by “reminder clinical” studies, which exhibited an RR of 1.24 (P<.001; see Figure S1B in ). Furthermore, “educational” interventions (RR 1.15; P<.001) and “reminder messaging” interventions (RR 1.14; P<.001) demonstrated a positive effect on VCIE. Forest plots summarizing results for other types of recall interventions can be found in Figure S1C, D in .For RCT studies, meta-regression analyses were conducted to obtain the best fitting model, including the following variables: publication year, continent, GNI, age category, and follow-up time since intervention. According to this analysis, interventions conducted in the European continent (coefficient 1.001; P=.03) and targeting the “adult-middle age” population (coefficient 0.537; P=.012) were the most effective in increasing vaccination coverage (
).Publication | Country | Study year range | Follow-up time since intervention | Main outcome (vaccination rate/coverage) | Intervention type | Mean age among the intervention and control groups | Number of patients enrolled | Quality score assigned |
Rodewald et al [ | ]United States | 1994-1995 | 18 months | Full series completion for all vaccines | Education (outreach educational campaign) | 0-12 months | 2741 | 5 |
LeBaron et al [ | ]United States | 1996-1998 | 36 months | dTPab, polio, MMRc, and Hibd series completion | Education (in-person/telephone call) | 1-14 months | 3050 | 3 |
Kimura et al [ | ]United States | May-October 2002 | 3 months | Influenza | Education (educational campaign for health care workers) | 18-65 years | 2338 | 1 |
Gilkey et al [ | ]United States | 2011 | 12 months | dTPa and meningococcal | Education (in-person and webinar-delivered AFIXe educational sessions) | 11-12 years (n=32,676); 13-18 years (n=74,767) | 107,443 | 1 |
Brewer et al [ | ]United States | 2015 | 6 months | HPVf 9 full series completion | Education (informative announcements vs face-to-face conversation) | 11-12 years | 17,173 | 3 |
Wong et al [ | ]China | 2013-2015 | 0.5 months | Influenza (adherence to self-reported vaccination) | Education (face-to-face short individual educational session for pregnant women) | 33-34 years | 321 | 3 |
Brown et al [ | ]Nigeria | 2012-2013 | 12 months | All vaccines | Education (nurse-led educational sessions in primary health care centers) | 0-12 weeks (intervention on parents) | 300 | 1 |
Hu et al [ | ]China | 2014 | 12 months (from birth to first year of life) | Full series completion of all vaccines | Education (educational sessions for pregnant women) | Adults (women aged 20-30 years); infants up to the first year of life | 1252 | 3 |
Esposito et al [ | ]Italy | 2015-2016 | 8 months | dTPa and meningitis ACWY | Education (multiple web-based educational programs) | Adolescents | 615 | 2 |
Lemaitre et al [ | ]Canada | 2014 | 24 months | Full series completion of all vaccines | Education (motivational interview-based educational strategy) | Adults (mothers); children at 2 years of age | 2717 | 1 |
Muñoz-Miralles et al [ | ]Spain | October 2017 to March 2018 | 6 months | Influenza | Education (face-to-face educational intervention) | Middle aged to aged >80 years: ≥60 years healthy; ≥60 years with risk factors; <60 years with risk factors; others | 524 | 1 |
Rodewald et al [ | ]United States | 1994-1995 | 18 months | Full series completion of all vaccines | Multicomponent (combined: tracking + outreach with prompting) | 0-12 months | 2741 | 5 |
LeBaron et al [ | ]United States | 1996-1998 | 36 months | dTPa, polio, MMR, and Hib full series completion | Multicomponent (autodialer with outreach backup) | 1-14 months | 3050 | 3 |
Szilagyi et al [ | ]United States | 1998-2000 | 18 months | dTPa and HBVg | Multicomponent (audiotaped telephone reminders and active calls) | 11-14 years | 3006 | 5 |
Kimura et al [ | ]United States | May to October 2002 | 3 months | Influenza | Multicomponent (educational campaign and vaccination day for health care workers) | 18-65 years | 2271 | 1 |
Schwarz et al [ | ]United States | 1995 | 3 months | HBV | Multicomponent (video on HBV, gift packages for children, and cash gifts for caregivers) | 2-18 years | 328 | 1 |
Humiston et al [ | ]United States | 2002-2004 | 0 months | Influenza | Multicomponent (patient tracking, recall, outreach, and provider prompts) | <65 years | 3752 | 3 |
Mantzari et al [ | ]United Kingdom | February 2010 to March 2010 | 6 months | HPV series initiation and completion | Multicomponent (first-time invitees: letter, voucher [financial incentive], and SMS text messages vs previous nonattenders: letter, voucher [financial incentive], SMS text messages) | 16-18 years | 1000 | 2 |
Chamberlain et al [ | ]United States | 2012-2013 | 3 months after giving birth | dTPa and influenza | Multicomponent (multilevel intervention involving clinic, provider, and patient) | 26.9-27.5 years (perinatal vaccination) | 325 | 1 |
Richman et al [ | ]United States | August 2011 to December 2013 | 7 months | HPV full series completion | Multicomponent (SMS text messages + emails) | 18-26 years | 283 | 1 |
Zimmerman et al [ | ]United States | 2014-2015 | 9 months | HPV 9 full series completion | Multicomponent (multimodal intervention: facilitations for access to vaccination services, communications with patients, SMS text messages, calls, and training sessions) | 11-17 years | 10,861 | 3 |
Brown et al [ | ]Nigeria | 2012-2013 | 12 months | All vaccines completion | Multicomponent (reminder intervention + providers training) | 0-3 months (intervention on parents) | 297 | 1 |
Ma et al [ | ]United States | Not mentioned | 12 months | HBV | Multicomponent (training of providers and involvement of church through messaging) | ≥18 (mean age 51.6) years | 2212 | 2 |
Nagar et al [ | ]India | August to December 2015 | 6 months | dTPa full series completion (within 180 days from birth) | Multicomponent (necklace with a pendant that records immunity data and provides voice reminders) | 0-3 months | 137 | 2 |
Esposito et al [ | ]Italy | 2015-2016 | 8 months | dTPa, meningitis ACWY, and meningitis B | Multicomponent (educational program on the website + face-to-face lessons) | 11.6-16.4 years | 636 | 2 |
Wallace et al [ | ]Indonesia | January 2016 to July 2016 | 7 months | dTPa full series completion (third dose) | Multicomponent (home-based records + sticker) | 0-12 months | 3616 | 3 |
Borgey et al [ | ]France | November 2014 to March 2015 | 0 months | Influenza | Multicomponent (multilevel intervention approach) | 18-65 years (health care professionals) | 4069 | 3 |
Currat et al [ | ]Switzerland | April 2016 to October 2016 | 5 months | Influenza | Multicomponent (preemployment health test check: face-to-face intervention + reminder: information leaflet) | 31-33 years | 379 | 1 |
Menzies et al [ | ]Australia | February 2015 to December 2015 | 36 months | Administering all vaccines in a timely manner | Multicomponent (SMS text messages through the VaxSMS app, calendar reminder) | 2-8 months (intervention on parents) | 1594 | 1 |
Liao et al [ | ]China | October 2017 to December 2017 | 5 months | Influenza | Multicomponent (vaccination reminders + pressure component, WhatsApp discussion group) | 6 months to 6 years | 365 | 1 |
Yunusa et al [ | ]Nigeria | November 2019 | 6 months | dTPa, HBV, and Hib full series completion (third dose) | Multicomponent (SMS text messages and calls) | 20.2-33 years | 554 | 1 |
Levine et al [ | ]Ghana | March 2019 to April 2019 | 3 months | Administering all vaccines in a timely manner | Multicomponent (mobile phone–based reminders + incentives to health workers and caregivers) | 28.5-29.8 years (mothers interviewed); outcome for neonatal vaccination | 467 | 3 |
Kagucia et al [ | ]Kenya | December 2016 to March 2017 | 6 months | MMR 1 timeliness vaccination | Multicomponent (SMS text messages and financial incentive) | 6-8 months | 537 | 3 |
Brown et al [ | ]Nigeria | 2012-2013 | 13 months | dTPa full series completion | Remind active call | 3 weeks | 614 | 1 |
Levine et al [ | ]Ghana | March 2019 to April 2019 | 3 months | Administering all vaccines in a timely manner | Remind active call (phone call with health care worker reminder) | 28.5-29.8 years (mothers interviewed); outcome for neonatal vaccination | 479 | 3 |
Kimura et al [ | ]United States | May to October 2002 | 3 months | Influenza | Clinical reminder (vaccination day for health care workers) | 18-65 years (health care workers) | 2349 | 1 |
Fiks et al [ | ]United States | September 2004 to August 2005 | Check at 2 years of age | All vaccines captured immunization | Clinical reminder (electronic health record–based clinical reminder) | 0-2 years | 3217 | 0 |
Andersson et al [ | ]Pakistan | 2005-2007 | 24 months | MMR and dTPa full series completion | Clinical reminder (informed discussion about vaccination) | 12-23 months (intervention on parents) | 904 | 3 |
Gilkey et al [ | ]United States | 2011 | 12 months | dTPa and meningococcal | Clinical reminder (in-person consultations) | 11-12 years (n=32,676); 13-18 years (n=74,767) | 69,051 | 1 |
Yoo et al [ | ]United States | 2009-2011 | 12 months | Influenza | Clinical reminder (school-located vaccination against flu in 2009-2010 and 2010-2011) | 6 months to 18 years | 13,561 | 0 |
Brown et al [ | ]Nigeria | 2012-2013 | 12 months | Full series completion for all vaccines | Clinical reminder | 0-3 months | 298 | 1 |
Kriss et al [ | ]United States | 2013 | 2 months after giving birth | dTPa | Clinical reminder (messaging iBook) | 25.4-27.5 years (women in the perinatal period) | 73 | 3 |
Hu et al [ | ]China | 2014 | 24 months | Varicella | Clinical reminder (messaging iBook) | 25-26 years (parents); outcome for children at 2 years of age | 136 | 1 |
Wallace et al [ | ]Indonesia | January 2016 to July 2016 | 7 months | dTPa full series completion | Clinical reminder (home-based records) | 0-12 months | 3616 | 3 |
Blanchi et al [ | ]France | May 2018 to May 2019 | dTPa-inactivated polio vaccine | Clinical reminder (catch-up strategy during hospitalization) | 65-97 years (hospitalized patients) | 162 | 3 | |
Rodewald et al [ | ]United States | 1994-1995 | 18 months | Full series completion for all vaccines | Remind messaging (prompting) | 0-12 months | 2741 | 5 |
Quinley and Shih [ | ]United States | 1999-2000 | 3 months | Pneumococcal (African American vs American) | Remind messaging (telephone call reminder) | <65 years | 218 (African American); 732 (American) | 3 |
LeBaron et al [ | ]United States | 1996-1998 | 36 months | dTPa, polio, MMR, and Hib full series completion | Remind messaging (autodialer: automated telephone or email reminders) | 1-14 months | 3050 | 3 |
Irigoyen et al [ | ]United States | 2001 (July to December) | 6 months | dTPa | Remind messaging (continuous messaging reminders) | 6 weeks to 15 months (outcome at 6 months after the intervention) | 1662 | 3 |
Muehleisen et al [ | ]Switzerland | 2003 | 9 months | All vaccines completion | Remind messaging (written letter reminders) | 2 months to 17 years; intervention on parents (postdischarge catch-up immunization) | 532 | 3 |
Rand et al [ | ]United States | 2013-2014 | 9 months (July 2013 to March 2014) | HPV 9 full series completion | Remind messaging (reminder SMS text messages) | 11-16 years | 3812 | 2 |
Chen et al [ | ]China | 2013-2015 | 14 months (December 2013 to January 2015) | BCGh, HBV, dTPa-inactivated polio vaccine, MMR full series completion | Remind messaging (smartphone app: reminder vaccination SMS text messages) | 0-13 months (children); intervention on parents | 214 | 3 |
Domek et al [ | ]Guatemala | 2013 | 6 months | All vaccines (pentavalent, rotavirus, polio, pneumococcal) series completion | Remind messaging (SMS text message reminders) | 2-4 months (infants); intervention on parents | 321 | 3 |
Hu et al [ | ]China | 2014 | 24 months | Varicella | Remind messaging (video messaging) | 25-26 years (parents); outcome for children at 2 years of age | 136 | 1 |
Menzies et al [ | ]Australia | February 2015 to December 2015 | 36 months | All vaccines timeliness vaccination | Remind messaging (SMS text message reminders through the VaxSMS app) | 2-8 months (mean age 4 months); intervention on parents | 1594 | 1 |
Liao et al [ | ]China | October 2017 to December 2017 | 5 months | Influenza | Remind messaging (vaccination reminders through WhatsApp) | 6 months to 6 years | 365 | 1 |
Qin et al [ | ]China | 2019-2020 | 10 months | Varicella | Remind messaging (telephone notification vs written notification) | Telephone notification: 2.1-12.2 years (mean age 4.0 years); written notification: 2.1-7.3 years (mean age 3.8 years) | 800 | 1 |
Kagucia et al [ | ]Kenya | December 2016 to March 2017 | 6 months | MMR vaccine 1 timeliness vaccination | Remind messaging (SMS text messages) | 6-8 months | 537 | 3 |
Nagar et al [ | ]India | August to December 2015 | 6 months | dTPa full series completion (third dose) | Remind object (pendant recording the vaccination history of the child) | 0-6 months (outcome assessed within 180 days from birth) | 123 | 2 |
Siddiqi et al [ | ]Pakistan | July 2017 to October 2017 | Until the administration of the measles-1 vaccine or until 12 months of age | dTPa, HBV, Hib full series completion (third dose); MMR vaccine 1 | Remind object (Alma Sana Bracelet vs star bracelet) | Infants: 0.2-5 weeks (mean age 2.5 years); mothers: 20.8-31.4 years (mean age 26.6 years); fathers: 26.1-37.7 years (mean age 31.8 years) | 2497 | 3 |
Irigoyen et al [ | ]United States | July to December 2001 | 6 months | dTPa vaccination rate at 6 months after intervention in infants | Remind web | 6 weeks to 15 months | 1662 | 3 |
Kriss et al [ | ]United States | 2013 | 2 months after giving birth | dTPa (prenatal period) | Remind web (messaging video) | 25.3-25.8 years | 73 | 3 |
Menzies et al [ | ]Australia | February 2015 to December 2015 | 36 months | All vaccines timeliness vaccination | Remind web (email calendar reminders) | 2-8 months (mean age 4 months) | 1594 | 1 |
Sääksvuori et al [ | ]Finland | June 2018 to October 2018 | 5 months | Influenza, all vaccines (low coverage in Western region) | Remind web (email: individual benefits reminder vs individual and social benefit reminder) | >65 years (mean age 75.5 years) | 7398 | 3 |
Chandir et al [ | ]Pakistan | 2006-2007 | 16 months | dTPa full series completion | Reward (food/medicine coupon incentives) | 0-6 months | 3059 | 1 |
Alessandrini et al [ | ]France | October 2016 to January 2017 | 4 months | Influenza | Reward (free vaccination at prenatal consultation ward) | 27.1-38.2 years | 248 | 1 |
aVariables reported were author’s first name, publication year, country, recruitment study year range, follow-up period since the intervention, outcome(s), intervention type and category, mean age range among controls/interventions, and number of enrolled patients.
bdTPa: diphtheria, tetanus, and acellular pertussis.
cMMR: measles, mumps, and rubella.
dHib: Hemophilus influenzae type b.
eAFIX: assessment, feedback, incentives, exchange.
fHPV: human papillomavirus.
gHBV: hepatitis B virus.
hBCG: bacillus Calmette-Guérin.
Study | Randomization | Blinding | An account of all patients | ||||||||
Mentioned | Appropriate | Inappropriate or not mentioned | Mentioned | Appropriate | Inappropriate or not mentioned | Fate of all patients known | Total score | ||||
Quinley and Shih [ | ]3 | ||||||||||
LeBaron et al [ | ]3 | ||||||||||
Irigoyen et al [ | ]3 | ||||||||||
Szilagyi et al [ | ]5 | ||||||||||
Fiks et al [ | ]0 | ||||||||||
Muehleisen et al [ | ]3 | ||||||||||
Kimura et al [ | ]1 | ||||||||||
Schwarz et al [ | ]1 | ||||||||||
Andersson et al [ | ]3 | ||||||||||
Chandir et al [ | ]1 | ||||||||||
Humiston et al [ | ]3 | ||||||||||
Rand et al [ | ]2 | ||||||||||
Gilkey et al [ | ]1 | ||||||||||
Mantzari et al [ | ]2 | ||||||||||
Yoo et al [ | ]0 | ||||||||||
Chamberlain et al [ | ]1 | ||||||||||
Richman et al [ | ]1 | ||||||||||
Brewer et al [ | ]3 | ||||||||||
Zimmerman et al [ | ]3 | ||||||||||
Wong et al [ | ]3 | ||||||||||
Chen et al [ | ]3 | ||||||||||
Domek et al [ | ]3 | ||||||||||
Brown et al [ | ]1 | ||||||||||
Brown et al [ | ]1 | ||||||||||
Ma et al [ | ]2 | ||||||||||
Hu et al [ | ]3 | ||||||||||
Kriss et al [ | ]3 | ||||||||||
Hu et al [ | ]1 | ||||||||||
Nagar et al [ | ]2 | ||||||||||
Esposito et al [ | ]2 | ||||||||||
Rodewald et al [ | ]5 | ||||||||||
Wallace et al [ | ]3 | ||||||||||
Alessandrini et al [ | ]1 | ||||||||||
Borgey et al [ | ]3 | ||||||||||
Lemaitre et al [ | ]1 | ||||||||||
Currat et al [ | ]1 | ||||||||||
Siddiqi et al [ | ]3 | ||||||||||
Blanchi et al [ | ]3 | ||||||||||
Menzies et al [ | ]1 | ||||||||||
Liao et al [ | ]1 | ||||||||||
Yunusa et al [ | ]1 | ||||||||||
Qin et al [ | ]1 | ||||||||||
Levine et al [ | ]3 | ||||||||||
Muñoz-Miralles et al [ | ]1 | ||||||||||
Kagucia et al [ | ]3 | ||||||||||
Sääksvuori et al [ | ]3 |
a1 additional point for the appropriate item, while 0 points are awarded if not appropriate; –1 point is awarded for not mentioned or not the appropriate method. The minimum score for each analyzed section is 0.
Variable | Coefficient | SE | t test (df) | P value | 95% CI | ||||||
Publication year | 0.001 | 0.017 | 0.05 (84) | .96 | –0.034 to 0.036 | ||||||
Continent | |||||||||||
Africa | 0.449 | 0.594 | 0.76 (84) | .45 | –0.736 to 1.635 | ||||||
America | 0.084 | 0.426 | 0.20 (84) | .84 | –0.766 to 0.935 | ||||||
Europa | 1.003 | 0.448 | 2.24 (84) | .03a | 0.108 to 1.898 | ||||||
Asia | 0.192 | 0.485 | 0.40 (84) | .69 | –0.775 to 1.158 | ||||||
Gross national income | 0.013 | 0.163 | 0.08 (84) | .94 | –0.312 to 0.338 | ||||||
Age | |||||||||||
Infant-preschool | 0.069 | 0.209 | 0.33 (84) | .74 | –0.349 to 0.487 | ||||||
Children-adolescent | 0.280 | 0.182 | 1.54 (84) | .13 | –0.082 to 0.643 | ||||||
Adult-middle age | 0.537 | 0.208 | 2.57 (84) | .01a | 0.121 to 0.954 | ||||||
Aged | –0.075 | 0.234 | –0.32 (84) | .75 | –0.542 to 0.392 | ||||||
Follow-up (months) | |||||||||||
6 | –0.238 | 0.669 | –0.36 (84) | .73 | –1.573 to 1.097 | ||||||
12 | 0.277 | 0.685 | 0.40 (84) | .69 | –1.089 to 1.644 | ||||||
>12 | 0.173 | 0.694 | 0.25 (84) | .80 | –1.210 to 1.558 |
aStatistically significant results.
Characteristics, Quality Score, and Results of Meta-Analysis and Meta-Regression for Before-After Studies
Among the 33 before-after studies included, 42% (n=14) were conducted in the American continent, predominantly in the United States (n=13, 39%). Europe accounted for 30% (n=10) of the studies, followed by Asia with 15% (n=5) of the studies. Additionally, 9% (n=3) of the studies were carried out in Africa (Egypt, Kenya, and Nigeria), while only 3% (n=1) were conducted in Australia.
The most prevalent “age categories” were the “child-adolescent” category, accounting for 58% (n=19), followed by the “adult-middle age” category, which comprised 39% (n=13) of the studies.
The most frequent “intervention category” was “multicomponent” (n=16), followed by “educational” studies (n=9). Within the “reminder” studies, 4 were classified as “clinical,” 2 as “messaging,” and 1 each as “active call” and “reward” studies. Further information is provided in
.The scoring system used to assess bias in before-after studies examined various items, with 1 additional point assigned each time the item in question was present. The items in question were clearly stated study question or objective (32/33 studies, 97%); prespecified and clearly described eligibility/selection criteria for the study population (28/33, 85%); study participants representative of those who would be eligible for the test/service/intervention in the general/clinical population of interest (28/33, 85%); whether all eligible participants who met prespecified entry criteria were enrolled (15/33, 45%); sample size large enough to provide confidence (18/33, 55%); test/service/intervention clearly described and delivered consistently across study population (17/33, 52%); prespecified, clearly defined, valid, reliable, and consistently assessed outcome measures across all study participants (19/33, 58%); people who assessed outcomes blinded to participant exposures/interventions (0/33, 0%); losses to follow-up after baseline 20% or less and whether those lost to follow-up were considered in the analysis (19/33, 58%); presence of changes in outcome measures from pre- to postintervention with P values statistically examined for pre-post changes (27/33, 82%); and outcome measures taken several times before the intervention/after the intervention (15/33, 45%). The evaluation of the quality score of the before-after studies revealed that 8 studies attained the maximum score of 8. Among these, 4 were categorized as “educational” [
- ], 2 as “multicomponent” [ , ], and 2 as “reminder clinical” [ , ]. By contrast, the lowest score of 4 was assigned to 2 studies: 1 categorized as “reminder clinical” [ ] and the other as “reminder messaging” [ ] ( ).The meta-analyses results for before-after studies indicated a statistically significant RR of 1.70 (P<.001). Subgroup analyses, as detailed in
, revealed that the most efficacious intervention reported was the “reminder active call” intervention (RR 2.19; P<.001), followed by “educational” (RR 2.16; P<.001) and “multicomponent” (RR 1.61; P<.001) interventions. Heterogeneity and significance tests for the type of intervention are provided in - .Meta-regression analyses were conducted for before-after studies, incorporating the following variables: quality score, publication year, continent, GNI, age category, intervention type, and follow-up time since the intervention. The variable associated with a statistically significant increase in vaccination coverage was the age category “adult-middle age” (coefficient 1.27; P=.01;
).Publication | Country | Recruitment/study year range | Follow-up time since intervention | Outcome (vaccination coverage) | Type of intervention | Age range | Number of patients enrolled | Quality score assigned |
Gargano et al [ | ]United States | 2008-2009 | 12 months | Influenza (2008-2009 and 2009-2010) | Education (a school-based educational intervention in rural Georgia) | 12-18 years | 3916 | 8 |
Chen et al [ | ]China | 2006-2007 | <6 months | HBVb | Education (a pilot program for HBV education in rural China) | 5-12 years | 2833 | 6 |
Suryadevara et al [ | ]United States | 2011-2012 | 9 months | Full series completion for all vaccines | Education (an educational intervention for resource-poor families) | 0-18 years | 1531 | 8 |
Toleman et al [ | ]United Kingdom | 2012-2014 | 24 months | Influenza and pneumococcal (ill patients with cancer) | Education (implementation of clinical guidelines to educate health care workers; outcome for vaccination rates in chemotherapy patients) | Adults >80 years | 200 | 6 |
Sengupta et al [ | ]India | 2013-2014 | 14 months | dTPac, OPVd, and HBV full series completion | Education (an educational intervention on the migrant population) | 9-12 months | 647 | 5 |
Costantino et al [ | ]Italy | October 2016 to November 2016 | 6 months | Influenza (health care workers) | Education (an educational intervention on influenza vaccination conducted at “Paolo Giaccone” University Hospital of Palermo for the 2016/2017 seasonal influenza vaccination campaign) | 18-65 years | 125 | 7 |
Wallace-Brodeur et al [ | ]United States | 2016 | 36 months | HPV full series completion | Education (quality improvement and educational training of participants) | 13-17 years | 26,763 | 8 |
Glanternik et al [ | ]United States | May 2015 to July 2015 | 7 months | All vaccines | Education (a training intervention of physicians to help improve communication and provide education to vaccine-hesitant parents; evaluation of outcomes for infants vaccinated) | Physicians: 24-65 years; infants: 0-6 months | 13,425 | 7 |
Costantino et al [ | ]Italy | October 2019 to October 2020 | 13 months | Influenza, dTPa, and influenza + dTPa | Education (an educational intervention during childbirth classes) | 18-40 years (pregnant women) | 326 | 8 |
Paunio et al [ | ]Finland | 1982 | 75 months | MMRe | Multicomponent (mass media and individual approach) | 14 months to 6 years | 562,932 | 6 |
Abd Elaziz et al [ | ]Egypt | 2008 | 1 month | MMR | Multicomponent (posters, flyers, and messages) | 16-23 years (medical and nonmedical students) | 651 | 6 |
Llupià et al [ | ]Spain | 2008-2009 influenza season | 6 months | Influenza (health care workers) | Multicomponent (messages sent by emails, rewards, and a web page) | >18 years | 9632 | 7 |
Cushon et al [ | ]Canada | 2007-2009 | 10 months | MMR | Multicomponent (phone calls, letters, reminders, and home visits) | 14-20 months | 24,540 | 8 |
Aspesi et al [ | ]United States | 2010-2011 | 9 months | Pneumococcal | Multicomponent (checklist, educational pocket cards, and handout) | All ages (hospitalized patients) | 2258 | 6 |
Hu et al [ | ]China | 2011-2014 | 32 months | All vaccines | Multicomponent (a training program for vaccinators, a screening tool to identify vaccination demands among migrant clinic attendants, and social mobilization for immunization) | 1-4 years (infants: n=1288; preschool: n=260) | 1548 | 6 |
Baker et al [ | ]United States | 2013-2014 | 12 months | PCVf 13 + PPV23g | Multicomponent (system-level intervention at an academic rheumatology clinic that included electronic reminders with linked order sets, physician auditing and feedback, and patient outreach) | Mean age: 57 years (patients with rheumatoid arthritis) | 1255 | 6 |
Mazzoni et al [ | ]United States | 2010-2014 | 24 months | dTPa, influenza, and HPVh 9 (perinatal period) | Multicomponent (stocking of immunizations in clinics, revision and expansion of standing orders, creation of a reminder/recall program, identification of an immunization champion to give direct provider feedback, expansion of a payment assistance program, and staff education) | dTPa: 20.7-33.4 years (mean age 27.4 years); influenza: 19.1-40.8 years (mean age 29.9 years); HPV 9: 19-25.1 years (mean age 22.3 years) | dTPa: 2710; influenza: 19,409; and HPV: 12,443 | 5 |
Mustafa et al [ | ]Qatar | 2014-2015 | 4 months | Influenza (health care workers and hospital B) | Multicomponent (promotional, educational, and vaccine delivery interventions; a dedicated influenza vaccination team; telephone hotline; free influenza vaccination with improved access; leadership involvement; incentives; group educational sessions; and reporting/tracking activities) | 18-65 years | Hospital A: 15,341; hospital B: 16,357 | 6 |
Nzioki et al [ | ]Kenya | 2012-2014 | 18 months | All vaccines | Multicomponent (community mobilization and identification and training of volunteer community health workers; enumeration, mapping of households, and creating community units; and recruitment and training of community health extension workers) | 0-1 year | 833 | 5 |
Varman et al [ | ]United States | 2015-2016 | 8 months | HPV 9 full series completion | Multicomponent (clinic discussion and introduction of a multilevel intervention aiming at avoiding missed opportunities, reminder emails, and educating patients) | 13-17 years (intervention on parents) | 3393 | 6 |
Poscia et al [ | ]Italy | 2015 | 8 months | All vaccines | Multicomponent (a 90-minute health promotion intervention, which includes a theoretical introduction and an interactive role-play technique. Parents provided informed consent and received an invitation to a meeting with the project team) | 11.3-13.3 years (mean age 12.3 years) | 801 | 7 |
Kaufman et al [ | ]Australia | October 2018 to December 2018 | 3 months | Influenza and pertussis | Multicomponent (the intervention targets all 3 levels of the health care encounter—the practice, provider, and parent levels (P3). The intervention included midwife prompts and vaccine communication training, a website, fact sheets, and parent SMS text message reminders) | 21-40 years (mean age 32 years); outcome for infants | 62 | 8 |
Podraza et al [ | ]United States | July 2020 | 5 months | Meningococcal ACWY and meningococcal B | Multicomponent (multicomponent intervention) | 16-19 years | 335 | 7 |
Akwataghibe et al [ | ]Nigeria | May 2016 to December 2016 | 4 months | All vaccines | Multicomponent (cycles of dialog and action between community members, frontline health workers, and local government officials in 2 wards of Remo North, facilitated by the research team) | >9 months (more than half of the child sample was aged >2 years) | 340 | 7 |
Perkins et al [ | ]United States | January 2017 to December 2017 | 12 months | HPV 9 full series completion | Multicomponent (multilevel intervention: provider training and ≥1 other evidence-based systems improvement) | 13 years | 3283 | 7 |
Cecinati et al [ | ]Italy | 2006-2007 | <6 months | Influenza (ill patients with cancer) | Remind active call (telephone recall system managed by pediatricians who usually follow-up ill children with cancer) | 10 years (intervention on parents) | 205 | 7 |
Lam et al [ | ]United States | 2010-2011 | 1 month | dTPa | Clinical reminder (face-to-face reminder at the gynecological visit) | Adults aged >80 years and women (child-bearing age or with frequent exposure to children) | 2309 | 7 |
Gattis et al [ | ]United States | 2011-2016 | 36 months | Influenza (transplanted patients) | Clinical reminder (face-to-face reminder for transplanted patients with the implementation of the transplant pharmacy vaccine program) | 10.8-11.3 years | 3044 | 8 |
Gossec et al [ | ]France | May 2014 to October 2015 | 36 months | Influenza and pneumococcal | Clinical reminder (nurse visit for comorbidity counseling and for vaccination execution) | Patients with rheumatoid arthritis: 18-80 years (mean age 58.0 years) | 970 | 8 |
Hernández-García and Aibar-Remón [ | ]Spain | November 2014 to June 2018 | —i | PCV 13 + PPV23 | Clinical reminder (hospital vaccine consultation) | Adults aged >80 years (patients with chronic kidney disease) | 101 | 4 |
Nguyen et al [ | ]Vietnam | 2013-2015 | 12 months | Timely vaccination for all vaccines | Remind messaging (SMS text message reminders) | Children | 7371 | 4 |
Esteban-Vasallo et al [ | ]Spain | 2016 (influenza vaccination campaign) | .4 months | Influenza (patients with rare disease) | Remind messaging (SMS text message reminders) | 47-68 years | 106,987 | 7 |
Fairbrother et al [ | ]United States | 1993-1996 | — | dTPa, OPV, HBV, Hibj, and MMR | Reward (distribution of free vaccines to health care providers) | 3 months to 3 years | 3211 | 7 |
aVariables reported were author’s first name, publication year, country, recruitment study year range, follow-up period since the intervention, outcome(s), intervention type and category, mean age range among controls/interventions, and number of enrolled patients.
bHBV: hepatitis B virus.
cdTPa: diphtheria, tetanus, and acellular pertussis.
dOPV: oral polio vaccine.
eMMR: measles, mumps, and rubella.
fPCV: pneumococcal conjugate vaccine.
gPPV: pneumococcal polysaccharide vaccine.
hHPV: human papillomavirus.
iNot available.
jHib: Hemophilus influenzae type b.
Scoring system | 1b | 2c | 3d | 4e | 5f | 6g | 7h | 8i | 9j | 10k | 11l | Total, n |
Paunio et al [ | ]6 | |||||||||||
Fairbrother et al [ | ]7 | |||||||||||
Abd Elaziz et al [ | ]6 | |||||||||||
Llupià et al [ | ]N/Am | 7 | ||||||||||
Cecinati et al [ | ]7 | |||||||||||
Gargano et al [ | ]8 | |||||||||||
Chen et al [ | ]6 | |||||||||||
Cushon et al [ | ]8 | |||||||||||
Lam et al [ | ]7 | |||||||||||
Suryadevara et al [ | ]8 | |||||||||||
Aspesi et al [ | ]6 | |||||||||||
Toleman et al [ | ]6 | |||||||||||
Hu et al [ | ]6 | |||||||||||
Baker et al [ | ]6 | |||||||||||
Mazzoni et al [ | ]5 | |||||||||||
Nzioki et al [ | ]5 | |||||||||||
Nguyen et al [ | ]4 | |||||||||||
Mustafa et al [ | ]6 | |||||||||||
Sengupta et al [ | ]5 | |||||||||||
Varman et al [ | ]6 | |||||||||||
Gossec et al [ | ]8 | |||||||||||
Esteban-Vasallo et al [ | ]7 | |||||||||||
Poscia et al [ | ]7 | |||||||||||
Costantino et al [ | ]7 | |||||||||||
Gattis et al [ | ]8 | |||||||||||
Wallace-Brodeur et al [ | ]8 | |||||||||||
Glanternik et al [ | ]7 | |||||||||||
Kaufman et al [ | ]8 | |||||||||||
Costantino et al [ | ]8 | |||||||||||
Podraza et al [ | ]7 | |||||||||||
Akwataghibe et al [ | ]7 | |||||||||||
Perkins et al [ | ]7 | |||||||||||
Hernández-García and Aibar-Remón [ | ]4 |
a1 additional point for the appropriate item, 0 points if inappropriate. A negative score is not expected.
bWas the study question or objective clearly stated?
cWere eligibility/selection criteria for the study population prespecified and clearly described?
dWere the participants in the study representative of those who would be eligible for the test/service/intervention in the general or clinical population of interest?
eWere all eligible participants that met the prespecified entry criteria enrolled?
fWas the sample size sufficiently large to provide confidence in the findings?
gWas the test/service/intervention clearly described and delivered consistently across the study population?
hWere the outcome measures prespecified, clearly defined, valid, reliable, and assessed consistently across all study participants?
iWere the people assessing the outcomes blinded to the participants’ exposures/interventions?
jWas the loss to follow-up after baseline 20% or less? Were those lost to follow-up accounted for in the analysis?
kDid the statistical methods examine changes in outcome measures from before to after the intervention? Were statistical tests done that provided P values for the pre-to-post changes?
lWere outcome measures of interest taken multiple times before the intervention and multiple times after the intervention (ie, did they use an interrupted time-series design)?
mN/A: not applicable.
Variable | Coefficient | SE | t test (df) | P value | 95% CI | |||||||
Quality score | 0.21 | 0.18 | 1.20 (45) | .24 | –0.15 to 0.57 | |||||||
Publication year | –0.002 | 0.03 | –0.08 (45) | .94 | –0.06 to 0.05 | |||||||
Continent | ||||||||||||
Africa | –0.06 | 0.66 | –0.09 (45) | .93 | –1.43 to 1.31 | |||||||
America | –0.14 | 0.33 | –0.44 (45) | .67 | –0.82 to 0.53 | |||||||
Australia | –0.32 | 0.64 | –0.51 (45) | .62 | –0.98 to 1.63 | |||||||
Asia | –0.08 | 0.54 | –0.14 (45) | .89 | –1.20 to 1.04 | |||||||
Gross national income | ||||||||||||
Low income | 0.06 | 0.36 | 0.17 (45) | .87 | –0.68 to 0.80 | |||||||
Low-middle income | 0.51 | 0.56 | 0.92 (45) | .37 | –0.63 to 1.66 | |||||||
Upper-high income | 0.51 | 0.73 | 0.70 (45) | .49 | –0.99 to 2.02 | |||||||
Intervention type | ||||||||||||
Education | –0.16 | 0.75 | –0.21 (45) | .84 | –1.70 to 1.39 | |||||||
Multicomponent | –0.38 | 0.70 | –0.54 (45) | .60 | –1.84 to 1.08 | |||||||
Active call | 0.25 | 0.98 | 0.25 (45) | .80 | –1.77 to 2.26 | |||||||
Clinical remind | –0.67 | 0.84 | –0.80 (45) | .43 | –2.40 to 1.05 | |||||||
Remind messaging | –0.45 | 0.86 | –0.52 (45) | .61 | –2.23 to 1.33 | |||||||
Age | ||||||||||||
Infant-preschool | –0.19 | 0.31 | –0.61 (45) | .55 | –0.83 to 0.45 | |||||||
Children-adolescent | –0.05 | 0.29 | –0.17 (45) | .87 | –0.65 to 0.55 | |||||||
Adult-middle age | 1.27 | 0.28 | 4.54 (45) | <.001a | 0.70 to 1.84 | |||||||
Aged | –0.75 | 0.38 | –1.95 (45) | .06 | –1.54 to 0.04 | |||||||
Follow-up | ||||||||||||
12 months | 0.37 | 0.32 | 1.17 (45) | .25 | –0.29 to 1.03 | |||||||
>12 months | 0.05 | 0.32 | 0.14 (45) | .89 | –0.62 to 0.71 |
aStatistically significant results.
Discussion
Principal Findings
Catch-up vaccination strategies are crucial components of a comprehensive national immunization program and should be continually integrated [
, ]. Understanding the effectiveness of vaccination interventions is essential for selecting those best suited to diverse sociodemographic contexts. Therefore, this research included RCTs and before-after studies, recognized as effective catch-up strategies.In general, catch-up interventions identified in the studies, categorized into 4 groups (“multicomponent,” “educational,” “remind,” and “reward studies”), demonstrated effectiveness in promoting adherence to vaccination. However, practices associated with certain types of “reward” interventions did not exhibit statistical significance [
, ]. Reminder and recall interventions are used to prompt individuals within a target population regarding upcoming vaccinations (recall) or overdue vaccinations (reminder). These strategies vary in content based on the type of vaccination and the target demographic. They are implemented through various methods, including telephone calls with active reminders; messaging via SMS text messages, emails, or traditional mails; in-person reminders within clinical settings; the use of physical objects as reminders; and reminders via web-based platforms. Active call interventions have been shown to significantly enhance vaccination adherence rates. This is likely because telephone contact provides direct access to health care professionals who can address patients’ concerns and inquiries. Moreover, active calls serve as a reminder tool that is easily accessible and adaptable, even in resource-constrained settings. For instance, a study conducted in Nigeria demonstrated that vaccination uptake doubled among newborns whose mothers received calls from health care workers at vaccination centers [ ].Vaccination reminder interventions conducted through messaging (SMS text messages, emails, letters, and notifications) are also effective, although they tend to have a lesser impact compared with “active calls” [
]. This could be attributed to the limitations of “messaging reminders” interventions, such as the inability to engage in immediate question-and-answer discussions with health care workers and the challenge of personalizing the SMS text message, which is often predefined and sent using automated software [ ]. Despite the limitations, the widespread use of mobile technologies enables rapid and effortless communication with large communities of people. Additionally, considering the low cost and ubiquity of mobile phones, “messaging reminders” could prove to be an excellent strategy for implementation, especially in low- and middle-income countries [ , ].Another highly effective strategy for increasing vaccination coverage is the “clinical-remind” approach, where all vaccination promotion interventions occur directly within hospital or primary care settings. Offering vaccination to patients during hospital visits for examinations, consultations, or treatments is a strategy endorsed by the World Health Organization (WHO) to minimize missed opportunities for vaccination. This approach aims to enhance health care service delivery and foster seamless collaboration among health care professionals [
]. A randomized study conducted in Georgia in 2018 serves as a demonstration of this strategy. In the study, the tetanus, diphtheria, and pertussis (Tdap) vaccine was offered to pregnant women during gynecological visits in antenatal clinics. Results indicated a higher willingness to receive vaccination among pregnant women in the intervention group compared with the control arm [ ]. Presently, the Advisory Committee on Immunization Practices (ACIP) recommends that pregnant women receive the Tdap vaccine during each pregnancy, regardless of their immunization history [ ]. Despite recommendations, maternal Tdap vaccination coverage remains low, not only in the United States but also in many other parts of the world. However, evidence suggests that vaccination strategies involving patient engagement in a clinical setting can effectively increase coverage [ ].The results further highlight the effectiveness of “educational interventions” in vaccine catch-up efforts. Health education stands as one of the primary tools for ensuring that a population has access to health care services. As early as 1983, the WHO recognized health education as a universal right of communities [
]. This right can be realized through integrated information and education programs, aiming to enhance both the population’s desire for good health and their ability to discern the validity of the information they receive [ ]. Lack of knowledge and misinformation stand as the primary barriers impeding widespread access to vaccination [ ]. Addressing these challenges necessitates a shift toward a more suitable educational approach within the vaccination context. Particularly, among the selected educational interventions, those based on face-to-face dialog between patients and health care professionals emerge as the most effective. An RCT conducted in Italy, aimed at evaluating the impact of various types of educational programs targeting the adolescent population, demonstrated that face-to-face lessons are more effective in increasing vaccination coverage compared with web-based lessons [ ].A highly effective strategy for boosting vaccination coverage is the multidimensional approach, which emerged as the most frequently utilized in the studies included in this review. This approach encompasses interventions that combine vaccination reminder tools with awareness sessions and patient education on vaccination. These interventions are implemented through multiple steps and in various formats. According to the Strategic Advisory Group of Experts on Immunization (SAGE), “multicomponent” interventions are more effective than those with a single component. By addressing various aspects, they are more successful in enhancing knowledge and awareness and in fostering psychological shifts and attitude changes toward vaccinations [
]. A compelling example comes from a before-after study conducted at a rheumatology clinic in Illinois, United States. This study implemented a multifaceted intervention, which included electronic reminders with linked order sets, physician auditing, and patient outreach, resulting in improved patient vaccination rates [ ].The meta-regression analysis indicated a higher effectiveness of vaccination interventions in the European continent compared with other geographic regions. This finding is likely a reflection of the disparity in economic resources and access to health care services between high-income and low-middle-income countries [
]. There is no one-size-fits-all approach to vaccine catch-up that proves effective across all contexts and realities. This is especially true for developing countries, where scientific evidence remains limited. Many vaccine interventions in the WHO African Region, reviewed by the SAGE to develop guidelines addressing vaccine hesitancy, are often documented in the gray literature, which was not encompassed in our review [ ]. However, this research has unveiled findings that hold potential global relevance. For instance, health strategies centered around reminders have proven to be effective and cost-efficient, making them particularly suitable for countries with limited resources [ ]. Conversely, the significant success observed in certain vaccination programs conducted in the European continent underscores the importance of evaluating the performance of vaccination services in these countries [ , , , ]. As of now, there remains a lack of standardized protocols for immunization services aimed at monitoring and improving service quality. Progress in this area has stagnated since the drafting of the National Vaccine Advisory Committee’s standards for vaccination services in the 1980s [ ]. However, some authors have proposed models to develop accreditation manuals for vaccination services. These manuals would establish a minimum set of quality standards to ensure the delivery of high-quality preventive health care services. Such standards are crucial for optimizing service effectiveness and ensuring the efficient allocation of economic resources toward public health initiatives [ , ].Finally, the meta-regression results also revealed the effectiveness of various interventions aimed at vaccination catch-up among a specific demographic: middle-aged adults. This finding may be attributed to the organization of vaccination services by age group. Historically, the majority of vaccines have been developed for pediatric populations, and extensive national and international collaborative efforts have strongly supported mass immunization of the youngest individuals, even in developed countries, to ensure adequate access to life-saving vaccines. Moreover, childhood vaccination programs are typically uniform, well-defined, and bolstered by annual monitoring of vaccine dissemination and its impact on reducing morbidity and mortality. Conversely, reaching the adult population with standard vaccine delivery methods can be more challenging. However, catch-up vaccination and recall interventions have the potential to be highly effective in enhancing coverage among adults.
The older age population, aged 65 years and over, faces a lack of dedicated vaccination programs tailored for their age group, despite being the demographic most vulnerable to the risks and complications associated with infectious diseases [
]. In 2009, 2 geriatric societies, the European Geriatric Medicine Society (EUGMS) and the International Association of Gerontology and Geriatrics-European Region (IAGGER), formulated guidelines outlining recommended vaccinations for the geriatric population. Despite these efforts, the vaccination provision for older patients continues to vary widely among different European countries [ ]. The ongoing challenge is to develop vaccination programs for older adults that are as comprehensive and effective as those designed for children.Moreover, numerous vaccination catch-up interventions rely on “reminder” strategies, which entail sending SMS text messages or emails and providing information through dedicated web pages [
, , ]. While the utilization of mobile technologies can be a significant asset for vaccination strategies targeting adolescents and adults, it may pose a challenge for the older age population. Alternative intervention modalities may thus prove more suitable. For instance, a study conducted in France aimed at offering recommended vaccinations to hospitalized patients demonstrated a significant increase in vaccination coverage [ ]. Providing vaccination counseling in hospital or outpatient settings could be the most effective strategy for achieving widespread vaccination among the older age population.Comparison With Prior Studies
We identified several prior meta-analyses, published between 2017 and 2018, that investigated the impact of vaccine interventions targeting specific population groups or focused on particular types of interventions [
]. Although patient reminder and recall systems have been extensively studied, the existing literature does not provide data on the potential impact of other vaccine catch-up interventions [ ]. Moreover, the search strategy for this systematic review was not confined to any specific geographical context or timeframe, nor was it designed to target a particular type of vaccination. Our study offers an analysis of various vaccination strategies, enabling the identification of the most suitable interventions for each population and vaccination category, across diverse sociodemographic contexts.Limitations
The search strategy for this systematic review did not encompass gray literature documents and reports. Although the investigation covered all geographical contexts, the majority of the selected and included studies were conducted in developed countries. This bias may arise because some studies on vaccinations and recall interventions in developing countries are typically found in gray literature. Furthermore, no vaccination catch-up interventions related to the COVID-19 vaccine were included. The COVID-19 vaccination, being introduced during an emergency pandemic situation, is not part of the scheduled vaccination regimen. Despite these limitations, this study is among the first to investigate a broad array of vaccine catch-up strategies for scheduled vaccines, encompassing recent studies targeting all age groups of the population.
Conclusions
Vaccination reminder interventions, incorporating educational sessions for the population and utilizing various reminder methods such as SMS text messages and calls, as well as multifaceted interventions combining multiple strategies, have demonstrated effectiveness in enhancing vaccination coverage. However, it is important to note that there is no universal catch-up strategy that performs well across all contexts and realities. It is essential to adopt the most suitable intervention strategy based on the patient category, resource availability, and the socioeconomic status of the target population to be vaccinated.
Authors' Contributions
AF and WP contributed equally to this study. AF, WP, AC, and VR were responsible for the conceptualization and were actively involved in planning the methodology. AF, WP, AC, PF, VP, and AC contributed equally to the investigation and project administration. AF and WP drafted the original manuscript. VR and AC provided critical advice. VR verified the underlying data reported in the manuscript. All authors reviewed, edited, and approved the final version of the manuscript. All authors had full access to all the data in the study and took responsibility for the decision to submit the manuscript for publication.
Conflicts of Interest
None declared.
PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analysis) checklist.
PDF File (Adobe PDF File), 145 KBSearch strategy.
DOCX File , 13 KBHeterogeneity test for randomized controlled trial included studies.
DOCX File , 16 KBForest plots of intervention for randomized controlled trial included studies.
DOCX File , 308 KBForest plots of intervention for before-after included studies.
DOCX File , 139 KBFunnel plot of randomized controlled trial included studies.
DOCX File , 128 KBHeterogeneity test for before-after included studies.
DOCX File , 15 KBFunnel plot of before-after included studies.
DOCX File , 48 KBReferences
- World Health Organization (WHO). Global immunization policies and guidelines. WHO recommendations for routine immunization - summary tables 2021. In: WHO. Geneva, Switzerland. WHO; 2021.
- Fine P, Eames K, Heymann DL. "Herd immunity": a rough guide. Clin Infect Dis. Apr 01, 2011;52(7):911-916. [CrossRef] [Medline]
- World Health Organization (WHO). Immunization coverage. WHO. URL: https://www.who.int/en/news-room/fact-sheets/detail/immunization-coverage [accessed 2024-06-09]
- Bright T, Felix L, Kuper H, Polack S. A systematic review of strategies to increase access to health services among children in low and middle income countries. BMC Health Serv Res. Apr 05, 2017;17(1):252. [FREE Full text] [CrossRef] [Medline]
- Hardt K, Bonanni P, King S, Santos JI, El-Hodhod M, Zimet GD, et al. Vaccine strategies: optimising outcomes. Vaccine. Dec 20, 2016;34(52):6691-6699. [FREE Full text] [CrossRef] [Medline]
- Subaiya S, Dumolard L, Lydon P, Gacic-Dobo M, Eggers R, Conklin L. Global routine vaccination coverage, 2014. MMWR Morb Mortal Wkly Rep. Nov 13, 2015;64(44):1252-1255. [FREE Full text] [CrossRef] [Medline]
- European Centre for Disease Prevention and Control (ECDC). Annual epidemiological reports (AERs). ECDC. URL: https://www.ecdc.europa.eu/en/publications-data/monitoring/all-annual-epidemiological-reports [accessed 2024-06-09]
- Markowitz LE, Naleway AL, Lewis RM, Crane B, Querec TD, Weinmann S, et al. Declines in HPV vaccine type prevalence in women screened for cervical cancer in the United States: evidence of direct and herd effects of vaccination. Vaccine. Jun 27, 2019;37(29):3918-3924. [CrossRef] [Medline]
- de Gomensoro E, Del Giudice G, Doherty TM. Challenges in adult vaccination. Ann Med. May 16, 2018;50(3):181-192. [CrossRef] [Medline]
- World Health Organization (WHO). Ten threats to global health. WHO. 2019. URL: https://www.who.int/emergencies/ten-threats-to-global-health-in-2019 [accessed 2024-06-09]
- Lane S, MacDonald NE, Marti M, Dumolard L. Vaccine hesitancy around the globe: analysis of three years of WHO/UNICEF Joint Reporting Form data-2015-2017. Vaccine. Jun 18, 2018;36(26):3861-3867. [FREE Full text] [CrossRef] [Medline]
- Reñosa MDC, Landicho J, Wachinger J, Dalglish SL, Bärnighausen K, Bärnighausen T, et al. Nudging toward vaccination: a systematic review. BMJ Glob Health. Sep 30, 2021;6(9):e006237. [FREE Full text] [CrossRef] [Medline]
- Sadaf A, Richards JL, Glanz J, Salmon DA, Omer SB. A systematic review of interventions for reducing parental vaccine refusal and vaccine hesitancy. Vaccine. Sep 13, 2013;31(40):4293-4304. [CrossRef] [Medline]
- Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. Mar 29, 2021;372:n71. [FREE Full text] [CrossRef] [Medline]
- Restivo V, Priano W, Fallucca A. Systematic review and meta-analysis of vaccination coverage effectiveness through catch up intervention. PROSPERO. 2023. URL: https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=307311 [accessed 2024-06-09]
- Willis N, Hill S, Kaufman J, Lewin S, Kis-Rigo J, De Castro Freire SB, et al. "Communicate to vaccinate": the development of a taxonomy of communication interventions to improve routine childhood vaccination. BMC Int Health Hum Rights. May 11, 2013;13(1):23. [FREE Full text] [CrossRef] [Medline]
- Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, et al. GRADE guidelines: 1. Introduction-GRADE evidence profiles and summary of findings tables. J Clin Epidemiol. Apr 2011;64(4):383-394. [CrossRef] [Medline]
- Jadad AR, Moore R, Carroll D, Jenkinson C, Reynolds DM, Gavaghan DJ, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials. Feb 1996;17(1):1-12. [CrossRef] [Medline]
- National Heart, Lung, and Blood Institute. Study quality assessment tools. NIH. URL: https://www.nhlbi.nih.gov/health-topics/study-quality-assessment-tools [accessed 2024-06-09]
- Rodewald L, Szilagyi P, Humiston S, Barth R, Kraus R, Raubertas R. A randomized study of tracking with outreach and provider prompting to improve immunization coverage and primary care. Pediatrics. Jan 1999;103(1):31-38. [CrossRef] [Medline]
- Szilagyi PG, Schaffer S, Barth R, Shone LP, Humiston SG, Ambrose S, et al. Effect of telephone reminder/recall on adolescent immunization and preventive visits: results from a randomized clinical trial. Arch Pediatr Adolesc Med. Feb 01, 2006;160(2):157-163. [CrossRef] [Medline]
- Kimura AC, Nguyen CN, Higa JI, Hurwitz EL, Vugia DJ. The effectiveness of vaccine day and educational interventions on influenza vaccine coverage among health care workers at long-term care facilities. Am J Public Health. Apr 2007;97(4):684-690. [CrossRef]
- Schwarz K, Garrett B, Lee J, Thompson D, Thiel T, Alter MJ, et al. Positive impact of a shelter-based hepatitis B vaccine program in homeless Baltimore children and adolescents. J Urban Health. Mar 15, 2008;85(2):228-238. [FREE Full text] [CrossRef] [Medline]
- Chamberlain A, Seib K, Ault K, Rosenberg E, Frew P, Cortés M, et al. Improving influenza and Tdap vaccination during pregnancy: a cluster-randomized trial of a multi-component antenatal vaccine promotion package in late influenza season. Vaccine. Jul 09, 2015;33(30):3571-3579. [FREE Full text] [CrossRef] [Medline]
- Richman AR, Maddy L, Torres E, Goldberg EJ. A randomized intervention study to evaluate whether electronic messaging can increase human papillomavirus vaccine completion and knowledge among college students. J Am Coll Health. Jan 29, 2016;64(4):269-278. [CrossRef] [Medline]
- Currat M, Lazor-Blanchet C, Zanetti G. Promotion of the influenza vaccination to hospital staff during pre-employment health check: a prospective, randomised, controlled trial. J Occup Med Toxicol. Nov 18, 2020;15(1):34. [FREE Full text] [CrossRef] [Medline]
- Menzies R, Heron L, Lampard J, McMillan M, Joseph T, Chan J, et al. A randomised controlled trial of SMS messaging and calendar reminders to improve vaccination timeliness in infants. Vaccine. Mar 30, 2020;38(15):3137-3142. [CrossRef] [Medline]
- Liao Q, Fielding R, Cheung Y, Lian J, Yuan J, Lam W. Effectiveness and parental acceptability of social networking interventions for promoting seasonal influenza vaccination among young children: randomized controlled trial. J Med Internet Res. Feb 28, 2020;22(2):e16427. [FREE Full text] [CrossRef] [Medline]
- Yunusa U, Ibrahim AH, Ladan MA, Gomaa HEM. Effect of mobile phone text message and call reminders in the completeness of pentavalent vaccines in Kano state, Nigeria. J Pediatr Nurs. May 2022;64:e77-e83. [CrossRef] [Medline]
- Gilkey MB, Dayton AM, Moss JL, Sparks AC, Grimshaw AH, Bowling JM, et al. Increasing provision of adolescent vaccines in primary care: a randomized controlled trial. Pediatrics. Aug 2014;134(2):e346-e353. [FREE Full text] [CrossRef] [Medline]
- Brown VB, Oluwatosin OA, Akinyemi JO, Adeyemo AA. Effects of community health nurse-led intervention on childhood routine immunization completion in primary health care centers in Ibadan, Nigeria. J Community Health. Apr 22, 2016;41(2):265-273. [CrossRef] [Medline]
- Lemaitre T, Carrier N, Farrands A, Gosselin V, Petit G, Gagneur A. Impact of a vaccination promotion intervention using motivational interview techniques on long-term vaccine coverage: the PromoVac strategy. Hum Vaccin Immunother. Jan 04, 2019;15(3):732-739. [FREE Full text] [CrossRef] [Medline]
- Muñoz-Miralles R, Bonvehí Nadeu S, Sant Masoliver C, Martín Gallego A, Gómez Del Canto J, Mendioroz Peña J, et al. Effectiveness of a brief intervention for acceptance of influenza vaccine in reluctant primary care patients. Gac Sanit. Sep 2022;36(5):446-451. [FREE Full text] [CrossRef] [Medline]
- Brown VB, Oluwatosin OA. Feasibility of implementing a cellphone-based reminder/recall strategy to improve childhood routine immunization in a low-resource setting: a descriptive report. BMC Health Serv Res. Dec 04, 2017;17(Suppl 2):703. [FREE Full text] [CrossRef] [Medline]
- Hu Y, Li Q, Chen Y. Evaluation of two health education interventions to improve the varicella vaccination: a randomized controlled trial from a province in the east China. BMC Public Health. Jan 16, 2018;18(1):144. [FREE Full text] [CrossRef] [Medline]
- Qin W, Song J, Wang Y, Nie T, Pan F, Xu X, et al. Upgrading the school entry vaccination record check strategy to improve varicella vaccination coverage: results from a quasi-experiment study. Hum Vaccin Immunother. Sep 02, 2021;17(9):3137-3144. [FREE Full text] [CrossRef] [Medline]
- Chandir S, Khan A, Hussain H, Usman H, Khowaja S, Halsey N, et al. Effect of food coupon incentives on timely completion of DTP immunization series in children from a low-income area in Karachi, Pakistan: a longitudinal intervention study. Vaccine. Apr 26, 2010;28(19):3473-3478. [CrossRef] [Medline]
- Alessandrini V, Anselem O, Girault A, Mandelbrot L, Luton D, Launay O, et al. Does the availability of influenza vaccine at prenatal care visits and of immediate vaccination improve vaccination coverage of pregnant women? PLoS One. Aug 1, 2019;14(8):e0220705. [FREE Full text] [CrossRef] [Medline]
- Fiks A, Grundmeier R, Biggs L, Localio A, Alessandrini E. Impact of clinical alerts within an electronic health record on routine childhood immunization in an urban pediatric population. Pediatrics. Oct 2007;120(4):707-714. [CrossRef] [Medline]
- Yoo B, Humiston SG, Szilagyi PG, Schaffer SJ, Long C, Kolasa M. Cost effectiveness analysis of Year 2 of an elementary school-located influenza vaccination program-results from a randomized controlled trial. BMC Health Serv Res. Nov 16, 2015;15(1):511. [FREE Full text] [CrossRef] [Medline]
- LeBaron CW, Starnes DM, Rask KJ. The impact of reminder-recall interventions on low vaccination coverage in an inner-city population. Arch Pediatr Adolesc Med. Mar 01, 2004;158(3):255-261. [CrossRef] [Medline]
- Brewer N, Hall M, Malo T, Gilkey M, Quinn B, Lathren C. Announcements versus conversations to improve HPV vaccination coverage: a randomized trial. Pediatrics. Jan 2017;139(1):a. [CrossRef] [Medline]
- Wong VWY, Fong DYT, Lok KYW, Wong JYH, Sing C, Choi AY, et al. Brief education to promote maternal influenza vaccine uptake: a randomized controlled trial. Vaccine. Oct 17, 2016;34(44):5243-5250. [CrossRef] [Medline]
- Hu Y, Chen Y, Wang Y, Song Q, Li Q. Prenatal vaccination education intervention improves both the mothers' knowledge and children's vaccination coverage: Evidence from randomized controlled trial from eastern China. Hum Vaccin Immunother. Jun 03, 2017;13(6):1-8. [FREE Full text] [CrossRef] [Medline]
- Esposito S, Bianchini S, Tagliabue C, Umbrello G, Madini B, Di Pietro G, et al. Impact of a website based educational program for increasing vaccination coverage among adolescents. Hum Vaccin Immunother. Apr 03, 2018;14(4):961-968. [FREE Full text] [CrossRef] [Medline]
- Humiston SG, Bennett NM, Long C, Eberly S, Arvelo L, Stankaitis J, et al. Increasing inner-city adult influenza vaccination rates: a randomized controlled trial. Public Health Rep. Jul 01, 2011;126(2_suppl):39-47. [CrossRef]
- Mantzari E, Vogt F, Marteau TM. Financial incentives for increasing uptake of HPV vaccinations: a randomized controlled trial. Health Psychol. Feb 2015;34(2):160-171. [FREE Full text] [CrossRef] [Medline]
- Zimmerman RK, Moehling KK, Lin CJ, Zhang S, Raviotta JM, Reis EC, et al. Improving adolescent HPV vaccination in a randomized controlled cluster trial using the 4 Pillars™ practice Transformation Program. Vaccine. Jan 03, 2017;35(1):109-117. [FREE Full text] [CrossRef] [Medline]
- Ma GX, Lee MM, Tan Y, Hanlon AL, Feng Z, Shireman TI, et al. Efficacy of a community-based participatory and multilevel intervention to enhance hepatitis B virus screening and vaccination in underserved Korean Americans. Cancer. Mar 01, 2018;124(5):973-982. [FREE Full text] [CrossRef] [Medline]
- Nagar R, Venkat P, Stone LD, Engel KA, Sadda P, Shahnawaz M. A cluster randomized trial to determine the effectiveness of a novel, digital pendant and voice reminder platform on increasing infant immunization adherence in rural Udaipur, India. Vaccine. Oct 22, 2018;36(44):6567-6577. [CrossRef] [Medline]
- Wallace AS, Peetosutan K, Untung A, Ricardo M, Yosephine P, Wannemuehler K, et al. Home-based records and vaccination appointment stickers as parental reminders to reduce vaccination dropout in Indonesia: a cluster-randomized controlled trial. Vaccine. Oct 23, 2019;37(45):6814-6823. [FREE Full text] [CrossRef] [Medline]
- Borgey F, Henry L, Lebeltel J, Lescure P, Le Coutour X, Vabret A, et al. Effectiveness of an intervention campaign on influenza vaccination of professionals in nursing homes: a cluster-randomized controlled trial. Vaccine. Feb 28, 2019;37(10):1260-1265. [CrossRef] [Medline]
- Levine G, Salifu A, Mohammed I, Fink G. Mobile nudges and financial incentives to improve coverage of timely neonatal vaccination in rural areas (GEVaP trial): A 3-armed cluster randomized controlled trial in Northern Ghana. PLoS One. May 19, 2021;16(5):e0247485. [FREE Full text] [CrossRef] [Medline]
- Kagucia EW, Ochieng B, Were J, Hayford K, Obor D, O'Brien KL, et al. Impact of mobile phone delivered reminders and unconditional incentives on measles-containing vaccine timeliness and coverage: a randomised controlled trial in western Kenya. BMJ Glob Health. Jan 28, 2021;6(1):e003357. [FREE Full text] [CrossRef] [Medline]
- Andersson N, Cockcroft A, Ansari NM, Omer K, Baloch M, Ho Foster A, et al. Evidence-based discussion increases childhood vaccination uptake: a randomised cluster controlled trial of knowledge translation in Pakistan. BMC Int Health Hum Rights. Oct 14, 2009;9(S1):S8. [CrossRef]
- Kriss JL, Frew PM, Cortes M, Malik FA, Chamberlain AT, Seib K, et al. Evaluation of two vaccine education interventions to improve pertussis vaccination among pregnant African American women: a randomized controlled trial. Vaccine. Mar 13, 2017;35(11):1551-1558. [FREE Full text] [CrossRef] [Medline]
- Blanchi S, Vaux J, Toqué JM, Hery L, Laforest S, Piccoli GB, et al. Impact of a catch-up strategy of DT-IPV vaccination during hospitalization on vaccination coverage among people over 65 years of age in France: the HOSPIVAC Study (vaccination during hospitalization). Vaccines (Basel). Jun 09, 2020;8(2):292. [FREE Full text] [CrossRef] [Medline]
- Quinley JC, Shih A. Improving physician coverage of pneumococcal vaccine: a randomized trial of a telephone intervention. J Community Health. Apr 2004;29(2):103-115. [CrossRef] [Medline]
- Irigoyen MM, Findley S, Wang D, Chen S, Chimkin F, Pena O, et al. Challenges and successes of immunization registry reminders at inner-city practices. Ambul Pediatr. Mar 2006;6(2):100-104. [CrossRef] [Medline]
- Muehleisen B, Baer G, Schaad UB, Heininger U. Assessment of immunization status in hospitalized children followed by counseling of parents and primary care physicians improves vaccination coverage: an interventional study. J Pediatr. Dec 2007;151(6):704-6, 706.e1. [CrossRef] [Medline]
- Rand CM, Brill H, Albertin C, Humiston SG, Schaffer S, Shone LP, et al. Effectiveness of centralized text message reminders on human papillomavirus immunization coverage for publicly insured adolescents. J Adolesc Health. May 2015;56(5 Suppl):S17-S20. [CrossRef] [Medline]
- Chen L, Du X, Zhang L, van Velthoven MH, Wu Q, Yang R, et al. Effectiveness of a smartphone app on improving immunization of children in rural Sichuan Province, China: a cluster randomized controlled trial. BMC Public Health. Aug 31, 2016;16(1):909. [FREE Full text] [CrossRef] [Medline]
- Domek GJ, Contreras-Roldan IL, O'Leary ST, Bull S, Furniss A, Kempe A, et al. SMS text message reminders to improve infant vaccination coverage in Guatemala: a pilot randomized controlled trial. Vaccine. May 05, 2016;34(21):2437-2443. [FREE Full text] [CrossRef] [Medline]
- Siddiqi DA, Ali RF, Munir M, Shah MT, Khan AJ, Chandir S. Effect of vaccine reminder and tracker bracelets on routine childhood immunization coverage and timeliness in urban Pakistan (2017-18): a randomized controlled trial. BMC Public Health. Jul 11, 2020;20(1):1086. [FREE Full text] [CrossRef] [Medline]
- Sääksvuori L, Betsch C, Nohynek H, Salo H, Sivelä J, Böhm R. Information nudges for influenza vaccination: evidence from a large-scale cluster-randomized controlled trial in Finland. PLoS Med. Feb 9, 2022;19(2):e1003919. [FREE Full text] [CrossRef] [Medline]
- Gargano L, Pazol K, Sales J, Painter J, Morfaw C, Jones LM, et al. Multicomponent interventions to enhance influenza vaccine delivery to adolescents. Pediatrics. Nov 2011;128(5):e1092-e1099. [FREE Full text] [CrossRef] [Medline]
- Suryadevara M, Bonville C, Ferraioli F, Domachowske J. Community-centered education improves vaccination rates in children from low-income households. Pediatrics. Aug 2013;132(2):319-325. [CrossRef] [Medline]
- Wallace-Brodeur R, Li R, Davis W, Humiston S, Albertin C, Szilagyi PG, et al. A quality improvement collaborative to increase human papillomavirus vaccination rates in local health department clinics. Prev Med. Oct 2020;139:106235. [CrossRef] [Medline]
- Costantino C, Mazzucco W, Bonaccorso N, Cimino L, Conforto A, Sciortino M, et al. Educational interventions on pregnancy vaccinations during childbirth classes improves vaccine coverages among pregnant women in Palermo's province. Vaccines (Basel). Dec 08, 2021;9(12):1455. [FREE Full text] [CrossRef] [Medline]
- Cushon JA, Neudorf CO, Kershaw TM, Dunlop TG, Muhajarine N. Coverage for the entire population: tackling immunization rates and disparities in Saskatoon Health Region. Can J Public Health. Sep 1, 2012;103(S1):S37-S41. [CrossRef]
- Kaufman J, Attwell K, Tuckerman J, O'Sullivan J, Omer SB, Leask J, et al. Feasibility and acceptability of the multi-component P3-MumBubVax antenatal intervention to promote maternal and childhood vaccination: a pilot study. Vaccine. May 19, 2020;38(24):4024-4031. [CrossRef] [Medline]
- Gattis S, Yildirim I, Shane A, Serluco S, McCracken C, Liverman R. Impact of pharmacy-initiated interventions on influenza vaccination rates in pediatric solid organ transplant recipients. J Pediatric Infect Dis Soc. Dec 27, 2019;8(6):525-530. [CrossRef] [Medline]
- Gossec L, Soubrier M, Foissac F, Molto A, Richette P, Beauvais C, et al. Screening for and management of comorbidities after a nurse-led program: results of a 3-year longitudinal study in 769 established rheumatoid arthritis patients. RMD Open. Jun 14, 2019;5(2):e000914. [FREE Full text] [CrossRef] [Medline]
- Hernández-García I, Aibar-Remón C. Effectiveness of an intervention to improve the vaccination coverage against in patients with chronic kidney disease. Hum Vaccin Immunother. Jan 02, 2021;17(1):170-172. [FREE Full text] [CrossRef] [Medline]
- Nguyen NT, Vu HM, Dao SD, Tran HT, Nguyen TXC. Digital immunization registry: evidence for the impact of mHealth on enhancing the immunization system and improving immunization coverage for children under one year old in Vietnam. Mhealth. Jul 2017;3:26-26. [FREE Full text] [CrossRef] [Medline]
- Chen JJ, Chang ET, Chen Y, Bailey MB, So SKS. A model program for hepatitis B vaccination and education of schoolchildren in rural China. Int J Public Health. Jun 16, 2012;57(3):581-588. [CrossRef] [Medline]
- Toleman MS, Herbert K, McCarthy N, Church DN. Vaccination of chemotherapy patients--effect of guideline implementation. Support Care Cancer. May 26, 2016;24(5):2317-2321. [CrossRef] [Medline]
- Sengupta P, Benjamin A, Myles P, Babu B. Evaluation of a community-based intervention to improve routine childhood vaccination uptake among migrants in urban slums of Ludhiana, India. J Public Health (Oxf). Dec 01, 2017;39(4):805-812. [CrossRef] [Medline]
- Costantino C, Restivo V, Gaglio V, Lanza G, Marotta C, Maida CM, et al. Effectiveness of an educational intervention on seasonal influenza vaccination campaign adherence among healthcare workers of the Palermo University Hospital, Italy. Ann Ig. 2019;31(1):35-44. [FREE Full text] [CrossRef] [Medline]
- Glanternik JR, McDonald JC, Yee AH, Howell Ba A, Saba KN, Mellor RG, et al. Evaluation of a vaccine-communication tool for physicians. J Pediatr. Sep 2020;224:72-78.e1. [CrossRef] [Medline]
- Paunio M, Virtanen M, Peltola H, Cantell K, Paunio P, Valle M, et al. Increase of vaccination coverage by mass media and individual approach: intensified measles, mumps, and rubella prevention program in Finland. Am J Epidemiol. Jun 01, 1991;133(11):1152-1160. [CrossRef] [Medline]
- Abd Elaziz KM, Sabbour SM, Dewedar SA. A measles and rubella (MR) catch-up vaccination campaign in an Egyptian University: vaccine uptake and knowledge and attitudes of students. Vaccine. Nov 03, 2010;28(47):7563-7568. [CrossRef] [Medline]
- Llupià A, Mena G, Olivé V, Quesada S, Aldea M, Sequera VG, et al. Evaluating influenza vaccination campaigns beyond coverage: a before-after study among health care workers. Am J Infect Control. Aug 2013;41(8):674-678. [CrossRef] [Medline]
- Aspesi AV, Kauffmann GE, Davis AM, Schulwolf EM, Press VG, Stupay KL, et al. IBCD: development and testing of a checklist to improve quality of care for hospitalized general medical patients. Jt Comm J Qual Patient Saf. Apr 2013;39(4):147-156. [FREE Full text] [CrossRef] [Medline]
- Hu Y, Luo S, Tang X, Lou L, Chen Y, Guo J, et al. Does introducing an immunization package of services for migrant children improve the coverage, service quality and understanding? An evidence from an intervention study among 1548 migrant children in eastern China. BMC Public Health. Jul 15, 2015;15(1):664. [FREE Full text] [CrossRef] [Medline]
- Baker DW, Brown T, Lee JY, Ozanich A, Liss DT, Sandler DS, et al. A multifaceted intervention to improve influenza, pneumococcal, and herpes zoster vaccination among patients with rheumatoid arthritis. J Rheumatol. Jun 15, 2016;43(6):1030-1037. [FREE Full text] [CrossRef] [Medline]
- Mazzoni SE, Brewer SE, Pyrzanowski JL, Durfee MJ, Dickinson LM, Barnard JG, et al. Effect of a multi-modal intervention on immunization rates in obstetrics and gynecology clinics. Am J Obstet Gynecol. May 2016;214(5):617.e1-617.e7. [CrossRef] [Medline]
- Mustafa M, Al-Khal A, Al Maslamani M, Al Soub H. Improving influenza vaccination rates of healthcare workers: a multipronged approach in Qatar. East Mediterr Health J. Jun 14, 2017;23(4):303-310. [FREE Full text] [CrossRef] [Medline]
- Nzioki JM, Ouma J, Ombaka JH, Onyango RO. Community health worker interventions are key to optimal infant immunization coverage, evidence from a pretest-posttest experiment in Mwingi, Kenya. Pan Afr Med J. 2017;28:21. [FREE Full text] [CrossRef] [Medline]
- Varman M, Sharlin C, Fernandez C, Vasudevan J, Wichman C. Human papilloma virus vaccination among adolescents in a community clinic before and after intervention. J Community Health. Jun 24, 2018;43(3):455-458. [CrossRef] [Medline]
- Poscia A, Pastorino R, Boccia S, Ricciardi W, Spadea A. The impact of a school-based multicomponent intervention for promoting vaccine uptake in Italian adolescents: a retrospective cohort study. Ann Ist Super Sanita. Mar 2019;55(2):124-130. [FREE Full text] [CrossRef] [Medline]
- Podraza L, Vasudevan J, Hudson C, Jayan A, Varman M. Outcomes from the use of targeted interventions to increase meningococcal vaccination rates in a pediatric clinic. J Community Health. Feb 13, 2022;47(1):87-93. [FREE Full text] [CrossRef] [Medline]
- Akwataghibe NN, Ogunsola EA, Popoola OA, Agbo AI, Dieleman MA. Using participatory action research to improve immunization utilization in areas with pockets of unimmunized children in Nigeria. Health Res Policy Syst. Aug 11, 2021;19(Suppl 2):88. [FREE Full text] [CrossRef] [Medline]
- Perkins RB, Foley S, Hassan A, Jansen E, Preiss S, Isher-Witt J, et al. Impact of a multilevel quality improvement intervention using national partnerships on human papillomavirus vaccination rates. Acad Pediatr. Sep 2021;21(7):1134-1141. [CrossRef] [Medline]
- Cecinati V, Esposito S, Scicchitano B, Delvecchio G, Amato D, Pelucchi C, et al. Effectiveness of recall systems for improving influenza vaccination coverage in children with oncohematological malignancies. Hum Vaccin. Feb 2010;6(2):194-197. [CrossRef] [Medline]
- Lam ST, George S, Dunlow S, Nelson M, Hartzell JD. Tdap coverage in a military beneficiary population: room for improvement. Military Medicine. Oct 2013;178(10):1133-1136. [CrossRef]
- Esteban-Vasallo MD, Domínguez-Berjón MF, García-Riolobos C, Zoni AC, Aréjula Torres JL, Sánchez-Perruca L, et al. Effect of mobile phone text messaging for improving the uptake of influenza vaccination in patients with rare diseases. Vaccine. Aug 23, 2019;37(36):5257-5264. [CrossRef] [Medline]
- Fairbrother G, Friedman S, Hanson KL, Butts GC. Effect of the vaccines for children program on inner-city neighborhood physicians. Arch Pediatr Adolesc Med. Dec 01, 1997;151(12):1229-1235. [CrossRef] [Medline]
- World Health Organization (WHO). Catch up vaccination. WHO. URL: https://www.who.int/teams/immunization-vaccines -and-biologicals/essential-programme-on-immunization/implementation/catch-up-vaccination [accessed 2024-06-09]
- Community Preventive Services Task Force. Increasing appropriate vaccination: client reminder and recall. The Community Guide. URL: https://www.thecommunityguide.org/media/pdf/Vaccination-Client-Reminders.pdf [accessed 2024-06-09]
- World Health Organization (WHO). Essential Immunization Program - Reducing Lost Opportunities to Immunize [MOV]. WHO. URL: https://www.who.int/teams/immunization-vaccines-and-biologicals/essential-programme-on-immunization/implementation/reducing-missed-opportunities-for-vaccination-[mov [accessed 2024-06-09]
- Centers for Disease ControlPrevention (CDC). Updated recommendations for use of tetanus toxoid, reduced diphtheria toxoid, and acellular pertussis vaccine (Tdap) in pregnant women--Advisory Committee on Immunization Practices (ACIP), 2012. MMWR Morb Mortal Wkly Rep. Feb 22, 2013;62(7):131-135. [FREE Full text] [Medline]
- World Health Organization (WHO). Health education in self-care: possibilities and limitations. WHO. URL: https://apps.who.int/iris/bitstream/handle/10665/70092/HED_84.1.pdf;jsessionid=D934CD23B551814D72C5AF73E582EA01?sequence=1 [accessed 2024-06-09]
- SAGE Working Group. Report of the SAGE Working Group on vaccine hesitancy. ASSET. Nov 12, 2014. URL: https://www.asset-scienceinsociety.eu/sites/default/files/sage_working_group_revised_report_vaccine_hesitancy.pdf [accessed 2024-06-09]
- No authors. Standards for pediatric immunization practices. Ad Hoc Working Group for the development of standards for pediatric immunization practices. JAMA. Apr 14, 1993;269(14):1817-1822. [Medline]
- Cassiani R, Marinelli G. Accreditation of vaccination services: experimental phase [Article in Italian]. Ann Ig. 2002;14(4 Suppl 4):87-93. [Medline]
- Restivo V, Orsi A, Ciampini S, Messano G, Trucchi C, Ventura G, et al. How should vaccination services be planned, organized, and managed? Results from a survey on the Italian vaccination services. Ann Ig. 2019;31(2 Supple 1):45-53. [FREE Full text] [CrossRef] [Medline]
- Michel J, Chidiac C, Grubeck-Loebenstein B, Johnson RW, Lambert PH, Maggi S, et al. Advocating vaccination of adults aged 60 years and older in Western Europe: statement by the Joint Vaccine Working Group of the European Union Geriatric Medicine Society and the International Association of Gerontology and Geriatrics-European Region. Rejuvenation Res. Apr 2009;12(2):127-135. [CrossRef] [Medline]
- European Geriatric Medicine Society (EUGMS). BGSInvestInCare: 8 key issues for older people's healthcare. British Geriatrics Society. 2022. URL: https://www.bgs.org.uk/european-geriatric-medicine-society-eugms [accessed 2024-06-09]
- Jacobson Vann JC, Jacobson RM, Coyne-Beasley T, Asafu-Adjei JK, Szilagyi PG. Patient reminder and recall interventions to improve immunization rates. Cochrane Database Syst Rev. Jan 18, 2018;1(1):CD003941. [FREE Full text] [CrossRef] [Medline]
Abbreviations
ACIP: Advisory Committee on Immunization Practices |
EUGMS: European Geriatric Medicine Society |
GNI: gross national income |
GRADE: Grading of Recommendations Assessment, Development, and Evaluation |
HPV: human papillomavirus |
IAGGER: International Association of Gerontology and Geriatrics-European Region |
MeSH: Medical Subject Headings |
PICOS: Population, Intervention, Comparison, Outcomes and Study |
PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analysis |
RCT: randomized controlled trial |
RR: risk ratio |
SAGE: Strategic Advisory Group of Experts on Immunization |
Tdap: tetanus, diphtheria, and pertussis |
VCIE: vaccination coverage improvement effectiveness |
WHO: World Health Organization |
Edited by A Mavragani; submitted 19.09.23; peer-reviewed by F Yang, E Paskett; comments to author 12.03.24; revised version received 16.04.24; accepted 30.04.24; published 23.07.24.
Copyright©Alessandra Fallucca, Walter Priano, Alessandro Carubia, Patrizia Ferro, Vincenzo Pisciotta, Alessandra Casuccio, Vincenzo Restivo. Originally published in JMIR Public Health and Surveillance (https://publichealth.jmir.org), 23.07.2024.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Public Health and Surveillance, is properly cited. The complete bibliographic information, a link to the original publication on https://publichealth.jmir.org, as well as this copyright and license information must be included.