Published on in Vol 10 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/52926, first published .
Effectiveness of Catch-Up Vaccination Interventions Versus Standard or Usual Care Procedures in Increasing Adherence to Recommended Vaccinations Among Different Age Groups: Systematic Review and Meta-Analysis of Randomized Controlled Trials and Before-After Studies

Effectiveness of Catch-Up Vaccination Interventions Versus Standard or Usual Care Procedures in Increasing Adherence to Recommended Vaccinations Among Different Age Groups: Systematic Review and Meta-Analysis of Randomized Controlled Trials and Before-After Studies

Effectiveness of Catch-Up Vaccination Interventions Versus Standard or Usual Care Procedures in Increasing Adherence to Recommended Vaccinations Among Different Age Groups: Systematic Review and Meta-Analysis of Randomized Controlled Trials and Before-After Studies

Review

1Department of Health Promotion, Mother and Child Care, Internal Medicine and Medical Specialities, University of Palermo, Palermo, Italy

2School of Medicine, University Kore of Enna, Enna, Italy

Corresponding Author:

Alessandra Fallucca, MD

Department of Health Promotion, Mother and Child Care, Internal Medicine and Medical Specialities

University of Palermo

Via del Vespro 129

Palermo, 90127

Italy

Phone: 39 3804703272

Email: alessandra.fallucca@unipa.it


Background: To address the global challenge of vaccine hesitancy, the Strategic Advisory Group of Experts on Immunization strongly promotes vaccination reminder and recall interventions. Coupled with the new opportunities presented by scientific advancements, these measures are crucial for successfully immunizing target population groups.

Objective: This systematic review and meta-analysis aims to assess the effectiveness of various interventions in increasing vaccination coverage compared with standard or usual care. The review will cover all vaccinations recommended for different age groups.

Methods: In February 2022, 2 databases were consulted, retrieving 1850 studies. Following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, 79 manuscripts were included after the assessment phase. These comprised 46 trials/randomized controlled trials (RCTs) and 33 before-after studies. A meta-analysis using a random-effects model was performed with STATA software (version 14.1.2). The selected outcome was the risk ratio (RR) of vaccination coverage improvement effectiveness. Additionally, meta-regression analyses were conducted for the included manuscripts.

Results: The analyses showed an overall efficacy of RR 1.22 (95% CI 1.19-1.26) for RCTs and RR 1.70 (95% CI 1.54-1.87) for before-after studies when considering all interventions cumulatively. Subgroup analyses identified multicomponent interventions (RR 1.58, 95% CI 1.36-1.85) and recall clinical interventions (RR 1.24, 95% CI 1.17-1.32) as the most effective in increasing vaccination coverage for RCTs. By contrast, educational interventions (RR 2.13, 95% CI 1.60-2.83) and multicomponent interventions (RR 1.61, 95% CI 1.43-1.82) achieved the highest increases for before-after studies. Meta-regression analyses indicated that the middle-aged adult population was associated with a higher increase in vaccination coverage (RCT: coefficient 0.54, 95% CI 0.12-0.95; before-after: coefficient 1.27, 95% CI 0.70-1.84).

Conclusions: Community, family, and health care–based multidimensional interventions, as well as education-based catch-up strategies, effectively improve vaccination coverage. Therefore, their systematic implementation is highly relevant for targeting undervaccinated population groups. This approach aligns with national vaccination schedules and aims to eliminate or eradicate vaccine-preventable diseases.

JMIR Public Health Surveill 2024;10:e52926

doi:10.2196/52926

Keywords



The immunization programs are specifically designed to maximize the health benefits for the population by offering the most appropriate vaccinations for different age groups and types of patients [1]. The effectiveness of vaccination programs is based on a high uptake level. In addition to providing direct protection for vaccinated individuals, these programs offer indirect protection to the community by decreasing the risk of infection [2].

Although vaccination is one of the most successful public health interventions, global immunization coverage rates remain unsatisfactory. In 2021, nearly 25 million children under the age of 1 year missed their routine diphtheria-tetanus-pertussis vaccinations. Additionally, human papillomavirus (HPV) vaccination coverage among girls in the least developed countries was only 15% [3]. Undervaccination can be attributed to a lack of health services available to the population, lower availability of vaccines for mass immunization programs, and difficulties in accessing these services in terms of both space and time [4]. Insufficient budgets are one of the main barriers preventing health governments from providing access to mass vaccination in low-income countries [5].

Although the health governments of the most developed countries are strongly implementing national immunization programs, introducing new vaccines, and expanding vaccination offers, coverage rates are still far from desirable targets. This shortfall has resulted in outbreaks of vaccine-preventable diseases, leading to hospitalizations and, in some cases, death [6,7]. The literature examining the acceptance of routine vaccinations for adolescents (such as the HPV vaccine) and vaccines recommended for older adults or those with chronic and disabling conditions (such as influenza, pneumococcal, and herpes zoster vaccines) indicates critical issues with uptake [8,9].

Vaccine hesitancy, defined as “the reluctance or refusal to vaccinate despite vaccine availability,” has gained recognition as a top threat to global health because it could undermine successful and cost-effective vaccination programs worldwide [10]. The main factors contributing to vaccine hesitancy are a lack of awareness about the benefits of vaccination, concerns regarding short- or long-term side effects of vaccines, general distrust in immunization practices, and doubts about the high number of vaccines administered according to schedules [11]. Furthermore, the growing complexity of vaccination programs, with the introduction of new vaccines and the high number of recommended booster doses, could represent an obstacle to achieving optimal coverage. This complexity can cause difficulties in adherence and delays in vaccinating the target population [12].

The decline in vaccinations threatens to strain health systems with outbreaks of vaccine-preventable diseases. Several attempts have been made to identify approaches that increase immunization coverage, such as vaccine information campaigns, promotional and educational messages for patients and health care professionals, and the use of reminders and various mobile apps [12,13]. Active vaccine catch-up interventions can be an extremely useful tool for improving adherence to vaccination practices. Experience and research can help identify the most effective vaccination strategies.

This systematic review and meta-analysis aims to evaluate vaccine adherence across various catch-up methods targeting different age groups. Additionally, we aimed to identify the most effective vaccination recall strategies compared with standard or usual care procedures, based on randomized controlled trials (RCTs) and before-after studies.


Study Guidelines

For this systematic review, we followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analysis; Multimedia Appendix 1) statement guidelines [14] to ensure transparency and thorough reporting of both the review process and results. The review protocol was registered on PROSPERO under the registration number CRD42022307311 and it can be accessed online [15].

Search Strategy and Selection Criteria

Two literature databases, PubMed/MEDLINE and Scopus, were utilized for this review. The literature search commenced on February 14, 2022, using a combination of free-text words and Medical Subject Headings (MeSH). The search strategy incorporated general terms such as “vaccine,” “effectiveness,” and “improvement,” along with specific terms related to catch-up intervention implementation. The search strings obtained are detailed in Multimedia Appendix 2.

The Population, Intervention, Comparison, Outcomes and Study (PICOS) criteria were applied to select studies, encompassing populations of all ages without restrictions on country or length of follow-up. Eligible participants were those eligible for vaccination and receiving a catch-/mop-/keep-up intervention involving reminders or recalls. The objective was to evaluate the intervention-dependent vaccination coverage improvement effectiveness (VCIE), which is a composite outcome created by assessing both the improvement in vaccination coverage and the completion of vaccination series, in comparison to standard vaccination practices. During both the screening and assessment phases, authors excluded research articles based on the following criteria: if the topic or outcome did not align with the review’s objective, if the study did not use an RCT or before-after study design, if the studies lacked vaccination coverage data, or if there were insufficient data regarding the “before” or “control” group or description of catch-up/recall intervention. Furthermore, non-English manuscripts and articles whose full texts were unavailable were excluded.

During the screening phase, a total of 6 reviewers applied the inclusion criteria (AF, WP, AC, PF, VP, and VR). This process involved 3 pairs of independent reviewers, each consisting of 2 reviewers. These pairs evaluated the title and abstract of each identified article. Subsequently, the same pairs performed the assessment phase by evaluating the full text of the selected articles. In case of disagreements or doubts, a formal reconciliation process was undertaken to reach a consensus among the reviewers. If needed, the intervention of another reviewer was sought to resolve the issue and make a final decision.

Data Analysis

For studies that met the inclusion criteria, a full-text review and data extraction were conducted using a standardized template. This template included outcome measures and demographics of the study population, such as study design, country, study recruitment range, follow-up time, primary objective, outcome, intervention type, number of patients enrolled, gender distribution, age range, and gross national income (GNI). The variable “follow-up time since intervention” was categorized as follows: 0 to <6 months (short), 6 to <12 months (medium), and more than 12 months (long).

Furthermore, given the study’s objective to detail the effectiveness of various types of catch-up reminder or recall vaccination interventions on coverage rates, the variable “intervention type” was further classified based on an existing reference [16]. The intervention categories were delineated as follows: “remind” studies were divided into clinical, messaging, web, active calls, and object; “reward” studies; and “educational” studies. In cases where multiple types of vaccination interventions were combined and administered, they were classified under the category of “multicomponent” interventions.

According to the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) classification [17], bodies of evidence from RCTs are a priori regarded as “high”-quality evidence, whereas evidence from observational studies starts as “low”-quality evidence. To further define and assess the risk of bias in each included study, 2 quality assessment score tools specific to the study designs were utilized. For RCTs, the assessment tool shown in Table 2 [18] was used, and for before-after studies, the tool in Table 5 [19] was used. The Duval and Tweedie nonparametric trim-and-fill method was used to adjust for the effect of publication bias. This method is utilized to account for hypothetical small missing null or negative studies, thereby providing a more balanced assessment of the data.

Study-level data were recorded in Excel spreadsheets (Microsoft Excel 2010). Risk ratios (RRs) and corresponding 95% CIs of VCIE were directly calculated to evaluate the effect of different intervention types on the receipt of immunizations. Separate analyses were conducted for RCTs and before-after studies. If data on the main outcome (VCIE) were available from more than 1 study, a random effects model meta-analysis was used to pool the data. The results were stratified based on the “intervention category” variable, and pooled RRs and risk differences were computed for each intervention category. These analyses were conducted using STATA software (version 14.2.1; StataCorp). Between-study variation was estimated by comparing each study’s result with a Mantel-Haenszel fixed-effect meta-analysis. The extent of heterogeneity was quantified using I2. Testing for publication bias was conducted separately for RCTs and before-after studies for the main outcome. Additionally, meta-regression analyses were performed using the following summary measures: an estimate of between-study variance (tau), the proportion of between-study variance (adjusted R2), the percentage of residual variation due to heterogeneity (I2), and a joint test for all covariates (model F) with Knapp-Hartung modification (prob>F).


Overview

A total of 1869 research articles were identified from the literature databases, with 1784 (94.45%) retrieved from the PubMed/MEDLINE platform and 85 (4.55%) from Scopus. After removing duplicates (n=22), 1847 records underwent screening based on titles and abstracts. Among these, 239 full-text articles were assessed for eligibility, and ultimately, 79 studies were included in the data extraction and qualitative synthesis. Specifically, 46 (58%) of these studies were RCTs, and 33 (42%) were before-after studies included in the meta-analysis. The main reasons for excluding studies were as follows: outcomes not aligned with the review’s interest (n=56) and studies not utilizing an RCT or before-after study design (n=29). A summary of the screening process and exclusions is depicted in the PRISMA flow diagram (Figure 1).

Figure 1. PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analysis) flow diagram of studies selection.

Characteristics, Quality Score, and Results of Meta-Analysis and Meta-Regression for RCT Studies

Of the included RCTs, 20 studies (43%) were conducted in the American continent, with 18 of them (39%) in the United States. Additionally, 11 studies (24%) were conducted in Asia and 9 studies (20%) in Europe. Only 5 studies (11%) were conducted in Africa and 1 study was conducted in Australia. Regarding the age groups targeted by the interventions, the studies were most frequently focused on the “infant-preschool” category in 46% of cases (n=21), followed closely by the “child-adolescent” category in 43% of cases (n=20). The “middle-aged adult” category was addressed in 15% of studies (n=7). According to the classification of intervention types, “multicomponent” studies were identified most frequently, accounting for 48% (n=22) of the total. Following this, “educational” studies comprised 24% (n=11) of the included studies. The “reward” category was the least represented, with only 4% (n=2) of the studies falling under this category. Among the reminder interventions, the “clinical” and “messaging” subcategories were the most populated, accounting for 22% (n=10) and 28% (n=13) of the included studies, respectively (Table 1).

The quality score evaluation of the included RCT studies revealed that 2 studies [20,21] received the maximum score of 5. Several studies were assigned a score of 1 point, including 8 “multicomponent” studies [22-29], 5 “educational” studies [22,30-33], 3 “reminder” studies [34-36], and 2 “reward” studies [37,38]. Only 2 studies [39,40] received the minimum score of 0. Adequacy of randomization was found in 27 studies (59%), while blinding was reported in only 2 studies (4%) out of the 46 included studies (Table 2).

The overall results of meta-analyses for all RCT studies demonstrated an RR of 1.22 (P<.001), indicating an increase in VCIE across all types of interventions included in the RCT sample. Further details on heterogeneity and significance tests for all intervention categories are provided in Multimedia Appendix 3. The most effective interventions are extensively detailed in Multimedia Appendix 4, which includes the forest plot of RCTs. The highest efficacy was reported for “multicomponent” interventions, with a risk ratio (RR) of 1.58 (P<.001) (see Figure S1A in Multimedia Appendix 4), followed by “reminder clinical” studies, which exhibited an RR of 1.24 (P<.001; see Figure S1B in Multimedia Appendix 4). Furthermore, “educational” interventions (RR 1.15; P<.001) and “reminder messaging” interventions (RR 1.14; P<.001) demonstrated a positive effect on VCIE. Forest plots summarizing results for other types of recall interventions can be found in Figure S1C, D in Multimedia Appendix 4.

For RCT studies, meta-regression analyses were conducted to obtain the best fitting model, including the following variables: publication year, continent, GNI, age category, and follow-up time since intervention. According to this analysis, interventions conducted in the European continent (coefficient 1.001; P=.03) and targeting the “adult-middle age” population (coefficient 0.537; P=.012) were the most effective in increasing vaccination coverage (Table 3).

Table 1. Characteristics of RCT included studies.a
PublicationCountryStudy year rangeFollow-up time since interventionMain outcome (vaccination rate/coverage)Intervention typeMean age among the intervention and control groupsNumber of patients enrolledQuality score assigned
Rodewald et al [20]United States1994-199518 monthsFull series completion for all vaccinesEducation (outreach educational campaign)0-12 months27415
LeBaron et al [41]United States1996-199836 monthsdTPab, polio, MMRc, and Hibd series completionEducation (in-person/telephone call)1-14 months30503
Kimura et al [22]United StatesMay-October 20023 monthsInfluenzaEducation (educational campaign for health care workers)18-65 years23381
Gilkey et al [30]United States201112 monthsdTPa and meningococcalEducation (in-person and webinar-delivered AFIXe educational sessions)11-12 years (n=32,676); 13-18 years (n=74,767)107,4431
Brewer et al [42]United States20156 monthsHPVf 9 full series completionEducation (informative announcements vs face-to-face conversation)11-12 years17,1733
Wong et al [43]China2013-20150.5 monthsInfluenza (adherence to self-reported vaccination)Education (face-to-face short individual educational session for pregnant women)33-34 years3213
Brown et al [31]Nigeria2012-201312 monthsAll vaccinesEducation (nurse-led educational sessions in primary health care centers)0-12 weeks (intervention on parents)3001
Hu et al [44]China201412 months (from birth to first year of life)Full series completion of all vaccinesEducation (educational sessions for pregnant women)Adults (women aged 20-30 years); infants up to the first year of life12523
Esposito et al [45]Italy2015-20168 monthsdTPa and meningitis ACWYEducation (multiple web-based educational programs)Adolescents6152
Lemaitre et al [32]Canada201424 monthsFull series completion of all vaccinesEducation (motivational interview-based educational strategy)Adults (mothers); children at 2 years of age27171
Muñoz-Miralles et al [33]SpainOctober 2017 to March 20186 monthsInfluenzaEducation (face-to-face educational intervention)Middle aged to aged >80 years: ≥60 years healthy; ≥60 years with risk factors; <60 years with risk factors; others5241
Rodewald et al [20]United States1994-199518 monthsFull series completion of all vaccinesMulticomponent (combined: tracking + outreach with prompting)0-12 months27415
LeBaron et al [41]United States1996-199836 monthsdTPa, polio, MMR, and Hib full series completionMulticomponent (autodialer with outreach backup)1-14 months30503
Szilagyi et al [21]United States1998-200018 months dTPa and HBVgMulticomponent (audiotaped telephone reminders and active calls)11-14 years30065
Kimura et al [22]United StatesMay to October 20023 monthsInfluenzaMulticomponent (educational campaign and vaccination day for health care workers)18-65 years22711
Schwarz et al [23]United States19953 monthsHBVMulticomponent (video on HBV, gift packages for children, and cash gifts for caregivers)2-18 years3281
Humiston et al [46]United States2002-20040 monthsInfluenzaMulticomponent (patient tracking, recall, outreach, and provider prompts)<65 years37523
Mantzari et al [47]United KingdomFebruary 2010 to March 20106 monthsHPV series initiation and completionMulticomponent (first-time invitees: letter, voucher [financial incentive], and SMS text messages vs previous nonattenders: letter, voucher [financial incentive], SMS text messages)16-18 years10002
Chamberlain et al [24]United States2012-20133 months after giving birthdTPa and influenzaMulticomponent (multilevel intervention involving clinic, provider, and patient)26.9-27.5 years (perinatal vaccination)3251
Richman et al [25]United StatesAugust 2011 to December 20137 monthsHPV full series completionMulticomponent (SMS text messages + emails)18-26 years2831
Zimmerman et al [48]United States2014-20159 monthsHPV 9 full series completionMulticomponent (multimodal intervention: facilitations for access to vaccination services, communications with patients, SMS text messages, calls, and training sessions)11-17 years10,8613
Brown et al [31]Nigeria2012-201312 monthsAll vaccines completionMulticomponent (reminder intervention + providers training)0-3 months (intervention on parents)2971
Ma et al [49]United StatesNot mentioned12 monthsHBVMulticomponent (training of providers and involvement of church through messaging)≥18 (mean age 51.6) years22122
Nagar et al [50]IndiaAugust to December 20156 monthsdTPa full series completion (within 180 days from birth)Multicomponent (necklace with a pendant that records immunity data and provides voice reminders)0-3 months1372
Esposito et al [45]Italy2015-20168 monthsdTPa, meningitis ACWY, and meningitis BMulticomponent (educational program on the website + face-to-face lessons)11.6-16.4 years6362
Wallace et al [51]IndonesiaJanuary 2016 to July 20167 monthsdTPa full series completion (third dose)Multicomponent (home-based records + sticker)0-12 months36163
Borgey et al [52]FranceNovember 2014 to March 20150 monthsInfluenzaMulticomponent (multilevel intervention approach)18-65 years (health care professionals)40693
Currat et al [26]SwitzerlandApril 2016 to October 20165 monthsInfluenzaMulticomponent (preemployment health test check: face-to-face intervention + reminder: information leaflet)31-33 years3791
Menzies et al [27]AustraliaFebruary 2015 to December 201536 monthsAdministering all vaccines in a timely mannerMulticomponent (SMS text messages through the VaxSMS app, calendar reminder)2-8 months (intervention on parents)15941
Liao et al [28]ChinaOctober 2017 to December 20175 monthsInfluenzaMulticomponent (vaccination reminders + pressure component, WhatsApp discussion group)6 months to 6 years3651
Yunusa et al [29]NigeriaNovember 20196 monthsdTPa, HBV, and Hib full series completion (third dose)Multicomponent (SMS text messages and calls)20.2-33 years5541
Levine et al [53]GhanaMarch 2019 to April 20193 monthsAdministering all vaccines in a timely mannerMulticomponent (mobile phone–based reminders + incentives to health workers and caregivers)28.5-29.8 years (mothers interviewed); outcome for neonatal vaccination4673
Kagucia et al [54]KenyaDecember 2016 to March 20176 monthsMMR 1 timeliness vaccinationMulticomponent (SMS text messages and financial incentive)6-8 months5373
Brown et al [34]Nigeria2012-201313 monthsdTPa full series completionRemind active call3 weeks6141
Levine et al [53]GhanaMarch 2019 to April 20193 monthsAdministering all vaccines in a timely mannerRemind active call (phone call with health care worker reminder)28.5-29.8 years (mothers interviewed); outcome for neonatal vaccination4793
Kimura et al [22]United StatesMay to October 20023 monthsInfluenzaClinical reminder (vaccination day for health care workers)18-65 years (health care workers)23491
Fiks et al [39]United StatesSeptember 2004 to August 2005Check at 2 years of ageAll vaccines captured immunizationClinical reminder (electronic health record–based clinical reminder)0-2 years32170
Andersson et al [55]Pakistan2005-200724 monthsMMR and dTPa full series completionClinical reminder (informed discussion about vaccination)12-23 months (intervention on parents)9043
Gilkey et al [30]United States201112 monthsdTPa and meningococcalClinical reminder (in-person consultations)11-12 years (n=32,676); 13-18 years (n=74,767)69,0511
Yoo et al [40]United States2009-201112 monthsInfluenzaClinical reminder (school-located vaccination against flu in 2009-2010 and 2010-2011)6 months to 18 years13,5610
Brown et al [31]Nigeria2012-201312 monthsFull series completion for all vaccinesClinical reminder0-3 months2981
Kriss et al [56]United States20132 months after giving birthdTPaClinical reminder (messaging iBook)25.4-27.5 years (women in the perinatal period)733
Hu et al [35]China201424 monthsVaricellaClinical reminder (messaging iBook)25-26 years (parents); outcome for children at 2 years of age1361
Wallace et al [51]IndonesiaJanuary 2016 to July 20167 monthsdTPa full series completionClinical reminder (home-based records)0-12 months36163
Blanchi et al [57]FranceMay 2018 to May 2019
dTPa-inactivated polio vaccineClinical reminder (catch-up strategy during hospitalization)65-97 years (hospitalized patients)1623
Rodewald et al [20]United States1994-199518 monthsFull series completion for all vaccinesRemind messaging (prompting)0-12 months27415
Quinley and Shih [58]United States1999-20003 monthsPneumococcal (African American vs American)Remind messaging (telephone call reminder)<65 years218 (African American); 732 (American)3
LeBaron et al [41]United States1996-199836 monthsdTPa, polio, MMR, and Hib full series completionRemind messaging (autodialer: automated telephone or email reminders)1-14 months30503
Irigoyen et al [59]United States2001 (July to December)6 monthsdTPaRemind messaging (continuous messaging reminders)6 weeks to 15 months (outcome at 6 months after the intervention)16623
Muehleisen et al [60]Switzerland20039 monthsAll vaccines completionRemind messaging (written letter reminders)2 months to 17 years; intervention on parents (postdischarge catch-up immunization)5323
Rand et al [61]United States2013-20149 months (July 2013 to March 2014)HPV 9 full series completionRemind messaging (reminder SMS text messages)11-16 years38122
Chen et al [62]China2013-201514 months (December 2013 to January 2015)BCGh, HBV, dTPa-inactivated polio vaccine, MMR full series completionRemind messaging (smartphone app: reminder vaccination SMS text messages)0-13 months (children); intervention on parents2143
Domek et al [63]Guatemala20136 monthsAll vaccines (pentavalent, rotavirus, polio, pneumococcal) series completionRemind messaging (SMS text message reminders)2-4 months (infants); intervention on parents3213
Hu et al [35]China201424 monthsVaricellaRemind messaging (video messaging)25-26 years (parents); outcome for children at 2 years of age1361
Menzies et al [27]AustraliaFebruary 2015 to December 201536 monthsAll vaccines timeliness vaccinationRemind messaging (SMS text message reminders through the VaxSMS app)2-8 months (mean age 4 months); intervention on parents15941
Liao et al [28]ChinaOctober 2017 to December 20175 monthsInfluenzaRemind messaging (vaccination reminders through WhatsApp)6 months to 6 years3651
Qin et al [36]China2019-202010 monthsVaricellaRemind messaging (telephone notification vs written notification)Telephone notification: 2.1-12.2 years (mean age 4.0 years); written notification: 2.1-7.3 years (mean age 3.8 years)8001
Kagucia et al [54]KenyaDecember 2016 to March 20176 monthsMMR vaccine 1 timeliness vaccinationRemind messaging (SMS text messages)6-8 months5373
Nagar et al [50]IndiaAugust to December 20156 monthsdTPa full series completion (third dose)Remind object (pendant recording the vaccination history of the child)0-6 months (outcome assessed within 180 days from birth)1232
Siddiqi et al [64]PakistanJuly 2017 to October 2017Until the administration of the measles-1 vaccine or until 12 months of agedTPa, HBV, Hib full series completion (third dose); MMR vaccine 1Remind object (Alma Sana Bracelet vs star bracelet)Infants: 0.2-5 weeks (mean age 2.5 years); mothers: 20.8-31.4 years (mean age 26.6 years); fathers: 26.1-37.7 years (mean age 31.8 years)24973
Irigoyen et al [59]United StatesJuly to December 20016 monthsdTPa vaccination rate at 6 months after intervention in infantsRemind web6 weeks to 15 months16623
Kriss et al [56]United States20132 months after giving birthdTPa (prenatal period)Remind web (messaging video)25.3-25.8 years733
Menzies et al [27]AustraliaFebruary 2015 to December 201536 monthsAll vaccines timeliness vaccinationRemind web (email calendar reminders)2-8 months (mean age 4 months)15941
Sääksvuori et al [65]FinlandJune 2018 to October 20185 monthsInfluenza, all vaccines (low coverage in Western region)Remind web (email: individual benefits reminder vs individual and social benefit reminder)>65 years (mean age 75.5 years)73983
Chandir et al [37]Pakistan2006-200716 monthsdTPa full series completionReward (food/medicine coupon incentives)0-6 months30591
Alessandrini et al [38]FranceOctober 2016 to January 20174 monthsInfluenzaReward (free vaccination at prenatal consultation ward)27.1-38.2 years248 1

aVariables reported were author’s first name, publication year, country, recruitment study year range, follow-up period since the intervention, outcome(s), intervention type and category, mean age range among controls/interventions, and number of enrolled patients.

bdTPa: diphtheria, tetanus, and acellular pertussis.

cMMR: measles, mumps, and rubella.

dHib: Hemophilus influenzae type b.

eAFIX: assessment, feedback, incentives, exchange.

fHPV: human papillomavirus.

gHBV: hepatitis B virus.

hBCG: bacillus Calmette-Guérin.

Table 2. The scoring systema used for randomized controlled trials.
StudyRandomizationBlindingAn account of all patients

MentionedAppropriateInappropriate or not mentionedMentionedAppropriateInappropriate or not mentionedFate of all patients knownTotal score
Quinley and Shih [58]3
LeBaron et al [41]3
Irigoyen et al [59]3
Szilagyi et al [21]5
Fiks et al [39]0
Muehleisen et al [60]3
Kimura et al [22]1
Schwarz et al [23]1
Andersson et al [55]3
Chandir et al [37]1
Humiston et al [46]3
Rand et al [61]2
Gilkey et al [30]1
Mantzari et al [47]2
Yoo et al [40]0
Chamberlain et al [24]1
Richman et al [25]1
Brewer et al [42]3
Zimmerman et al [48]3
Wong et al [43]3
Chen et al [62]3
Domek et al [63]3
Brown et al [31]1
Brown et al [34]1
Ma et al [49]2
Hu et al [44]3
Kriss et al [56]3
Hu et al [35]1
Nagar et al [50]2
Esposito et al [45]2
Rodewald et al [20]5
Wallace et al [51]3
Alessandrini et al [38]1
Borgey et al [52]3
Lemaitre et al [32]1
Currat et al [26]1
Siddiqi et al [64]3
Blanchi et al [57]3
Menzies et al [27]1
Liao et al [28]1
Yunusa et al [29]1
Qin et al [36]1
Levine et al [53]3
Muñoz-Miralles et al [33]1
Kagucia et al [54]3
Sääksvuori et al [65] 3

a1 additional point for the appropriate item, while 0 points are awarded if not appropriate; –1 point is awarded for not mentioned or not the appropriate method. The minimum score for each analyzed section is 0.

Table 3. Meta-regression of randomized controlled trials.
VariableCoefficientSEt test (df)P value95% CI
Publication year0.0010.0170.05 (84).96–0.034 to 0.036
Continent





Africa0.4490.5940.76 (84).45–0.736 to 1.635

America0.0840.4260.20 (84).84–0.766 to 0.935

Europa1.0030.4482.24 (84).03a0.108 to 1.898

Asia0.1920.4850.40 (84).69–0.775 to 1.158

Gross national income0.0130.1630.08 (84).94–0.312 to 0.338
Age





Infant-preschool0.0690.2090.33 (84).74–0.349 to 0.487

Children-adolescent0.2800.1821.54 (84).13–0.082 to 0.643

Adult-middle age0.5370.2082.57 (84).01a0.121 to 0.954

Aged–0.0750.234–0.32 (84).75–0.542 to 0.392
Follow-up (months)





6–0.2380.669–0.36 (84).73–1.573 to 1.097

120.2770.6850.40 (84).69–1.089 to 1.644

>120.1730.6940.25 (84).80 –1.210 to 1.558

aStatistically significant results.

Characteristics, Quality Score, and Results of Meta-Analysis and Meta-Regression for Before-After Studies

Among the 33 before-after studies included, 42% (n=14) were conducted in the American continent, predominantly in the United States (n=13, 39%). Europe accounted for 30% (n=10) of the studies, followed by Asia with 15% (n=5) of the studies. Additionally, 9% (n=3) of the studies were carried out in Africa (Egypt, Kenya, and Nigeria), while only 3% (n=1) were conducted in Australia.

The most prevalent “age categories” were the “child-adolescent” category, accounting for 58% (n=19), followed by the “adult-middle age” category, which comprised 39% (n=13) of the studies.

The most frequent “intervention category” was “multicomponent” (n=16), followed by “educational” studies (n=9). Within the “reminder” studies, 4 were classified as “clinical,” 2 as “messaging,” and 1 each as “active call” and “reward” studies. Further information is provided in Table 4.

The scoring system used to assess bias in before-after studies examined various items, with 1 additional point assigned each time the item in question was present. The items in question were clearly stated study question or objective (32/33 studies, 97%); prespecified and clearly described eligibility/selection criteria for the study population (28/33, 85%); study participants representative of those who would be eligible for the test/service/intervention in the general/clinical population of interest (28/33, 85%); whether all eligible participants who met prespecified entry criteria were enrolled (15/33, 45%); sample size large enough to provide confidence (18/33, 55%); test/service/intervention clearly described and delivered consistently across study population (17/33, 52%); prespecified, clearly defined, valid, reliable, and consistently assessed outcome measures across all study participants (19/33, 58%); people who assessed outcomes blinded to participant exposures/interventions (0/33, 0%); losses to follow-up after baseline 20% or less and whether those lost to follow-up were considered in the analysis (19/33, 58%); presence of changes in outcome measures from pre- to postintervention with P values statistically examined for pre-post changes (27/33, 82%); and outcome measures taken several times before the intervention/after the intervention (15/33, 45%). The evaluation of the quality score of the before-after studies revealed that 8 studies attained the maximum score of 8. Among these, 4 were categorized as “educational” [66-69], 2 as “multicomponent” [70,71], and 2 as “reminder clinical” [72,73]. By contrast, the lowest score of 4 was assigned to 2 studies: 1 categorized as “reminder clinical” [74] and the other as “reminder messaging” [75] (Table 5).

The meta-analyses results for before-after studies indicated a statistically significant RR of 1.70 (P<.001). Subgroup analyses, as detailed in Multimedia Appendix 5, revealed that the most efficacious intervention reported was the “reminder active call” intervention (RR 2.19; P<.001), followed by “educational” (RR 2.16; P<.001) and “multicomponent” (RR 1.61; P<.001) interventions. Heterogeneity and significance tests for the type of intervention are provided in Multimedia Appendices 6-8.

Meta-regression analyses were conducted for before-after studies, incorporating the following variables: quality score, publication year, continent, GNI, age category, intervention type, and follow-up time since the intervention. The variable associated with a statistically significant increase in vaccination coverage was the age category “adult-middle age” (coefficient 1.27; P=.01; Table 6).

Table 4. Characteristics of before-after included studies.a
PublicationCountryRecruitment/study year rangeFollow-up time since interventionOutcome (vaccination coverage)Type of interventionAge rangeNumber of patients enrolledQuality score assigned
Gargano et al [66]United States2008-200912 monthsInfluenza (2008-2009 and 2009-2010)Education (a school-based educational intervention in rural Georgia)12-18 years39168
Chen et al [76]China2006-2007<6 monthsHBVbEducation (a pilot program for HBV education in rural China)5-12 years28336
Suryadevara et al [67]United States2011-20129 monthsFull series completion for all vaccinesEducation (an educational intervention for resource-poor families)0-18 years15318
Toleman et al [77]United Kingdom2012-201424 monthsInfluenza and pneumococcal (ill patients with cancer)Education (implementation of clinical guidelines to educate health care workers; outcome for vaccination rates in chemotherapy patients)Adults >80 years2006
Sengupta et al [78]India2013-201414 months dTPac, OPVd, and HBV full series completionEducation (an educational intervention on the migrant population)9-12 months6475
Costantino et al [79]ItalyOctober 2016 to November 20166 monthsInfluenza (health care workers)Education (an educational intervention on influenza vaccination conducted at “Paolo Giaccone” University Hospital of Palermo for the 2016/2017 seasonal influenza vaccination campaign)18-65 years1257
Wallace-Brodeur et al [68]United States201636 monthsHPV full series completionEducation (quality improvement and educational training of participants)13-17 years26,7638
Glanternik et al [80]United StatesMay 2015 to July 20157 monthsAll vaccinesEducation (a training intervention of physicians to help improve communication and provide education to vaccine-hesitant parents; evaluation of outcomes for infants vaccinated)Physicians: 24-65 years; infants: 0-6 months13,4257
Costantino et al [69]ItalyOctober 2019 to October 202013 months Influenza, dTPa, and influenza + dTPaEducation (an educational intervention during childbirth classes)18-40 years (pregnant women)3268
Paunio et al [81]Finland198275 monthsMMReMulticomponent (mass media and individual approach)14 months to 6 years562,9326
Abd Elaziz et al [82]Egypt20081 monthMMRMulticomponent (posters, flyers, and messages)16-23 years (medical and nonmedical students)6516
Llupià et al [83]Spain2008-2009 influenza season6 monthsInfluenza (health care workers)Multicomponent (messages sent by emails, rewards, and a web page)>18 years96327
Cushon et al [70]Canada2007-200910 monthsMMRMulticomponent (phone calls, letters, reminders, and home visits)14-20 months24,5408
Aspesi et al [84]United States2010-20119 monthsPneumococcalMulticomponent (checklist, educational pocket cards, and handout)All ages (hospitalized patients)22586
Hu et al [85]China2011-201432 monthsAll vaccinesMulticomponent (a training program for vaccinators, a screening tool to identify vaccination demands among migrant clinic attendants, and social mobilization for immunization)1-4 years (infants: n=1288; preschool: n=260)15486
Baker et al [86]United States2013-201412 monthsPCVf 13 + PPV23gMulticomponent (system-level intervention at an academic rheumatology clinic that included electronic reminders with linked order sets, physician auditing and feedback, and patient outreach)Mean age: 57 years (patients with rheumatoid arthritis)12556
Mazzoni et al [87]United States2010-201424 monthsdTPa, influenza, and HPVh 9 (perinatal period)Multicomponent (stocking of immunizations in clinics, revision and expansion of standing orders, creation of a reminder/recall program, identification of an immunization champion to give direct provider feedback, expansion of a payment assistance program, and staff education)dTPa: 20.7-33.4 years (mean age 27.4 years); influenza: 19.1-40.8 years (mean age 29.9 years); HPV 9: 19-25.1 years (mean age 22.3 years)dTPa: 2710; influenza: 19,409; and HPV: 12,4435
Mustafa et al [88]Qatar2014-20154 monthsInfluenza (health care workers and hospital B)Multicomponent (promotional, educational, and vaccine delivery interventions; a dedicated influenza vaccination team; telephone hotline; free influenza vaccination with improved access; leadership involvement; incentives; group educational sessions; and reporting/tracking activities)18-65 yearsHospital A: 15,341; hospital B: 16,3576
Nzioki et al [89]Kenya2012-201418 monthsAll vaccinesMulticomponent (community mobilization and identification and training of volunteer community health workers; enumeration, mapping of households, and creating community units; and recruitment and training of community health extension workers)0-1 year8335
Varman et al [90]United States2015-20168 monthsHPV 9 full series completionMulticomponent (clinic discussion and introduction of a multilevel intervention aiming at avoiding missed opportunities, reminder emails, and educating patients)13-17 years (intervention on parents)33936
Poscia et al [91]Italy20158 monthsAll vaccinesMulticomponent (a 90-minute health promotion intervention, which includes a theoretical introduction and an interactive role-play technique. Parents provided informed consent and received an invitation to a meeting with the project team)11.3-13.3 years (mean age 12.3 years)8017
Kaufman et al [71]AustraliaOctober 2018 to December 20183 monthsInfluenza and pertussisMulticomponent (the intervention targets all 3 levels of the health care encounter—the practice, provider, and parent levels (P3). The intervention included midwife prompts and vaccine communication training, a website, fact sheets, and parent SMS text message reminders)21-40 years (mean age 32 years); outcome for infants628
Podraza et al [92]United StatesJuly 20205 monthsMeningococcal ACWY and meningococcal BMulticomponent (multicomponent intervention)16-19 years3357
Akwataghibe et al [93]NigeriaMay 2016 to December 20164 monthsAll vaccinesMulticomponent (cycles of dialog and action between community members, frontline health workers, and local government officials in 2 wards of Remo North, facilitated by the research team)>9 months (more than half of the child sample was aged >2 years)3407
Perkins et al [94]United StatesJanuary 2017 to December 201712 monthsHPV 9 full series completionMulticomponent (multilevel intervention: provider training and ≥1 other evidence-based systems improvement)13 years32837
Cecinati et al [95]Italy2006-2007<6 monthsInfluenza (ill patients with cancer)Remind active call (telephone recall system managed by pediatricians who usually follow-up ill children with cancer)10 years (intervention on parents)2057
Lam et al [96]United States2010-20111 monthdTPaClinical reminder (face-to-face reminder at the gynecological visit)Adults aged >80 years and women (child-bearing age or with frequent exposure to children)23097
Gattis et al [72]United States2011-201636 monthsInfluenza (transplanted patients)Clinical reminder (face-to-face reminder for transplanted patients with the implementation of the transplant pharmacy vaccine program)10.8-11.3 years30448
Gossec et al [73]FranceMay 2014 to October 201536 monthsInfluenza and pneumococcalClinical reminder (nurse visit for comorbidity counseling and for vaccination execution)Patients with rheumatoid arthritis: 18-80 years (mean age 58.0 years)9708
Hernández-García and Aibar-Remón [74]SpainNovember 2014 to June 2018iPCV 13 + PPV23Clinical reminder (hospital vaccine consultation)Adults aged >80 years (patients with chronic kidney disease)1014
Nguyen et al [75]Vietnam2013-201512 monthsTimely vaccination for all vaccinesRemind messaging (SMS text message reminders)Children73714
Esteban-Vasallo et al [97]Spain2016 (influenza vaccination campaign).4 monthsInfluenza (patients with rare disease)Remind messaging (SMS text message reminders)47-68 years106,9877
Fairbrother et al [98]United States1993-1996dTPa, OPV, HBV, Hibj, and MMRReward (distribution of free vaccines to health care providers)3 months to 3 years3211 7

aVariables reported were author’s first name, publication year, country, recruitment study year range, follow-up period since the intervention, outcome(s), intervention type and category, mean age range among controls/interventions, and number of enrolled patients.

bHBV: hepatitis B virus.

cdTPa: diphtheria, tetanus, and acellular pertussis.

dOPV: oral polio vaccine.

eMMR: measles, mumps, and rubella.

fPCV: pneumococcal conjugate vaccine.

gPPV: pneumococcal polysaccharide vaccine.

hHPV: human papillomavirus.

iNot available.

jHib: Hemophilus influenzae type b.

Table 5. The scoring systema used for before-after studies.
Scoring system1b2c3d4e5f6g7h8i9j10k11lTotal, n
Paunio et al [81]6
Fairbrother et al [98]7
Abd Elaziz et al [82]6
Llupià et al [83]N/Am7
Cecinati et al [95]7
Gargano et al [66]8
Chen et al [76]6
Cushon et al [70]8
Lam et al [96]7
Suryadevara et al [67]8
Aspesi et al [84]6
Toleman et al [77]6
Hu et al [85]6
Baker et al [86]6
Mazzoni et al [87]5
Nzioki et al [89]5
Nguyen et al [75]4
Mustafa et al [88]6
Sengupta et al [78]5
Varman et al [90]6
Gossec et al [73]8
Esteban-Vasallo et al [97]7
Poscia et al [91]7
Costantino et al [79]7
Gattis et al [72]8
Wallace-Brodeur et al [68]8
Glanternik et al [80]7
Kaufman et al [71]8
Costantino et al [69]8
Podraza et al [92]7
Akwataghibe et al [93]7
Perkins et al [94]7
Hernández-García and Aibar-Remón [74] 4

a1 additional point for the appropriate item, 0 points if inappropriate. A negative score is not expected.

bWas the study question or objective clearly stated?

cWere eligibility/selection criteria for the study population prespecified and clearly described?

dWere the participants in the study representative of those who would be eligible for the test/service/intervention in the general or clinical population of interest?

eWere all eligible participants that met the prespecified entry criteria enrolled?

fWas the sample size sufficiently large to provide confidence in the findings?

gWas the test/service/intervention clearly described and delivered consistently across the study population?

hWere the outcome measures prespecified, clearly defined, valid, reliable, and assessed consistently across all study participants?

iWere the people assessing the outcomes blinded to the participants’ exposures/interventions?

jWas the loss to follow-up after baseline 20% or less? Were those lost to follow-up accounted for in the analysis?

kDid the statistical methods examine changes in outcome measures from before to after the intervention? Were statistical tests done that provided P values for the pre-to-post changes?

lWere outcome measures of interest taken multiple times before the intervention and multiple times after the intervention (ie, did they use an interrupted time-series design)?

mN/A: not applicable.

Table 6. Meta-regression of before-after studies.
VariableCoefficientSEt test (df)P value95% CI
Quality score0.210.181.20 (45).24–0.15 to 0.57
Publication year–0.0020.03–0.08 (45).94–0.06 to 0.05
Continent

Africa–0.060.66–0.09 (45).93–1.43 to 1.31

America–0.140.33–0.44 (45).67–0.82 to 0.53

Australia–0.320.64–0.51 (45).62–0.98 to 1.63

Asia–0.080.54–0.14 (45).89–1.20 to 1.04
Gross national income

Low income0.060.360.17 (45).87–0.68 to 0.80

Low-middle income0.510.560.92 (45).37–0.63 to 1.66

Upper-high income0.510.730.70 (45).49–0.99 to 2.02
Intervention type

Education–0.160.75–0.21 (45).84–1.70 to 1.39

Multicomponent–0.380.70–0.54 (45).60–1.84 to 1.08

Active call0.250.980.25 (45).80–1.77 to 2.26

Clinical remind–0.670.84–0.80 (45).43–2.40 to 1.05

Remind messaging–0.450.86–0.52 (45).61–2.23 to 1.33
Age

Infant-preschool–0.190.31–0.61 (45).55–0.83 to 0.45

Children-adolescent–0.050.29–0.17 (45).87–0.65 to 0.55

Adult-middle age1.270.284.54 (45)<.001a0.70 to 1.84

Aged–0.750.38–1.95 (45).06–1.54 to 0.04
Follow-up

12 months0.370.321.17 (45).25–0.29 to 1.03

>12 months0.050.320.14 (45).89 –0.62 to 0.71

aStatistically significant results.


Principal Findings

Catch-up vaccination strategies are crucial components of a comprehensive national immunization program and should be continually integrated [99,100]. Understanding the effectiveness of vaccination interventions is essential for selecting those best suited to diverse sociodemographic contexts. Therefore, this research included RCTs and before-after studies, recognized as effective catch-up strategies.

In general, catch-up interventions identified in the studies, categorized into 4 groups (“multicomponent,” “educational,” “remind,” and “reward studies”), demonstrated effectiveness in promoting adherence to vaccination. However, practices associated with certain types of “reward” interventions did not exhibit statistical significance [37,38]. Reminder and recall interventions are used to prompt individuals within a target population regarding upcoming vaccinations (recall) or overdue vaccinations (reminder). These strategies vary in content based on the type of vaccination and the target demographic. They are implemented through various methods, including telephone calls with active reminders; messaging via SMS text messages, emails, or traditional mails; in-person reminders within clinical settings; the use of physical objects as reminders; and reminders via web-based platforms. Active call interventions have been shown to significantly enhance vaccination adherence rates. This is likely because telephone contact provides direct access to health care professionals who can address patients’ concerns and inquiries. Moreover, active calls serve as a reminder tool that is easily accessible and adaptable, even in resource-constrained settings. For instance, a study conducted in Nigeria demonstrated that vaccination uptake doubled among newborns whose mothers received calls from health care workers at vaccination centers [34].

Vaccination reminder interventions conducted through messaging (SMS text messages, emails, letters, and notifications) are also effective, although they tend to have a lesser impact compared with “active calls” [36]. This could be attributed to the limitations of “messaging reminders” interventions, such as the inability to engage in immediate question-and-answer discussions with health care workers and the challenge of personalizing the SMS text message, which is often predefined and sent using automated software [41]. Despite the limitations, the widespread use of mobile technologies enables rapid and effortless communication with large communities of people. Additionally, considering the low cost and ubiquity of mobile phones, “messaging reminders” could prove to be an excellent strategy for implementation, especially in low- and middle-income countries [54,63].

Another highly effective strategy for increasing vaccination coverage is the “clinical-remind” approach, where all vaccination promotion interventions occur directly within hospital or primary care settings. Offering vaccination to patients during hospital visits for examinations, consultations, or treatments is a strategy endorsed by the World Health Organization (WHO) to minimize missed opportunities for vaccination. This approach aims to enhance health care service delivery and foster seamless collaboration among health care professionals [101]. A randomized study conducted in Georgia in 2018 serves as a demonstration of this strategy. In the study, the tetanus, diphtheria, and pertussis (Tdap) vaccine was offered to pregnant women during gynecological visits in antenatal clinics. Results indicated a higher willingness to receive vaccination among pregnant women in the intervention group compared with the control arm [56]. Presently, the Advisory Committee on Immunization Practices (ACIP) recommends that pregnant women receive the Tdap vaccine during each pregnancy, regardless of their immunization history [102]. Despite recommendations, maternal Tdap vaccination coverage remains low, not only in the United States but also in many other parts of the world. However, evidence suggests that vaccination strategies involving patient engagement in a clinical setting can effectively increase coverage [56].

The results further highlight the effectiveness of “educational interventions” in vaccine catch-up efforts. Health education stands as one of the primary tools for ensuring that a population has access to health care services. As early as 1983, the WHO recognized health education as a universal right of communities [103]. This right can be realized through integrated information and education programs, aiming to enhance both the population’s desire for good health and their ability to discern the validity of the information they receive [104]. Lack of knowledge and misinformation stand as the primary barriers impeding widespread access to vaccination [12]. Addressing these challenges necessitates a shift toward a more suitable educational approach within the vaccination context. Particularly, among the selected educational interventions, those based on face-to-face dialog between patients and health care professionals emerge as the most effective. An RCT conducted in Italy, aimed at evaluating the impact of various types of educational programs targeting the adolescent population, demonstrated that face-to-face lessons are more effective in increasing vaccination coverage compared with web-based lessons [45].

A highly effective strategy for boosting vaccination coverage is the multidimensional approach, which emerged as the most frequently utilized in the studies included in this review. This approach encompasses interventions that combine vaccination reminder tools with awareness sessions and patient education on vaccination. These interventions are implemented through multiple steps and in various formats. According to the Strategic Advisory Group of Experts on Immunization (SAGE), “multicomponent” interventions are more effective than those with a single component. By addressing various aspects, they are more successful in enhancing knowledge and awareness and in fostering psychological shifts and attitude changes toward vaccinations [104]. A compelling example comes from a before-after study conducted at a rheumatology clinic in Illinois, United States. This study implemented a multifaceted intervention, which included electronic reminders with linked order sets, physician auditing, and patient outreach, resulting in improved patient vaccination rates [86].

The meta-regression analysis indicated a higher effectiveness of vaccination interventions in the European continent compared with other geographic regions. This finding is likely a reflection of the disparity in economic resources and access to health care services between high-income and low-middle-income countries [4]. There is no one-size-fits-all approach to vaccine catch-up that proves effective across all contexts and realities. This is especially true for developing countries, where scientific evidence remains limited. Many vaccine interventions in the WHO African Region, reviewed by the SAGE to develop guidelines addressing vaccine hesitancy, are often documented in the gray literature, which was not encompassed in our review [104]. However, this research has unveiled findings that hold potential global relevance. For instance, health strategies centered around reminders have proven to be effective and cost-efficient, making them particularly suitable for countries with limited resources [54]. Conversely, the significant success observed in certain vaccination programs conducted in the European continent underscores the importance of evaluating the performance of vaccination services in these countries [45,79,83,97]. As of now, there remains a lack of standardized protocols for immunization services aimed at monitoring and improving service quality. Progress in this area has stagnated since the drafting of the National Vaccine Advisory Committee’s standards for vaccination services in the 1980s [105]. However, some authors have proposed models to develop accreditation manuals for vaccination services. These manuals would establish a minimum set of quality standards to ensure the delivery of high-quality preventive health care services. Such standards are crucial for optimizing service effectiveness and ensuring the efficient allocation of economic resources toward public health initiatives [106,107].

Finally, the meta-regression results also revealed the effectiveness of various interventions aimed at vaccination catch-up among a specific demographic: middle-aged adults. This finding may be attributed to the organization of vaccination services by age group. Historically, the majority of vaccines have been developed for pediatric populations, and extensive national and international collaborative efforts have strongly supported mass immunization of the youngest individuals, even in developed countries, to ensure adequate access to life-saving vaccines. Moreover, childhood vaccination programs are typically uniform, well-defined, and bolstered by annual monitoring of vaccine dissemination and its impact on reducing morbidity and mortality. Conversely, reaching the adult population with standard vaccine delivery methods can be more challenging. However, catch-up vaccination and recall interventions have the potential to be highly effective in enhancing coverage among adults.

The older age population, aged 65 years and over, faces a lack of dedicated vaccination programs tailored for their age group, despite being the demographic most vulnerable to the risks and complications associated with infectious diseases [108]. In 2009, 2 geriatric societies, the European Geriatric Medicine Society (EUGMS) and the International Association of Gerontology and Geriatrics-European Region (IAGGER), formulated guidelines outlining recommended vaccinations for the geriatric population. Despite these efforts, the vaccination provision for older patients continues to vary widely among different European countries [109]. The ongoing challenge is to develop vaccination programs for older adults that are as comprehensive and effective as those designed for children.

Moreover, numerous vaccination catch-up interventions rely on “reminder” strategies, which entail sending SMS text messages or emails and providing information through dedicated web pages [25,35,97]. While the utilization of mobile technologies can be a significant asset for vaccination strategies targeting adolescents and adults, it may pose a challenge for the older age population. Alternative intervention modalities may thus prove more suitable. For instance, a study conducted in France aimed at offering recommended vaccinations to hospitalized patients demonstrated a significant increase in vaccination coverage [57]. Providing vaccination counseling in hospital or outpatient settings could be the most effective strategy for achieving widespread vaccination among the older age population.

Comparison With Prior Studies

We identified several prior meta-analyses, published between 2017 and 2018, that investigated the impact of vaccine interventions targeting specific population groups or focused on particular types of interventions [3]. Although patient reminder and recall systems have been extensively studied, the existing literature does not provide data on the potential impact of other vaccine catch-up interventions [110]. Moreover, the search strategy for this systematic review was not confined to any specific geographical context or timeframe, nor was it designed to target a particular type of vaccination. Our study offers an analysis of various vaccination strategies, enabling the identification of the most suitable interventions for each population and vaccination category, across diverse sociodemographic contexts.

Limitations

The search strategy for this systematic review did not encompass gray literature documents and reports. Although the investigation covered all geographical contexts, the majority of the selected and included studies were conducted in developed countries. This bias may arise because some studies on vaccinations and recall interventions in developing countries are typically found in gray literature. Furthermore, no vaccination catch-up interventions related to the COVID-19 vaccine were included. The COVID-19 vaccination, being introduced during an emergency pandemic situation, is not part of the scheduled vaccination regimen. Despite these limitations, this study is among the first to investigate a broad array of vaccine catch-up strategies for scheduled vaccines, encompassing recent studies targeting all age groups of the population.

Conclusions

Vaccination reminder interventions, incorporating educational sessions for the population and utilizing various reminder methods such as SMS text messages and calls, as well as multifaceted interventions combining multiple strategies, have demonstrated effectiveness in enhancing vaccination coverage. However, it is important to note that there is no universal catch-up strategy that performs well across all contexts and realities. It is essential to adopt the most suitable intervention strategy based on the patient category, resource availability, and the socioeconomic status of the target population to be vaccinated.

Authors' Contributions

AF and WP contributed equally to this study. AF, WP, AC, and VR were responsible for the conceptualization and were actively involved in planning the methodology. AF, WP, AC, PF, VP, and AC contributed equally to the investigation and project administration. AF and WP drafted the original manuscript. VR and AC provided critical advice. VR verified the underlying data reported in the manuscript. All authors reviewed, edited, and approved the final version of the manuscript. All authors had full access to all the data in the study and took responsibility for the decision to submit the manuscript for publication.

Conflicts of Interest

None declared.

Multimedia Appendix 1

PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analysis) checklist.

PDF File (Adobe PDF File), 145 KB

Multimedia Appendix 2

Search strategy.

DOCX File , 13 KB

Multimedia Appendix 3

Heterogeneity test for randomized controlled trial included studies.

DOCX File , 16 KB

Multimedia Appendix 4

Forest plots of intervention for randomized controlled trial included studies.

DOCX File , 308 KB

Multimedia Appendix 5

Forest plots of intervention for before-after included studies.

DOCX File , 139 KB

Multimedia Appendix 6

Funnel plot of randomized controlled trial included studies.

DOCX File , 128 KB

Multimedia Appendix 7

Heterogeneity test for before-after included studies.

DOCX File , 15 KB

Multimedia Appendix 8

Funnel plot of before-after included studies.

DOCX File , 48 KB

  1. World Health Organization (WHO). Global immunization policies and guidelines. WHO recommendations for routine immunization - summary tables 2021. In: WHO. Geneva, Switzerland. WHO; 2021.
  2. Fine P, Eames K, Heymann DL. "Herd immunity": a rough guide. Clin Infect Dis. Apr 01, 2011;52(7):911-916. [CrossRef] [Medline]
  3. World Health Organization (WHO). Immunization coverage. WHO. URL: https://www.who.int/en/news-room/fact-sheets/detail/immunization-coverage [accessed 2024-06-09]
  4. Bright T, Felix L, Kuper H, Polack S. A systematic review of strategies to increase access to health services among children in low and middle income countries. BMC Health Serv Res. Apr 05, 2017;17(1):252. [FREE Full text] [CrossRef] [Medline]
  5. Hardt K, Bonanni P, King S, Santos JI, El-Hodhod M, Zimet GD, et al. Vaccine strategies: optimising outcomes. Vaccine. Dec 20, 2016;34(52):6691-6699. [FREE Full text] [CrossRef] [Medline]
  6. Subaiya S, Dumolard L, Lydon P, Gacic-Dobo M, Eggers R, Conklin L. Global routine vaccination coverage, 2014. MMWR Morb Mortal Wkly Rep. Nov 13, 2015;64(44):1252-1255. [FREE Full text] [CrossRef] [Medline]
  7. European Centre for Disease Prevention and Control (ECDC). Annual epidemiological reports (AERs). ECDC. URL: https://www.ecdc.europa.eu/en/publications-data/monitoring/all-annual-epidemiological-reports [accessed 2024-06-09]
  8. Markowitz LE, Naleway AL, Lewis RM, Crane B, Querec TD, Weinmann S, et al. Declines in HPV vaccine type prevalence in women screened for cervical cancer in the United States: evidence of direct and herd effects of vaccination. Vaccine. Jun 27, 2019;37(29):3918-3924. [CrossRef] [Medline]
  9. de Gomensoro E, Del Giudice G, Doherty TM. Challenges in adult vaccination. Ann Med. May 16, 2018;50(3):181-192. [CrossRef] [Medline]
  10. World Health Organization (WHO). Ten threats to global health. WHO. 2019. URL: https://www.who.int/emergencies/ten-threats-to-global-health-in-2019 [accessed 2024-06-09]
  11. Lane S, MacDonald NE, Marti M, Dumolard L. Vaccine hesitancy around the globe: analysis of three years of WHO/UNICEF Joint Reporting Form data-2015-2017. Vaccine. Jun 18, 2018;36(26):3861-3867. [FREE Full text] [CrossRef] [Medline]
  12. Reñosa MDC, Landicho J, Wachinger J, Dalglish SL, Bärnighausen K, Bärnighausen T, et al. Nudging toward vaccination: a systematic review. BMJ Glob Health. Sep 30, 2021;6(9):e006237. [FREE Full text] [CrossRef] [Medline]
  13. Sadaf A, Richards JL, Glanz J, Salmon DA, Omer SB. A systematic review of interventions for reducing parental vaccine refusal and vaccine hesitancy. Vaccine. Sep 13, 2013;31(40):4293-4304. [CrossRef] [Medline]
  14. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. Mar 29, 2021;372:n71. [FREE Full text] [CrossRef] [Medline]
  15. Restivo V, Priano W, Fallucca A. Systematic review and meta-analysis of vaccination coverage effectiveness through catch up intervention. PROSPERO. 2023. URL: https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=307311 [accessed 2024-06-09]
  16. Willis N, Hill S, Kaufman J, Lewin S, Kis-Rigo J, De Castro Freire SB, et al. "Communicate to vaccinate": the development of a taxonomy of communication interventions to improve routine childhood vaccination. BMC Int Health Hum Rights. May 11, 2013;13(1):23. [FREE Full text] [CrossRef] [Medline]
  17. Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, et al. GRADE guidelines: 1. Introduction-GRADE evidence profiles and summary of findings tables. J Clin Epidemiol. Apr 2011;64(4):383-394. [CrossRef] [Medline]
  18. Jadad AR, Moore R, Carroll D, Jenkinson C, Reynolds DM, Gavaghan DJ, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials. Feb 1996;17(1):1-12. [CrossRef] [Medline]
  19. National Heart, Lung, and Blood Institute. Study quality assessment tools. NIH. URL: https://www.nhlbi.nih.gov/health-topics/study-quality-assessment-tools [accessed 2024-06-09]
  20. Rodewald L, Szilagyi P, Humiston S, Barth R, Kraus R, Raubertas R. A randomized study of tracking with outreach and provider prompting to improve immunization coverage and primary care. Pediatrics. Jan 1999;103(1):31-38. [CrossRef] [Medline]
  21. Szilagyi PG, Schaffer S, Barth R, Shone LP, Humiston SG, Ambrose S, et al. Effect of telephone reminder/recall on adolescent immunization and preventive visits: results from a randomized clinical trial. Arch Pediatr Adolesc Med. Feb 01, 2006;160(2):157-163. [CrossRef] [Medline]
  22. Kimura AC, Nguyen CN, Higa JI, Hurwitz EL, Vugia DJ. The effectiveness of vaccine day and educational interventions on influenza vaccine coverage among health care workers at long-term care facilities. Am J Public Health. Apr 2007;97(4):684-690. [CrossRef]
  23. Schwarz K, Garrett B, Lee J, Thompson D, Thiel T, Alter MJ, et al. Positive impact of a shelter-based hepatitis B vaccine program in homeless Baltimore children and adolescents. J Urban Health. Mar 15, 2008;85(2):228-238. [FREE Full text] [CrossRef] [Medline]
  24. Chamberlain A, Seib K, Ault K, Rosenberg E, Frew P, Cortés M, et al. Improving influenza and Tdap vaccination during pregnancy: a cluster-randomized trial of a multi-component antenatal vaccine promotion package in late influenza season. Vaccine. Jul 09, 2015;33(30):3571-3579. [FREE Full text] [CrossRef] [Medline]
  25. Richman AR, Maddy L, Torres E, Goldberg EJ. A randomized intervention study to evaluate whether electronic messaging can increase human papillomavirus vaccine completion and knowledge among college students. J Am Coll Health. Jan 29, 2016;64(4):269-278. [CrossRef] [Medline]
  26. Currat M, Lazor-Blanchet C, Zanetti G. Promotion of the influenza vaccination to hospital staff during pre-employment health check: a prospective, randomised, controlled trial. J Occup Med Toxicol. Nov 18, 2020;15(1):34. [FREE Full text] [CrossRef] [Medline]
  27. Menzies R, Heron L, Lampard J, McMillan M, Joseph T, Chan J, et al. A randomised controlled trial of SMS messaging and calendar reminders to improve vaccination timeliness in infants. Vaccine. Mar 30, 2020;38(15):3137-3142. [CrossRef] [Medline]
  28. Liao Q, Fielding R, Cheung Y, Lian J, Yuan J, Lam W. Effectiveness and parental acceptability of social networking interventions for promoting seasonal influenza vaccination among young children: randomized controlled trial. J Med Internet Res. Feb 28, 2020;22(2):e16427. [FREE Full text] [CrossRef] [Medline]
  29. Yunusa U, Ibrahim AH, Ladan MA, Gomaa HEM. Effect of mobile phone text message and call reminders in the completeness of pentavalent vaccines in Kano state, Nigeria. J Pediatr Nurs. May 2022;64:e77-e83. [CrossRef] [Medline]
  30. Gilkey MB, Dayton AM, Moss JL, Sparks AC, Grimshaw AH, Bowling JM, et al. Increasing provision of adolescent vaccines in primary care: a randomized controlled trial. Pediatrics. Aug 2014;134(2):e346-e353. [FREE Full text] [CrossRef] [Medline]
  31. Brown VB, Oluwatosin OA, Akinyemi JO, Adeyemo AA. Effects of community health nurse-led intervention on childhood routine immunization completion in primary health care centers in Ibadan, Nigeria. J Community Health. Apr 22, 2016;41(2):265-273. [CrossRef] [Medline]
  32. Lemaitre T, Carrier N, Farrands A, Gosselin V, Petit G, Gagneur A. Impact of a vaccination promotion intervention using motivational interview techniques on long-term vaccine coverage: the PromoVac strategy. Hum Vaccin Immunother. Jan 04, 2019;15(3):732-739. [FREE Full text] [CrossRef] [Medline]
  33. Muñoz-Miralles R, Bonvehí Nadeu S, Sant Masoliver C, Martín Gallego A, Gómez Del Canto J, Mendioroz Peña J, et al. Effectiveness of a brief intervention for acceptance of influenza vaccine in reluctant primary care patients. Gac Sanit. Sep 2022;36(5):446-451. [FREE Full text] [CrossRef] [Medline]
  34. Brown VB, Oluwatosin OA. Feasibility of implementing a cellphone-based reminder/recall strategy to improve childhood routine immunization in a low-resource setting: a descriptive report. BMC Health Serv Res. Dec 04, 2017;17(Suppl 2):703. [FREE Full text] [CrossRef] [Medline]
  35. Hu Y, Li Q, Chen Y. Evaluation of two health education interventions to improve the varicella vaccination: a randomized controlled trial from a province in the east China. BMC Public Health. Jan 16, 2018;18(1):144. [FREE Full text] [CrossRef] [Medline]
  36. Qin W, Song J, Wang Y, Nie T, Pan F, Xu X, et al. Upgrading the school entry vaccination record check strategy to improve varicella vaccination coverage: results from a quasi-experiment study. Hum Vaccin Immunother. Sep 02, 2021;17(9):3137-3144. [FREE Full text] [CrossRef] [Medline]
  37. Chandir S, Khan A, Hussain H, Usman H, Khowaja S, Halsey N, et al. Effect of food coupon incentives on timely completion of DTP immunization series in children from a low-income area in Karachi, Pakistan: a longitudinal intervention study. Vaccine. Apr 26, 2010;28(19):3473-3478. [CrossRef] [Medline]
  38. Alessandrini V, Anselem O, Girault A, Mandelbrot L, Luton D, Launay O, et al. Does the availability of influenza vaccine at prenatal care visits and of immediate vaccination improve vaccination coverage of pregnant women? PLoS One. Aug 1, 2019;14(8):e0220705. [FREE Full text] [CrossRef] [Medline]
  39. Fiks A, Grundmeier R, Biggs L, Localio A, Alessandrini E. Impact of clinical alerts within an electronic health record on routine childhood immunization in an urban pediatric population. Pediatrics. Oct 2007;120(4):707-714. [CrossRef] [Medline]
  40. Yoo B, Humiston SG, Szilagyi PG, Schaffer SJ, Long C, Kolasa M. Cost effectiveness analysis of Year 2 of an elementary school-located influenza vaccination program-results from a randomized controlled trial. BMC Health Serv Res. Nov 16, 2015;15(1):511. [FREE Full text] [CrossRef] [Medline]
  41. LeBaron CW, Starnes DM, Rask KJ. The impact of reminder-recall interventions on low vaccination coverage in an inner-city population. Arch Pediatr Adolesc Med. Mar 01, 2004;158(3):255-261. [CrossRef] [Medline]
  42. Brewer N, Hall M, Malo T, Gilkey M, Quinn B, Lathren C. Announcements versus conversations to improve HPV vaccination coverage: a randomized trial. Pediatrics. Jan 2017;139(1):a. [CrossRef] [Medline]
  43. Wong VWY, Fong DYT, Lok KYW, Wong JYH, Sing C, Choi AY, et al. Brief education to promote maternal influenza vaccine uptake: a randomized controlled trial. Vaccine. Oct 17, 2016;34(44):5243-5250. [CrossRef] [Medline]
  44. Hu Y, Chen Y, Wang Y, Song Q, Li Q. Prenatal vaccination education intervention improves both the mothers' knowledge and children's vaccination coverage: Evidence from randomized controlled trial from eastern China. Hum Vaccin Immunother. Jun 03, 2017;13(6):1-8. [FREE Full text] [CrossRef] [Medline]
  45. Esposito S, Bianchini S, Tagliabue C, Umbrello G, Madini B, Di Pietro G, et al. Impact of a website based educational program for increasing vaccination coverage among adolescents. Hum Vaccin Immunother. Apr 03, 2018;14(4):961-968. [FREE Full text] [CrossRef] [Medline]
  46. Humiston SG, Bennett NM, Long C, Eberly S, Arvelo L, Stankaitis J, et al. Increasing inner-city adult influenza vaccination rates: a randomized controlled trial. Public Health Rep. Jul 01, 2011;126(2_suppl):39-47. [CrossRef]
  47. Mantzari E, Vogt F, Marteau TM. Financial incentives for increasing uptake of HPV vaccinations: a randomized controlled trial. Health Psychol. Feb 2015;34(2):160-171. [FREE Full text] [CrossRef] [Medline]
  48. Zimmerman RK, Moehling KK, Lin CJ, Zhang S, Raviotta JM, Reis EC, et al. Improving adolescent HPV vaccination in a randomized controlled cluster trial using the 4 Pillars™ practice Transformation Program. Vaccine. Jan 03, 2017;35(1):109-117. [FREE Full text] [CrossRef] [Medline]
  49. Ma GX, Lee MM, Tan Y, Hanlon AL, Feng Z, Shireman TI, et al. Efficacy of a community-based participatory and multilevel intervention to enhance hepatitis B virus screening and vaccination in underserved Korean Americans. Cancer. Mar 01, 2018;124(5):973-982. [FREE Full text] [CrossRef] [Medline]
  50. Nagar R, Venkat P, Stone LD, Engel KA, Sadda P, Shahnawaz M. A cluster randomized trial to determine the effectiveness of a novel, digital pendant and voice reminder platform on increasing infant immunization adherence in rural Udaipur, India. Vaccine. Oct 22, 2018;36(44):6567-6577. [CrossRef] [Medline]
  51. Wallace AS, Peetosutan K, Untung A, Ricardo M, Yosephine P, Wannemuehler K, et al. Home-based records and vaccination appointment stickers as parental reminders to reduce vaccination dropout in Indonesia: a cluster-randomized controlled trial. Vaccine. Oct 23, 2019;37(45):6814-6823. [FREE Full text] [CrossRef] [Medline]
  52. Borgey F, Henry L, Lebeltel J, Lescure P, Le Coutour X, Vabret A, et al. Effectiveness of an intervention campaign on influenza vaccination of professionals in nursing homes: a cluster-randomized controlled trial. Vaccine. Feb 28, 2019;37(10):1260-1265. [CrossRef] [Medline]
  53. Levine G, Salifu A, Mohammed I, Fink G. Mobile nudges and financial incentives to improve coverage of timely neonatal vaccination in rural areas (GEVaP trial): A 3-armed cluster randomized controlled trial in Northern Ghana. PLoS One. May 19, 2021;16(5):e0247485. [FREE Full text] [CrossRef] [Medline]
  54. Kagucia EW, Ochieng B, Were J, Hayford K, Obor D, O'Brien KL, et al. Impact of mobile phone delivered reminders and unconditional incentives on measles-containing vaccine timeliness and coverage: a randomised controlled trial in western Kenya. BMJ Glob Health. Jan 28, 2021;6(1):e003357. [FREE Full text] [CrossRef] [Medline]
  55. Andersson N, Cockcroft A, Ansari NM, Omer K, Baloch M, Ho Foster A, et al. Evidence-based discussion increases childhood vaccination uptake: a randomised cluster controlled trial of knowledge translation in Pakistan. BMC Int Health Hum Rights. Oct 14, 2009;9(S1):S8. [CrossRef]
  56. Kriss JL, Frew PM, Cortes M, Malik FA, Chamberlain AT, Seib K, et al. Evaluation of two vaccine education interventions to improve pertussis vaccination among pregnant African American women: a randomized controlled trial. Vaccine. Mar 13, 2017;35(11):1551-1558. [FREE Full text] [CrossRef] [Medline]
  57. Blanchi S, Vaux J, Toqué JM, Hery L, Laforest S, Piccoli GB, et al. Impact of a catch-up strategy of DT-IPV vaccination during hospitalization on vaccination coverage among people over 65 years of age in France: the HOSPIVAC Study (vaccination during hospitalization). Vaccines (Basel). Jun 09, 2020;8(2):292. [FREE Full text] [CrossRef] [Medline]
  58. Quinley JC, Shih A. Improving physician coverage of pneumococcal vaccine: a randomized trial of a telephone intervention. J Community Health. Apr 2004;29(2):103-115. [CrossRef] [Medline]
  59. Irigoyen MM, Findley S, Wang D, Chen S, Chimkin F, Pena O, et al. Challenges and successes of immunization registry reminders at inner-city practices. Ambul Pediatr. Mar 2006;6(2):100-104. [CrossRef] [Medline]
  60. Muehleisen B, Baer G, Schaad UB, Heininger U. Assessment of immunization status in hospitalized children followed by counseling of parents and primary care physicians improves vaccination coverage: an interventional study. J Pediatr. Dec 2007;151(6):704-6, 706.e1. [CrossRef] [Medline]
  61. Rand CM, Brill H, Albertin C, Humiston SG, Schaffer S, Shone LP, et al. Effectiveness of centralized text message reminders on human papillomavirus immunization coverage for publicly insured adolescents. J Adolesc Health. May 2015;56(5 Suppl):S17-S20. [CrossRef] [Medline]
  62. Chen L, Du X, Zhang L, van Velthoven MH, Wu Q, Yang R, et al. Effectiveness of a smartphone app on improving immunization of children in rural Sichuan Province, China: a cluster randomized controlled trial. BMC Public Health. Aug 31, 2016;16(1):909. [FREE Full text] [CrossRef] [Medline]
  63. Domek GJ, Contreras-Roldan IL, O'Leary ST, Bull S, Furniss A, Kempe A, et al. SMS text message reminders to improve infant vaccination coverage in Guatemala: a pilot randomized controlled trial. Vaccine. May 05, 2016;34(21):2437-2443. [FREE Full text] [CrossRef] [Medline]
  64. Siddiqi DA, Ali RF, Munir M, Shah MT, Khan AJ, Chandir S. Effect of vaccine reminder and tracker bracelets on routine childhood immunization coverage and timeliness in urban Pakistan (2017-18): a randomized controlled trial. BMC Public Health. Jul 11, 2020;20(1):1086. [FREE Full text] [CrossRef] [Medline]
  65. Sääksvuori L, Betsch C, Nohynek H, Salo H, Sivelä J, Böhm R. Information nudges for influenza vaccination: evidence from a large-scale cluster-randomized controlled trial in Finland. PLoS Med. Feb 9, 2022;19(2):e1003919. [FREE Full text] [CrossRef] [Medline]
  66. Gargano L, Pazol K, Sales J, Painter J, Morfaw C, Jones LM, et al. Multicomponent interventions to enhance influenza vaccine delivery to adolescents. Pediatrics. Nov 2011;128(5):e1092-e1099. [FREE Full text] [CrossRef] [Medline]
  67. Suryadevara M, Bonville C, Ferraioli F, Domachowske J. Community-centered education improves vaccination rates in children from low-income households. Pediatrics. Aug 2013;132(2):319-325. [CrossRef] [Medline]
  68. Wallace-Brodeur R, Li R, Davis W, Humiston S, Albertin C, Szilagyi PG, et al. A quality improvement collaborative to increase human papillomavirus vaccination rates in local health department clinics. Prev Med. Oct 2020;139:106235. [CrossRef] [Medline]
  69. Costantino C, Mazzucco W, Bonaccorso N, Cimino L, Conforto A, Sciortino M, et al. Educational interventions on pregnancy vaccinations during childbirth classes improves vaccine coverages among pregnant women in Palermo's province. Vaccines (Basel). Dec 08, 2021;9(12):1455. [FREE Full text] [CrossRef] [Medline]
  70. Cushon JA, Neudorf CO, Kershaw TM, Dunlop TG, Muhajarine N. Coverage for the entire population: tackling immunization rates and disparities in Saskatoon Health Region. Can J Public Health. Sep 1, 2012;103(S1):S37-S41. [CrossRef]
  71. Kaufman J, Attwell K, Tuckerman J, O'Sullivan J, Omer SB, Leask J, et al. Feasibility and acceptability of the multi-component P3-MumBubVax antenatal intervention to promote maternal and childhood vaccination: a pilot study. Vaccine. May 19, 2020;38(24):4024-4031. [CrossRef] [Medline]
  72. Gattis S, Yildirim I, Shane A, Serluco S, McCracken C, Liverman R. Impact of pharmacy-initiated interventions on influenza vaccination rates in pediatric solid organ transplant recipients. J Pediatric Infect Dis Soc. Dec 27, 2019;8(6):525-530. [CrossRef] [Medline]
  73. Gossec L, Soubrier M, Foissac F, Molto A, Richette P, Beauvais C, et al. Screening for and management of comorbidities after a nurse-led program: results of a 3-year longitudinal study in 769 established rheumatoid arthritis patients. RMD Open. Jun 14, 2019;5(2):e000914. [FREE Full text] [CrossRef] [Medline]
  74. Hernández-García I, Aibar-Remón C. Effectiveness of an intervention to improve the vaccination coverage against in patients with chronic kidney disease. Hum Vaccin Immunother. Jan 02, 2021;17(1):170-172. [FREE Full text] [CrossRef] [Medline]
  75. Nguyen NT, Vu HM, Dao SD, Tran HT, Nguyen TXC. Digital immunization registry: evidence for the impact of mHealth on enhancing the immunization system and improving immunization coverage for children under one year old in Vietnam. Mhealth. Jul 2017;3:26-26. [FREE Full text] [CrossRef] [Medline]
  76. Chen JJ, Chang ET, Chen Y, Bailey MB, So SKS. A model program for hepatitis B vaccination and education of schoolchildren in rural China. Int J Public Health. Jun 16, 2012;57(3):581-588. [CrossRef] [Medline]
  77. Toleman MS, Herbert K, McCarthy N, Church DN. Vaccination of chemotherapy patients--effect of guideline implementation. Support Care Cancer. May 26, 2016;24(5):2317-2321. [CrossRef] [Medline]
  78. Sengupta P, Benjamin A, Myles P, Babu B. Evaluation of a community-based intervention to improve routine childhood vaccination uptake among migrants in urban slums of Ludhiana, India. J Public Health (Oxf). Dec 01, 2017;39(4):805-812. [CrossRef] [Medline]
  79. Costantino C, Restivo V, Gaglio V, Lanza G, Marotta C, Maida CM, et al. Effectiveness of an educational intervention on seasonal influenza vaccination campaign adherence among healthcare workers of the Palermo University Hospital, Italy. Ann Ig. 2019;31(1):35-44. [FREE Full text] [CrossRef] [Medline]
  80. Glanternik JR, McDonald JC, Yee AH, Howell Ba A, Saba KN, Mellor RG, et al. Evaluation of a vaccine-communication tool for physicians. J Pediatr. Sep 2020;224:72-78.e1. [CrossRef] [Medline]
  81. Paunio M, Virtanen M, Peltola H, Cantell K, Paunio P, Valle M, et al. Increase of vaccination coverage by mass media and individual approach: intensified measles, mumps, and rubella prevention program in Finland. Am J Epidemiol. Jun 01, 1991;133(11):1152-1160. [CrossRef] [Medline]
  82. Abd Elaziz KM, Sabbour SM, Dewedar SA. A measles and rubella (MR) catch-up vaccination campaign in an Egyptian University: vaccine uptake and knowledge and attitudes of students. Vaccine. Nov 03, 2010;28(47):7563-7568. [CrossRef] [Medline]
  83. Llupià A, Mena G, Olivé V, Quesada S, Aldea M, Sequera VG, et al. Evaluating influenza vaccination campaigns beyond coverage: a before-after study among health care workers. Am J Infect Control. Aug 2013;41(8):674-678. [CrossRef] [Medline]
  84. Aspesi AV, Kauffmann GE, Davis AM, Schulwolf EM, Press VG, Stupay KL, et al. IBCD: development and testing of a checklist to improve quality of care for hospitalized general medical patients. Jt Comm J Qual Patient Saf. Apr 2013;39(4):147-156. [FREE Full text] [CrossRef] [Medline]
  85. Hu Y, Luo S, Tang X, Lou L, Chen Y, Guo J, et al. Does introducing an immunization package of services for migrant children improve the coverage, service quality and understanding? An evidence from an intervention study among 1548 migrant children in eastern China. BMC Public Health. Jul 15, 2015;15(1):664. [FREE Full text] [CrossRef] [Medline]
  86. Baker DW, Brown T, Lee JY, Ozanich A, Liss DT, Sandler DS, et al. A multifaceted intervention to improve influenza, pneumococcal, and herpes zoster vaccination among patients with rheumatoid arthritis. J Rheumatol. Jun 15, 2016;43(6):1030-1037. [FREE Full text] [CrossRef] [Medline]
  87. Mazzoni SE, Brewer SE, Pyrzanowski JL, Durfee MJ, Dickinson LM, Barnard JG, et al. Effect of a multi-modal intervention on immunization rates in obstetrics and gynecology clinics. Am J Obstet Gynecol. May 2016;214(5):617.e1-617.e7. [CrossRef] [Medline]
  88. Mustafa M, Al-Khal A, Al Maslamani M, Al Soub H. Improving influenza vaccination rates of healthcare workers: a multipronged approach in Qatar. East Mediterr Health J. Jun 14, 2017;23(4):303-310. [FREE Full text] [CrossRef] [Medline]
  89. Nzioki JM, Ouma J, Ombaka JH, Onyango RO. Community health worker interventions are key to optimal infant immunization coverage, evidence from a pretest-posttest experiment in Mwingi, Kenya. Pan Afr Med J. 2017;28:21. [FREE Full text] [CrossRef] [Medline]
  90. Varman M, Sharlin C, Fernandez C, Vasudevan J, Wichman C. Human papilloma virus vaccination among adolescents in a community clinic before and after intervention. J Community Health. Jun 24, 2018;43(3):455-458. [CrossRef] [Medline]
  91. Poscia A, Pastorino R, Boccia S, Ricciardi W, Spadea A. The impact of a school-based multicomponent intervention for promoting vaccine uptake in Italian adolescents: a retrospective cohort study. Ann Ist Super Sanita. Mar 2019;55(2):124-130. [FREE Full text] [CrossRef] [Medline]
  92. Podraza L, Vasudevan J, Hudson C, Jayan A, Varman M. Outcomes from the use of targeted interventions to increase meningococcal vaccination rates in a pediatric clinic. J Community Health. Feb 13, 2022;47(1):87-93. [FREE Full text] [CrossRef] [Medline]
  93. Akwataghibe NN, Ogunsola EA, Popoola OA, Agbo AI, Dieleman MA. Using participatory action research to improve immunization utilization in areas with pockets of unimmunized children in Nigeria. Health Res Policy Syst. Aug 11, 2021;19(Suppl 2):88. [FREE Full text] [CrossRef] [Medline]
  94. Perkins RB, Foley S, Hassan A, Jansen E, Preiss S, Isher-Witt J, et al. Impact of a multilevel quality improvement intervention using national partnerships on human papillomavirus vaccination rates. Acad Pediatr. Sep 2021;21(7):1134-1141. [CrossRef] [Medline]
  95. Cecinati V, Esposito S, Scicchitano B, Delvecchio G, Amato D, Pelucchi C, et al. Effectiveness of recall systems for improving influenza vaccination coverage in children with oncohematological malignancies. Hum Vaccin. Feb 2010;6(2):194-197. [CrossRef] [Medline]
  96. Lam ST, George S, Dunlow S, Nelson M, Hartzell JD. Tdap coverage in a military beneficiary population: room for improvement. Military Medicine. Oct 2013;178(10):1133-1136. [CrossRef]
  97. Esteban-Vasallo MD, Domínguez-Berjón MF, García-Riolobos C, Zoni AC, Aréjula Torres JL, Sánchez-Perruca L, et al. Effect of mobile phone text messaging for improving the uptake of influenza vaccination in patients with rare diseases. Vaccine. Aug 23, 2019;37(36):5257-5264. [CrossRef] [Medline]
  98. Fairbrother G, Friedman S, Hanson KL, Butts GC. Effect of the vaccines for children program on inner-city neighborhood physicians. Arch Pediatr Adolesc Med. Dec 01, 1997;151(12):1229-1235. [CrossRef] [Medline]
  99. World Health Organization (WHO). Catch up vaccination. WHO. URL: https:/​/www.​who.int/​teams/​immunization-vaccines -and-biologicals/​essential-programme-on-immunization/​implementation/​catch-up-vaccination [accessed 2024-06-09]
  100. Community Preventive Services Task Force. Increasing appropriate vaccination: client reminder and recall. The Community Guide. URL: https://www.thecommunityguide.org/media/pdf/Vaccination-Client-Reminders.pdf [accessed 2024-06-09]
  101. World Health Organization (WHO). Essential Immunization Program - Reducing Lost Opportunities to Immunize [MOV]. WHO. URL: https:/​/www.​who.int/​teams/​immunization-vaccines-and-biologicals/​essential-programme-on-immunization/​implementation/​reducing-missed-opportunities-for-vaccination-[mov [accessed 2024-06-09]
  102. Centers for Disease ControlPrevention (CDC). Updated recommendations for use of tetanus toxoid, reduced diphtheria toxoid, and acellular pertussis vaccine (Tdap) in pregnant women--Advisory Committee on Immunization Practices (ACIP), 2012. MMWR Morb Mortal Wkly Rep. Feb 22, 2013;62(7):131-135. [FREE Full text] [Medline]
  103. World Health Organization (WHO). Health education in self-care: possibilities and limitations. WHO. URL: https:/​/apps.​who.int/​iris/​bitstream/​handle/​10665/​70092/​HED_84.​1.​pdf;jsessionid=D934CD23B551814D72C5AF73E582EA01?sequence=1 [accessed 2024-06-09]
  104. SAGE Working Group. Report of the SAGE Working Group on vaccine hesitancy. ASSET. Nov 12, 2014. URL: https:/​/www.​asset-scienceinsociety.eu/​sites/​default/​files/​sage_working_group_revised_report_vaccine_hesitancy.​pdf [accessed 2024-06-09]
  105. No authors. Standards for pediatric immunization practices. Ad Hoc Working Group for the development of standards for pediatric immunization practices. JAMA. Apr 14, 1993;269(14):1817-1822. [Medline]
  106. Cassiani R, Marinelli G. Accreditation of vaccination services: experimental phase [Article in Italian]. Ann Ig. 2002;14(4 Suppl 4):87-93. [Medline]
  107. Restivo V, Orsi A, Ciampini S, Messano G, Trucchi C, Ventura G, et al. How should vaccination services be planned, organized, and managed? Results from a survey on the Italian vaccination services. Ann Ig. 2019;31(2 Supple 1):45-53. [FREE Full text] [CrossRef] [Medline]
  108. Michel J, Chidiac C, Grubeck-Loebenstein B, Johnson RW, Lambert PH, Maggi S, et al. Advocating vaccination of adults aged 60 years and older in Western Europe: statement by the Joint Vaccine Working Group of the European Union Geriatric Medicine Society and the International Association of Gerontology and Geriatrics-European Region. Rejuvenation Res. Apr 2009;12(2):127-135. [CrossRef] [Medline]
  109. European Geriatric Medicine Society (EUGMS). BGSInvestInCare: 8 key issues for older people's healthcare. British Geriatrics Society. 2022. URL: https://www.bgs.org.uk/european-geriatric-medicine-society-eugms [accessed 2024-06-09]
  110. Jacobson Vann JC, Jacobson RM, Coyne-Beasley T, Asafu-Adjei JK, Szilagyi PG. Patient reminder and recall interventions to improve immunization rates. Cochrane Database Syst Rev. Jan 18, 2018;1(1):CD003941. [FREE Full text] [CrossRef] [Medline]


ACIP: Advisory Committee on Immunization Practices
EUGMS: European Geriatric Medicine Society
GNI: gross national income
GRADE: Grading of Recommendations Assessment, Development, and Evaluation
HPV: human papillomavirus
IAGGER: International Association of Gerontology and Geriatrics-European Region
MeSH: Medical Subject Headings
PICOS: Population, Intervention, Comparison, Outcomes and Study
PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analysis
RCT: randomized controlled trial
RR: risk ratio
SAGE: Strategic Advisory Group of Experts on Immunization
Tdap: tetanus, diphtheria, and pertussis
VCIE: vaccination coverage improvement effectiveness
WHO: World Health Organization


Edited by A Mavragani; submitted 19.09.23; peer-reviewed by F Yang, E Paskett; comments to author 12.03.24; revised version received 16.04.24; accepted 30.04.24; published 23.07.24.

Copyright

©Alessandra Fallucca, Walter Priano, Alessandro Carubia, Patrizia Ferro, Vincenzo Pisciotta, Alessandra Casuccio, Vincenzo Restivo. Originally published in JMIR Public Health and Surveillance (https://publichealth.jmir.org), 23.07.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Public Health and Surveillance, is properly cited. The complete bibliographic information, a link to the original publication on https://publichealth.jmir.org, as well as this copyright and license information must be included.