Published on in Vol 8, No 8 (2022): August

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/37656, first published .
Google Trends on Human Papillomavirus Vaccine Searches in the United States From 2010 to 2021: Infodemiology Study

Google Trends on Human Papillomavirus Vaccine Searches in the United States From 2010 to 2021: Infodemiology Study

Google Trends on Human Papillomavirus Vaccine Searches in the United States From 2010 to 2021: Infodemiology Study

Original Paper

Center for Public Health and Technology, Department of Health, Human Performance, and Recreation, College of Education and Health Professions, University of Arkansas, Fayetteville, AR, United States

*all authors contributed equally

Corresponding Author:

Philip M Massey, MPH, PhD

Center for Public Health and Technology

Department of Health, Human Performance, and Recreation, College of Education and Health Professions

University of Arkansas

346 West Ave.

West Avenue Annex Building, Suite 317

Fayetteville, AR, 72701

United States

Phone: 1 479 575 8491

Email: masseyp@uark.edu


Background: The human papillomavirus (HPV) vaccine is recommended for adolescents and young adults to prevent HPV-related cancers and genital warts. However, HPV vaccine uptake among the target age groups is suboptimal.

Objective: The aim of this infodemiology study was to examine public online searches in the United States related to the HPV vaccine from January 2010 to December 2021.

Methods: Google Trends (GT) was used to explore online searches related to the HPV vaccine from January 1, 2010, to December 31, 2021. Online searches and queries on the HPV vaccine were investigated using relative search volumes (RSVs). Analysis of variance was performed to investigate quarterly differences in HPV vaccine searches in each year from 2010 to 2021. A joinpoint regression was used to identify statistically significant changes over time; the α level was set to .05.

Results: The year-wise online search volume related to the HPV vaccine increased from 2010 to 2021, often following federal changes related to vaccine administration. Joinpoint regression analysis showed that HPV vaccine searches significantly increased on average by 8.6% (95% CI 5.9%-11.4%) across each year from 2010 to 2021. Moreover, HPV vaccine searches demonstrated a similar pattern across years, with search interest increasing through August nearly every year. At the state level, the highest 12-year mean RSV was observed in California (59.9, SD 14.3) and the lowest was observed in Wyoming (17.4, SD 8.5) during the period of 2010-2021.

Conclusions: Online searches related to the HPV vaccine increased by an average of 8.6% across each year from 2010 to 2021, with noticeable spikes corresponding to key changes in vaccine recommendations. We identified patterns across years and differences at the state level in the online search interest related to the HPV vaccine. Public health organizations can use GT as a tool to characterize the public interest in and promote the HPV vaccine in the United States.

JMIR Public Health Surveill 2022;8(8):e37656

doi:10.2196/37656

Keywords



Human papillomavirus (HPV) is the most common sexually transmitted infection in the United States, and certain strains are associated with the majority of cancers of the cervix (90%), anus (90%), vagina and vulva (70%), penis (60%), and oropharynx (71%) [1]. In the United States, with nearly 80 million people currently infected with HPV and an estimated 14 million new cases each year, there is a significant burden of HPV-associated cancers [2]. Vaccination against HPV is highly effective at preventing HPV-related cancers, and the US Advisory Committee on Immunization Practices (ACIP) recommends two doses of the HPV vaccine for males and females aged 9-14 years, with catch-up doses recommended up to age 26 [3]. The US Department of Health and Human Services has set a goal to increase the proportion of adolescents who receive the recommended doses of the HPV vaccine to 80% by 2030 [4]. In 2020, up-to-date HPV vaccine coverage among adolescents remained below this mark at 58.6%; however, coverage was up from 54.2% in 2019 [5]. Although the HPV vaccine is safe, effective, and widely available, rates of HPV vaccine coverage in the United States remain suboptimal.

In the internet age, Google searches represent a common approach for discovering information online [6] and the HPV vaccine is one of the most widely discussed vaccinations on the internet [7]. Existing research on the HPV vaccine and social media using various platforms such as YouTube [7,8], Facebook [9], Instagram [10], and Twitter [11,12] have shown that a sizable proportion of HPV vaccine–related misinformation has created a negative perception of the HPV vaccine by the public [13]. During the first decade of HPV vaccine availability, research suggests that its representation on the internet is both positive and negative, with a growing number of false conspiracies and myths circulating [14].

Google Trends (GT) is a popular tool used to analyze online search behavior and search queries in the field of big data analytics in health care and public health research [15]. GT can show changes in online interest for any selected term in any country or region over a selected time period, and can also compare different regions simultaneously [16]. Data from GT have proven to be valuable to monitor health information–seeking behavior trends, often contributing to predictions or detection of outbreaks [17-21]. The emerging discipline of “infodemiology” focuses on these online behaviors, examining data from the internet, including GT, and is defined as “the science of distribution and determinants of information in an electronic medium, specifically the Internet, or in a population, with the ultimate aim to inform public health and public policy” [22].

To date, several studies have examined HPV vaccine–related misinformation [6-11], vaccine hesitancy [23], and arguments circulating on the internet [10,12]. However, there has been little to no research that has used the data of GT to look exclusively at online interest in the HPV vaccine based on search behavior. The purpose of this study was to characterize US public online searches and queries related to the HPV vaccine from 2010 to 2021, and determine the year-over-year changes in searches as well as differences across US states.


Data Collection

We collected monthly search volumes and search queries for the term “HPV vaccine” from GT between January 1, 2010, and December 31, 2021; the GT data retrieval period was from November 1, 2021, to January 31, 2022. GT provides a public database of the proportion of searches of a selected query performed on Google Search, and presents the data as a relative search volume (RSV) in a normalized format. The data can be delineated by specific topics and search terms, time and year, and location. Specific to each search term, the RSV value ranges from 0 (minimal to no interest) to 100 (high popularity) based on the term’s search volume. An RSV value of 100 indicates the maximum search interest for the time and location selected relative to that specific term.

GT enables exploring online searches at different time intervals and retrieval queries for any keywords entered in the Google search engine. Using this technique, we retrieved monthly online search queries and normalized RSVs related to the HPV vaccine across states in the United States. GT allows for queries of both “search terms” and “search topics.” The “search terms” query provides the results for all keywords that fall within the category and the “search topic” query renders the results of a group of terms that share the same concept in any language [16]. We used both search terms and search topics to query results for “HPV vaccine.”

We used the framework described by Mavragani and Ochoa [24] for the region selection and time period selection to retrieve query data from GT. Briefly, we searched for the keyword “HPV vaccine” at the country level (ie, the entire United States) to understand the overall RSVs in each year. Subsequently, using this information, we retrieved RSVs at the state level. All queries were searched between January 1, 2010, and December 31, 2021. The time periods demonstrating high-value RSVs were further investigated by checking with news bulletins or the scientific literature to identify any events associated with these same time periods.

Statistical Analysis

We plotted a line chart to describe “HPV vaccine” search trends from January 1, 2010, to December 31, 2021. The annual mean (SD) is used to summarize the online searches for each year between 2010 and 2021. One-way analysis of variance followed by the Tukey posthoc test was performed to identify overall and quarterly differences in HPV vaccine searches in each year between 2010 and 2021. A joinpoint regression analysis was performed for each year to analyze the time trend in the GT data using the Joinpoint Regression program (version 4.9.1.0) developed by the National Cancer Institute [25]. This software analyzes trends by regression modeling while searching for temporal trend changes at time points called “joinpoints,” and estimates the regression function from previous joinpoints [26]. The number of joinpoints is obtained using a permutation test via Monte Carlo resampling [26] and the analysis criteria were set to find up to three joinpoints. The monthly percentage changes (MPCs) or annual percentage changes (APCs) between trend-change points were determined with their 95% CIs.


Trends in RSVs Related to HPV Vaccine

Figure 1 shows the trends in HPV vaccine online searches from 2010 to 2021, including both the monthly and annual mean RSVs, as well as the up-to-date HPV vaccine rates among 13-17 year-olds in the United States from 2016 to 2020. An increase in searches was observed in October 2011, when the ACIP recommended routine use of the quadrivalent HPV vaccine for boys aged 11-12 years [27]. Between January 2012 and June 2016, there were minimal increases in HPV vaccine searches. The RSV for HPV vaccine reached the highest peak value of 100% (ie, the most popular time the search term was used in our data set from 2010 and 2021) in late 2016, when the ACIP updated the HPV vaccination recommendation to use a 2-dose schedule for boys and girls who initiate the vaccination series at ages 9-14 years [28]. In June 2019, the ACIP recommended a catch-up HPV vaccination for all individuals aged up to 26 years, and the RSV on HPV vaccine reached 81% at this time [3]. Further, in 2020, there was a dramatic decrease in the RSV (28%) during the early COVID-19 pandemic and a comparable situation was observed in the latter half of 2021. The highest annual mean RSVs were recorded in 2018 (62.3%) and 2021 (60.7%), and the lowest annual mean RSVs were recorded in 2010 (20.7%).

Figure 1. Human papillomavirus (HPV) vaccine–related relative search volumes (RSVs) on Google Trends from 2010 to 2021 in the United States with the corresponding timeline of Centers for Disease Control and Prevention (CDC) guidelines for HPV vaccine administration.
View this figure

Quarterly HPV Searches From 2010 to 2021

Table 1 demonstrates the quarterly RSVs of HPV vaccine searches in each year from 2010 to 2021. Online search interest differed significantly across quarters in the years 2014, 2016, and 2017. In 2014, the search interest in the third quarter (July 1-September 30) was significantly higher than that in the second quarter (April 1-June 30) and fourth quarter (October 1-December 31). In 2016, search interest in the third quarter was significantly higher than that in the first, second, and fourth quarters. In 2017, third-quarter search interest was significantly higher than that in the first and fourth quarters.

Table 1. Quarterly differences in relative search volumes on Google Trends for the term “HPV vaccine” from 2010 to 2021 in the United States.
YearRelative search volume point estimate, mean (SD)Fa (df=3)P value

January 1-March 31 (group 1)April 1-June 30 (group 2)July 1-September 30 (group 3)October 1-December 31 (group 4)

201019.6 (0.5)21.0 (2.0)22.0 (2.6)20.3 (3.7)0.463.72
201123.6 (4.9)21.0 (2.6)41.0 (31.3)40.6 (10.0)1.242.36
201232.0 (2.6)27.3 (1.1)32.3 (2.1)27.3 (6.5)1.588.27
201327.0 (1.7)36.3 (17.143.0 (8.1)42.3 (11.9)1.306.34
201436.0 (2.6)30.6 (1.5)42.3 (5.2)30.6 (4.5)6.593.02b, c
201535.0 (3.6)36.3 (2.5)45.6 (8.5)35.0 (5.2)2.659.12
201637.6 (3.0)39.3 (7.5)79.3 (18.8)42.0 (7.5)9.014.005b, c, d
201742.0 (2.6)53.3 (5.5)63.0 (11.8)42.0 (7.8)5.192.03c, d
201849.3 (4.9)49.6 (2.0)60.0 (8.8)54.3 (16.6)0.780.54
201956.6 (5.7)67.3 (12.0)68.3 (5.0)57.0 (7.0)1.914.21
202047.0 (10.4)42.0 (16.3)62.6 (7.0)52.6 (3.2)2.166.17
202154.3 (6.8)62.6 (2.3)71.0 (11.5)55.0 (6.9)3.146 .09

aOne-way analysis of variance followed by Tukey posthoc test for multiple comparisons.

bSignificant (P<.05) difference between group 2 and group 3.

cSignificant (P<.05) difference between group 2 and group 4.

dSignificant (P<.05) difference between group 3 and group 1.

State-Level HPV Vaccine Searches and Changes in HPV Vaccine Searches

Table 2 describes the average RSV of HPV vaccine searches at the state level for each year from 2010 to 2021 as well as the average across all 12 years. The highest 12-year mean RSVs were observed in California, New York, Texas, Florida, and Massachusetts, whereas Delaware, North Dakota, South Dakota, Vermont, and Wyoming recorded the lowest HPV vaccine searches.

Table 2. “HPV vaccine” relative search volume on Google Trends by US states for each year from 2010 to 2021.
State201020112012201320142015201620172018201920202021Mean (SD)
Alabama18.517.925.529.435.34235.23258.653.943.340.136.0 (12.6)
Alaska1116.918.228.922.219.236.723.834.923.926.828.824.3 (7.5)
Arizona22.819.74545.336.441.740.73542.848.845.255.139.9 (10.2)
Arkansas15.527.231.730.9233532.135.730.237.739.941.231.7 (7.3)
California57.826.27042.861.367.853.461.860.364.57479.459.9 (14.3)
Colorado24.72236.427.348.248.940.653.851.256.351.95342.9 (12.3)
Connecticut25.623.136.232.731.75040.64757.754.3404540.3 (11.0)
Delaware8.220.815.520.219.424.319.928.82529.733.332.623.1 (7.3)
District of Columbia34.218.541.523.934.556.644.142.226.131.724.931.534.1 (10.6)
Florida57.626.560.149.367574749.138.560.163.453.952.5 (11.3)
Georgia42.527.354.348.14841.850.852.7525757.850.648.6 (8.3)
Hawaii21.937.529.127.24332.332.234.739.433.340.534.533.8 (5.9)
Idaho9.718.125.123.637.126.232.624.835.836.831.928.827.5 (8.1)
Illinois4126.15641.639.756.648.350.851.959.433.960.747.2 (10.8)
Indiana36.129.837.752.839.242.64143.64352.558.55043.9 (8.2)
Iowa8.426.328.12942.8354435.936.140.14238.333.8 (9.9)
Kansas27.11833.644.718.330.732.72949.24144.738.333.9 (10.1)
Kentucky32.229.339.535.837.34226.139.833.948.14738.437.5 (6.6)
Louisiana28.518.740.338.841.436.338.833.857.750.247.553.840.5 (10.9)
Maine8.630.127.222.212.42534.624.634.932.515.133.125.0 (8.9)
Maryland39.12548.446.545.939.94335.64356.751.664.544.9 (10.1)
Massachusetts43.827.354.146.556.752.445.850.158.364.751.465.451.4 (10.2)
Michigan34.424.341.232.835.957.546.753.558.25862.364.847.5 (13.4)
Minnesota40.818.540.55350.93836.545.743.357.650.653.744.1 (10.5)
Mississippi18.218.528.732.521.122.434.731.138.639.434.149.330.7 (9.5)
Missouri4025.349.437.948.252.734.431.747.650.938.14741.9 (8.6)
Montana11.217.724.320.420.6202625.224.534.732.830.624.0 (6.6)
Nebraska21.318.33239.333.22620.335.441.444.542.143.733.1 (9.6)
Nevada21.814.729.235.238.439.738.13942.341.53859.736.5 (11.2)
New Hampshire19.215.83129.425.4302828.535402831.528.5 (6.4)
New Jersey43.329.739.544.23958.347.148.546.651.844.959.746.1 (8.3)
New Mexico2420.721.629.92627.135.141.140.530.720.133.829.2 (7.3)
New York51.225.347.358.751.466.655.662.162.656.460.672.455.9 (11.9)
North Carolina34.717.651.451.448.761.444.454.356.75453.861.649.2 (12.3)
North Dakota9.522.725.118.41726.725.324.630.229.121.223.922.8 (5.7)
Ohio43.524.452.43341.238.640.744.258.457.654.655.545.3 (10.6)
Oklahoma23.214.637.539.539.746.64334.250.541.138.94337.7 (9.9)
Oregon21.631.738.531.248.438.233.554.929.750.843.640.538.6 (9.7)
Pennsylvania50.13553.424.943.252.946.155.251.169.361.469.851.0 (13.0)
Rhode Island211828.7222110.837.927.330.339.537.43227.2 (8.9)
South Carolina19.932.339.34739.337.731.443.743.245.350.65340.2 (9.2)
South Dakota1216.723.614.720.516.425.828.131.426.127.52622.4 (6.2)
Tennessee27.626.335.241.446.933.442.839.250.552.249.75841.9 (10.0)
Texas5522.152.755.251.263.85052.56553.660.561.553.6 (11.1)
Utah31.425.236.328.8313332.8412146.149.348.335.4 (9.1)
Vermont12.615.615.123.322.125.321.327.824.916.616.733.821.3 (6.2)
Virginia59.125.861.543.43038.244.855.158.859.358.962.849.8 (12.9)
Washington4016.753.341.347.651.137.754.7566451.457.947.6 (12.5)
West Virginia12.826.116.829.833.923.12929.343.841.533.739.429.9 (9.4)
Wisconsin31.428.744.74720.845.142.439.855.344.344.262.242.2 (11.2)
Wyoming9.57.93.517.31422.213.513.925.431.526.723.517.4 (8.5)

Trends in HPV Vaccine Searches 2010-2021

The joinpoint regression plots are provided in Figure 2 and Table 3 gives the corresponding MPCs in the HPV vaccine searches in each full year from 2010 to 2021. Four out of the 12 years examined had no joinpoints (2010, 2011, 2012, 2013), suggesting no changes in search trends across the year. Five of the 12 years (2015, 2017, 2018, 2019, and 2021) had one joinpoint, suggesting two distinct time trends (one increasing and one decreasing) in searches during that year period. Three of the 12 years (2014, 2016, and 2020) had two joinpoints, suggesting three distinct trends, or changes, in searches. With respect to HPV vaccine searches, a common increasing trend across years in search volume (ie, search interest) was observed leading up to August.

Two joinpoints were noted in 2014, 2016, and 2020, all demonstrating similar patterns: a decrease in search interest early in the year, followed by an increase from April/May to August, and finishing with a decrease through December. Specifically, in 2014, there was a significant increase in the RSVs by 17.8% (P<.001) from May to August, followed by a significant decrease in the RSVs by 13.1% (P<.001) from August until December. The RSV search interest in 2016 demonstrated a very similar pattern. The beginning of 2020 demonstrated the largest significant downward trend of all time periods in the joinpoint regression, decreasing by 20% (P<.001) from January to April (ie, corresponding to the early COVID-19 pandemic time period). This sharp decrease was followed by an increase from April to July, although it was not significant.

To explore annual temporal changes in trends in HPV vaccine RSVs in the United States from 2010 to 2021, we estimated the APCs using joinpoint regression analysis and fit three models, allowing for no joinpoints, one joinpoint, and two joinpoints, respectively (Table 4). Model 1 showed that from 2010 to 2021, there was a significant annual average increase of 8.6% in RSVs. In Model 2, the joinpoint regression identified two trends: from 2010 to 2018 there was a significant annual average increase of 11.6% in RSVs, with an annual average decrease of –2.2% in RSVs from 2018 to 2021, although the decrease was not significant. In Model 3, the joinpoint regression analysis identified three separate trends, with only the period from 2012 to 2018 demonstrating a significant annual change in RSVs. Model 1 was the best-fitting model based on the permutation method [29].

Figure 2. Joinpoint regression analysis indicating trends in "HPV vaccine" relative search volume (RSV) on Google Trends from 2010 to 2021 in the United States. Monthly percentage changes (MPCs) in the HPV vaccine RSVs are described in Table 2. The number of slopes is determined by the number of joinpoints identified by the analysis. Joinpoints are the time points when statistically significant changes in the linear slopes are noted.
View this figure
Table 3. Monthly percentage changes (MPCs) in the “HPV vaccine” relative search volumes (RSVs) corresponding to the regression graphs (a–i) in Figure 2.
Regression graph in Figure 2YearSpecified monthly periodaMPC in RSVsb
a20111-127.80
b20131-125.13
c20141-57.50
c20145-817.77
c20148-12–13.12
d20164-740.73
d20167-12–16.14
e20171-88.05
e20178-12–15.44
f20181-103.91
f201810-12–21.73
g20191-76.13
g20197-12–6.99
h20201-4–20.04
i20211-85.51
i20218-12–10.05

aNonsignificant monthly periods are not displayed.

bThe MPC is significantly different from 0 at α=.05 in all periods.

Table 4. Joinpoint regression analysis showing changes in “HPV vaccine” relative search volume on Google Trends over time in the United States.
SegmentPeriodChange yearAnnual percentage change (95% CI)t valueP valueb
Model 1a2010-2021None8.6 (5.9 to 11.4)7.2<.001
Model 22010-2018201811.6 (7.3 to 16.1)6.6<.001
Model 22018-20212021–2.2 (–18.4 to 17.2)–0.3.78
Model 32010-2012201217.9 (–16.8 to 67.0)1.3.26
Model 32012-2018201810.3 (2.0 to 19.3)3.5.03
Model 32018-20212021–1.3 (–17.1 to 17.5)–0.2.85

aFinal selected model, best fitting based on the permutation method.

bP<.05 indicates that the annual percentage change is significantly different from zero.


Main Findings

To our knowledge, this is one of the first studies to examine US public online searches regarding the HPV vaccine using GT data. In analyzing the data on HPV vaccine–related online searches in the period from January 2010 to December 2021, we identified important trends, including an overall increase in online searches with noticeable spikes corresponding to key changes in vaccine recommendations. Overall, the joinpoint regression showed a significant average annual percentage increase of 8.6% in HPV vaccine search interest from 2012 to 2021, along with various time trends in HPV vaccine searches across years as well as within years. At the state level, the 12-year average annual HPV vaccine search interest in the United States was the greatest in California (59.9, SD 14.3), New York (55.9, SD 11.9), and Texas (53.6, SD 11.1), while Wyoming (17.4, SD 8.5) recorded the lowest interest in HPV vaccine searches.

Comparison With Prior Studies

Although previous studies in the United States have explored the influence of social media on HPV vaccine communication [30-34], misinformation [10-14], social interactions, and HPV vaccination behavior [35-37], they also highlighted the need for specific strategies to counter misinformation spreading on the HPV vaccine. In our study, we documented an upward trend in HPV vaccine–related searches following federal changes related to vaccine administration. Despite the consistent evidence that the HPV vaccine is safe and effective, the up-to-date HPV vaccination coverage in 13-17–year-old adolescents was only 59% in 2020 [4]. Moreover, the percentage of parents who refused the HPV vaccine due to safety concerns nearly doubled [38]. Results from a recent study by Sonawane et al [39] showed that HPV vaccine safety concerns are increasing in 30 states. However, much of the information available on social media is not peer-reviewed or evidence-based, and researchers indicated that the information warning about the HPV vaccine is often comprised of innuendos, half-truths, or baseless propaganda [40]. Therefore, continuous monitoring of the trends specific to HPV vaccination across the national and regional landscape is essential to document online health information–seeking behaviors and potential safety concerns.

By using joinpoint regression, we found significant variation in the HPV vaccine RSVs trend by month and year. In nearly every year (8 out of 12), we saw a similar pattern with a significant rise in searches (ie, RSVs) leading up to July and August, followed by a drop in searches, suggesting that HPV vaccine interest was short-lived. This pattern of RSV peaks in July/August syncs with the annual school calendar and the back-to-school period. This is worth noting, as many states and school districts continue to weigh the benefits and costs of vaccine mandates, and whether the HPV vaccine will be required for school attendance [41]. Moreover, public health campaigns can partner with schools during this period to raise public awareness, strengthen parental knowledge, and offer HPV vaccination to all eligible students. This also has important implications, as public health authorities can use this period to promote public health campaigns through internet-based media. There was a considerable decrease in RSVs at the beginning of 2020, corresponding to the start of the COVID-19 pandemic, which could have diverted public interest away from the HPV vaccine onto COVID-19. Nevertheless, our findings showed a positive trend in the online interest of HPV vaccine health–seeking behavior from 2010 to 2021.

HPV vaccine searches differed by US states and demonstrated wide variations in year-over-year searches. All of the US states showed a positive trend in annual HPV vaccine searches from 2010 to 2021; however, some states such as Delaware (mean 23.1, SD 7.3), North Dakota (mean 22.8, SD 6.2), South Dakota (mean 22.4, SD 6.2), Vermont (mean 21.3, SD 6.2), and Wyoming (mean 17.4, SD 8.5) recorded lower RSVs. Although the underlying reasons for these differences are not clear, the changing trend in HPV vaccine searches indicates a positive impact on health-seeking behavior. In this regard, information technology interventions may consider targeting states with lower search volumes to raise awareness, or, alternatively, targeting states with higher search volumes to provide resources for action. Overall, targeted health education materials are needed to ensure that accurate, reliable, and updated information on the HPV vaccine is available online for parents, caregivers, adolescents, and young adults.

Our study identified variations in HPV vaccine search volume by time and geography. These findings could be used to inform targeted search engine advertisements that describe the benefits of the HPV vaccine and how it can prevent cancers, tailoring to different times, geographies, and topics. This approach builds upon prior work using Google Ads to deliver health education materials based on keyword searches [42,43] and geography [44]. For example, our findings demonstrate sharp increases in search volume after changes to HPV vaccine administration, such as making the vaccine available to boys or altering to a 2-dose series. When future changes or announcements arise, we may anticipate a large increase in online searches and create targeted and tailored messaging, utilizing Google Ads, to provide health education materials in the same space people are using to seek information. This approach can be tailored by geography (ie, targeting ads to searches from specific states) or even by topic (ie, tailoring ads to address vaccine safety, age eligibility, or misinformation, to name a few). Targeted online ads may also be utilized to link online searches to community resources or health care providers in local areas.

Limitations

This study has several limitations. First, GT data are observational data; therefore, making causal inferences (eg, more HPV vaccine searching leads to greater HPV vaccine coverage) is not possible. However, we can use these infodemiology data, demonstrating variation in online searches by time and topic, to tailor health education and promotion materials related to HPV vaccination. These materials may be made available online and even targeted as search engine advertisements during periods of high search volume. Second, our study’s units of analysis were at the national and state levels. While these data provide overall indicators for online searches and vaccine coverage, they do not capture the relationship that may be present at other levels of analysis, such as at the community or county level. Third, we are unable to determine the true causes behind changes in search volume; that is, we do not know exactly what prompted increases or declines in searches, but we are able to surmise potential associations based on known federal guideline changes and other information. Fourth, our findings are biased in that they only represent individuals who have internet access and who use Google as their search engine. While most internet users use Google as their search engine (90%) [45], this does not represent the entire US population and may overrepresent certain types of individuals. Finally, variability in the data in specific years may have resulted in the statistical software incorrectly identifying joinpoints.

Conclusions

This study supports the growing body of work examining online and other digital data, and their application to health care and public health research. Specific to the HPV vaccine, we examined GT data to document online search trends from 2010 to 2021. Our observational findings can be used to inform online intervention points such as event-based opportunities (ie, back-to-school night) and state-specific programs. Notably, we observed a marked decline in online searches during the start of the 2020 COVID-19 pandemic. Further investigation is needed to understand whether the significant factors and variations observed in our study hold to HPV vaccination trends outside of the United States.

Authors' Contributions

Conceptualization, ASB and PM; methodology, ASB and PM; software, ASB; validation, ASB and PM; formal analysis, ASB; writing—original draft preparation, ASB; writing—review and editing, PM; visualization, ASB; supervision, PM. All authors have read and agreed to the published version of the manuscript.

Conflicts of Interest

None declared.

  1. Cancers caused by HPV. Centers for Disease Control and Prevention. 2019.   URL: https://www.cdc.gov/hpv/parents/cancer.html [accessed 2021-11-27]
  2. Van Dyne EA, Henley SJ, Saraiya M, Thomas CC, Markowitz LE, Benard VB. Trends in human papillomavirus-associated cancers - United States, 1999-2015. MMWR Morb Mortal Wkly Rep 2018 Aug 24;67(33):918-924. [CrossRef] [Medline]
  3. Meites E, Szilagyi PG, Chesson HW, Unger ER, Romero JR, Markowitz LE. Human papillomavirus vaccination for adults: updated recommendations of the Advisory Committee on Immunization Practices. MMWR Morb Mortal Wkly Rep 2019 Aug 16;68(32):698-702. [CrossRef] [Medline]
  4. Increase the proportion of adolescents who get recommended doses of the HPV vaccine - IID-08. Healthy People 2030 US Department of Health and Human Services.   URL: https:/​/health.​gov/​healthypeople/​objectives-and-data/​browse-objectives/​vaccination/​increase-proportion-adolescents-who-get-recommended-doses-hpv-vaccine-iid-08 [accessed 2022-04-14]
  5. Pingali C, Yankey D, Elam-Evans LD, Markowitz LE, Williams CL, Fredua B, et al. National, regional, state, and selected local area vaccination coverage among adolescents aged 13-17 years - United States, 2020. MMWR Morb Mortal Wkly Rep 2021 Sep 03;70(35):1183-1190. [CrossRef] [Medline]
  6. Brin S, Page L. Reprint of: The anatomy of a large-scale hypertextual web search engine. Comput Netw 2012 Dec;56(18):3825-3833. [CrossRef]
  7. Keelan J, Pavri-Garcia V, Tomlinson G, Wilson K. YouTube as a source of information on immunization: a content analysis. JAMA 2007 Dec 05;298(21):2482-2484. [CrossRef] [Medline]
  8. Ekram S, Debiec KE, Pumper MA, Moreno MA. Content and commentary: HPV vaccine and YouTube. J Pediatr Adolesc Gynecol 2019 Apr;32(2):153-157. [CrossRef] [Medline]
  9. Mohanty S, Leader AE, Gibeau E, Johnson C. Using Facebook to reach adolescents for human papillomavirus (HPV) vaccination. Vaccine 2018 Sep 25;36(40):5955-5961. [CrossRef] [Medline]
  10. Massey PM, Kearney MD, Hauer MK, Selvan P, Koku E, Leader AE. Dimensions of misinformation about the HPV vaccine on Instagram: content and network analysis of social media characteristics. J Med Internet Res 2020 Dec 03;22(12):e21451 [FREE Full text] [CrossRef] [Medline]
  11. Dunn AG, Leask J, Zhou X, Mandl KD, Coiera E. Associations between exposure to and expression of negative opinions about human papillomavirus vaccines on social media: an observational study. J Med Internet Res 2015 Jun 10;17(6):e144 [FREE Full text] [CrossRef] [Medline]
  12. Surian D, Nguyen DQ, Kennedy G, Johnson M, Coiera E, Dunn AG. Characterizing Twitter discussions about HPV vaccines using topic modeling and community detection. J Med Internet Res 2016 Aug 29;18(8):e232 [FREE Full text] [CrossRef] [Medline]
  13. Dunn AG, Surian D, Leask J, Dey A, Mandl KD, Coiera E. Mapping information exposure on social media to explain differences in HPV vaccine coverage in the United States. Vaccine 2017 May 25;35(23):3033-3040 [FREE Full text] [CrossRef] [Medline]
  14. Sonawane K, Zhu Y, Montealegre JR, Lairson DR, Bauer C, McGee LU, et al. Parental intent to initiate and complete the human papillomavirus vaccine series in the USA: a nationwide, cross-sectional survey. Lancet Public Health 2020 Sep;5(9):e484-e492 [FREE Full text] [CrossRef] [Medline]
  15. Nuti SV, Wayda B, Ranasinghe I, Wang S, Dreyer RP, Chen SI, et al. The use of google trends in health care research: a systematic review. PLoS One 2014 Oct 22;9(10):e109583 [FREE Full text] [CrossRef] [Medline]
  16. Google Trends. Google.   URL: https://trends.google.com/trends/ [accessed 2022-01-10]
  17. Bragazzi NL, Barberis I, Rosselli R, Gianfredi V, Nucci D, Moretti M, et al. How often people google for vaccination: qualitative and quantitative insights from a systematic search of the web-based activities using Google Trends. Hum Vaccin Immunother 2017 Feb 16;13(2):464-469 [FREE Full text] [CrossRef] [Medline]
  18. Cervellin G, Comelli I, Lippi G. Is Google Trends a reliable tool for digital epidemiology? Insights from different clinical settings. J Epidemiol Glob Health 2017 Sep;7(3):185-189 [FREE Full text] [CrossRef] [Medline]
  19. Sycinska-Dziarnowska M, Paradowska-Stankiewicz I, Woźniak K. The global interest in vaccines and its prediction and perspectives in the era of COVID-19. Real-time surveillance using Google Trends. Int J Environ Res Public Health 2021 Jul 24;18(15):7841 [FREE Full text] [CrossRef] [Medline]
  20. Lu Y, Wang S, Wang J, Zhou G, Zhang Q, Zhou X, et al. An epidemic avian influenza prediction model based on Google Trends. Lett Org Chem 2019 Mar 20;16(4):303-310. [CrossRef]
  21. Yousefinaghani S, Dara R, Mubareka S, Sharif S. Prediction of COVID-19 waves using social media and Google search: a case study of the US and Canada. Front Public Health 2021 Apr 16;9:656635. [CrossRef] [Medline]
  22. Eysenbach G. Infodemiology: The epidemiology of (mis)information. Am J Med 2002 Dec 15;113(9):763-765. [CrossRef] [Medline]
  23. Nan X, Madden K. HPV vaccine information in the blogosphere: how positive and negative blogs influence vaccine-related risk perceptions, attitudes, and behavioral intentions. Health Commun 2012 Nov;27(8):829-836. [CrossRef] [Medline]
  24. Mavragani A, Ochoa G. Google Trends in infodemiology and infoveillance: methodology framework. JMIR Public Health Surveill 2019 May 29;5(2):e13439 [FREE Full text] [CrossRef] [Medline]
  25. Joinpoint RP, Version 4. Joinpoint Trend Analysis Software. National Institute of Health National Cancer Institute Division of Cancer Control & Population Sciences.   URL: https://surveillance.cancer.gov/joinpoint/ [accessed 2022-04-13]
  26. Kim H, Fay MP, Feuer EJ, Midthune DN. Permutation tests for joinpoint regression with applications to cancer rates. Stat Med 2000 Feb 15;19(3):335-351. [CrossRef] [Medline]
  27. Robinson CL, Advisory Committee on Immunization Practices (ACIP)‚ ACIP Child/Adolescent Immunization Work Group. Advisory Committee on Immunization Practices recommended immunization schedules for persons aged 0 through 18 Years--United States, 2016. MMWR Morb Mortal Wkly Rep 2016 Feb 05;65(4):86-87. [CrossRef] [Medline]
  28. Meites E, Kempe A, Markowitz LE. Use of a 2-dose schedule for human papillomavirus vaccination - updated recommendations of the Advisory Committee on Immunization Practices. MMWR Morb Mortal Wkly Rep 2016 Dec 16;65(49):1405-1408. [CrossRef] [Medline]
  29. How Joinpoint Selects the Final Model. National Institute of Health National Cancer Institute Division of Cancer Control & Population Sciences.   URL: https:/​/surveillance.​cancer.gov/​help/​joinpoint/​setting-parameters/​method-and-parameters-tab/​model-selection-method [accessed 2022-04-13]
  30. Thompson EL, Galvin AM, Garg A, Moore JD, Litt DM. Exploring novel strategies for social media HPV vaccine information. Hum Vaccin Immunother 2021 Dec 02;17(12):5397-5401. [CrossRef] [Medline]
  31. Tung W, Lin Y, Chao HW, Chen Y. HPV vaccination, information sources, and acculturation among Chinese college students aged 18-26 in the United States. Res Nurs Health 2022 Apr;45(2):194-204. [CrossRef] [Medline]
  32. Pho A, Bakken S, Lunn M, Lubensky M, Flentje A, Dastur Z, et al. Online health information seeking, health literacy, and human papillomavirus vaccination among transgender and gender-diverse people. J Am Med Inform Assoc 2022 Jan 12;29(2):285-295 [FREE Full text] [CrossRef] [Medline]
  33. Argyris YA, Kim Y, Roscizewski A, Song W. The mediating role of vaccine hesitancy between maternal engagement with anti- and pro-vaccine social media posts and adolescent HPV-vaccine uptake rates in the US: The perspective of loss aversion in emotion-laden decision circumstances. Soc Sci Med 2021 Aug;282:114043. [CrossRef] [Medline]
  34. Galvin AM, Garg A, Moore JD, Litt DM, Thompson EL. Quality over quantity: human papillomavirus vaccine information on social media and associations with adult and child vaccination. Hum Vaccin Immunother 2021 Oct 03;17(10):3587-3594 [FREE Full text] [CrossRef] [Medline]
  35. Margolis MA, Brewer NT, Shah PD, Calo WA, Gilkey MB. Stories about HPV vaccine in social media, traditional media, and conversations. Prev Med 2019 Jan;118:251-256. [CrossRef] [Medline]
  36. Gilkey MB, Calo WA, Marciniak MW, Brewer NT. Parents who refuse or delay HPV vaccine: differences in vaccination behavior, beliefs, and clinical communication preferences. Hum Vaccin Immunother 2017 Mar 04;13(3):680-686 [FREE Full text] [CrossRef] [Medline]
  37. Buller DB, Pagoto S, Henry K, Berteletti J, Walkosz BJ, Bibeau J, et al. Human papillomavirus vaccination and social media: results in a trial with mothers of daughters aged 14-17. Front Digit Health 2021;3:683034 [FREE Full text] [CrossRef] [Medline]
  38. Despite proven safety of HPV vaccines, more parents have concerns. National Cancer Institute.   URL: https://www.cancer.gov/news-events/cancer-currents-blog/2021/hpv-vaccine-parents-safety-concerns [accessed 2022-01-01]
  39. Sonawane K, Lin Y, Damgacioglu H, Zhu Y, Fernandez ME, Montealegre JR, et al. Trends in human papillomavirus vaccine safety concerns and adverse event reporting in the United States. JAMA Netw Open 2021 Sep 01;4(9):e2124502. [CrossRef] [Medline]
  40. Osazuwa-Peters N, Rohde RL, Boakye EA. HPV vaccination is safe-you don't have to whisper it. JAMA Netw Open 2021 Sep 01;4(9):e2125124 [FREE Full text] [CrossRef] [Medline]
  41. HPV vaccine mandates for elementary and secondary schools. Immunize.org. 2022.   URL: https://www.immunize.org/laws/hpv.asp [accessed 2022-01-02]
  42. Cidre Serrano W, Chren M, Resneck JS, Aji NN, Pagoto S, Linos E. Online advertising for cancer prevention: Google Ads and tanning beds. JAMA Dermatol 2016 Jan 01;152(1):101-102. [CrossRef] [Medline]
  43. Upadhyay UD, Jovel IJ, McCuaig KD, Cartwright AF. Using Google Ads to recruit and retain a cohort considering abortion in the United States. Contraception: X 2020;2:100017. [CrossRef]
  44. Murphy AL, Peltekian S, Gardner DM. Website analytics of a Google Ads campaign for a men's mental health website: comparative analysis. JMIR Ment Health 2018 Dec 13;5(4):e12428 [FREE Full text] [CrossRef] [Medline]
  45. Worldwide desktop market share of leading search engines from January 2010 to September. Statista. 2021.   URL: https://www.statista.com/statistics/216573/worldwide-market-share-of-search-engines/.htm [accessed 2022-01-17]


ACIP: Advisory Committee on Immunization Practices
APC: annual percentage change
GT: Google Trends
HPV: human papillomavirus
MPC: monthly percentage change
RSV: relative search volume


Edited by A Mavragani; submitted 01.03.22; peer-reviewed by M Lotto, K Taira, I Mircheva; comments to author 27.03.22; revised version received 20.05.22; accepted 18.07.22; published 29.08.22

Copyright

©Akshaya Srikanth Bhagavathula, Philip M Massey. Originally published in JMIR Public Health and Surveillance (https://publichealth.jmir.org), 29.08.2022.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Public Health and Surveillance, is properly cited. The complete bibliographic information, a link to the original publication on https://publichealth.jmir.org, as well as this copyright and license information must be included.