Published on in Vol 3, No 3 (2017): Jul-Sept

Facebook Recruitment of Vaccine-Hesitant Canadian Parents: Cross-Sectional Study

Facebook Recruitment of Vaccine-Hesitant Canadian Parents: Cross-Sectional Study

Facebook Recruitment of Vaccine-Hesitant Canadian Parents: Cross-Sectional Study

Original Paper

1School of Occuaptional and Public Health, Ryerson University, Toronto, ON, Canada

2Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada

3Public Health Ontario, Toronto, ON, Canada

4Laboratory Medicine and Pathobiology, University of Toronto, Toronto, ON, Canada

5Concordia University of Edmonton, Edmonton, AB, Canada

6Toronto Public Health, Toronto, ON, Canada

*these authors contributed equally

Corresponding Author:

Jordan Lee Tustin, MSc, PhD

School of Occuaptional and Public Health

Ryerson University

350 Victoria St, POD 249

Toronto, ON, M5N 2K3

Canada

Phone: 1 416 979 5000 ext 3021

Fax:1 416 979 5377

Email: jtustin@ryerson.ca


Background: There is concern over the increase in the number of “vaccine-hesitant” parents, which contributes to under-vaccinated populations and reduced herd immunity. Traditional studies investigating parental immunization beliefs and practices have relied on random digit dialing (RDD); however, this method presents increasing limitations. Facebook is the most used social media platform in Canada and presents an opportunity to recruit vaccine-hesitant parents in a novel manner.

Objective: The study aimed to explore the use of Facebook as a tool to reach vaccine-hesitant parents, as compared with RDD methods.

Methods: We recruited Canadian parents over 4 weeks in 2013-14 via targeted Facebook advertisements linked to a Web-based survey. We compared methodological parameters, key parental demographics, and three vaccine hesitancy indicators to an RDD sample of Canadian parents. Two raters categorized respondent reasons for difficulties in deciding to vaccinate, according to the model of determinants of vaccine hesitancy developed by the World Health Organization’s Strategic Advisory Group of Experts on Immunization.

Results: The Facebook campaign received a total of 4792 clicks from unique users, of whom 1696 started the Web-based survey. The total response rate of fully completed unique Web-based surveys was 22.89% (1097/4792) and the survey completion rate was 64.68% (1097/1696). The total cost including incentives was reasonable (Can $4861.19). The Web-based sample yielded younger parents, with 85.69% (940/1097) under the age of 40 years as compared with 23.38% (408/1745) in the RDD sample; 91.43% (1003/1097) of the Facebook respondents were female as compared with 59.26% (1034/1745) in the RDD sample. Facebook respondents had a lower median age of their youngest child (1 year vs 8 years for RDD). When compared with the RDD sample, the Web-based sample yielded a significantly higher proportion of respondents reporting vaccines as moderately safe to not safe (26.62% [292/1097] vs 18.57% [324/1745]), partially or not at all up-to-date vaccination status of youngest child (22.06% [242/1097] vs 9.57% [167/1745]), and difficulty in making the decision to vaccinate their youngest child (21.06% [231/1097] vs 10.09% [176/1745]). Out of the Web-based respondents who reported reasons for the difficulties in deciding to vaccinate, 37.2% (83/223) reported lack of knowledge or trust due to conflicting information and 23.8% (53/223) reported the perception of the risk of the adverse effects of vaccines being higher than the risk of disease acquisition.

Conclusions: We successfully recruited a large sample of our target population at low cost and achieved a high survey completion rate using Facebook. When compared with the RDD sampling strategy, we reached more vaccine-hesitant parents and younger parents with younger children—a population more likely to be making decisions on childhood immunizations. Facebook is a promising economical modality for reaching vaccine-hesitant parents for studies on the determinants of vaccine uptake.

JMIR Public Health Surveill 2017;3(3):e47

doi:10.2196/publichealth.6870

Keywords



Background

Immunization is one of the most important accomplishments in the global fight against infectious diseases. In Canada, vaccines have saved more lives than any other public health intervention [1]. Despite this success, a 2011 Canadian national survey on immunization coverage reported sub-optimal coverage rates for recommended childhood vaccinations [2]. This low coverage among Canadian children is of concern as vaccine-preventable diseases (VPDs) endemic in other parts of the world could be imported into Canada and lead to outbreaks due to transmission among unvaccinated or under-vaccinated individuals in low coverage areas [3]. Measles is still common in developing countries and remains one of the leading causes of death in young children [4]. The import of measles into Canada was made evident with several recent outbreaks [3]. For example, in 2011, the province of Québec reported the largest North American outbreak of measles since 2002, with 776 cases as compared with the usual annual average of 0 to 2 cases [5,6]. In 2013, there were nine measles outbreaks in Canada with more than half of the cases (42/71) linked to one outbreak in a non-immunizing community in Alberta [7]. In March 2014, the Public Health Agency of Canada (PHAC) released a public health notice, warning Canadians of unusually high numbers of measles cases in five Canadian provinces [8,9]. In 2015, another notice was released because of outbreaks in Ontario and Quebec and the multi-state measles outbreak in the United States [10]. Outbreaks of VPDs such as measles are an imminent threat to Canadians, and experts have suggested that lower vaccine coverage rates are an “impending crisis” [11].

Vaccine hesitant individuals are a “heterogeneous group in the middle of a continuum ranging from total acceptors to complete refusers” [12]. These individuals are of interest as they are undecided about vaccination and may decide to accept, refuse, or delay all or some vaccines for themselves or their children [12]. A recent systematic review by Larson et al (2014) on vaccine hesitancy found that factors affecting vaccine hesitancy include confidence in the vaccine or the provider, complacency regarding the need for or effectiveness of the vaccine, and convenience in terms of access to health care or vaccines [12]. The Strategic Advisory Group of Experts Working Group (SAGE WG) on Immunization recently built on this definition by organizing vaccine hesitancy around three domains: contextual influences such as socio-economic barriers or communications via media/social media, individual/social group influences such as personal knowledge or perceptions of risk, and vaccinations and vaccination-specific issues such as vaccination schedules or characteristics of the vaccines [12-14].

There is a critical need to better understand the factors underlying vaccine hesitancy in Canada in order to implement interventions to help parents in their decision to vaccinate and increase vaccine coverage. Random digit dialing (RDD) surveys have historically been the “Gold Standard” in the collection of Canadian immunization study data. However, Statistics Canada reports that more Canadian households are abandoning their traditional landline telephones; the number of households with landlines has fallen from 66% of households in 2010 to 56% in 2013 [15]. In the province of Quebec, only 43% of households reported having a landline [15]. In contrast, Internet use has been steadily increasing over the years and as of 2010, 80% of Canadians 16 years of age and older use the Internet at home at least once per day [16]. In 2012, this increased to 83% [17]. In addition, the majority (58%) of Internet users are using social media, including over 86% of those under the age of 35 [16], that is, those in their peak reproductive, childbearing, and small-child-rearing years. Concerns have been emerging in the public health community that parental fears regarding childhood vaccines are growing, largely due to rapid sharing of misinformation and the increasing expression and empowerment of anti-vaccine communities and activists on social media [11,18]. Therefore, recruiting via social media platforms for Web-based surveys should be investigated as a viable alternative or complement to RDD to reach self-selecting higher risk populations, such as vaccine-hesitant parents. Alshaikh et al (2013) conducted a systematic review of articles using social media for health research and reported that despite the risk of sampling bias, social media platforms are a useful tool in health research [19]. Furthermore, several recent studies have reported the success of Facebook as a viable, rapid, and cost-effective platform for targeted recruitment of specific populations such as pregnant women, unvaccinated women, parents, young adults and smokers [20-24].

Objective

This study aims to explore the effectiveness of Canada’s most popular social media platform, Facebook, as a tool to reach vaccine-hesitant parents, and it will explore the differences in key parental demographics and vaccine hesitancy indicators between a Facebook survey of recruits and the most recent RDD survey of the Canadian population [25]. To date no study has investigated the value of social media recruitment versus traditional RDD household recruitment in the study of parental immunization practices and beliefs.


Study Design

In this observational study, we used two datasets that included data on parental immunization beliefs and practices collected from Canadian parents via two different cross-sectional methods. The inclusion criteria for both populations were as follows: (1) over 18 years of age, (2) having at least one child under 18 years, (3) living in Canada, and (4) able to respond to questions in English or French.

Population-based data were de-identified and extracted from a survey collected by a research company contracted by PHAC. During a period of three weeks in March 2011, the researchers randomly selected a sample of Canadian households with a landline via RDD and administered a telephone survey in French or English. The telephone survey consisted of questions on demographics and Canadian parents’ knowledge, awareness, attitudes, and behaviors related to immunization [25]. The researchers attempted contact with each household in the sample 8 times prior to retiring the phone number [25]. The average time to complete the survey was 18 minutes and 30 seconds [25]. Researchers of the RDD sample reported a participation rate of 23.43% (7898/33,698) and a total cost of Can $163,398. The average cost per completed survey was Can $93.64.

The Web-based survey comprised primary data collected from self-selected respondents recruited via the social media platform, Facebook. Facebook has been reported as the most popular social media platform in Canada, with more than half of the population logging into Facebook at least once per month, and daily Facebook usage reported as higher than global and US averages [26,27]. The Web-based semistructured survey was available in French and English and contained questions similar to the RDD survey on demographics, parents’ knowledge, awareness, attitudes, and behaviors related to immunization. Trusted website links with reliable information on childhood immunizations appeared immediately after terminating or completing the survey to ensure there was no prior influence on the respondents. We piloted the survey with a convenience sample of the primary researcher’s “Facebook friends” and a snowball sample of the friends’ “Facebook friends” who met the inclusion criteria.

The Web-based survey was set to automatically terminate if the respondents did not provide informed consent or did not meet eligibility criteria. We used a Canadian Web-based survey company (now owned by an American company), Fluid Surveys, to capture the survey data. Fluid Surveys stored all of its data in Canada and used the latest in firewall and encryption technology to protect private information. We exported, encrypted, and password protected the survey responses and did not collect any identifying information on respondents. Upon completion of the survey, respondents were eligible to participate in a draw with an estimated 1 in 90 chance (based on an estimated sample size of 800 respondents participating in the draw) to win an iPad mini (value of Can $375). We kept all email addresses of participating respondents confidential and destroyed them at the end of the draw. We obtained ethical approval from University of Toronto’s Office of Research Ethics (REF# 29309).

Recruitment

We displayed Facebook advertisements on the News Feeds of Facebook users whose profiles matched the following inclusion criteria: (1) located in Canada, (2) 18 years or older, (3) parent of a child aged 0 to 15 years, and (4) displaying a profile in English or French. Our advertisements did not target parents with children aged 16-19 years as they are self-consenting to immunization and their inclusion would significantly increase the target audience and dilute our advertisements; however, they would be included if they had younger children. Facebook determines users’ location based on information in their timeline, verified by their Internet Protocol (IP) address and by examination of the user’s friends’ locations [28]. A user’s age was determined by their year of birth, required by Facebook for all personal accounts [28]. Parents were identified based on activity or information on their timelines and language was determined from the language used in their profiles [28].

The optimal delivery mechanism of advertisements on Facebook is determined by many factors such as the target audience, the marketplace competition, the bid, and the advertisement’s performance history [29]. Facebook provides the option of being charged each time the advertisement is displayed, that is, cost per thousand impressions (CPM) or each time the advertisement is clicked (CPC) [29]. We chose to pay based on CPM as Facebook ensures the advertisement will be optimized to the people most likely to click on your advertisement (eg, most active and engaging users) and remains in the optimal bid range. In addition, Facebook paces the rate at which the advertisement is displayed based on the budget, goal, and period of time specified [29]. We set a goal to reach a minimum of 800 participants based on power calculations and our budget for survey incentives. We began with a lifetime budget of Can $1500 over a period of one month, as this would grant us access to a Facebook consultant. At the time of our advertisement launch, there was a potential to reach 300,000 Canadian parents on Facebook (260,000 English users and 40,000 French users). Therefore the money was allocated based on this distribution with approximately 85% of the budget allocated to the English campaign. Fifty dollars (Can $) gifted by Facebook was later added to the French campaign budget. The Facebook advertisement campaign was launched on December 12, 2013, at 14:00 and ended on January 11, 2014, at 14:00. Three different images were used in our advertisement (Figures 1-3).

Facebook provided several advertisement statistics such as the number of clicks (eg, likes, comments, click for our Facebook page, and click for our Web-based survey), the number of impressions (placements on users’ News Feeds), the CPM, and the CPC. Based on these statistics, Facebook optimized the advertisements with the highest click-through rate (CTR) (the number of clicks received/number of impressions) to serve the most users. We removed advertisements that fell below the Facebook average CTR of 1-1.5 % from the campaign.

The objective of the campaign was for targeted Facebook users to click on the advertisement linked to our secure Web-based survey. Users could also be directed to our Facebook page titled “Parents, tell us what you think about vaccines” by clicking on the advertisement’s profile user as opposed to the link. We provided further information on the study and links to the survey on our official Facebook Page.

Statistical Analysis

Campaign and Recruitment

We investigated methodological parameters on the number of impressions, the number of clicks, demographics of users who clicked the advertisement, timelines of data collection, and the costs for both the English and French campaigns. The response rate calculation for the Web-based sample is a derivation from definitions provided by the American Association for Public Opinion Research [30] and is the number of completed surveys divided by the total number of surveys (completed, partially completed, and terminated), plus the remaining unique clicks of unknown eligibility.

Respondent Characteristics and Vaccine Hesitancy

We validated Web-based sample data for single questionnaire response and accuracy of eligibility criteria by verifying IP addresses and demographic information. We conducted univariate analyses for the Web-based and the RDD samples on individual level variables for respondent characteristics and vaccine hesitancy indicators. Respondent characteristics included age group, sex, income and education level, median age of youngest child, birthplace, and place of residence. We investigated vaccine hesitancy using three indicators: perception of safety of childhood vaccinations, measured on a 7-point scale from “Not safe” (1) to “Moderately Safe” (4) to “Extremely Safe” (7); vaccination status of youngest child was classified as “Completely up-to-date” or “Partially or Not at all up-to-date;” and difficulty in making the decision to vaccinate (or not vaccinate) their youngest child, measured as “Very Easy,” “Easy,” “Difficult,” or “Very Difficult.” We conducted all descriptive analyses using Microsoft Office Excel 2007 and SAS Version 9.3 (SAS Institute Inc.).

A primary and secondary rater independently coded qualitative data from the Web-based survey on the difficulties in deciding to vaccinate youngest child according to the SAGE model of determinants of vaccine hesitancy [13]. Two raters independently coded all responses with a high level of agreement (percent agreement>90%). Discrepancies were resolved via consensus to reach 100% agreement. The raters could not code the pre-categorized open-ended responses from the RDD data. However, the raters classified the pre-coded categories according to best fit in the SAGE model. The raters conducted all qualitative analyses with NVivo 10 software (QSR International).

Figure 1. Facebook advertisement A in the English campaign.
View this figure
Figure 2. Facebook advertisement B in the English campaign.
View this figure
Figure 3. Facebook advertisement C in the English campaign.
View this figure

Campaign and Recruitment

During the one-month campaign, our advertisements made 280,485 impressions yielding 8557 total clicks on our advertisements. The overall campaign CTR was 3.05% (8557/280,485), with the English campaign yielding a higher click rate of 3.57% (7981/223,637) as compared with 1.01% (576/56,848) for the French campaign. Over 75% (215,770/280,485) of the impressions were among women. Women aged 25-34 years were reached the most, with 39.15% (109,808/280,485) of the overall impressions. Thus, the majority (87.05% [7449/8557]) of the clicks on the advertisements were also women, with the highest average CTR of 2.82% (159/12,410 in the French campaign and 1818/41,804 in the English campaign) among women aged 35-44 years, followed closely by an average CTR of 2.59% among women aged 45-54 years (45/3008 in the French campaign and 261/7080 in the English campaign) and 2.53% among women aged 25-34 years (107/13,212 in the French campaign and 4111/96,596 in the English campaign). In terms of unique Facebook users, our campaign reached 32.53% (97,598/300,000) of our target population on Facebook, with 4.91% (4792/97,598) clicking on the advertisement. Out of the 4792 unique clicks on our advertisements, 35.41% (1697/4792) started the survey. Only fully completed surveys were counted as part of our sample, resulting in 1097 unique respondents. Thus, the response rate was 22.89% (1097/ 4792) and the survey completion rate was 64.68% (1097/1696), with very little missing data (Figure 4). The average time taken to complete the survey was 17 minutes.

Advertisement success varied by language and image displayed. All advertisements produced clicks; however, advertisement A (Figure 1) produced the highest reach and click-through rate and had the lowest cost (Table 1). The CTR was consistently higher over time and the CPC consistently lower for the English campaign as compared with the French campaign. CTRs and CPCs were variable over time for both campaigns; however, the English campaign experienced a substantial drop in the CTR during the holidays from December 23 to 25, 2013. In periods of CTR decrease, there was a corresponding increase in CPC (Figure 5). For the English campaign, the average cost per 1000 impressions (CPM) was Can $5.59 and Can $5.28 for the French campaign. Translated into CPC, the English campaign cost an average of Can $0.16 and the average for the French campaign was Can $0.52. The total research cost was Can $4,861.19 (Can $1500 campaign cost – Can $50 Facebook credit + Can $3361.19 incentives cost).

Table 1. Facebook advertisement statistics.


Campaign


Reach
(No. of
unique
Facebook
users)
No.
of
impressions
No.
of
clicks
CTRb
(%)
No.
of
unique
clicks
Unique
CTR
(%)
Average
cost per
CPMc (Can $)
Average
CPCd
(Can $)
Average cost
per
unique
click
(Can $)
English
advertisements











A74,572153,21757673.7633464.495.390.140.25

B38,64351,64717783.4411893.106.050.180.26

C16,91918,7734362.323682.185.980.260.30











French
advertisementsa











A15,76736,3273931.083382.145.180.480.56

B917815,8911500.941281.405.390.570.67

C38114630330.71330.875.630.790.79

aFrench advertisements B and C were removed from the campaign on January 3, 2014.

bCTR: click-through rate.

cCPM: cost per impression.

dCPC: cost per click.

Figure 4. Facebook advertisement recruitment.
View this figure
Figure 5. Daily click rates as compared with the cost per click for all campaigns from December 11, 2013, to January 11, 2014.
View this figure

Respondent Characteristics

Of the respondents in the Web-based survey and the population-based RDD survey, 91.89% (1008/1097) and 83.61% (1459/1745), respectively were born in Canada. The distribution across place of residence was similar, except that the Web-based sample had a lower proportion of respondents from Québec as compared with the RDD sample (10.94% [120/1097] vs 24.47% [427/1745) and a higher proportion of respondents from Alberta (23.61% [259/1097] vs 11.46% [200/1745]). The age distribution differed, with 85.69% (940/1097) of the Web-based survey respondents under the age of 40 years as compared with 23.38% (408/1745) in the RDD sample; however, the age for 37.99% (663/1745) of the RDD respondents is not known. For both samples, the median number of children was two (IQR 1.0) with the median age of the youngest child at 1 year (IQR 1.50) in the Web-based sample and 8 years (IQR 10.0) in the RDD sample. The Web-based sample had 91.43% (1003/1097) female respondents as compared with 59.26% (1034/1745) in the RDD sample. Both samples had similar distribution of education and income level, with almost half of the respondents completing some level of higher education, following the education distribution of Canadian adults [31], and the majority lying close to or above the 2012 median total household income for Canadian families of $74,540 [32] (Table 2).

Vaccine Hesitancy

Of the respondents from the Web-based survey, 26.62% (292/1097) perceived childhood immunizations to be not safe to moderately safe as compared with 18.57% of the RDD sample (324/1745), 22.06% (242/1097) reported the vaccination status of their youngest child to be not up-to date compared to 9.57% (167/1745) in the RDD sample, and 21.1% (231/1097) of the Web-based sample reported the decision to vaccinate their youngest child to be difficult or very difficult as compared with 10.09% (176/1745) in the RDD sample. In the Web-based sample, more than half of those not up-to-date reported that their youngest child had not received any vaccinations (126/242), with 6.3% (n=8/126) reporting the child was too young for vaccinations (Table 3). In total, 20.2% (49/242) of the respondents with their youngest child not up-to-date in terms of vaccinations reported concerns over autism or sudden infant death syndrome as important reasons for deciding not to vaccinate their youngest child.

Of those who found the decision difficult or very difficult, 54.8% (125/228) of the Web-based sample and 36.4% (64/176) of the RDD sample reported their youngest child to be not-up-to date. No significant trends were found when stratifying by parental age, parity, and sex.

In the Web-based sample, 79.8% (178/223) of the reasons for difficulty in their decision making were reported as individual and group influences with knowledge/awareness of vaccination information reported as the most important determinant for 35.4% (40/113) of those with their youngest child up-to-date and 39.1% (43/110) of those who reported their child as not-up-to-date (Table 4). In terms of knowledge, the majority reported difficulties with too much controversial or contradicting information and not enough unbiased or trustworthy information. The second highest determinant reported was the perception of the risks/benefits of vaccination, reported by 23.9% (27/113) of parents with an up-to-date child and 23.6% (26/110) of those whose children were not up-to-date. Most struggled with the risk of adverse effects or side effects versus the risk of acquiring the disease, where 23% (12/53) specifically expressed concern over the risk of autism. Approximately 6.0% (7/113) in the up-to-date and 9.1% (10/110) in the not-up-to-date group reported pressure from society, family/friends, or physicians to vaccinate or not. To a lesser extent, other individual or group influences included personal experience or knowledge of someone who subsequently experienced side effects or developed autism after vaccination, distrust of the government, and belief that vaccines are not necessary for health. Vaccine or vaccination specific issues were reported as reasons in 12.1% (27/223) of the sample. The majority in both groups reported issues with the vaccination schedules in terms of multiple vaccines or age of vaccination, followed by issues with lack of research or testing of new vaccines. Approximately 8% (18/223) of the reasons were reported as contextual, with respondents reporting distrust of the pharmaceutical industry, controversial coverage or fear mongering by the media, and forced vaccination as a result of mandatory vaccination policies in schools. Based on the pre-coded categories in the RDD sample, the majority of both up-to-date and not up-to-date parents also reported perception of risks/benefits and knowledge/awareness as the most important reasons why their decision to vaccinate was difficult or very difficult.

Table 2. Respondent demographic characteristics.
CharacteristicWeb-based survey
(N=1097)
Population-based RDD survey,
un-weighted (N=1745)


n%95% CIn%95% CI
Age group (years)







Under 3039536.0133.20-38.88573.272.51-4.18

30-3435632.4529.73-35.271297.396.23-8.69

35-3918917.2315.08-19.5522212.7211.22-14.35

40-44968.757.19-10.5324413.9812.41-15.67

45 and over565.103.92-6.5343024.6422.66-26.71

Unknown50.460.17-1.0166337.9935.74-40.29
Sex







Male807.295.86-8.9571140.7438.46-43.06

Female100391.4389.66-92.98103459.2656.94-61.54

Unknown141.280.73-2.08--
Education level







Did not graduate high school252.281.51-3.30834.763.83-5.83

High school diploma14713.4011.48-15.5127515.7614.11-17.53

Trade or vocational school28626.0723.54-28.7351429.4627.35-31.63

Some university11010.038.35-11.911448.257.02-9.61

Bachelor’s degree27725.2522.75-27.8940423.1521.22-25.17

Professional certification12311.219.45-13.18975.564.56-6.71

Graduate degree1019.217.60-11.0322112.6611.17-14.29

Unknown282.551.74-3.6270.400.18-0.86
Income level (Can $)







Under $30,000857.756.27-9.441579.007.22-10.41

$30,000-$70,00023621.5119.16-24.0252229.9127.80-32.09

$70,000-$79,999928.396.85-10.141257.166.02-8.45

$80,000-$119,99931628.8026.18-31.5438121.8319.94-23.82

Over $120,00025623.3420.90-25.9137421.4319.56-23.41

Unknown11210.218.52-12.1118610.669.28-12.17
Province or Territory of residence







British Columbia16014.5912.59-16.7717510.038.68-11.51

Alberta25923.6121.17-26.1920011.4610.03-13.02

Saskatchewan958.667.10-10.441015.794.76-6.96

Manitoba423.832.80-5.09965.504.50-6.65

Ontario33630.6327.95-33.4148627.8525.79-29.99

Québec12010.949.19-12.8942724.4722.50-26.53

New Brunswick262.371.59-3.40623.552.76-4.50

Nova Scotia312.831.96-3.94704.013.16-5.01

Prince Edward Island50.460.17-1.01301.721.18-2.42

Newfoundland161.460.87-2.31462.641.96-3.47

Yukon30.270.07-0.74150.860.50-1.38

Northwest Territories20.180.03-0.60231.320.86-1.94

Nunavut---140.800.46-1.31

Unknown20.180.03-0.60---
Birthplace







Canada100891.8990.16-93.39145983.6181.82-85.29

Outside of Canada615.564.32-7.0428616.3914.71-18.18

Unknown282.551.74-3.62---
Table 3. Respondent perception of safety of childhood vaccination, vaccination status of youngest child, and difficulty in making the decision to vaccinate youngest child.
Characteristic
Web-based survey
(N=1097)
Population-based RDD survey,
Un-weighted (N=1745)


n%95% CIn%95% CI
Perception on safety of childhood immunizations







1-Not at all safe494.473.36-5.82432.461.81-3.28

2484.383.28-5.71241.380.90-2.01

3645.834.56-7.34502.872.16-3.73

4-Moderately safe13111.9410.12-13.9620711.8610.41-13.44

513412.2210.38-14.2527515.7614.11-17.53

633830.8128.13-53.5950028.6526.57-30.81

7-Extremely safe32729.8127.16-32.5763036.1033.87-38.38

Unknown60.550.22-1.13160.920.54-1.45
Vaccination status of youngest child







Completely up-to-date85177.5875.03-79.97155288.9487.40-90.35

Somewhat-up-to-date or not at all up-to-date24222.0619.68-24.591679.578.26-11.02

Unknown40.360.12-0.88261.490.99-2.15
Difficulty in making the decision to vaccinate youngest child







Very easy62456.8853.94-59.7964236.7934.55-39.07

Easy23421.3318.98-23.8391452.3850.03-54.72

Difficult15213.8611.91-16.001317.516.34-8.82

Very difficult797.205.78-8.85452.581.91-3.41

Unknown80.730.34-1.38130.740.42-1.24
Table 4. Web-based survey respondent reasons for difficulty in deciding to vaccinate youngest child by youngest child vaccination status.
SAGE Model determinant of vaccine hesitancyVaccination status of youngest child


Up-to-dateNot up-to-date



n%n%TotalTotal
%
Contextual influences







Communication and media environment32.710.941.8

Influential leaders, gatekeepers, and anti- or pro-vaccination lobbies10.9--10.5

Pharmaceutical industry32.743.673.1

Politics, policies32.732.762.7

Total108.987.3188.1








Individual and group influences







Experience with past vaccination65.354.6114.9

Beliefs and attitudes about health and prevention43.621.862.7

Knowledge/awareness4035.44339.18337.2

Health system and providers—trust and personal experience32.754.683.6

Risk/benefit (perceived, heuristic)2723.92623.65323.8

Immunization as a social norm versus not needed/harmful76.2109.1177.6

Total8777.09182.717879.8








Vaccine/vaccination specific issues







Risk/Benefit (scientific evidence)--10.910.5

Introduction of a new vaccine or new formulation65.354.6114.9

Mode of administration21.8--20.9

Vaccination schedule87.132.7114.9

Costs--10.910.9

Role of healthcare professionals--10.910.9

Total1614.61110.02712.1









Grand Total113100.0110100.0223100.0

Principal Findings

Overall, Facebook was a successful recruitment method for parents to complete a Web-based survey on vaccination. Out of the three advertisements posted in French and English, the English advertisements were the most successful with the highest CTR and subsequently lowest CPC and Advertisement A producing the highest CTR and lowest CPC. We were able to exceed our ideal sample size within a short timeframe, at low cost, and with one researcher running the campaign and data collection. The cost (Can $4,861), timeliness, and sample size of this study achieved comparable or better results than other recent health studies using targeted recruitment via Facebook [20-24,33]. For both the Web-based and RDD survey methods, data collection spanned the same time frame and individual surveys took approximately the same amount of time; however, the costs were 97% lower with Web-based recruitment. The quality of the data was evident with a rich pool of qualitative and quantitative data, a high completion rate, and little missing data. Although both monetary figures represent the total research costs, there are some notable differences as the Web-based recruitment costs also include incentives (no incentives were utilized in the RDD survey), but does not include the supplementary research costs associated with the use of an outside agency (eg, salaries and resources for implementation and deliverables). Notwithstanding, a typical RDD phone survey of 1000 participants might cost approximately Can $70,000 [34], and as demonstrated in this study, external contractual services would not necessarily be needed using Facebook targeted recruitment as it is a less labor-intensive process.

This study solely recruited from one social media platform, Facebook. However, respondents could have also been recruited from other social media platforms such as Twitter. Although Twitter users are typically younger and in childbearing/childrearing years [35], Twitter does not permit targeted recruitment via paid advertisement. Thus, it was considered as a supplementary sampling strategy should we not reach our pre-determined sample size of completed surveys via targeted recruitment on Facebook. Furthermore, Quach et al (2013) reported less success using a social network strategy (as opposed to a paid advertisement) in the recruitment of Canadian parents via Facebook and Twitter [36].

In both populations, the majority of the respondents were Canadian born, followed similar distribution patterns in terms of province/territory of residence, had mostly higher education levels and higher household income levels than the median total household income. We did not compare our data to census data as we were not trying to generalize to the Canadian population. In addition, census data is not available specifically for Canadian parents, our target population. The high response from residents of Alberta in the Web-based sample could be the result of higher engagement due to a large measles outbreak in Alberta that occurred in the month before our campaign launch [7]. The lower number of Québec responses was surprising as Québec has the second highest Facebook usage next to Ontario [27] and experienced a large measles outbreak in 2011. Moreover, we specifically targeted French Facebook users. Based on the lower success of our French campaigns, it is possible that the advertisements were not as attractive to French-speaking Québec users or that Québec users do not interact on the Internet in the same manner as Ontario users or that a higher percentage of the budget needed to be allocated to the French campaign to reach more French-speaking Facebook users.

The Web-based sample demographics differed because we recruited a majority of female respondents and a younger population with younger children compared to the RDD sample that had fairly equal representation of males and females, an older population (even if we assumed all of the unknowns were below 35 years), and older median age of the youngest child. As evidenced by the impression demographics, the Facebook campaign biased the recruitment toward a younger and female population, however the advertisements were intended to target parents with younger children as this would be the demographic interacting on the Internet and making decisions on childhood immunizations. Furthermore, Dubé et al (2012) reported no difference between mothers and fathers in intentions to vaccinate [37]. Combined, both methods produce the greatest spectrum of respondents; however, the Facebook campaign recruited more parents with young children at the most important stage of the vaccination process. Some of the differences we observed may be due to cohort effects, as vaccine hesitancy may have been increasing and been more prevalent in the younger parents recruited through Facebook.

According to our indicators, the Web-based strategy was successful in recruiting a higher number of vaccine-hesitant parents: more respondents perceived childhood immunizations to be not safe to moderately safe, more reported their youngest child’s vaccination status as not-up-to-date and more had difficulty in making the decision to vaccinate their youngest child. In addition, out of those reporting difficulty in the decision to vaccinate, more than half in the Web-based sample reported their youngest child’s vaccination status as not up-to-date. Moreover, one-fifth of the respondents who reported their child as not-up-to-date reported concerns over autism or sudden infant death syndrome as important reasons for deciding to not vaccinate their youngest child, even though it has been proven that neither disorder is associated with vaccination [38-40]. No significant contributions were observed when stratifying by age, sex, or parity; however, low numbers in some categories prevented reliable comparisons from being made. The factors associated with parental decisions to not vaccinate have been well studied [12,41,42], but no study has focused on vaccine-hesitant Canadian parents. We found that the main reasons reported for difficulty in decision-making were the inability to decipher or trust all the information available and the difficulties in weighing the risks and benefits of immunization with concerns over side effects and adverse effects. The contextual influence of media, social media, or other sources of communication may have played an important role in contributing to respondent concerns regarding their own knowledge or risk perception. However, this could not be further probed because of the inherent limitations of Web-based surveys.

Limitations

As more people abandon landlines, the validity of traditional population telephone surveys is compromised with low response rates and potentially non-representative samples [43]. Representativeness and validity concerns are also relevant for Web-based surveys as research relies on the collection of self-reported data by self-selected participants [44]. However, there are more and more people on popular social media platforms such as Facebook and possibly different people than those reached by RDD. For example, active social media users may be mostly represented by educated females in higher income brackets [17,45,46], which is also the demographic most often looking for health information on the Internet [18]. Furthermore, active social media users may be potentially viewing an abundance of anti-vaccination sentiment on the Internet and may be the people that need to be reached most to combat vaccine hesitancy [47,48].

Both sampling techniques produced low response rates of 23%, which could produce biased samples. The reasons for the low response rate in the RDD sample include invalid numbers, unresolved callbacks, ineligibility, and refusals [25]. In the Web-based survey, there was no direct communication with the potential respondents; thus, it is not clear why certain Facebook users did not click on the advertisement or why those who clicked on the advertisement did not participate in the Web-based survey. This could be an important area for future study.

However, purposive Facebook targeted recruitment of self-selected respondents was not intended to provide a sample representative of the RDD sample or the Census population, but to determine whether we could recruit more “at risk” vaccine-hesitant parents as compared with the standard sampling technique. Reaching a higher proportion of vaccine-hesitant respondents proved successful; however, there are several inherent biases in using Facebook as a recruiting platform and in targeted sampling to self-selectors. For example, the low recruitment of male respondents could be the result of Facebook’s targeting criteria, the visuals, or the content of the advertisements. Selection bias is inevitable as Facebook identifies your desired target population, targets the most active and engaged users, and the number of impressions depends on factors such as the amount spent, the CTR, and market competition. However, for the purpose of our research, this proved to be a strength as this was the group we intended to target and would likely reach with any Web-based intervention. There is potential for volunteer bias and without a sampling frame we cannot calculate a true participation rate, nor can we characterize users who did not see the advertisement or did not engage. The timing of the advertisement (December) may have affected the type of respondents. However, this could not be verified without data from Facebook on who may be more likely to respond at different periods in time. Duplicate responses and gaming are also an important concern in Web-based recruitment [36]. Although difficult to prevent, safety measures as recommended in the Checklist for Reporting Results of Internet E-Surveys (CHERRIES) [49], were implemented to prevent and evaluate repeat respondents. Furthermore, it is possible that we attracted participants who were more likely to click on the advertisement because of strong views (anti or pro) on vaccination. However, based on our results, we were also able to reach an important proportion of participants who did not fall on the very extreme ends of the vaccination spectrum and reached a higher proportion of vaccine-hesitant parents when compared with the RDD.

As with any Web-based recruitment strategy, there are concerns about the “digital divide.” Statistics Canada recently reported that Canadians over the age of 65 years are responsible for the lag in Internet use in lower income households [17]. This population is not expected to represent a large proportion of our target population of vaccine-hesitant parents. In addition, the Web-based sample neglected to recruit many foreign-born parents or children. Yet, nearly 20% of Canadians were born outside of Canada. This might represent a significant bias that is difficult to quantify, as the Facebook activity of foreign-born residents is not known. Moreover, recent immigrants may not be a priority group to address for vaccine-hesitancy as they are more likely to arrive with immunity due to previous infections and more likely to become immunized as citizens [50,51]. Notwithstanding the inherent biases, we were able to obtain a large sample size for the recruitment period at a low cost, and we achieved a high survey completion rate with very little missing data. Furthermore, we reached younger Canadian mothers with younger children and more vaccine-hesitant parents when compared with the RDD sample.

Conclusions

Targeted recruitment via Facebook was successful in reaching a population more likely to be engaging in health discussions on the Internet and making decisions on childhood immunizations. Thus, this recruitment strategy was superior to the RDD methodology in reaching “at-risk” vaccine-hesitant parents. Engaged respondents also provided us with insights into the most important determinants of vaccine hesitancy, providing valuable information in directing any future intervention efforts. With more Canadians abandoning landlines and interacting on the Internet with potential exposure to an abundance of anti-vaccination sentiment, popular social media platforms should be considered as part of any recruitment strategy or study on the determinants of vaccine-hesitant parents but also in the implementation of interventions to address these determinants. Future research should consider studies to investigate data reliability and to better examine the relative importance of contextual influences, such as the Internet, as determinants of vaccine hesitancy.

Acknowledgments

The authors wish to thank the Public Health Agency of Canada (PHAC) for providing the RDD sample data, the Facebook consultants for their advice and expertise, and the parents of the children pictured in the advertisements for their permission to use the photographs. We would also like to thank the Canadian parents who participated in this study. Funding was provided by Public Health Ontario, Toronto, ON and the Dalla Lana School of Public Health, Toronto, ON.

Conflicts of Interest

None declared.

  1. Canadian immunization guide. CMAJ 1989 Aug 01;141(3):227-228 [FREE Full text] [Medline]
  2. Public Health Agency of Canada. Public Health Agency of Canada. 2015. Vaccine coverage in Canadian children: results from the 2011 childhood national immunization coverage survey   URL: http://www.phac-aspc.gc.ca/im/nics-enva/vccc-cvec-eng.php [accessed 2015-05-21] [WebCite Cache]
  3. Public Health Agency of Canada. Public Health Agency of Canada. 2013. Elimination of measles, rubella and congenital rubella syndrome in Canada: documentation and verification report   URL: http://www.phac-aspc.gc.ca/im/vpd-mev/measles-rougeole-mrer-eng.php [accessed 2016-05-28] [WebCite Cache]
  4. World Health Organization. World Health Organization. 2015. Measles   URL: http://www.who.int/mediacentre/factsheets/fs286/en/ [accessed 2017-06-01] [WebCite Cache]
  5. Public Health Agency of Canada. 2013. Guidelines for the prevention and control of measles outbreaks in Canada   URL: http://www.phac-aspc.gc.ca/publicat/ccdr-rmtc/13vol39/acs-dcc-3/assets/pdf/meas-roug-eng.pdf [accessed 2017-06-15] [WebCite Cache]
  6. Ministère de la Santé et des Services sociaux du Québec. MSSS. 2014. Rougeole   URL: http://www.msss.gouv.qc.ca/sujets/prob_sante/rougeole/rougeole.php [accessed 2015-05-21] [WebCite Cache]
  7. Shane A, Hiebert J, Sherrard L, Deehan H. Public Health Agency of Canada. 2014. Measles surveillance in Canada: trends for 2013   URL: http://www.phac-aspc.gc.ca/publicat/ccdr-rmtc/14vol40/dr-rm40-12/dr-rm40-12-surv-1-eng.php [accessed 2017-06-01] [WebCite Cache]
  8. Public Health Agency of Canada. Public Health Agency of Canada. 2014. Public health notice: measles   URL: http://www.phac-aspc.gc.ca/phn-asp/2013/measles-0717-eng.php [accessed 2015-05-21] [WebCite Cache]
  9. Deehan H, Shane A. Public Health Agency of Canada. Measles activity in Canada: January - June 2014   URL: http://www.phac-aspc.gc.ca/publicat/ccdr-rmtc/14vol40/dr-rm40-12/dr-rm40-12-rc-cr-eng.php [accessed 2017-06-01] [WebCite Cache]
  10. Public Health Agency of Canada. Public Health Agency of Canada. 2015. Public health notice: measles   URL: http://www.phac-aspc.gc.ca/phn-asp/2015/meas-roug-eng.php [accessed 2015-05-19] [WebCite Cache]
  11. Larson HJ, Cooper LZ, Eskola J, Katz SL, Ratzan S. Addressing the vaccine confidence gap. Lancet 2011 Aug 06;378(9790):526-535. [CrossRef] [Medline]
  12. Larson HJ, Jarrett C, Eckersberger E, Smith DM, Paterson P. Understanding vaccine hesitancy around vaccines and vaccination from a global perspective: a systematic review of published literature, 2007-2012. Vaccine 2014 Apr 17;32(19):2150-2159. [CrossRef] [Medline]
  13. MacDonald NE, SAGE Working Group on Vaccine Hesitancy. Vaccine hesitancy: definition, scope and determinants. Vaccine 2015 Aug 14;33(34):4161-4164 [FREE Full text] [CrossRef] [Medline]
  14. Dubé E, Laberge C, Guay M, Bramadat P, Roy R, Bettinger J. Vaccine hesitancy: an overview. Hum Vaccin Immunother 2013 Aug;9(8):1763-1773 [FREE Full text] [CrossRef] [Medline]
  15. Statistics Canada. 2014. Residential telephone service survey 2013   URL: http://www.statcan.gc.ca/daily-quotidien/140623/dq140623a-eng.htm [accessed 2016-05-28] [WebCite Cache]
  16. Statistics Canada. 2010. Individual internet use and e-commerce   URL: http://www.statcan.gc.ca/daily-quotidien/111012/dq111012a-eng.htm [accessed 2015-05-21] [WebCite Cache]
  17. Statistics Canada. 2013. Individual internet use and e-commerce 2012   URL: http://www.statcan.gc.ca/daily-quotidien/131028/dq131028a-eng.htm [accessed 2015-05-19] [WebCite Cache]
  18. Fox S. Pew Research Center. 2011. The social life of health information   URL: http://www.pewinternet.org/files/old-media/Files/Reports/2011/PIP_Social_Life_of_Health_Info.pdf [accessed 2015-05-21] [WebCite Cache]
  19. Alshaikh F, Ramzan F, Rawaf S, Majeed A. Social network sites as a mode to collect health data: a systematic review. J Med Internet Res 2014;16(7):e171 [FREE Full text] [CrossRef] [Medline]
  20. Adam LM, Manca DP, Bell RC. Can facebook be used for research? experiences using facebook to recruit pregnant women for a randomized controlled trial. J Med Internet Res 2016;18(9):e250 [FREE Full text] [CrossRef] [Medline]
  21. Subasinghe AK, Nguyen M, Wark J, Tabrizi S, Garland S. Targeted facebook advertising is a novel and effective method of recruiting participants into a human papillomavirus vaccine effectiveness study. JMIR Res Protoc 2016 Jul 22;5(3):e154 [FREE Full text] [CrossRef] [Medline]
  22. Gilligan C, Kypri K, Bourke J. Social networking versus facebook advertising to recruit survey respondents: a quasi-experimental study. JMIR Res Protoc 2014;3(3):e48 [FREE Full text] [CrossRef] [Medline]
  23. Ramo DE, Prochaska JJ. Broad reach and targeted recruitment using facebook for an online survey of young adult substance use. J Med Internet Res 2012;14(1):e28 [FREE Full text] [CrossRef] [Medline]
  24. Carter-Harris L, Bartlett ER, Warrick A, Rawl S. Beyond traditional newspaper advertisement: leveraging facebook-targeted advertisement to recruit long-term smokers for research. J Med Internet Res 2016;18(6):e117 [FREE Full text] [CrossRef] [Medline]
  25. Ekos Research Associates Inc. CPHA. 2011. Survey of parents on key issues related to immunization, final report   URL: http://resources.cpha.ca/immunize.ca/data/1792e.pdf [accessed 2015-05-21] [WebCite Cache]
  26. Financial Post. 2015. More Canadians use facebook daily than anywhere else in the world   URL: http:/​/business.​financialpost.com/​fp-tech-desk/​more-canadians-use-facebook-daily-than-anywhere-else-in-the-world?__lsa=0d4a-d43d [accessed 2015-05-21] [WebCite Cache]
  27. Webfuel. 2015. Canadian social media statistics 2013   URL: http://www.webfuel.ca/canadian-social-media-statistics-2013/ [accessed 2015-05-21] [WebCite Cache]
  28. Facebook. 2015. Targeting   URL: https://www.facebook.com/help/433385333434831 [WebCite Cache]
  29. Facebook. 2015. Bidding and pricing   URL: https://www.facebook.com/help/564328533621978/ [WebCite Cache]
  30. Esomar. 2011. Standard definitions: final dispositions of case codes and outcome rates for surveys   URL: https:/​/www.​esomar.org/​uploads/​public/​knowledge-and-standards/​codes-and-guidelines/​ESOMAR_Standard-Definitions-Final-Dispositions-of-Case-Codes-and-Outcome-Rates-for-Surveys.​pdf [accessed 2015-05-21] [WebCite Cache]
  31. Statistics Canada. 2013. Education indicators in Canada: an international perspective 2014   URL: http://www.statcan.gc.ca/pub/81-604-x/2014001/hl-fs-eng.htm [accessed 2015-05-21] [WebCite Cache]
  32. Statistics Canada. 2014. Median total income, by family type, by province and territory   URL: http://www.statcan.gc.ca/tables-tableaux/sum-som/l01/cst01/famil108a-eng.htm [accessed 2015-05-19] [WebCite Cache]
  33. Fenner Y, Garland SM, Moore EE, Jayasinghe Y, Fletcher A, Tabrizi SN, et al. Web-based recruiting for health research using a social networking site: an exploratory study. J Med Internet Res 2012;14(1):e20 [FREE Full text] [CrossRef] [Medline]
  34. Dredze M, Broniatowski DA, Smith MC, Hilyard KM. Understanding vaccine refusal: why we need social media now. Am J Prev Med 2016 Apr;50(4):550-552. [CrossRef] [Medline]
  35. Smith A, Brenner J. Pew Research Center. 2012. Twitter use 2012   URL: http://www.pewinternet.org/2012/05/31/twitter-use-2012/ [accessed 2017-03-22] [WebCite Cache]
  36. Quach S, Pereira JA, Russell ML, Wormsbecker AE, Ramsay H, Crowe L, et al. The good, bad, and ugly of online recruitment of parents for health-related focus groups: lessons learned. J Med Internet Res 2013 Jan;15(11):e250 [FREE Full text] [CrossRef] [Medline]
  37. Dubé E, Bettinger JA, Halperin B, Bradet R, Lavoie F, Sauvageau C, et al. Determinants of parents' decision to vaccinate their children against rotavirus: results of a longitudinal study. Health Educ Res 2012 Dec;27(6):1069-1080 [FREE Full text] [CrossRef] [Medline]
  38. Committee to Review Adverse Effects of Vaccine, Institute of Medicine. In: Stratton K, Ford A, Rusch E, Wright Clayton E, editors. Adverse Effects of Vaccines: Evidence and Causality. Washington, DC: National Academies Press; Aug 25, 2012.
  39. DeStefano F, Price CS, Weintraub ES. Increasing exposure to antibody-stimulating proteins and polysaccharides in vaccines is not associated with risk of autism. J Pediatr 2013 Aug;163(2):561-567. [CrossRef] [Medline]
  40. Institute of Medicine (US) Immunization Safety Review Committee. In: Stratton K, Almario D, Wizemann T, McCormick M, editors. Immunization safety review: vaccinations and sudden unexpected death in infancy. Washington, DC: National Academies Press; 2003.
  41. Brown KF, Kroll JS, Hudson MJ, Ramsay M, Green J, Long SJ, et al. Factors underlying parental decisions about combination childhood vaccinations including MMR: a systematic review. Vaccine 2010 Jun 11;28(26):4235-4248. [CrossRef] [Medline]
  42. Falagas ME, Zarkadoulia E. Factors associated with suboptimal compliance to vaccinations in children in developed countries: a systematic review. Curr Med Res Opin 2008 Jun;24(6):1719-1741. [CrossRef] [Medline]
  43. Galesic M, Tourangeau R, Couper MP. Complementing random-digit-dial telephone surveys with other approaches to collecting sensitive data. Am J Prev Med 2006 Nov;31(5):437-443. [CrossRef] [Medline]
  44. Janssens AC, Kraft P. Research conducted using data obtained through online communities: ethical implications of methodological limitations. PLoS Med 2012;9(10):e1001328 [FREE Full text] [CrossRef] [Medline]
  45. Dewing M. Parl. 2012. Social media: who uses them? Library of parliament   URL: http://www.parl.gc.ca/Content/LOP/ResearchPublications/2010-05-e.htm [accessed 2015-05-21] [WebCite Cache]
  46. Newbold K, Campos S. Mcmaster. 2011. Media and social media in public health messages: a systematic review   URL: http://www.mcmaster.ca/mihe/documents/publications/Social%20Media%20Report.pdf [accessed 2016-05-28] [WebCite Cache]
  47. Betsch C, Sachse K. Dr. Jekyll or Mr. Hyde? (How) the Internet influences vaccination decisions: recent evidence and tentative guidelines for online vaccine communication. Vaccine 2012 May 28;30(25):3723-3726. [CrossRef] [Medline]
  48. Betsch C, Brewer NT, Brocard P, Davies P, Gaissmaier W, Haase N, et al. Opportunities and challenges of Web 2.0 for vaccination decisions. Vaccine 2012 May 28;30(25):3727-3733. [CrossRef] [Medline]
  49. Eysenbach G. Improving the quality of web surveys: the checklist for reporting results of internet e-surveys (CHERRIES). J Med Internet Res 2004 Sep 29;6(3):e34 [FREE Full text] [CrossRef] [Medline]
  50. Crowcroft NS. Public Health Agency of Canada. 2014. The challenges of sustaining measles elimination in Canada   URL: http://www.phac-aspc.gc.ca/publicat/ccdr-rmtc/14vol40/dr-rm40-12/dr-rm40-12-ie-ei-eng.php [accessed 2017-06-01] [WebCite Cache]
  51. Quach S, Hamid JS, Pereira JA, Heidebrecht CL, Deeks SL, Crowcroft NS, Public Health Agency of Canada/Canadian Institutes of Health Research Influenza Research Network Vaccine Coverage Theme Group. Influenza vaccination coverage across ethnic groups in Canada. CMAJ 2012 Oct 16;184(15):1673-1681 [FREE Full text] [CrossRef] [Medline]


CPC: cost per click
CPM: cost per impression
CTR: click-through rate
IQR: interquartile range
IP: Internet Protocol
PHAC: Public Health Agency of Canada
RDD: random digit dialing
SAGE WG: Strategic Advisory Group of Experts Working Group
VPD: vaccine preventable disease


Edited by G Eysenbach; submitted 22.10.16; peer-reviewed by AC Ianos, D Broniatowski, A Subasinghe; comments to author 09.02.17; revised version received 22.03.17; accepted 05.04.17; published 24.07.17

Copyright

©Jordan Lee Tustin, Natasha Sarah Crowcroft, Dionne Gesink, Ian Johnson, Jennifer Keelan, Barbara Lachapelle. Originally published in JMIR Public Health and Surveillance (http://publichealth.jmir.org), 24.07.2017.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Public Health and Surveillance, is properly cited. The complete bibliographic information, a link to the original publication on http://publichealth.jmir.org, as well as this copyright and license information must be included.