Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Monday, December 24 through Wednesday, December 26 inclusive. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 20.09.18 in Vol 4, No 3 (2018): Jul-Sept

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/10090, first published Feb 09, 2018.

This paper is in the following e-collection/theme issue:

    Original Paper

    User-Driven Comments on a Facebook Advertisement Recruiting Canadian Parents in a Study on Immunization: Content Analysis

    1School of Occupational and Public Health, Ryerson University, Toronto, ON, Canada

    2Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada

    3Public Health Ontario, Toronto, ON, Canada

    4Laboratory Medicine and Pathobiology, University of Toronto, Toronto, ON, Canada

    5Department of Public Health, Concordia University of Edmonton, Edmonton, AB, Canada

    6Toronto Public Health, Toronto, ON, Canada

    Corresponding Author:

    Jordan Lee Tustin, MHSc, PhD

    School of Occupational and Public Health

    Ryerson University

    350 Victoria Street

    Toronto, ON, M5B 2K3

    Canada

    Phone: 1 416 979 5000 ext 3021

    Fax:1 416 979 5377

    Email:


    ABSTRACT

    Background: More people are searching for immunization information online and potentially being exposed to misinformation and antivaccination sentiment in content and discussions on social media platforms. As vaccination coverage rates remain suboptimal in several developed countries, and outbreaks of vaccine-preventable diseases become more prevalent, it is important that we build on previous research by analyzing themes in online vaccination discussions, including those that individuals may see without actively searching for information on immunization.

    Objective: The study aimed to explore the sentiments and themes behind an unsolicited debate on immunization in order to better inform public health interventions countering antivaccination sentiment.

    Methods: We analyzed and quantified 117 user-driven open-ended comments on immunization posted in the Comments section of a Facebook advertisement that targeted Canadian parents for recruitment into a larger study on immunization. Then, 2 raters coded all comments using content analysis.

    Results: Of 117 comments, 85 were posted by unique commentators, with most being female (65/85, 77%). The largest proportion of the immunization comments were positive (51/117, 43.6%), followed by negative (41/117, 35.0%), ambiguous (20/117, 17.1%), and hesitant (5/117, 4.3%). Inaccurate knowledge (27/130, 20.8%) and misperceptions of risk (23/130, 17.7%) were most prevalent in the 130 nonpositive comments. Other claims included distrust of pharmaceutical companies or government agencies (18/130, 13.8%), distrust of the health care system or providers (15/130, 11.5%), past negative experiences with vaccination or beliefs (10/130, 7.7%), and attitudes about health and prevention (10/130, 7.7%). Almost 40% (29/74, 39%) of the positive comments communicated the risks of not vaccinating, followed by judgments on the knowledge level of nonvaccinators (13/74, 18%). A total of 10 positive comments (10/74, 14%) specifically refuted the link between autism and vaccination.

    Conclusions: The presence of more than 100 unsolicited user-driven comments on a platform not intended for discussion, nor providing any information on immunization, illustrates the strong sentiments associated with immunization and the arbitrariness of the online platforms used for immunization debates. Health authorities should be more proactive in finding mechanisms to refute misinformation and misperceptions that are propagating uncontested online. Online debates and communications on immunization need to be identified by continuous monitoring in order for health authorities to understand the current themes and trends, and to engage in the discussion.

    JMIR Public Health Surveill 2018;4(3):e10090

    doi:10.2196/10090

    KEYWORDS



    Introduction

    The Role of the Internet in Vaccine Hesitancy

    The World Health Organization (WHO) and its group of experts have identified vaccine hesitancy as an important issue facing immunization programs in the developed world [1]. This has been evident in Canada and other developed nations such as the United States and countries in Europe that have reported an increase in the number of outbreaks of vaccine-preventable diseases [2-7].

    Many factors influence vaccine noncompliance or hesitancy; however, the role of the internet due to the abundance of online antivaccination sentiment and activists has been reported as an important concern [8-13]. A significant association was established between using the internet to search for vaccine information and negative parental perception of the risk of childhood immunizations [14]. More people are searching for health information online, including information on immunization [15,16]. Health professionals are concerned that parents seeking vaccine information online are being exposed to misinformation and antivaccination sentiment via websites and online communications on social media platforms [8,11,12,17]. Over the past decade, social media sites have gained popularity in Canada, where 67% of Canadian internet users are using social media on a daily basis [16], with most users being under the age of 35 years [18]. In Canada, Facebook is reported as the most popular social media platform, with usage rates higher than global and US averages [19,20]. Health information communicated in interactive platforms is of questionable accuracy, as it is often exchanged without the participation of health professionals or health organizations [17,21]. This exchange of misinformation online has the potential to influence parents’ decision to vaccinate their children [12,14,22,23] and may be contributing to suboptimal vaccination coverage among Canadian children [24] and increases in vaccine-preventable disease rates [25-28]. Results from the last Childhood National Immunization Coverage Survey show that 70% of Canadian parents surveyed reported being concerned about potential side effects of vaccines, and 37% believed that vaccines can cause disease [24]. A recent study by Dubé et al reported that vaccine experts perceive a decline in vaccination rates and that vaccine hesitancy is an important issue to address in Canada [29]. Furthermore, participants reported that dissemination of negative information online and lack of knowledge about vaccines were key issues in the causes of vaccine hesitancy in Canada [29].

    Many studies have analyzed content from vaccine-critical websites and blogs found via search engines, as well as content posted on participative websites, chat rooms, and social media platforms such as Twitter, Facebook, YouTube, and Myspace [30]. These studies have identified similar themes, such as vaccine safety and effectiveness, alternative medicine, civil liberties, conspiracy theories, morality and misinformation, and mistrust of health professionals as the predominant arguments in the antivaccination movement [10,30,31]. Techniques such as skewing science, shifting hypotheses, and attacking critics have been reported as tactics of the online antivaccination community arguing against vaccination [11]. Themes underlying vaccine hesitancy can change over time and by place [13,29]; therefore, as coverage rates remain suboptimal in Canada and outbreaks of vaccine-preventable diseases become more prevalent, it is critical that we continue to build on previous research by analyzing themes in online vaccination discussions. Most research has focused on analyzing the content of discussions on sites or platforms that individuals would find via active research on immunization [30]. However, there is a gap in research in analyzing vaccine information that individuals may see without actively searching for information and could influence decisions on vaccination [30]. Ward et al proposed that future research on vaccine criticism on the internet should include analysis of more complex and interactive ways of information circulation, such as posts, likes, links, and retweets [30]. Furthermore, there is a need for more research to better understand vaccination sentiments specifically among Canadian parents.

    From December 12, 2013 to January 11, 2014, we posted 6 different Facebook advertisements linked to a Web-based survey on childhood immunizations to the Facebook News Feeds of Canadian parents as part of a larger research study [32]. The advertisements reached over 100,000 Canadian parents who matched the following inclusion criteria: (1) located in Canada, (2) 18 years of age or older, (3) parent of a child aged 0 to 15 years, and (4) displaying a profile in French or English. Overall, women represented the majority of Facebook users reached by the advertisements and who also clicked on the advertisement to the Web-based survey [32]. Two advertisements (Figure 1 and Figure 2) had the highest number of views from unique Facebook users reaching 74,572 users and 38,643 users, respectively, and the highest click-through rates to our online survey [32]. Further details on the methods and results of this recruitment strategy are available [32]. The advertisements did not provide any information on immunization, did not try to solicit discussion, and were not posted, shared, liked, or promoted by the researchers. The advertisements did not provide any information on immunization, did not try to solicit discussion, and were not posted, shared, liked, or promoted by the researchers. The Comments section of the advertisements was accessible, and this created an unsolicited and spontaneous discourse where users posted comments on immunization to the 2 most viewed advertisements (Figures 1 and 2).

    Figure 1. The most popular Facebook advertisement posted to Canadian parents’ News Feeds from December 12, 2013 to January 11, 2014.
    View this figure
    Figure 2. The second most popular Facebook advertisement posted to Canadian parents’ News Feeds from December 12, 2013 to January 11, 2014.
    View this figure

    Objective

    This study investigated a unique interactive debate on Facebook resulting from the above Facebook advertisements to recruit parents in immunization research. Our objective was to qualitatively analyze and quantify the content of users’ posts to describe the main vaccination sentiments and themes of an online immunization debate of Facebook users who commented on our posted advertisements, in order to better understand the vaccination debate and to identify underlying themes. We addressed this by asking 2 questions. First, what are the main vaccination sentiments (eg, anti- or provaccination) in the online debate? Second, what are the main themes on vaccination by type of sentiment? This study will add to the body of research on online vaccination discussions by analyzing a posting not intended for interaction that individuals could see without actively searching for information on immunization. The results will assist health professionals in understanding some of the content on vaccine information being shared online in order to help guide messaging and the development of online interventions.


    Methods

    Content Analysis

    In this study, we qualitatively analyzed and quantified the content of open-ended comments posted by Facebook users. On January 11, 2014, at the end of the 4-week recruitment period, we captured and saved all user comments posted in the Comments section of the Facebook advertisements. We included all comments in French or English that contained any message on immunization. We excluded any comments that did not pertain to immunization (eg, comments on the advertisement itself, “lol”). We did not capture any identifying information from the Facebook users, and we removed the advertisement (along with the posted comments) from Facebook immediately at the end of the recruitment period; thus, no captured comments can be directly or indirectly linked to any Facebook user.

    Data Analysis

    After comment capture, 2 raters (JLT and BL) independently coded the comments on the type of message, the sex of the user, the main message of the comment, and the claims made in the comment. To increase validity, the 2 raters independently categorized the comments and resolved any difference to reach 100% consensus based on discussion and a clear framework previously established [33-35]. A third rater was available if consensus was not attainable.

    We measured user interaction by the number of “likes” for specific comments. Commentators either simply made comments or provided a link to vaccine information online. Thus, we classified the type of comment as comment only, comment with link to accurate information or trustworthy source, or comment with link to inaccurate information or nontrustworthy source. We classified trustworthy sources as links to government or reputable associations or scientists. We classified accurate information as websites with information or statistics from government sources or peer-reviewed studies. We classified remaining links as nontrustworthy or inaccurate. We determined the sex of the commentator by using the user’s name, photo, or comment and classified sex as not clear if one or both raters had any uncertainty.

    We categorized the main message of the comments as positive, negative, hesitant, or ambiguous. We coded the comments as positive if the central message supported vaccination, portraying it positively (eg, describing the benefits or safety of vaccination, promoting vaccinations, describing the risks of not vaccinating or low risk of vaccinating) [36]. We coded comments as negative if the central message portrayed vaccination negatively (eg, emphasizing the risk of vaccination, opposing vaccination, promoting distrust in vaccine science, making allegations of conspiracy or collusion) [36]. If the central message portrayed indecision or uncertainty on the risks or benefits of vaccination (eg, questions or concerns about risk or safety, requests for information or links, questions regarding others’ decision to vaccinate), we coded the comments as hesitant. If the main message was not clear, we coded the comment as ambiguous. We then used two separate coding schemes to subcategorize the content: one for the negative, hesitant, and ambiguous comments and one for the positive comments.

    We subcategorized the claims in the negative, hesitant, and ambiguous comments based on the themes of determinants of vaccine hesitancy suggested by the WHO’s Strategic Advisory Group of Experts Working Group (SAGE WG) on Immunization [37,38]. The SAGE WG matrix organizes vaccine sentiment into three domains: contextual influences, such as socioeconomic barriers, mistrust in the pharmaceutical industry, or religious values; individual and social group influences, such as personal knowledge or perceptions of risk; and vaccination and vaccination-specific issues, such as the vaccination schedule or characteristics of the vaccine; each main theme contains specific subcategories [37-39]. We categorized claims about vaccination within the comments according to the major themes and subthemes; claims could be classified into one or more themes and subcategories within the themes. We chose the SAGE WG matrix as the coding framework because it was developed by experts to include all known and potential determinants of vaccine hesitancy based on a thorough systematic review and expert opinion [37,38]. We created a category of other for any claim not covered by the SAGE WG matrix as determined by rater consensus [40]. The material was read several times prior to coding to ensure it fit the preconceived framework and to identify any other themes. Definitions of the framework categories were researched and discussed between the raters prior to coding. Both raters manually coded and discussed material from a random sample of respondents prior to independent coding.

    The SAGE WG coding framework did not accurately capture the themes in the positive comments; thus, we categorized the claims in the positive comments based on broad themes in the data, with both raters independently generating categories and reaching consensus to develop the final coding scheme [33-35,40]. No new codes arose after approximately 40% of the comments were assessed.

    The 2 raters independently categorized all comments (negative and positive) and claims within the comments, and achieved over 95% consensus. The raters met once to discuss items where consensus was not reached and achieved 100% consensus based on discussion and preestablished frameworks and criteria [33-35].

    We conducted descriptive statistics to quantify respondent characteristics, main messages, and identified themes. Raters conducted content analysis with NVivo 10 qualitative data analysis software (QSR International) and quantified the analysis with descriptive statistics using Microsoft Office Excel 2007 (Microsoft Corporation). We obtained ethical approval from the University of Toronto’s Office of Research Ethics, Toronto, ON, Canada (REF#29309).


    Results

    Respondent Characteristics, Main Messages, and User Interaction

    The advertisements generated 117 comments by 85 unique Facebook users after we excluded 9 comments not meeting the inclusion criteria. Of the 85 commentators, 77% (65/85) were female, 14% (12/85) were male, and for 9% (8/85) the sex was not clear. The majority of the comments were comments only (103/117, 88.0%), and 11.9% (14/117) posted links to websites. Of the 14 website links, 2 were from trustworthy sources, with 1 linked to a trustworthy source with accurate information (a government website with official statistics) and 1 linked to an online news story with accurate information posted from a government source. The main message of 43.6% (51/117) of comments was positive, followed by 35.0% (41/117) negative, 17.1% (20/117) ambiguous, and 4.3% (5/117) hesitant. Comments with the most interaction (20 or more likes) had mostly positive main messages (8/9, 89%) and 1 negative. The following 2 redacted positive comments had the most interaction (43 and 40 likes, respectively) and highlighted the predominant theme within the positive comments: the benefits of vaccines versus the risk for children and others in becoming infected with the disease (indicated as theme 1 in the comments below). In addition, the 2 other most identified themes were represented within these comments: parents who do not vaccinate their children are uneducated (theme 2), and vaccines do not cause autism (theme 3). Note that we redacted comments solely for the purpose of omitting words and sentences inconsequential to the context and analysis.

    Vaccinating your children is the best way to prevent them (and others) from getting viruses and diseases...you are essentially protecting them from the awful signs and symptoms of the disease...the benefits out way the risks (Theme 1). Why do you think small pox was eradicated? Bc enough people around the world got the vaccine for it and it had no one to spread to, therefore: eradicated!!! There is NOT as many people unvaccinated as vaccinated, 80% of the population vaccinate their children...that # is decreasing bc of people’s lack of knowledge...Your not idiots for vaccinating your children you are just uneducated about biomedical facts! (Theme 2)
    What about the infants and people who are immuno-compromised who CANT vaccinate? They depend on those people who CAN vaccinate to be protected and not spread these things!! (Theme 1) I have a child with autism, and do NOT believe vaccines have ANYTHING to do with it! That has been disproven! (Theme 3)

    Lack of knowledge or awareness was the most prevalent theme in the negative comments, as suggested by the misinformation on immunity and transmission of disease contained within the following most liked (40 likes) negative redacted comment:

    If their was a breakout of tuberculosis, polio...the vaccinated children would not be amune! If a vaccine protects you & your children, why...are all the vaccinated children catching it? There is absolutely no evidence that outbreaks start from unvaccinated people!...Every time there’s an outbreak there’s as many vaccinated as unvaccinated people catching the disease. There is absolutely no protection from a disease from taking a vaccine!

    Themes in the Negative, Hesitant, and Ambiguous Comments

    In the 66 negative, hesitant, or ambiguous comments, 130 claims were made on factors affecting vaccination decisions. Individual and social group influence was the predominant theme in the claims within the posted comments (85/130, 65.4%). Within this theme, 20.8% (27/130) of the claims displayed lack of knowledge or awareness on immunization (including misinformation and the belief in their own research and knowledge), with the majority (22/27, 81%) providing inaccurate information or misperceptions on immunization and some explicitly stating their belief in the credibility or accuracy of their knowledge and research (5/27, 19%). Approximately 18% (23/130, 17.7%) of the claims revealed a low perception of the risk of disease and need for the vaccine or a high perception of risk of adverse events associated with vaccination. Table 1 displays the identified themes according to the WHO SAGE WG matrix on vaccine hesitancy.

    Themes in the Positive Comments

    In the 51 positive comments (and 2 hesitant comments with positive claims), we identified 74 claims on factors affecting vaccination decisions. Within these comments, the majority (29/74, 39%) of the positive claims stated concerns over nonvaccinating parents putting their children and others at risk of disease and death or stated how the benefits outweigh the potential risks, followed by claims that nonvaccinating parents are uneducated, unintelligent, or selfish (13/74, 18%) (Table 2).

    Table 1. Negative, hesitant, and ambivalent claims posted by Facebook users on Facebook advertisements categorized by themes (n=130).
    View this table
    Table 2. Positive claims posted by Facebook users on Facebook advertisements categorized by themes (n=74)a,b.
    View this table

    Discussion

    Principal Findings

    The majority of comments were clearly pro- (51/117, 43.6%) or antivaccination (41/117, 35.0%) with few comments vocalizing vaccine hesitancy (4.3%). Themes in the online debate followed those identified in the literature and mostly captured in the SAGE WG framework [30,37]. As reported in other studies analyzing online vaccination messages [31,37,41], information in the negative comments was often inaccurate and the risks of immunization were misperceived. Mistrust in the pharmaceutical industry, the government, and health system was also a recurring theme in the online debate and previously identified as an important theme in studies analyzing vaccine-critical websites [10,21,30,31]. The right to choose without being judged was expressed within many negative comments yet not identified in the SAGE WG framework. This theme could have emerged in response to several judgments made within the positive comments on the level of intelligence or education of nonvaccinators. However, the theme of civil liberties or parents’ right to choose has been reported in previous studies analyzing vaccine opposition website content [10,30,31,41]. Slightly more positive comments were posted than negative or hesitant, and positive comments received the most interaction. Although the majority of the positive comments did not provide any links or obvious information from health authorities, there was encouragement to seek out trusted sources and people. No commentator self-identified as a health professional. The debate also highlighted the persistence of the myth linking vaccines to autism. Seeman et al [42] also reported this persistent inaccuracy on the safety of the measles-mumps-rubella (MMR) vaccine in an online survey of Canadian parents, and Nicholson and Leask [21] reported that one-third of the participants in an online MMR vaccine discussion forum were critical of the vaccine, with the risk of adverse effects and autism and concerns with vaccine ingredients as the major themes. Furthermore, a recent Canadian survey reported that 28% of adults reported to believe that there is or be uncertain about a link between vaccines and autism [43].

    As we targeted the advertisements at Canadian parents, most of the commentators likely represented this demographic. Most of the commentators were female, but we expected this, as the Facebook campaign biased the advertisement reach toward a female population [32]. The 2 most popular advertisements reached over 100,000 Canadian parents on Facebook [32]; thus, the posted comments would have been visible to other targeted and potentially vaccine-hesitant Canadian parents who chose not to respond, as well as an unknown number of individuals not targeted by the campaign. These online debates should be of concern to public health authorities, as the spread of misinformation and misperceptions can reach large audiences with the potential to negatively influence vaccine-hesitant and provaccine individuals [22]. In addition, the analysis of the online debate revealed the lack of knowledge and spread of misinformation on a platform not intended to solicit discussion. The presence of public health authorities online is limited to top-down dissemination of information with limited engagement in online debates. This lack of public health involvement online could potentially enable the unabated spread of antivaccination sentiment and misinformation that potentially affect vaccination decisions among hesitant and provaccine parents.

    Identified themes, such as the perceived risk of adverse events versus the risk of disease, and misinformation on autism and other disorders, immunity, and vaccine ingredients, could be addressed with more communication messages tailored to the issues in the online discussions. Although some antivaccination activists may never be swayed by evidence, it is important for health authorities to provide information to those with genuine concerns or questions, and engage in online debates rapidly in a nonjudgmental and transparent manner. Parents’ right to choose and not be judged was an important theme among the negative comments. The issue of freedom and individual rights versus the notion of social good is a fundamental ethical issue in immunization programs and needs to be given careful thought in our communications on issues such as mandatory vaccination and exemption rights. Passive interventions such as increasing knowledge or reminder recalls have been shown to be the least effective in addressing vaccine hesitancy [44], and there is a need for more dialogue-based approaches targeted to specific subpopulations with an intended focus on social networks [44]. In a recent randomized controlled trial, Glanz et al [45] found that Web-based information delivered on vaccines via social media platforms during pregnancy can have a positive impact on parental vaccine decisions. However, communication strategies on immunization via social media are still not well understood, and caution must be used to prevent legitimizing vaccine hesitancy [46]. Social media can be an important communication tool for public health; however, the content of online debates needs to be better monitored to identify the predominant themes, the type of misinformation, or specific requests for information, and to understand the determinants among Canadian parents [46,47]. This study adds to this body of research and highlights the major themes in one online debate, as well as the need for ongoing monitoring due to the extent of misinformation being shared.

    Although online monitoring is essential, we need to better understand who should be engaging online to rebut misinformation and spread accurate and scientifically valid information on immunization. Mistrust in health care professionals and the government has been reported as an important determinant in vaccine hesitancy [30,37,48,49]; thus, alternative spokespeople (eg, influential mommy bloggers or celebrities) may need to be considered in the delivery of expert-based information. However, a recent survey of Canadian adults reported that the majority trust physicians and public health officials for timely and credible vaccine information, while popular celebrities were the least trusted [43]. Further research is needed to determine the extent of public health involvement, and what interventions or messaging and by whom would have the most impact online. MacDonald et al [50] reported that no simple strategy exists in overcoming vaccine hesitancy and that health care workers and immunization program managers need to “become adept at recognizing and tackling hesitancy in all of its incarnations.” This includes detecting vaccine hesitancy in populations and subgroups, having communication plans to address antivaccination misinformation, and actively supporting vaccine acceptors [50]. Online silence from public health authorities could give the impression of agreement with antivaccination information or sentiment [50]. Adversarial approaches could be counterproductive [51]; thus, public health departments need to be proactive in their social media strategies by promoting the safety of vaccines and addressing misinformation with targeted and tested interventions and messaging [13,17,50]. As such, it would also be useful to develop a common matrix that captures the arguments of those engaging in online discussions to influence nonvaccinators and vaccine-hesitant individuals (ie, provaccinators) and to further research their impact. Furthermore, health authorities and researchers should consider the ethical implications of nonengagement when using interactive online platforms for public health communications and interventions.

    Limitations

    This study was limited in that the analysis was of one online debate and not necessarily representative of the main themes in all online immunization debates. Furthermore, the target audience was self-selected Canadian parents on an online social media platform, and we collected the presented data in 2013 and 2014. Thus, the results are not generalizable to a larger population, and the themes underlying vaccine hesitancy may have changed for this population, as they can be context specific, varying across time, place, or vaccine [13,37]. Thus, it is imperative that the online conversation be continually monitored in various subgroups and over time in order to identify current themes and trends to tailor public health communications on immunization to specific audiences. Although we did not intend the advertisement to elicit discussion on vaccines and clearly requested users to complete an online survey, it is possible that the advertisement unintentionally provoked discussion by asking for thoughts on vaccines. The type of messaging used should be considered when posting online advertisements, and the Comments section should be deactivated when appropriate and feasible. It is also important to note that we could have overestimated the total number of individual commentators (85 unique Facebook users), as it was not possible to verify whether the same individual had multiple accounts under different user names.

    Conclusion

    The presence of over 100 comments posted on advertisements not intended as a discussion forum illustrates not only the strong sentiments associated with immunization but also the arbitrariness of platforms used for online debates. This unsolicited online debate is evidence of the importance of monitoring online discussions and of using technology capable of identifying immunization discussions among Canadian parents, as interactions are not just limited to vaccine-critical websites or groups and can occur via several platforms. The random nature of online debates will present a challenge for health authorities in terms of monitoring and engagement. Monitoring will need to include data mining with algorithms for keywords on immunization to quickly identify and engage in all public online communications on immunization. Health authorities need to identify methods to better leverage online platforms and networks in order to build trust, increase knowledge and access to information, and contest misinformation and misperceptions. It would also be important to consider appropriate jurisdictional responsibilities among health authorities for online surveillance and communications in immunization discussions.

    Acknowledgments

    The authors wish to thank Public Health Ontario and the Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada, for providing funding sources.

    Conflicts of Interest

    None declared.

    References

    1. Schuster M, Eskola J, Duclos P, SAGE Working Group on Vaccine Hesitancy. Review of vaccine hesitancy: rationale, remit and methods. Vaccine 2015 Aug 14;33(34):4157-4160 [FREE Full text] [CrossRef] [Medline]
    2. World Health Organization. Measles continues to spread and take lives in Europe. Copenhagen, Denmark: World Health Organization. Regional Office for Europe; 2017 Jul 11.   URL: http:/​/www.​euro.who.int/​en/​media-centre/​sections/​press-releases/​2017/​measles-continues-to-spread-and-take-lives-in-europe [accessed 2018-02-09] [WebCite Cache]
    3. Datta SS, O'Connor PM, Jankovic D, Muscat M, Ben Mamou MC, Singh S, et al. Progress and challenges in measles and rubella elimination in the WHO European Region. Vaccine 2017 Jun 23. [CrossRef] [Medline]
    4. National Center for Immunization and Respiratory Diseases, Division of Viral Diseases. Measles cases and outbreaks. Atlanta, GA: Centers for Disease Control and Prevention; 2018 Jul 23.   URL: https://www.cdc.gov/measles/cases-outbreaks.html [accessed 2018-02-09] [WebCite Cache]
    5. Public Health Agency of Canada. Public health notice: measles. Ottawa, ON: PHAC; 2015 Feb 12.   URL: http://www.phac-aspc.gc.ca/phn-asp/2015/meas-roug-eng.php [accessed 2015-05-19] [WebCite Cache]
    6. Lam P, Williams L, Gadient S, Squires S, St-Laurent M. Maintaining measles elimination in Canada: moving forward. Can Commun Dis Rep 2015 Jul 02;41(7):175-178 [FREE Full text] [Medline]
    7. Public Health Agency of Canada. Chief Public Health Officer statement: public health reminder regarding mumps. Ottawa, ON: PHAC; 2017 Mar 01.   URL: https:/​/www.​canada.ca/​en/​public-health/​news/​2017/​03/​cpho_statement_publichealthreminderregardingmumps.​html [accessed 2017-09-12] [WebCite Cache]
    8. Betsch C, Brewer NT, Brocard P, Davies P, Gaissmaier W, Haase N, et al. Opportunities and challenges of Web 2.0 for vaccination decisions. Vaccine 2012 May 28;30(25):3727-3733. [CrossRef] [Medline]
    9. Dubé E, Laberge C, Guay M, Bramadat P, Roy R, Bettinger J. Vaccine hesitancy: an overview. Hum Vaccin Immunother 2013 Aug;9(8):1763-1773 [FREE Full text] [CrossRef] [Medline]
    10. Bean SJ. Emerging and continuing trends in vaccine opposition website content. Vaccine 2011 Feb 24;29(10):1874-1880. [CrossRef] [Medline]
    11. Kata A. Anti-vaccine activists, Web 2.0, and the postmodern paradigm-an overview of tactics and tropes used online by the anti-vaccination movement. Vaccine 2012 May 28;30(25):3778-3789. [CrossRef] [Medline]
    12. Stahl J, Cohen R, Denis F, Gaudelus J, Martinot A, Lery T, et al. The impact of the web and social networks on vaccination. New challenges and opportunities offered to fight against vaccine hesitancy. Med Mal Infect 2016 May;46(3):117-122. [CrossRef] [Medline]
    13. Dubé E, Bettinger JA, Fisher WA, Naus M, Mahmud SM, Hilderman T. Vaccine acceptance, hesitancy and refusal in Canada: challenges and potential approaches. Can Commun Dis Rep 2016 Dec 01;42(12):246-251 [FREE Full text] [Medline]
    14. Tustin JL, Crowcroft NS, Gesink D, Johnson I, Keelan J. Internet exposure associated with Canadian parents’ perception of risk on childhood immunization: cross-sectional study. JMIR Public Health Surveill 2018 Jan 19;4(1):e7 [FREE Full text] [CrossRef] [Medline]
    15. Fox S. The social life of health information, 2011. Washington, DC: Pew Internet & American Life Project; 2011 May 12.   URL: http://www.pewinternet.org/files/old-media/Files/Reports/2011/PIP_Social_Life_of_Health_Info.pdf [accessed 2015-05-21] [WebCite Cache]
    16. Statistics Canada. Individual internet use and e-commerce, 2012. 2013 Oct 28.   URL: http://www.statcan.gc.ca/daily-quotidien/131028/dq131028a-eng.htm [accessed 2017-09-12] [WebCite Cache]
    17. Witteman HO, Zikmund-Fisher BJ. The defining characteristics of Web 2.0 and their potential influence in the online vaccination debate. Vaccine 2012 May 28;30(25):3734-3740. [CrossRef] [Medline]
    18. Statistics Canada. Individual internet use and e-commerce. 2010.   URL: http://www.statcan.gc.ca/daily-quotidien/111012/dq111012a-eng.htm [accessed 2015-05-21] [WebCite Cache]
    19. The Canadian Press. More Canadians use Facebook daily than anywhere else in the world. Toronto, ON: Financial Post; 2013 Aug 13.   URL: https://tinyurl.com/yakhqq53 [accessed 2017-11-16] [WebCite Cache]
    20. Faber H. Canadian social media statistics 2013. Ottawa, ON: Webfuel Inc; 2013 Aug 14.   URL: http://www.webfuel.ca/canadian-social-media-statistics-2013/ [accessed 2017-11-16] [WebCite Cache]
    21. Nicholson MS, Leask J. Lessons from an online debate about measles-mumps-rubella (MMR) immunization. Vaccine 2012 May 28;30(25):3806-3812. [CrossRef] [Medline]
    22. Betsch C, Renkewitz F, Betsch T, Ulshöfer C. The influence of vaccine-critical websites on perceiving vaccination risks. J Health Psychol 2010 Apr;15(3):446-455. [CrossRef] [Medline]
    23. Betsch C. Innovations in communication: the Internet and the psychology of vaccination decisions. Euro Surveill 2011 Apr 28;16(17) [FREE Full text] [Medline]
    24. Public Health Agency of Canada. Vaccine coverage in Canadian children: results from the 2013 Childhood National Immunization Coverage Survey. Ottawa, ON: PHAC; 2017.   URL: https://tinyurl.com/y8mshshj [accessed 2018-08-30] [WebCite Cache]
    25. Public Health Agency of Canada. Elimination of measles, rubella and congenital rubella syndrome in Canada: documentation and verification report. Ottawa, ON: PHAC; 2013 Apr 04.   URL: https://tinyurl.com/yd2cdb7h [accessed 2018-02-09] [WebCite Cache]
    26. Deehan H, Shane A. Measles activity in Canada: January - June 2014. Can Commun Dis Rep 2014 Jun 12;40(12):233-235 [FREE Full text] [Medline]
    27. Shane A, Hiebert J, Sherrard L, Deehan H. Measles surveillance in Canada: Trends for 2013. Can Commun Dis Rep 2014 Jun 12;40(12):219-232 [FREE Full text] [Medline]
    28. Sherrard L, Hiebert J, Cunliffe J, Mendoza L, Cutler J. Measles surveillance in Canada 2015. Can Commun Dis Rep 2016 Jul 07;42(7):139-145. [Medline]
    29. Dubé E, Gagnon D, Ouakki M, Bettinger JA, Guay M, Halperin S, Canadian Immunization Research Network. Understanding vaccine hesitancy in Canada: results of a consultation study by the Canadian Immunization Research Network. PLoS One 2016;11(6):e0156118 [FREE Full text] [CrossRef] [Medline]
    30. Ward JK, Peretti-Watel P, Verger P. Vaccine criticism on the Internet: propositions for future research. Hum Vaccin Immunother 2016 Dec 02;12(7):1924-1929 [FREE Full text] [CrossRef] [Medline]
    31. Kata A. A postmodern Pandora's box: anti-vaccination misinformation on the Internet. Vaccine 2010 Feb 17;28(7):1709-1716. [CrossRef] [Medline]
    32. Tustin JL, Crowcroft NS, Gesink D, Johnson I, Keelan J, Lachapelle B. Facebook recruitment of vaccine-hesitant Canadian parents: cross-sectional study. JMIR Public Health Surveill 2017 Jul 24;3(3):e47 [FREE Full text] [CrossRef] [Medline]
    33. Bengtsson M. How to plan and perform a qualitative study using content analysis. NursingPlus Open 2016;2:8-14. [CrossRef]
    34. Burnard P. A method of analysing interview transcripts in qualitative research. Nurse Educ Today 1991 Dec;11(6):461-466. [Medline]
    35. Graneheim UH, Lundman B. Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness. Nurse Educ Today 2004 Feb;24(2):105-112. [CrossRef] [Medline]
    36. Keelan J, Pavri-Garcia V, Tomlinson G, Wilson K. YouTube as a source of information on immunization: a content analysis. JAMA 2007 Dec 5;298(21):2482-2484. [CrossRef] [Medline]
    37. Larson HJ, Jarrett C, Eckersberger E, Smith DMD, Paterson P. Understanding vaccine hesitancy around vaccines and vaccination from a global perspective: a systematic review of published literature, 2007-2012. Vaccine 2014 Apr 17;32(19):2150-2159. [CrossRef] [Medline]
    38. MacDonald NE. Vaccine hesitancy: definition, scope and determinants. Vaccine 2015 Aug 14;33(34):4161-4164 [FREE Full text] [CrossRef] [Medline]
    39. The SAGE working Group on vaccine hesitancy. World Health Organization. 2014 Oct 1. Report of the SAGE Working Group on vaccine hesitancy   URL: https://tinyurl.com/nwuwls8 [WebCite Cache]
    40. Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol 2013 Sep 18;13:117 [FREE Full text] [CrossRef] [Medline]
    41. Keelan J, Pavri V, Balakrishnan R, Wilson K. An analysis of the Human papilloma virus vaccine debate on MySpace blogs. Vaccine 2010 Feb 10;28(6):1535-1540. [CrossRef] [Medline]
    42. Seeman N, Seeman M. Autism and the measles, mumps, and rubella vaccine: need to communicate a health study retraction to patients. J Particip Med 2010 Dec 17;2:e18 [FREE Full text]
    43. Greenberg J, Dubé E, Driedger M. Vaccine hesitancy: in search of the risk communication comfort zone. PLoS Curr 2017 Mar 03;9 [FREE Full text] [CrossRef] [Medline]
    44. Jarrett C, Wilson R, O'Leary M, Eckersberger E, Larson HJ, SAGE Working Group on Vaccine Hesitancy. Strategies for addressing vaccine hesitancy - a systematic review. Vaccine 2015 Aug 14;33(34):4180-4190 [FREE Full text] [CrossRef] [Medline]
    45. Glanz JM, Wagner NM, Narwaney KJ, Kraus CR, Shoup JA, Xu S, et al. Web-based social media intervention to increase vaccine acceptance: a randomized controlled trial. Pediatrics 2017 Dec;140(6). [CrossRef] [Medline]
    46. Goldstein S, MacDonald NE, Guirguis S, SAGE Working Group on Vaccine Hesitancy. Health communication and vaccine hesitancy. Vaccine 2015 Aug 14;33(34):4212-4214 [FREE Full text] [CrossRef] [Medline]
    47. Eskola J, Duclos P, Schuster M, MacDonald NE, SAGE Working Group on Vaccine Hesitancy. How to deal with vaccine hesitancy? Vaccine 2015 Aug 14;33(34):4215-4217 [FREE Full text] [CrossRef] [Medline]
    48. Wilson K, Barakat M, Vohra S, Ritvo P, Boon H. Parental views on pediatric vaccination: the impact of competing advocacy coalitions. Public Underst Sci 2008 Apr;17(2):231-243. [CrossRef] [Medline]
    49. Freed GL, Clark SJ, Butchart AT, Singer DC, Davis MM. Sources and perceived credibility of vaccine-safety information for parents. Pediatrics 2011 May;127 Suppl 1:S107-S112. [CrossRef] [Medline]
    50. MacDonald NE, Butler R, Dubé E. Addressing barriers to vaccine acceptance: an overview. Hum Vaccin Immunother 2018 Jan 02;14(1):218-224. [CrossRef] [Medline]
    51. Leask J. Should we do battle with antivaccination activists? Public Health Res Pract 2015 Mar 30;25(2):e2521515 [FREE Full text] [CrossRef] [Medline]


    Abbreviations

    MMR: measles-mumps-rubella
    SAGE WG: Strategic Advisory Group of Experts Working Group
    WHO: World Health Organization


    Edited by G Eysenbach; submitted 09.02.18; peer-reviewed by AC Ianos, D Broniatowski, S Chandir, B Hoffman; comments to author 02.03.18; revised version received 30.06.18; accepted 19.07.18; published 20.09.18

    ©Jordan Lee Tustin, Natasha Sarah Crowcroft, Dionne Gesink, Ian Johnson, Jennifer Keelan, Barbara Lachapelle. Originally published in JMIR Public Health and Surveillance (http://publichealth.jmir.org), 20.09.2018.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Public Health and Surveillance, is properly cited. The complete bibliographic information, a link to the original publication on http://publichealth.jmir.org, as well as this copyright and license information must be included.