Published on in Vol 3, No 2 (2017): Apr-Jun

Saúde na Copa: The World’s First Application of Participatory Surveillance for a Mass Gathering at FIFA World Cup 2014, Brazil

Saúde na Copa: The World’s First Application of Participatory Surveillance for a Mass Gathering at FIFA World Cup 2014, Brazil

Saúde na Copa: The World’s First Application of Participatory Surveillance for a Mass Gathering at FIFA World Cup 2014, Brazil

Original Paper

1Epitrack, Recife, Brazil

2SingularityU Recife Chapter, Recife, Brazil

3Aggeu Magalhães Research Center, Departament of Health Collective, Recife, Brazil

4Pernambuco Health Departament, Recife, Brazil

5Skoll Global Threats Fund, Pandemics Team, San Francisco, CA, United States

6Aggeu Magalhães Research Center, Departament of Public Health, Recife, Brazil

7Brazil's Ministry of Health, General Coordination of Public Health Emergencies Response, Brasilia, Brazil

8Federal Rural University of Pernambuco, Informatics Departament, Recife, Brazil

Corresponding Author:

Onicio Leal Neto, MPH

Epitrack

Republica do Libano, 251. 2508 A

Pina

Recife, 51110-160

Brazil

Phone: 55 81991849209

Fax:55 8137218600

Email: onicio@epitrack.tech


Background: The 2005 International Health Regulations (IHRs) established parameters for event assessments and notifications that may constitute public health emergencies of international concern. These requirements and parameters opened up space for the use of nonofficial mechanisms (such as websites, blogs, and social networks) and technological improvements of communication that can streamline the detection, monitoring, and response to health problems, and thus reduce damage caused by these problems. Specifically, the revised IHR created space for participatory surveillance to function, in addition to the traditional surveillance mechanisms of detection, monitoring, and response. Participatory surveillance is based on crowdsourcing methods that collect information from society and then return the collective knowledge gained from that information back to society. The spread of digital social networks and wiki-style knowledge platforms has created a very favorable environment for this model of production and social control of information.

Objective: The aim of this study was to describe the use of a participatory surveillance app, Healthy Cup, for the early detection of acute disease outbreaks during the Fédération Internationale de Football Association (FIFA) World Cup 2014. Our focus was on three specific syndromes (respiratory, diarrheal, and rash) related to six diseases that were considered important in a mass gathering context (influenza, measles, rubella, cholera, acute diarrhea, and dengue fever).

Methods: From May 12 to July 13, 2014, users from anywhere in the world were able to download the Healthy Cup app and record their health condition, reporting whether they were good, very good, ill, or very ill. For users that reported being ill or very ill, a screen with a list of 10 symptoms was displayed. Participatory surveillance allows for the real-time identification of aggregates of symptoms that indicate possible cases of infectious diseases.

Results: From May 12 through July 13, 2014, there were 9434 downloads of the Healthy Cup app and 7155 (75.84%) registered users. Among the registered users, 4706 (4706/7155, 65.77%) were active users who posted a total of 47,879 times during the study period. The maximum number of users that signed up in one day occurred on May 30, 2014, the day that the app was officially launched by the Minister of Health during a press conference. During this event, the Minister of Health announced the special government program Health in the World Cup on national television media. On that date, 3633 logins were recorded, which accounted for more than half of all sign-ups across the entire duration of the study (50.78%, 3633/7155).

Conclusions: Participatory surveillance through community engagement is an innovative way to conduct epidemiological surveillance. Compared to traditional epidemiological surveillance, advantages include lower costs of data acquisition, timeliness of information collected and shared, platform scalability, and capacity for integration between the population being served and public health services.

JMIR Public Health Surveill 2017;3(2):e26

doi:10.2196/publichealth.7313

Keywords



Mass gatherings (MGs) are situations that involve large populations that come together for specific causes related to leisure (eg, sports events, carnivals, and concerts), religion (eg, Hajj, World Youth Day), politics (eg, marches, protests, presidential inaugurations), or similar purposes [1-4]. By changing business, media, and public health environments, MGs create both new opportunities and novel risks [3-5].

During any MG, two changes in particular have the potential to significantly increase pressure on the local health care system. The first is the increase in simple contact between travelers (ie, tourists, athletes, workers, volunteers, press staff, authorities) and individuals in the local population [1-3]. This contact can promote both the introduction of diseases into the local population by visitors and the transmission of diseases to visitors through either visitor-to-visitor or native-to-visitor contact. The potential for transmission among visitors and between natives and visitors (both native-to-visitor and visitor-to-native) is further influenced by the increased mobility of people and goods made possible by the forces of globalization [3]. This mobility increases contact among individuals and goods from different epidemiological settings, promotes the exchange of potential threats to public health, and generates new risks [3,4,6,7]. Recent experiences with the persistence of dengue fever and increased circulation of Zika virus [8-10] and Chikungunya fever have made the threat of infectious disease transmission a tangible reality that requires rapid detection and response preparation (ie, including case findings, vaccine availability, diagnostic procedures, medical services, epidemiological research, medicines, and guidance for the public and professionals) [3,4,7]. A second MG-associated change that has the potential to significantly increase pressure on the local health care system is the size of the MG itself, which can impact routine demand not only for health, but for all public services, especially security and transportation [3,4,6].

The revised International Health Regulations (IHRs) 2005 required states to develop, strengthen, and maintain the capabilities to detect, assess, notify, and report risk events to international public health authorities, including situations resulting from MGs [11]. Additionally, the 2005 IHRs established parameters for event assessments and notifications that may constitute public health emergencies of international concern [12-14]. These requirements and parameters opened up space for the use of nonofficial mechanisms (eg, websites, blogs, and social networks) and technological improvements of communication that can streamline the detection, monitoring, and response to health problems, and thus reduce damage caused by these problems [15-19]. Specifically, the revised IHRs created space for participatory surveillance to function, in addition to the traditional surveillance mechanisms of detection, monitoring, and response [20-27]. Participatory surveillance is based on crowdsourcing methods that collect information from society and then return the collective knowledge gained from that information back to society. The spread of digital social networks and wiki-style knowledge platforms has created a very favorable environment for this model of production and social control of information [18,19,28-31].

The aim of this study was to describe the use of a participatory surveillance app, Healthy Cup, for the early detection of acute disease outbreaks during the Fédération Internationale de Football Association (FIFA) World Cup 2014. The main health outcomes (ie, outcomes related to infectious diseases) that have been associated with MG sporting events like this are respiratory, cardiovascular, and gastrointestinal (ie, diarrhea) [32-36]. Respiratory outcomes are mainly associated with viruses that can spread easily between individuals, cardiovascular outcomes are usually associated with the emotional stress that fans experience during sports events, and gastrointestinal outcomes are often associated with the expansion of the informal food trade that typically occurs during MG events (eg, foods being sold on the street) and the desire of tourists to sample local cuisine, which may not be well tolerated by travelers’ bodies. Our focus was on these three main infectious disease outcomes, specifically respiratory, diarrheal, and rash syndromes related to diseases that are considered important in an MG context (ie, influenza, measles, rubella, cholera, acute diarrhea, and dengue fever).


From May 12 to July 13, 2014, users from anywhere in the world were able to download the Healthy Cup app and record their health condition, reporting whether they were good, very good, ill, or very ill. For users that reported being ill or very ill, a screen with a list of 10 symptoms was displayed. Participatory surveillance allows for the real-time identification of aggregates of symptoms that indicate possible cases of infectious diseases. Table 1 lists the symptoms, and syndromes and diseases associated with these symptoms, that were included in the Healthy Cup app. In addition to these 10 symptoms, the app also had 2 additional queries regarding contact chain (eg, “I got in touch or know someone with some of these symptoms in the last 7 days”) and severity of the symptoms (“I looked for a health care service”).

Table 1. Symptoms, syndromes, and diseases searched using Healthy Cup app.
SymptomsSyndromesDiseases

RespiratoryDiarrhealRashInfluenzaMeaslesRubellaCholeraAcute diarrheaDengue
FeverXXXXXX-XX
CoughX-XXXX---
Sore throatX--X-----
Nausea-X-----X-
Joint pain--X-----X
Headache--X-----X
Diarrhea-X----XX-
Rash--X-XX--X
Bleeding--X-----X
Shortness of breathX--X-----

Healthy Cup was developed by a partnership between the Secretariat of Health Surveillance (Brazil’s Ministry of Health), Skoll Global Threats Fund, and Epitrack eHealth. The app was designed on an open source platform for use on mobile devices. The platform was developed as a hybrid app for both iOS and Android operating systems that could be accessed by anyone using an iOS or Android smartphone, or as a Web app in any Internet browser. The iOS native and Web apps were developed using PhoneGap (built with JavaScript, HTML5 and CSS) [37]; the Android app was developed in native language. The mobile and Web apps use external interface capabilities to support Application Program Interface (API) Google Places (for location of nearby hospitals and pharmacies), Google Maps API (for user navigation to points of interest and viewpoints on the dashboard), and Twitter API (for streaming of the Ministry of Health profile) [38,39]. We used a MySQL-type server developed in PHP language, and we managed the database using phpMyAdmin.

The Healthy Cup project was hosted throughout the study period by Dreamhost [40], and its code and versioning used GitHub. To ensure safety of the platform, we also set up a virtual private server with 60 gigabytes of storage, 2 gigabytes of random-access memory, and unlimited bandwidth. Both reports and registers had geolocation features, in which the system captured the coordinates related to each use. This function was implemented following these standards to acquire geolocation data: (1) asking the permission of the users; (2) starting up a cron job to get the coordinates; and (3) inserting this coordinate for each respective event, whether it was a report or register.


From May 12 through July 13, 2014, there were 9434 downloads of the Healthy Cup app and 7155 (75.84%) registered users. Among the registered users, 4706 (4706/7155, 65.77%) were active users who posted a total of 47,879 times during the study period. Of these posts, 89.43% (42,818/47,879) reported no symptoms. One symptom was reported in 3173 posts (3173/47,879, 6.63%); one or more symptoms were reported in 5329 posts (5329/47,879, 11.13%; with an average of 1.8 per post); five or more symptoms were reported in 220 posts (220/47,879, 0.46%); and all 10 symptoms were reported in 99 posts (99/47,879, 0.21%; see Table 1 and Table 2).

Table 2. Distribution of the posts, symptoms profile, and syndromes by host city. Saúde na Copa 2014 percentages for posts are in relation to total posts among all host cities; percentages for symptoms are in relation to host city posts.
Host cityPosts, n (%)With symptoms, n (%)Diarrhea syndrome, n (%)Respiratory syndrome, n (%)Rash Syndrome, n (%)
Belo Horizonte1133 (4.32)128 (11.30)7 (5.5)12 (9.4)5 (3.9)
Brasilia7951 (30.33)573 (7.20)14 (2.4)37 (6.5)7 (1.2)
Cuiabá1109 (4.23)173 (15.60)1 (0.6)15 (8.7)0 (0.0)
Curitiba824 (3.14)92 (11.2)6 (6.5)9 (9.8)2 (2.2)
Fortaleza1519 (5.80)174 (11.45)6 (3.4)9 (5.2)3 (1.7)
Manaus985 (3.76)136 (13.8)4 (2.9)12 (8.8)2 (1.5)
Natal938 (3.58)77 (8.2)2 (2.6)4 (5.2)0 (0.0)
Porto Alegre925 (3.53)113 (12.2)6 (5.3)7 (6.2)3 (2.7)
Recife4316 (16.47)282 (6.53)5 (1.8)9 (3.2)1 (0.4)
Rio de Janeiro3069 (11.70)348 (11.34)15 (4.3)28 (8.0)13 (3.7)
Salvador1324 (5.04)230 (17.38)5 (2.2)19 (8.3)2 (0.9)
São Paulo2125 (8.10)358 (16.84)16 (4.5)37 (10.3)5 (1.4)
Total26,218 (100.00)2684 (10.24)87 (3.2)198 (7.4)43 (1.6)

The maximum number of users that signed up in one day occurred on May 30, 2014, the day that the app was officially launched by the Minister of Health during a press conference. During this event, the Minister of Health announced the special government program Health in the World Cup on national television media (Figure 1). On that date, 3633 logins were recorded, which accounted for more than half of all sign-ups across the entire duration of the study (50.78%, 3633/7155). Based on cost reduction efforts by the Brazilian government, this was the only advertising action that was undertaken for the app.

Most of the active users (3526/4706, 74.95%) installed the app on Android mobile devices, 1167 (1167/4706, 24.80%) were on Apple iOS mobile devices, and 13 (13/4706, 0.28%) were on desktop computers. Slightly more than half of all users were male (2478/4706, 52.66%). Users ranged in age from 13 to 77 years with a median of 32 years (only individuals aged 13 years and older were allowed to use the app; see Figure 2). Due to privacy rules, we were not allowed to collect nationality data. A total of 4661 users (4661/4706, 99.04%) preferred the app in Portuguese, 34 (34/4706, 0.72%) in Spanish, and 12 (12/4706, 0.25%) in English.

The intensity of participation in relation to the match dates of the Brazilian team and the World Cup calendar are illustrated in Figure 3 and Table 3, respectively. It should be emphasized that on the days the Brazilian team played (Figure 1) and in the second phase of the World Cup matches (Table 3), push notifications were sent to users through the app.

Table 3. Distribution of reports according to World Cup Saúde na Copa, 2014.
World Cup timeframeAll posts (reports)% (of total posts)Posts with symptoms% (of all posts during timeframe)
1. Pre-World Cup (May 12 - June 11)19,73741.22349017.68
2. Group phase (June 12 - 27)16,86835.2312417.36
3. Eighth finals (June 28 - July 3)37627.862175.77
4. Fourth finals (Jul 4 - 7)24385.091034.22
5. Semifinals (Jul 9 - 11)19103.991286.70
6. Finals (Jul 12 and 13)15333.20986.39
7. Post-World Cup (Jul 14 - 23)16313.41825.03
Total47,879100.00535911.19

Upon user authorization and if the device had an active global positioning system, the app automatically recorded the location of each post. Only 6.00% (2,824/47,879) of posts provided no location information. More than half of all posts were recorded in World Cup host cities (26,218/47,879, 54.76%; Table 2), 37.90% (18,146/47,879) were elsewhere in Brazil, and 1.40% (670/47,879) were in other countries. Table 2 also displays the locations with the highest number of known posts: Brasília (30.33%, 7951/26,218), Recife (16.46%, 4316/26,218), and Rio de Janeiro (11.71%, 3069/26,218), which together accounted for more than half (54.76%, 26,218/47,879) of all posts located in World Cup host cities. Among the 26,218 posts in World Cup host cities, the greatest number of symptoms were recorded in Brasilia (573 posts with symptoms), São Paulo (358 posts with symptoms), and Rio de Janeiro (348 posts with symptoms). Also among the 26,218 host city posts, the greatest frequency of symptoms proportionally were recorded in Salvador (17.38%, 230/1324), São Paulo (16.84%, 358/2125), and Cuiabá (15.60%, 173/1109).

Of the three syndromes detected by Healthy Cup (ie, respiratory, diarrheal, and rash), respiratory syndrome occurred with the greatest frequency based on reported symptoms. The greatest number of posts of respiratory syndromes were reported in São Paulo (n=37), Brasilia (n=37), and Rio de Janeiro (n=28). The highest frequencies of rash syndrome (ie, percentage of posts signaling rashes) were reported in Belo Horizonte (3.9%, 5/128), Rio de Janeiro (3.7%, 13/348), and Porto Alegre (2.7%. 3/113). The greatest number of diarrheal syndromes were reported in São Paulo (n=16), Rio de Janeiro (n=15), and Brasilia (n=14). The highest frequencies of diarrheal syndrome were reported in Curitiba (6.5%, 6/92), Belo Horizonte (5.5%, 7/128), Minas Gerais (5.5%, 7/128), and Porto Alegre (5.3%, 6/113). Finally, the greatest number of rash syndromes were reported in Rio de Janeiro (n=13), Brasilia (n=7), São Paulo (n=5), and Belo Horizonte (n=5).

Figure 1. Temporal distribution of posts by dates, Saúde na Copa, 2014.
View this figure
Figure 2. Distribution of users according to sex and age, Saúde na Copa, 2014.
View this figure
Figure 3. Spatial distribution of posts with and without symptoms during the period of launch of Saúde na Copa app until the end of the championship.
View this figure

Although the initial impact of the media was remarkable, with the greatest number of users signing up for Healthy Cup on the day the app was officially launched and first advertised on national television (Figure 1), this impact was not sustained even after 7 days of intense media (eg, television and websites) news about the app. The fact that the median age among those who signed up was 30 years suggests that this age group was more exposed to Healthy Cup promotion through television and website news [21,24,41,42]. The limited participation of foreigners (less than 1%) may reflect the limited language options of the app (English and Spanish) [24].

The increased number of posts during the Brazilian matches may be related to the sending of push notifications before those matches, which reminded participants to use the app [24,29]. The host city with the highest concentration of posts was Brasilia (30.33%, 7951/26,218), which may be related to the fact that Brasilia had the highest number of local news reports about the app.

More than half of all posts were recorded in World Cup host cities (54.76%, 26,218/47,879), suggesting that the app can be used as a tool to identify potential alerts for outbreaks associated with MGs [31-36]. The remaining 45.24% of posts (21,661/47,879) were recorded in cities elsewhere in Brazil (ie, other than the host cities of the World Cup), illustrating rapid penetration of the app across the country, even in states not hosting the FIFA World Cup 2014 [24].

Posts with six or more reported symptoms that were incompatible with the sought-after syndromes were considered spam reports. The higher prevalence of posts reported during the first two weeks (Figure 1) may be related to curiosity about this new type of tool being used in public health, with users wanting to record their health situation even if they were not showing symptoms [24].

Respiratory syndromes were reported more often than any other (Table 2), suggesting that the tool may have the capacity for early detection of epidemiological changes associated with influenza [41]. It is noteworthy that reports of bleeding and rash showed a high frequency of demand for health services [43,44].

The criteria used to classify syndromes (ie, based on parameters used by the Ministry of Health’s Secretariat of Health Surveillance) may have underestimated the number of users with any of the three syndromes (ie, respiratory, diarrheal, or rash) [45]. However, during this same time period, the official Health Surveillance System (at the Ministry of Health) routinely used by the Integrated Health Center of Joint Operations did not identify the occurrence of any public health emergency events (ie, syndromic clusters) warranting intervention. Thus, data and findings from the Healthy Cup platform were validated by traditional sources.

Conclusions

Participatory surveillance through community engagement is an innovative way to conduct epidemiological surveillance. Compared to traditional epidemiological surveillance, the advantages of participatory surveillance include its lower cost for data acquisition, timeliness of information collected and shared, platform scalability, and capacity for integration between the population being served and public health services.

The pilot of the Healthy Cup app during the FIFA World Cup 2014 allowed us to evaluate the potential for participatory surveillance in Brazil. Based on our results, participatory surveillance appears to have the potential to become a routine component of national health surveillance and to help improve the early detection of outbreaks and epidemics, timely intervention, and risk minimization. The Healthy Cup platform in particular appears to be sensitive to multiple symptoms and syndromes associated with a range of potential threats.

We also learned several lessons from our piloting experience, including the idea that investment in communication, marketing, and advertising is necessary to penetrate multiple social strata (eg, different age groups) and to reach as many users as possible. Relying on spontaneous media (ie, news and nonpaid ads) and press conferences alone limited use of the app to consumer groups that seek out this specific type of information. Investment in digital media could create a great opportunity to not only boost the number of users, but also enhance the engagement of users.

Another lesson learned is the need for reciprocity. Citizens may feel more motivated to participate if they receive something in return, such as information about diseases that are being reported in their area. This information could be sent back to users on maps or via specific screens within the app. Providing population-level information in return for individual participation could ensure continuous engagement with the app, which would improve data quality. The value of reciprocity should be tested in future MG participatory surveillance scenarios.

The Healthy Cup app served as the basis for the Guardians of Health (Guardiões da Saúde) participatory surveillance app that was used during the Olympic and Paralympic games in Brazil. An additional lesson learned through use of Guardians of Health is the importance of the need for clear expectations of a government’s role in participatory surveillance. Some governments may not have dedicated teams to examine and interpret data generated through participatory surveillance. This issue underscores the importance of designing an intuitive platform that generates easily-visualized data.

Acknowledgments

This work was funded by a grant from Skoll Global Threats Fund, mediated by TEPHINET. We would like to especially thank Rodrigo Carneiro, Dennis Calazans, Lucas Medeiros, Gustavo Almeida, Thulio Philipe, Tulio Assis, Geraldo Augusto, and Cesar Albuquerque.

Authors' Contributions

OBLN organized and conceived of the paper, and analyzed and wrote the first and final versions of the paper. GSD conceived of analysis plans and analyzed the data. ML critically reviewed the paper. WKO conceptualized the aims. WS and EC conceptualized the aims, and reviewed the paper and intellectual content. MS and JA reviewed the paper and intellectual content. All authors read and approved the final manuscript.

Conflicts of Interest

None declared.

  1. Memish Z, Stephens G, Al Rabeeah A. Mass gatherings health. Lancet Infect Dis 2012;3099(11):10. [CrossRef]
  2. Johansson A, Batty M, Hayashi K, Al Bar O, Marcozzi D, Memish ZA. Crowd and environmental management during mass gatherings. Lancet Infect Dis 2012 Feb;12(2):150-156 [FREE Full text] [CrossRef] [Medline]
  3. Abubakar I, Gautret P, Brunette GW, Blumberg L, Johnson D, Poumerol G, et al. Global perspectives for prevention of infectious diseases associated with mass gatherings. Lancet Infect Dis 2012 Jan;12(1):66-74. [CrossRef] [Medline]
  4. Memish ZA, Stephens GM, Steffen R, Ahmed QA. Emergence of medicine for mass gatherings: lessons from the Hajj. Lancet Infect Dis 2012 Jan;12(1):56-65. [CrossRef] [Medline]
  5. Steffen R, Bouchama A, Johansson A, Dvorak J, Isla N, Smallwood C, et al. Non-communicable health risks during mass gatherings. Lancet Infect Dis 2012 Feb;12(2):142-149. [CrossRef] [Medline]
  6. Deris ZZ, Hasan H, Sulaiman SA, Wahab MS, Naing NN, Othman NH. The prevalence of acute respiratory symptoms and role of protective measures among Malaysian hajj pilgrims. J Travel Med 2010;17(2):82-88 [FREE Full text] [CrossRef] [Medline]
  7. Khan K, Freifeld CC, Wang J, Mekaru SR, Kossowsky D, Sonricker AL, et al. Preparing for infectious disease threats at mass gatherings: the case of the Vancouver 2010 Olympic Winter Games. CMAJ 2010 Apr 06;182(6):579-583 [FREE Full text] [CrossRef] [Medline]
  8. Noël H, Rizzo C. Spread of chikungunya from the Caribbean to mainland Central and South America: a greater risk of spillover in Europe? Euro Surveill 2014 Jul 17;19(28):20855. [Medline]
  9. Donalisio MR, Freitas AR. Chikungunya in Brazil: an emerging challenge. Rev Bras Epidemiol 2015 Mar;18(1):283-285 [FREE Full text] [CrossRef] [Medline]
  10. Dyer O. Zika virus spreads across Americas as concerns mount over birth defects. BMJ 2015 Dec 23;351:h6983. [Medline]
  11. World Health Organization. International Health Regulations 2005 2nd Edition. Geneva: World Health Organization; 2005.
  12. Bogich TL, Chunara R, Scales D, Chan E, Pinheiro LC, Chmura AA, et al. Preventing pandemics via international development: a systems approach. PLoS Med 2012;9(12):e1001354 [FREE Full text] [CrossRef] [Medline]
  13. Christakis NA, Fowler JH. Social network sensors for early detection of contagious outbreaks. PLoS One 2010;5(9):e12948 [FREE Full text] [CrossRef] [Medline]
  14. Chan EH, Brewer TF, Madoff LC, Pollack MP, Sonricker AL, Keller M, et al. Global capacity for emerging infectious disease detection. Proc Natl Acad Sci U S A 2010 Dec 14;107(50):21701-21706 [FREE Full text] [CrossRef] [Medline]
  15. Brownstein JS, Freifeld CC, Madoff LC. Digital disease detection--harnessing the Web for public health surveillance. N Engl J Med 2009 May 21;360(21):2153-5, 2157 [FREE Full text] [CrossRef] [Medline]
  16. Brownstein JS, Freifeld CC. HealthMap: the development of automated real-time Internet surveillance for epidemic intelligence. Euro Surveill 2007 Nov 29;12(11):E071129.5 [FREE Full text] [Medline]
  17. Madoff LC, Woodall JP. The Internet and the global monitoring of emerging diseases: lessons from the first 10 years of ProMED-mail. Arch Med Res 2005;36(6):724-730. [CrossRef] [Medline]
  18. Chew C, Eysenbach G. Pandemics in the age of Twitter: content analysis of Tweets during the 2009 H1N1 outbreak. PLoS One 2010;5(11):e14118 [FREE Full text] [CrossRef] [Medline]
  19. Signorini A, Segre AM, Polgreen PM. The use of Twitter to track levels of disease activity and public concern in the U.S. during the influenza A H1N1 pandemic. PLoS One 2011;6(5):e19467 [FREE Full text] [CrossRef] [Medline]
  20. Salathé M, Bengtsson L, Bodnar TJ, Brewer DD, Brownstein JS, Buckee C, et al. Digital epidemiology. PLoS Comput Biol 2012;8(7):e1002616 [FREE Full text] [CrossRef] [Medline]
  21. Freifeld CC, Chunara R, Mekaru SR, Chan EH, Kass-Hout T, Ayala IA, et al. Participatory epidemiology: use of mobile phones for community-based health reporting. PLoS Med 2010 Dec 07;7(12):e1000376 [FREE Full text] [CrossRef] [Medline]
  22. Keller M, Blench M, Tolentino H, Freifeld CC, Mandl KD, Mawudeku A, et al. Use of unstructured event-based reports for global infectious disease surveillance. Emerg Infect Dis 2009 May;15(5):689-695 [FREE Full text] [CrossRef] [Medline]
  23. Paolotti D, Carnahan A, Colizza V, Eames K, Edmunds J, Gomes G, et al. Web-based participatory surveillance of infectious diseases: the Influenzanet participatory surveillance experience. Clin Microbiol Infect 2014 Jan;20(1):17-21 [FREE Full text] [CrossRef] [Medline]
  24. Oliveira W, Dimech GS, Leal-Neto OB, Libel M, Smolinski M. The world’s first application of participatory surveillance at a mass gathering: FIFA World Cup 2014, Brazil. 2014 Presented at: International Meeting on Emerging Diseases and Surveillance 2014; Nov 1 2014; Vienna, Austria p. 44.
  25. Observatório da Dengue. 2017.   URL: http://observatorio.inweb.org.br/dengue/conteudo/inicial%3E [accessed 2017-04-04] [WebCite Cache]
  26. Leal-Neto OB, Dimech GS, Libel M, Oliveira W, Ferreira JP. Digital disease detection and participatory surveillance: overview and perspectives for Brazil. Rev Saude Publica 2016;50:17 [FREE Full text] [CrossRef] [Medline]
  27. Dengue na Web. 2017.   URL: http://www.denguenaweb.org/projeto%3E [accessed 2017-04-04] [WebCite Cache]
  28. Wójcik OP, Brownstein JS, Chunara R, Johansson MA. Public health for the people: participatory infectious disease surveillance in the digital age. Emerg Themes Epidemiol 2014;11:7 [FREE Full text] [CrossRef] [Medline]
  29. Eysenbach G. Infodemiology and infoveillance: framework for an emerging set of public health informatics methods to analyze search, communication and publication behavior on the Internet. J Med Internet Res 2009;11(1):e11 [FREE Full text] [CrossRef] [Medline]
  30. Chunara R, Smolinski MS, Brownstein JS. Why we need crowdsourced data in infectious disease surveillance. Curr Infect Dis Rep 2013 Aug;15(4):316-319 [FREE Full text] [CrossRef] [Medline]
  31. Jost CC, Mariner JC, Roeder PL, Sawitri E, Macgregor-Skinner GJ. Participatory epidemiology in disease surveillance and research. Rev Sci Tech 2007 Dec;26(3):537-549. [Medline]
  32. Brockmann S, Piechotowski I, Bock-Hensley O, Winter C, Oehme R, Zimmermann S, et al. Outbreak of leptospirosis among triathlon participants in Germany, 2006. BMC Infect Dis 2010 Apr 10;10:91 [FREE Full text] [CrossRef] [Medline]
  33. Pfaff G, Lohr D, Santibanez S, Mankertz A, van Treeck U, Schonberger K, et al. Spotlight on measles 2010: Measles outbreak among travellers returning from a mass gathering, Germany, September to October 2010. Euro Surveill 2010 Dec 16;15(50) [FREE Full text] [Medline]
  34. Schmid D, Holzmann H, Alfery C, Wallenko H, Popow-Kraupp TH, Allerberger F. Mumps outbreak in young adults following a festival in Austria, 2006. Euro Surveill 2008 Feb 14;13(7) [FREE Full text] [Medline]
  35. Centers for Disease Control and Prevention (CDC). Update: outbreak of acute febrile illness among athletes participating in Eco-Challenge-Sabah 2000--Borneo, Malaysia, 2000. MMWR Morb Mortal Wkly Rep 2001 Jan 19;50(2):21-24 [FREE Full text] [Medline]
  36. Wilder-Smith A, Earnest A, Ravindran S, Paton NI. High incidence of pertussis among Hajj pilgrims. Clin Infect Dis 2003 Nov 01;37(9):1270-1272 [FREE Full text] [CrossRef] [Medline]
  37. PhoneGap. Adobe Systems Inc. 2016.   URL: http://phonegap.com/ [accessed 2017-04-04] [WebCite Cache]
  38. Google. Google Developers Consoles. 2017.   URL: https:/​/accounts.​google.com/​ServiceLogin?service=cloudconsole&ltmpl=api&osid=1&passive=true&continue=https:/​/console.​developers.google.com/​ [accessed 2017-04-04] [WebCite Cache]
  39. Twitter APIs. Twitter Developers. Disponível em   URL: https://dev.twitter.com/ [WebCite Cache]
  40. DreamHost. DreamHost. 2017.   URL: http://www.dreamhost.com/ [accessed 2017-04-16] [WebCite Cache]
  41. Chunara R, Freifeld CC, Brownstein JS. New technologies for reporting real-time emergent infections. Parasitology 2012 Dec;139(14):1843-1851 [FREE Full text] [CrossRef] [Medline]
  42. Debin M, Turbelin C, Blanchon T, Bonmarin I, Falchi A, Hanslik T, et al. Evaluating the feasibility and participants' representativeness of an online nationwide surveillance system for influenza in France. PLoS One 2013;8(9):e73675 [FREE Full text] [CrossRef] [Medline]
  43. Eysenbach G. SARS and population health technology. J Med Internet Res 2003;5(2):e14 [FREE Full text] [CrossRef] [Medline]
  44. Collier N, Son NT, Nguyen NM. OMG U got flu? Analysis of shared health messages for bio-surveillance. J Biomed Semantics 2011;2 Suppl 5:S9 [FREE Full text] [CrossRef] [Medline]
  45. Patterson-Lomba O, Van Noort NS, Cowling BJ, Wallinga J, Gomes MG, Lipsitch M, et al. Utilizing syndromic surveillance data for estimating levels of influenza circulation. Am J Epidemiol 2014 Jun 01;179(11):1394-1401 [FREE Full text] [CrossRef] [Medline]


API: Application Program Interface
FIFA: Fédération Internationale de Football Association
IHR: International Health Regulation
MG: mass gathering


Edited by T Sanchez; submitted 12.01.17; peer-reviewed by E Yom-Tov, D Bateman; comments to author 16.02.17; revised version received 23.02.17; accepted 20.03.17; published 04.05.17

Copyright

©Onicio Leal Neto, George Santiago Dimech, Marlo Libel, Wayner Vieira de Souza, Eduarda Cesse, Mark Smolinski, Wanderson Oliveira, Jones Albuquerque. Originally published in JMIR Public Health and Surveillance (http://publichealth.jmir.org), 04.05.2017.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Public Health and Surveillance, is properly cited. The complete bibliographic information, a link to the original publication on http://publichealth.jmir.org, as well as this copyright and license information must be included.