Viewpoint
Abstract
Globally, millions of lives are impacted every year by infectious diseases outbreaks. Comprehensive and innovative surveillance strategies aiming at early alert and timely containment of emerging and reemerging pathogens are a pressing priority. Shortcomings and delays in current pathogen surveillance practices further disturbed informing responses, interventions, and mitigation of recent pandemics, including H1N1 influenza and SARS-CoV-2. We present the design principles of the architecture for an early-alert surveillance system that leverages the vast available data landscape, including syndromic data from primary health care, drug sales, and rumors from the lay media and social media to identify areas with an increased number of cases of respiratory disease. In these potentially affected areas, an intensive and fast sample collection and advanced high-throughput genome sequencing analyses would inform on circulating known or novel pathogens by metagenomics-enabled pathogen characterization. Concurrently, the integration of bioclimatic and socioeconomic data, as well as transportation and mobility network data, into a data analytics platform, coupled with advanced mathematical modeling using artificial intelligence or machine learning, will enable more accurate estimation of outbreak spread risk. Such an approach aims to readily identify and characterize regions in the early stages of an outbreak development, as well as model risk and patterns of spread, informing targeted mitigation and control measures. A fully operational system must integrate diverse and robust data streams to translate data into actionable intelligence and actions, ultimately paving the way toward constructing next-generation surveillance systems.
JMIR Public Health Surveill 2024;10:e47673doi:10.2196/47673
Keywords
Introduction
Overview
The COVID-19 pandemic has illustrated the limited capabilities of existing surveillance systems worldwide and the need to maximize the use of data to inform public health decisions [
, ]. Among the lessons learned from the pandemic is the critical importance of leveraging early alert warning capabilities to detect and respond to emerging and reemerging pathogens before they cause widespread impact. Unfortunately, existing global surveillance systems are often fragmented, lack coordination and collaboration, and do not prioritize early alerts [ , ]. This has resulted in millions of lives lost due to outbreaks of infectious diseases that usually occur following spillover from contacts at the animal-human interface. Therefore, as governments, civil society, and private entities continue to recover from the losses incurred by the COVID-19 pandemic, it is crucial to sustain the momentum generated by this global crisis and prioritize efforts to elevate health surveillance to the next level.Developing a system focused on early warning tools is a fundamental requirement to enhance pandemic preparedness and response [
, ]. By investing in disease surveillance systems and building resilient health systems, countries can better prevent, detect, and respond to infectious diseases and other health threats. In this endeavor, we should take advantage of the improvements in several branches of technology and science, in particular digitalization of health routine records, data science, and artificial intelligence modeling, for the rapid gathering and analysis of large amounts of diverse data streams [ , , ]. Next-generation early-alert warning systems should prioritize sensitivity by integrating various data streams for syndromic surveillance, as opposed to relying on traditional case reports. Additionally, achieving specificity through molecular pathogen characterization is crucial for efficient preemptive actions ( A). However, the process of collecting and analyzing samples is complex and expensive. To optimize logistics and reduce costs, it is recommended to identify priority areas for sample collection through risk assessment based on syndromic surveillance.To inform the development of next-generation surveillance systems, here we outline key principles and requirements that should be addressed for creating a comprehensive and effective approach to disease monitoring. We instantiate these principles into the Alert-Early System for Outbreaks with Pandemic Potential (ÆSOP)—a system under development in Brazil that aims to improve the surveillance capacity and pandemic preparedness of this country.
Preparing for the Next Pandemic by Harnessing the Power of Data
Many countries, Brazil included, have now established national digital systems that capture routine health information, such as clinical consultations at the primary health care (PHC) level, hospital admissions, and drug prescriptions, and the COVID-19 pandemic has also accelerated integration of these digital systems within health systems and networks [
- ]. The next generation of surveillance systems should leverage this existing and emerging rich data landscape and integrate health routine databases with alternate data streams.In ÆSOP, early warning will be achieved by monitoring of clinical-related data, which enables the mining of potentially anomalous patterns, such as unexpected surges of respiratory diseases outside the expected seasonality or in atypical age groups or locations (
B). More specifically, PHC weekly visits coded by reason for encounter, as well as drug sales related to acute respiratory syndromes and social media interactions will be monitored. Brazil’s national PHC database, SISAB (Information System for Primary Health Care; in Portuguese, Sistema de Informação em Saúde para a Atenção Básica), harbors data on the majority of public-funded PHC encounters in the country [ ], coded by either the International Classification of Diseases or the International Classification of Primary Care, with 5535 out of 5570 municipalities reporting to SISAB in 2020, corresponding to 98.5% of the total Brazilian population for that year. Complementary, drug sales data encompasses approximately 95% of all drug sales in Brazil. Continuous monitoring of clinical-related data streams in ÆSOP will enable the system to detect shifts in patterns, which can signal potential outbreaks. By issuing anticipatory warnings to health authorities, the system aims to provide early and timely alerts, as severe cases are not expected to be reported until days or weeks after an increase in mild cases seeking PHC assistance [ , ]. A proof-of-concept evaluating the early-warning capability performance of the system was conducted in Brazil, totaling over 589 million patient visits to PHC facilities between 2017-2020 in 97% of Brazilian municipalities [ ]. Of these visits, 4.24% were associated with upper respiratory infections, and results showed that rises in patient consultation in PHC encounters for respiratory disease were able to anticipate increases of severe acute respiratory syndromes, with geographical variabilities [ ]. In a retrospective analysis conducted with data from Bahia, a state with 14.8 million inhabitants in the Northeast region, PHC syndromic monitoring was able to detect COVID-19 entry in 20 out of 21 regions of the state at least 1 week before the rise in COVID-19 cases, showing feasibility for use of the system [ ]. The system can also be adapted to the monitoring of other syndromes, such as dengue-like illnesses, by reparametrizing the codes for reason for encounter and drugs used to treat these diseases. This flexibility by design is a key feature that enables the system to be customized to the specific needs of different regions and populations.Different modeling frameworks were developed and applied to health data aiming at the early detection of outbreaks [
- ], including statistical, mathematical, and computational methods. Although some of them are in use in the routine of health surveillance agencies [ , ], to the best of our knowledge none has been adopted as a gold standard of undoubtedly effectiveness. However, all methods have limitations, and further developments are still needed in this field [ - ]. The proposal described herein aims to combine several approaches in a systemic logical approach combining their strengths. presents general features of traditional health surveillance in comparison to what we envision would make a next-generation surveillance system (exemplified by ÆSOP) that overcomes identified deficiencies which hamper pandemic preparedness and response.Characteristic | Traditional surveillance | Next-generation surveillance |
Data sources | Largely focused on notifiable diseases, clinical and laboratory reports, but can also include sentinel surveillance, registries, surveys, and administrative data systems | Expands these streams to include syndromic data, drug sales, social media, rumors on news outlets and in the digital world, and can be fit to distinct syndromes and to accommodate country-specific data assets |
Data integration | Limited integration of different data streams | Integrates diverse data streams, enabling a comprehensive view |
Data sharing | Limited sharing of data between countries and agencies | Encourages data sharing within a federated approach, allowing for global data collaboration without compromising sovereignty |
Interoperability | Limited interoperability between different health agencies and stakeholders due to lack of standards | Promotes collaboration among various entities by leveraging standardized vocabularies or ontologies |
Early alerting | Typically relies on case reports and may lead to delayed detection | Uses syndromic data for early alerting, enhancing timely outbreak detection |
Flexibility | Often lacks adaptability for different syndromes or regions | Designed with flexibility to target various syndromes |
Molecular analysis (pathogen specificity) | Focuses on traditional laboratory-based pathogen analysis | High-throughput metagenomics for rapid pathogen characterization at specific regions informed by syndromic monitoring |
This approach should overcome current public health response limitations, as digital health has been recognized as a critical element [
] and an emerging discipline to prepare for, prevent, and respond to pandemics [ , ], while the syndromic surveillance approach will allow for greater sensitivity [ ]. It is also of great importance that this monitoring tool is built over existing systems, as we aim for cost-effectiveness, and no additional burden should be added to already overwrought health systems. The system aims to complement traditional surveillance methods, which in Brazil rely mainly on the mandatory notification of suspected cases of priority diseases listed by the Ministry of Health, a usually paper-based process that often incurs in notification delays.Combining Digital and Molecular Approaches for Achieving Both Sensitivity and Specificity
Genomics-enabled pathogen discovery has been proposed as a game changer for infectious disease surveillance, which some—optimistically—refer to as “not yet a panacea” [
]. The genomics component of ÆSOP, however, leverages sequencing power to provide pathogen specificity for the system at a later stage, rather than initially. By building upon the existing digitally informed streams of syndromic surveillance, which allows for “broad, but swift” monitoring, and using its output to pinpoint areas for the pathogen identification strategy continuously, ÆSOP aims to equate the costs associated with real-time event monitoring paralleled with targeted genomics. With further reduction of DNA sequencing costs in developing countries, metagenomics may become a key epidemiological tool for rapid pathogen identification.Alerts generated by clinical-related data will be used internally to activate site-directed genomic analysis for pathogen identification. This will allow for optimizing the logistic strategy for obtaining and analyzing samples. For instance, once a signal of a potential outbreak is identified, field teams will collect clinical samples that undergo molecular characterization for pathogen identification over a small area (
C). A major challenge in the system is the timely transportation of samples to the processing sites. In large countries with logistic hindrances, it is important to have decentralized sequencing sites for shortening transportation delays. ÆSOP will leverage and use the capillarity of the existing Brazilian Genomic Network facilities, such as that induced by Fiocruz during the COVID-19 pandemic [ ], the National Network of Health Surveillance Laboratories, and others to speed-up the identification of circulating pathogens. Similar networks have been established in other countries as well, including the COVID-19 Genomics UK Consortium [ ], the Indian SARS-CoV-2 Genomic Consortium [ ], and the Africa Pathogen Genomics Initiative [ ], among others. These initiatives have proven to be valuable in the response against SARS-CoV-2, providing critical insights into the spread and evolution of the virus. As the number of COVID-19 cases continues to decrease in many countries, it is vital that these networks are strengthened and expanded to ensure that they can be used as an essential component of next-generation surveillance systems, allowing for identification of pathogens behind potential outbreaks.This integrated approach combines both data- and hypothesis-driven disease surveillance approaches, enabling quick identification of anomalies through syndromic surveillance using a combination of bona fide health data and alternative data streams (data-driven approach); once anomalies are identified, targeted sample collection and modeling (hypothesis-driven approach) can be used to confirm the outbreak and determine appropriate actions. To generate risk maps, computational models will integrate socioeconomic, environmental, and mobility and transportation data. Additionally, mathematical models coupled with artificial intelligence and machine learning methods will enable the assessment of risk and routes of outbreak spread (
B and 1C).Data Security, Privacy, and Trust
Another unique feature of ÆSOP is the use of a defined methodology for the collection, linkage, and use of relevant and appropriate data. We will use, extract, transform, and load protocols [
] for capturing and standardizing data from different sources, and machine learning methods for feature engineering and longitudinal multimodal data integration. To ensure the security and privacy of data, ÆSOP will follow strict legal and ethical guidelines established by the Center of Data and Knowledge Integration for Health, which has already implemented robust rules and regulations for working with health data, based on global best practices [ ]. This approach will ensure that ÆSOP not only provides early warning surveillance for outbreaks of epidemic or pandemic potential but also protects the confidentiality of individuals’ health information.To ensure the responsible use of data, all information collected will be subject to rigorous digital curation procedures and preserved according to established standards [
]. The resulting deidentified and aggregated data will be made available to health authorities and the scientific community through an application programming interface, allowing for integration with other relevant data sources. This comprehensive set of spatially integrated health, environmental, social, and contextual data has the potential to be a valuable resource for research and other purposes beyond outbreak surveillance.Fit for Purpose
An essential aspect of ÆSOP is its development in close collaboration with stakeholders and end users, ensuring its adoption by health authorities and successful implementation in mitigating and preventing outbreaks. We have collected feedback and identified key requirements from end users to inform rapid response, by convening workshops and focused meetings. Ultimately, these will lead to creating and fostering local/regional communities of practice for surveillance that will involve end users and other stakeholders in the development and implementation of surveillance systems, inspired by previous experiences such as the US Centers for Disease Control and Prevention’s National Syndromic Surveillance Program [
]. These communities will provide a platform for sharing experiences, challenges, and best practices in surveillance, and will serve as a valuable source of feedback for improving the system. By engaging with end users in this way, we aim to create a sense of ownership and investment in the system, which is crucial for ensuring its long-term success and sustainability through adoption.Balancing Surveillance Data Sharing Needs With Data Sovereignty Concerns Using a Federated Approach
A critical lesson learned from responding to the COVID-19 pandemic is the need to build trust between governments, organizations, and societies to facilitate the early sharing of accurate information for responsive global health surveillance [
, ]. However, individuals’ privacy and data sovereignty concerns cannot be ignored. While balancing these necessities is not trivial, we understand that finding a solution to safely share information to guide decisions and provide global health security is crucial. In this sense, federated approaches represent a feasible solution that balances the need for data sharing with the need to protect data privacy and sovereignty ( ). By allowing data owners to maintain control over their data, a federated system can help encourage collaboration between organizations, with sharing occurring only on a need-to-know basis. This is particularly relevant in health surveillance, where potentially sensitive data are involved.A subset of the federated approach, federated learning enables independently built models to be trained on distributed data sets without sharing of raw data; then, an updated model is sent back to a central server to be aggregated with other models, and by iteratively exchanging parameters a globally refined model emerges [
]. This allows for the development of a more robust and accurate model while preserving data privacy. Combined, federated approaches provide a powerful solution for meeting the swift exchange of information under the International Health Regulations while also ensuring compliance with local legislation on individual privacy. Common data models and standards are necessary to ensure that data can be exchanged, integrated, and analyzed effectively across different sites [ ].Conclusions
The COVID-19 pandemic, and those before it, evidenced the need for substantial improvements in pandemic preparedness and response, globally. We presented key features and essential building blocks of the ÆSOP system—a system being developed with a combination of data-driven and hypothesis-driven infectious disease surveillance approach for early-alert identification of areas with significant risk of reemergence of infectious disease outbreaks. ÆSOP aims to accurately anticipate an outbreak when compared to currently in-place surveillance systems. Moreover, ÆSOP’s reports should enable precision public health strategies, such as targeted early outbreak mitigation and response strategies, as well as site-directed sample collection for pathogen molecular characterization, thus improving logistics and enhancing responses. To ensure that next-generation surveillance systems will properly meet public health needs, and to obtain a broader perspective of possibilities and bottlenecks, active engagement and cocreation processes with stakeholders, end users, and multidisciplinary experts will be essential and key to building and refining enhanced surveillance systems. Final, we are aware of the revision of the International Health Regulations and the preparation of the Pandemic Treaty, for eventual adaptation of ÆSOP to these rules.
Acknowledgments
ÆSOP is under development by Brazil’s Fundação Oswaldo Cruz (Fiocruz) and the Federal University of Rio de Janeiro in a cocreation partnership with the Rockefeller Foundation’s Health Initiative. We acknowledge the representatives of the Secretariat of Health Surveillance (SVS-A, Ministry of Health, Brazil), the Brazilian Health Regulatory Agency (Anvisa), the National Council of Municipal Health Secretariats (Conasems), the Pan American Health Organization, and the Gorgas Memorial Institute for their thoughtful inputs during a Visioning Workshop held in Bahia. The initial concept development of ÆSOP was supported by Fundação Oswaldo Cruz (Fiocruz). The System Visioning workshop in Bahia was funded and co-organized by The Rockefeller Foundation. We thank Andres Marquez-Lara, Felipe Abreu, Jessica Fan, and Sarah Forrester-Wilson from UFacilitate team for inputs during the workshop organization and event facilitation. The valuable inputs from Krista Mizenko to the project are also acknowledged. The funders did not interfere in the decision to submit the manuscript for publication. Figures were created with BioRender and are published under permission. Details are provided in
regarding the “ÆSOP Collaborating Teams.”Data Availability
Data sharing is not applicable to this article as no data sets were generated or analyzed during this study.
Authors' Contributions
MB-N is responsible for the conceptualization and coordination of ÆSOP. PIPR wrote the original manuscript draft with input from IM, AIB, KvdH, and MB-N. All authors reviewed and edited the manuscript for intellectual content. All authors reviewed and approved the final version of the manuscript.
Conflicts of Interest
None declared.
List of members of the ÆSOP Collaborating Teams.
DOCX File , 21 KBReferences
- Al Knawy B, Adil M, Crooks G, Rhee K, Bates D, Jokhdar H, et al. The Riyadh declaration: the role of digital health in fighting pandemics. Lancet. 2020;396(10262):1537-1539. [FREE Full text] [CrossRef] [Medline]
- Morgan OW, Aguilera X, Ammon A, Amuasi J, Fall IS, Frieden T, et al. Disease surveillance for the COVID-19 era: time for bold changes. Lancet. 2021;397(10292):2317-2319. [FREE Full text] [CrossRef] [Medline]
- Communication from the Commission to the European Parliament, the European Council, the Council, the European Economic and Social Committee and the Committee of the Regions. European Commission. 2021. URL: https://www.astrid-online.it/static/upload/comm/0000/communication150621.pdf [accessed 2023-12-13]
- Xu L, Zhou C, Luo S, Chan DK, McLaws ML, Liang W. Modernising infectious disease surveillance and an early-warning system: the need for China's action. Lancet Reg Health West Pac. 2022;23:100485. [FREE Full text] [CrossRef] [Medline]
- Zhang H, Wang L, Lai S, Li Z, Sun Q, Zhang P. Surveillance and early warning systems of infectious disease in China: from 2012 to 2014. Int J Health Plann Manage. 2017;32(3):329-338. [CrossRef] [Medline]
- Huang MZ, Gibson CJ, Terry AL. Measuring electronic health record use in primary care: a scoping review. Appl Clin Inform. 2018;9(1):15-33. [FREE Full text] [CrossRef] [Medline]
- Mulholland RH, Vasileiou E, Simpson CR, Robertson C, Ritchie LD, Agrawal U, et al. Cohort profile: early pandemic evaluation and enhanced surveillance of COVID-19 (EAVE II) database. Int J Epidemiol. 2021;50(4):1064-1074. [FREE Full text] [CrossRef] [Medline]
- Albhaisi S, Wenzel RP. The value of medical registries and observational studies early in pandemics: the coronavirus disease 2019 (COVID-19) experience. Clin Infect Dis. 2022;74(6):1112-1116. [FREE Full text] [CrossRef] [Medline]
- Sellera PEG, Pedebos LA, Harzheim E, de Medeiros OL, Ramos LG, Martins C, et al. Monitoring and evaluation of primary health care attributes at the national level: new challenges. Cien Saude Colet. 2020;25(4):1401-1412. [FREE Full text] [CrossRef] [Medline]
- Holmes EC, Rambaut A, Andersen KG. Pandemics: spend on surveillance, not prediction. Nature. 2018;558(7709):180-182. [CrossRef] [Medline]
- de Araújo Oliveira A, Sironi A, Florentino PTV, Marcilio I, Cerqueira-Silva T, Flores-Ortiz R, et al. Syndromic detection of upper respiratory infections in primary healthcare as a candidate for COVID-19 early warning in Brazil: a retrospective ecological study. SSRN Journal. Preprint posted online on February 24 2023. [FREE Full text] [CrossRef]
- Cerqueira-Silva T, Marcilio I, de Araújo Oliveira V, Florentino PTV, Penna GO, Ramos PIP, et al. Early detection of respiratory disease outbreaks through primary healthcare data. J Glob Health. 2023;13:04124. [FREE Full text] [CrossRef] [Medline]
- Lewis MD, Pavlin JA, Mansfield JL, O'Brien S, Boomsma LG, Elbert Y, et al. Disease outbreak detection system using syndromic data in the greater Washington DC area. Am J Prev Med. 2002;23(3):180-186. [CrossRef] [Medline]
- Lazarus R, Kleinman K, Dashevsky I, Adams C, Kludt P, DeMaria A, et al. Use of automated ambulatory-care encounter records for detection of acute illness clusters, including potential bioterrorism events. Emerg Infect Dis. 2002;8(8):753-760. [FREE Full text] [CrossRef] [Medline]
- Vega T, Lozano JE, Meerhoff T, Snacken R, Beauté J, Jorgensen P, et al. Influenza surveillance in Europe: comparing intensity levels calculated using the moving epidemic method. Influenza Other Respir Viruses. 2015;9(5):234-246. [FREE Full text] [CrossRef] [Medline]
- Noufaily A, Enki DG, Farrington P, Garthwaite P, Andrews N, Charlett A. An improved algorithm for outbreak detection in multiple surveillance systems. Stat Med. 2013;32(7):1206-1222. [CrossRef] [Medline]
- Hashimoto S, Murakami Y, Taniguchi K, Nagai M. Detection of epidemics in their early stage through infectious disease surveillance. Int J Epidemiol. 2000;29(5):905-910. [FREE Full text] [CrossRef] [Medline]
- World Health Organization. Global Strategy on Digital Health 2020-2025. Geneva. WHO; 2021.
- Mandl KD, Overhage JM, Wagner MM, Lober WB, Sebastiani P, Mostashari F, et al. Implementing syndromic surveillance: a practical guide informed by the early experience. J Am Med Inform Assoc. 2004;11(2):141-150. [FREE Full text] [CrossRef] [Medline]
- Gardy JL, Loman NJ. Towards a genomics-informed, real-time, global pathogen surveillance system. Nat Rev Genet. 2018;19(1):9-20. [FREE Full text] [CrossRef] [Medline]
- SARS-CoV-2. Fiocruz Genomic Network. URL: http://www.genomahcov.fiocruz.br/ [accessed 2023-03-26]
- COVID-19 Genomics UK Consortium. URL: https://www.cogconsortium.uk/ [accessed 2023-03-01]
- Indian SARS-CoV-2 Genomics Consortium (INSACOG). URL: https://inda.rcb.ac.in/insacog/statisticsinsacog [accessed 2023-03-01]
- Africa Pathogen Genomics Initiative (Africa PGI). URL: https://africacdc.org/africa-pathogen-genomics-initiative-africa-pgi/ [accessed 2023-12-19]
- Vassiliadis P, Simitsis A, Skiadopoulos S. Conceptual modeling for ETL processes. New York, NY, US. Association for Computing Machinery; Presented at: DOLAP '02: Proceedings of the 5th ACM international workshop on Data Warehousing and OLAP; November 8, 2002, 2002;14-21; McLean, Virginia, UA. [CrossRef]
- Barreto ML, Ichihara MY, Almeida BA, Barreto ME, Cabral L, Fiaccone RL, et al. The Centre for Data and Knowledge Integration for Health (CIDACS): linking health and social data in Brazil. Int J Popul Data Sci. 2019;4(2):1140. [FREE Full text] [CrossRef] [Medline]
- Gould DW, Walker D, Yoon PW. The evolution of BioSense: lessons learned and future directions. Public Health Rep. 2017;132(1_suppl):7S-11S. [FREE Full text] [CrossRef] [Medline]
- Vaid A, Jaladanki SK, Xu J, Teng S, Kumar A, Lee S, et al. Federated learning of electronic health records to improve mortality prediction in hospitalized patients with COVID-19: machine learning approach. JMIR Med Inform. 2021;9(1):e24207. [FREE Full text] [CrossRef] [Medline]
- Junior EPP, Normando P, Flores-Ortiz R, Afzal MU, Jamil MA, Bertolin SF, et al. Integrating real-world data from Brazil and Pakistan into the OMOP common data model and standardized health analytics framework to characterize COVID-19 in the Global South. J Am Med Inform Assoc. 2023;30(4):643-655. [FREE Full text] [CrossRef] [Medline]
Abbreviations
ÆSOP: Alert-Early System for Outbreaks with Pandemic Potential |
PHC: primary health care |
SISAB: Sistema de Informação em Saúde para a Atenção Básica; in English, Information System for Primary Health Care |
Edited by A Mavragani, T Sanchez; submitted 29.03.23; peer-reviewed by S Pesälä, C Zhao; comments to author 01.09.23; revised version received 18.09.23; accepted 22.11.23; published 09.01.24.
Copyright©Pablo Ivan P Ramos, Izabel Marcilio, Ana I Bento, Gerson O Penna, Juliane F de Oliveira, Ricardo Khouri, Roberto F S Andrade, Roberto P Carreiro, Vinicius de A Oliveira, Luiz Augusto C Galvão, Luiz Landau, Mauricio L Barreto, Kay van der Horst, Manoel Barral-Netto, ÆSOP Collaborating Teams. Originally published in JMIR Public Health and Surveillance (https://publichealth.jmir.org), 09.01.2024.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Public Health and Surveillance, is properly cited. The complete bibliographic information, a link to the original publication on https://publichealth.jmir.org, as well as this copyright and license information must be included.