Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 24.04.20 in Vol 6, No 2 (2020): Apr-Jun

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/19054, first published Apr 02, 2020.

This paper is in the following e-collection/theme issue:

    Protocol

    Detection of SARS-CoV-2 RNA and Antibodies in Diverse Samples: Protocol to Validate the Sufficiency of Provider-Observed, Home-Collected Blood, Saliva, and Oropharyngeal Samples

    1Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, GA, United States

    2Molecular Testing Labs, Vancouver, WA, United States

    3Division of Infectious Diseases, Emory University School of Medicine, Atlanta, GA, United States

    4Department of Behavioral Sciences and Health Education, Rollins School of Public Health, Emory University, Atlanta, GA, United States

    Corresponding Author:

    Patrick Sean Sullivan, DVM, PhD

    Department of Epidemiology

    Rollins School of Public Health

    Emory University

    1518 Clifton Road NE

    Atlanta, GA, 30322

    United States

    Phone: 1 4047272038

    Email: pssulli@emory.edu


    ABSTRACT

    Background: The response in the United States to the coronavirus disease (COVID-19) pandemic has been hampered by a lack of aggressive testing for the infection. Testing for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is the cornerstone of an effective public health response. However, efforts to test have been hampered by limited reagents, limitations in the availability of swabs used for the collection of nasopharyngeal swab (NPS) specimens, limitations in personal protective equipment (PPE) for health care providers collecting the NPS specimens, and limitations in viral transport media for transporting the specimens. Therefore, more flexible options for screening for SARS-CoV-2 RNA and serologic responses are critical to inform clinical and public health responses.

    Objective: We aim to document the ability of patients to self-collect sufficient specimens for SARS-CoV-2 viral detection and serology.

    Methods: Patient self-collection of samples will be done with observation by a health care provider during a telemedicine session. Participants will be mailed a specimen collection kit, engage in a telehealth session with a provider through a HIPPA (Health Insurance Portability and Accountability Act of 1996)-compliant video meeting, and collect specimens while being observed by the provider. Providers will record whether they are confident in the suitability of the specimen for laboratory testing that would inform clinical decision making. We will objectively assess the sufficiency of biological material in the mailed-in specimens.

    Results: The protocol was approved by the Emory University Institutional Review Board (IRB) on March 30, 2020 (Protocol number 371). To date, we have enrolled 159 participants.

    Conclusions: Defining a conceptual framework for assessing the sufficiency of patient-collected samples for the detection of SARS-CoV-2 RNA and serologic responses to infection is critical for facilitating public health responses and providing PPE-sparing options to increase testing. Validation of alternative methods of specimen collection should include objective measures of the sufficiency of specimens for testing. A strong evidence base for diversifying testing modalities will improve tools to guide public health responses to the COVID-19 pandemic.

    JMIR Public Health Surveill 2020;6(2):e19054

    doi:10.2196/19054

    KEYWORDS



    Introduction

    Background

    The global pandemic of SARS-CoV-2 (severe acute respiratory syndrome coronavirus 2) infection and associated illness (coronavirus disease or COVID-19) have emerged very quickly, challenging traditional systems of clinical and public health response [1,2]. There is broad consensus that adequate testing for SARS-CoV-2 is imperative as a cornerstone of public health efforts to control the spread of the virus [3-5]. The response in the United States to the SARS-CoV-2 pandemic has been hampered by a slow implementation of screening programs and by a variety of factors that have limited the extent of SARS-CoV-2 testing. Following initial problems with quality control of reagents [6], the US government allowed more liberal policies for the development of laboratory developed tests (LDTs) [7], which allowed for a massive expansion of capacity in terms of availability of equipment and staff capacity at commercial laboratories.

    However, other factors now limit the reach and volume of testing for SARS-CoV-2 infection. Currently, the gold standard specimen for testing for SARS-CoV-2 RNA is a provider-administered nasopharyngeal swab (NPS) [8]; there are currently supply chain challenges, including shortages of rigid swabs for NPS collection, personal protective equipment (PPE) required for health care workers to collect NPS specimens, and viral transport media required for transporting specimens [9-12]. There are also important questions about testing sites for SARS-CoV-2 infection—should people with mild symptoms who may or may not have COVID-19 come into clinics for testing if they do not require immediate clinical care? How can people who have been quarantined receive testing to document viral shedding to guide the time of release from quarantine, without coming into places where patients are congregating? Finally, we have essentially no epidemiologic data about asymptomatic infection, which could be answered with serology data. Decisions about when to end “stay at home” curfews should likely be based, in part, on the prevalence of antibodies (and, perhaps, immunity) among populations. All these applications will require mechanisms to collect specimens that minimize the need for PPE and allow flexibility of where specimens are collected. Patient-collected samples have appeal in terms of minimizing PPE requirements and enabling the possibility of epidemiologic studies to characterize the infection and immune status of populations.

    The regulatory environment governing both the development of LDTs and specifically the testing of patient-collected samples, either in the office of the health care provider or at home, is complicated [13,14]. In response to the urgency of COVID-19 in the United States, the Food and Drug Administration (FDA) has relaxed the regulatory pathways for the development of LDTs to increase the national laboratory capacity [15]. With respect to specimen types, the FDA has developed two pathways for approval for SARS-CoV-2 infection testing: (1) develop laboratory data documenting validation or performance to submit to the FDA for review as an Emergency Use Authorization (EUA); or (2) use state regulatory mechanisms when the test is developed under the jurisdiction of the state in which the lab resides. In the latter case, the state regulators take responsibility for COVID-19 testing by laboratories in their state.

    Patient-collected samples have slightly different requirements. The FDA has issued clarifications that the ability of states to oversee the validation of LDTs with patient-collected samples is not covered by the general policy for the development of LDTs, and that assays with patient-collected samples will be required to submit data for review through the FDA for an EUA application [15]. The FDA recently updated guidance to allow collection of patient-collected mid-nasal turbinate samples collected in the provider office, but specifically noted that this approval did not extend to patient-collected samples collected at home [16]. Guidelines for the validation of patient-collected serology specimens do not appear to be explicitly addressed under current FDA guidance, which has focused on the collection of samples for viral detection.

    Outside of the realm of SARS-CoV-2 diagnosis, the FDA has reviewed and approved patient-collected samples for a wide variety of laboratory assays, including HIV serology through dried blood spot (DBS) specimens [17]. In other fields, there is a long history of using patient-collected samples under research protocols to develop data on acceptability and to provide clinical services (eg, STI [sexually transmitted infection] testing) as part of research studies [18,19].

    We anticipate that there will be biological, immunologic, and temporal aspects that will be important to consider in the design of validation studies for alternative specimen types and results interpretation. When directly comparing provider-collected and patient-collected samples of the same type (eg, provider-collected versus patient-collected oropharyngeal swab [OPS]), it is appropriate to compare the cycle threshold (Ct) for the paired samples to assess comparability. However, RNA concentrations may differ between different specimen types because of differences in RNA shedding at the two sites, such that a direct comparison of Ct results between nasopharyngeal and oropharyngeal swabs might not be an appropriate comparison. Similarly, the timing of onset and waning of IgM (immunoglobulin M) titers in patients and detection of IgA (immunoglobulin A) in saliva or serum following infection with SARS-CoV-2 are not well understood. Finally, it is unclear whether RNA might persist for variable lengths of time after infection in different specimen types. For example, To et al [20] document the presence of RNA in saliva for nearly 2 weeks post hospitalization. Ultimately, all of these questions need to be explored to make the most evidence-based recommendations for specimen screening types and collection methods in specific time phases of the infection cycle.

    Objective

    In this paper, we lay out a protocol for describing the sufficiency of patient-collected samples for SARS-CoV-2 infection testing in OPS and saliva, and for immune response to SARS-CoV-2 in DBS and saliva. We consider two aspects of assessment:

    1. Do providers who observe patient-collected samples consider them to be comparable to provider-collected specimens in terms of specimen suitability for testing for SARS-CoV-2 RNA and antibodies?
    2. Do assessments of specimen quality (eg, human nucleic acid for OPS and saliva, specimen saturation and DBS size for DBS cards) document that patient-collected samples contain sufficient biological material for accurate testing?

    Methods

    We propose methods to validate multiple sample types for RNA-PCR (polymerase chain reaction) and for serology tests. Proposed specimen types and assays are depicted in Table 1.

    Table 1. Specimen types and assays to be performed in an evaluation of diverse samples for SARS-CoV-2 (severe acute respiratory syndrome coronavirus 2) RNA and antibody testing.
    View this table

    Specimen Collection

    Oropharyngeal Swab Self-Collection

    Patients will be provided with printed instructions for collection (Figure 1). They will be instructed to insert the swab into their mouth and rub the swab tip against the back of their throat for 20 seconds on the left side, then 20 seconds on the right side. They are advised to avoid touching their tongue, teeth, and gums with the swab. They are instructed to insert the swab in the tube of viral transport media, break the swab at the score, and cap the tube.

    Figure 1. Participant instructions for self-collection via oropharyngeal swab.
    View this figure
    Self-Collection of Dried Blood Spots

    Patients will be provided with printed instructions for DBS collection (Figure 2). They will be instructed to wash their hands thoroughly, use an alcohol swab to clean the tip of the middle or ring finger of their nondominant hand, release the blade of the provided lancet by pressing into the side of the finger near the tip of the finger, and fill each of the 5 circles on a Whatman standard dried blood spot collection card. Participants are instructed to allow the blood card to dry for at least 15 minutes before packaging for return shipment.

    Figure 2. Participant instructions for self-collection of dried blood spots.
    View this figure
    Saliva Self-Collection

    Participants are asked not to eat, drink, smoke or use oral hygiene products for at least 10 minutes before the collection process (Figure 3). Participants will be instructed to rinse their mouth with water and discard, and then wait 5 minutes after the rinse before collecting the specimen. Participants will be instructed to place their lips over the collection tube funnel and collect saliva until the saliva reaches the red indicator line. They will then be instructed to screw the cap on the tube tightly and invert it 20 times to stabilize the sample. The participant will be instructed to write their date of birth on the tube before preparing for shipping.

    Figure 3. Participant instructions for self-collection of saliva.
    View this figure

    Provider Observations

    Providers will observe participants as they collect specimens through a telehealth video session on a HIPPA (Health Insurance Portability and Accountability Act of 1996)-compliant video conference service. After establishing a secure connection and confirming the identity of participants using a study identifier, the provider will direct the participant to use the provided instructions to collect the specimen; the provider will identify their role as that of an observer. The provider will document on case report forms (CRFs) that they observed the participant collecting the specimens (see Multimedia Appendix 1 for CRFs). The provider will also record their assessment of whether the specimen collected is suitable for laboratory testing, and, as secondary assessments, complete checklists of steps in the correct collection of the specimen (eg, did not smoke or drink while collecting saliva specimen, inverted closed saliva tube 20 times as directed, dropped blood on the DBS card rather than touching the card).

    Testing

    RNA-PCR

    Specimens will first be checked for quality. The samples will then undergo total nucleic acid extraction using the Thermo Kingfisher platform (Fisher Scientific). Isolated RNA will be reverse transcribed to DNA using a one-step, one-tube system via reagents from Thermo (Fisher Scientific). The second half of the one-tube system will involve qPCR (quantitative polymerase chain reaction). The reverse-transcribed DNA will undergo qPCR with primers and probes targeting 3 gene regions of the SARS-CoV-2 genome (N, S, ORF1), using reagents from Thermo. The results will be analyzed, and an interpretation will be made based on Ct values and positive identification of the nucleic acid.

    Specimen Sufficiency for RNA-PCR

    We will test OPS and saliva specimens for RNase P (ribonuclease P) as an endogenous internal amplification control and to quantify the nucleic acid content of the specimen [21]. We will consider OPS and saliva specimens with Ct values of <30 to indicate sufficient collection of biological material in the saliva sample and the swab.

    Serology Tests

    Specimens will first be checked for quality. For blood, a 6 mm punch will be obtained from the DBS, and the material will undergo standard antibody extraction using Tris buffer. For saliva, the sample will be aliquoted and used directly in the serology assay. Once the material is added to the reaction tube, the enzyme immunoassay primary and secondary antibodies (SARS-CoV-2 assay, IgG and IgM, Epitope Diagnostics; IgA, EuroIMMUN) will be added using an automated liquid handler instrument (DSX; Dynex Technologies). The protocol will follow the manufacturer’s guidelines for reaction conditions, data interpretation, and ensuring that internal controls pass.

    Specimen Sufficiency for Serology

    For DBSs, we will conduct a three-point quality check, documenting the visual appearance of the blood spot, whether it is soaked through the paper, and whether the circles are filled, as we have previously reported [22].

    Analysis

    We will tabulate the provider impressions of specimen suitability (primary outcome); exploratory analyses for provider observation will include enumeration of how common certain errors in self-collection were. For assessment of the sufficiency of RNA-PCR specimens, we will tabulate the proportion of OPS and saliva samples that had Ct values for RNAse P<30. As a secondary analysis, we will examine whether the RNAse P Ct values for the patient-collected OPS were different from the Ct values from a historical set of provider-collected OPS tested with the same reagents and laboratory equipment in the study laboratory. These analyses will involve comparing the means of the two groups using a t test.


    Results

    The protocol was approved by the Emory University Institutional Review Board (IRB) on March 30, 2020 (Protocol number 371). To date, we have enrolled 159 participants.


    Discussion

    There is an urgent need to develop and validate new methods to monitor SARS-CoV-2 infection status and immune experience [4]. Currently, provider and supply chain shortages threaten our national capacity to diagnose people who need care and monitor the growing COVID-19 pandemic. Patient-collected samples, if they are validated and approved through regulatory channels for clinical purposes, offer several advantages from clinical and public health perspectives. From a clinical perspective, patient-collected specimen options will decrease provider burden, allow for follow-up monitoring for viral shedding without the need for return office visits, and reduce risks for provider exposure during specimen collection. From a supply chain perspective, depending on the specimen that is used, self-collection can reduce the need for PPE for providers who would otherwise collect the sample, will reduce the need for rigid NPSs, and could reduce the need for viral transport media (eg, saliva samples). From a public health perspective, having options for patient-collected samples will allow for population-based studies to measure the population prevalence of current and past infection with SARS-CoV-2. Such studies are critical to understand the natural history of infection, to develop an understanding of what proportion of the population have asymptomatic infections, to monitor population immunity, and to reach patients who live in remote areas with testing.

    We developed this protocol for validation, recognizing the extreme urgency of developing new testing options and appreciating the regulatory structures that ensure that clinical testing in the United States meets high standards and produces actionable results. We believe that having providers observe patients collecting specimens is an important steppingstone on the path between relying wholly on provider-collected samples (and the required PPE and clinical visits) and the use of patient-collected samples collected outside of the supervision of providers. We note that the FDA has approved SARS-CoV-2 testing on patient-collected mid-nasal turbinate swabs, but only if the patient-collected swabs are collected in the provider’s office [16]. The kappa values of the mid-nasal turbinate study have not been reported, but the sensitivity of the patient-collected swabs to detect SARS-CoV-2 RNA among those known to be infected was 90% [16]. This approval is a rational decision, because modeling data suggest that testing at this stage of the epidemic is still valuable in blunting it, even if it is imperfect [3]. Recent data suggest that staff-collected and patient-collected mid-nasal turbinate swabs have high correlation for the detection of influenza viruses [23].

    The COVID-19 pandemic has been remarkable for its rapid onset and spread into new populations. The public health and clinical medicine systems in the United States have not had time to respond in conventional ways to this pandemic. There is a need to be innovative in developing and deploying new strategies to meet the clinical needs of patients who are infected with SARS-CoV-2 and simultaneously to gather data to understand the broad picture of the epidemic and to monitor infections and immunity at the population level. Given the catastrophic demands on our hospitals and medical offices, we must develop ways to move testing for screening purposes and epidemiologic monitoring out of the health care system [24]. Patient-collected specimens are widely used for monitoring of other infectious diseases and health conditions, and it is imperative to validate and deploy self-collection tools to understand and respond to this pandemic. We propose a structured and objective process by which patient-collected samples can be evaluated by providers during sample collection for their suitability and by laboratorians for their biological sufficiency. As we learn more about the capacity of patients to correctly collect specimens and illustrate the use of internal controls to document the biological sufficiency of specimens, there will be opportunities to use SARS-CoV-2 testing in innovative ways to address the COVID-19 pandemic.

    Conflicts of Interest

    TS is editor-in-chief of JMIR Public Health and Surveillance. Because of this, he was not involved in the editorial handling or peer-review of this paper.

    Multimedia Appendix 1

    Case report forms for self-collection evaluation.

    PDF File (Adobe PDF File), 193 KB

    References

    1. World Health Organization. 2020. Coronavirus disease 2019 (COVID-19): situation report, 51   URL: https:/​/www.​who.int/​docs/​default-source/​coronaviruse/​situation-reports/​20200311-sitrep-51-covid-19.​pdf?sfvrsn=1ba62e57_10 [accessed 2020-03-31]
    2. Watkins J. Preventing a covid-19 pandemic. BMJ 2020 Feb 28;368:m810. [CrossRef] [Medline]
    3. Goldstein N, Burstyn I. On the importance of early testing even when imperfect in a pandemic such as COVID-19. Preprint 2020 Mar. [CrossRef]
    4. Adalja AA, Toner E, Inglesby TV. Priorities for the US Health Community Responding to COVID-19. JAMA 2020 Mar 03. [CrossRef] [Medline]
    5. Rimmer A. Covid-19: BMA calls for rapid testing and appropriate protective equipment for doctors. BMJ 2020 Mar 17;368:m1099. [CrossRef] [Medline]
    6. Baird R. The New Yorker. 2020 Mar 16. What went wrong with Coronavirus testing in the US?   URL: https://www.newyorker.com/news/news-desk/what-went-wrong-with-coronavirus-testing-in-the-us [accessed 2020-04-23]
    7. Binnicker M. Emergence of a Novel Coronavirus Disease (COVID-19) and the Importance of Diagnostic Testing: Why Partnership between Clinical Laboratories, Public Health Agencies, and Industry Is Essential to Control the Outbreak. Clin Chem 2020 Feb 20:2020 [FREE Full text] [CrossRef] [Medline]
    8. Centers for Disease Control and Prevention. 2020 Apr 16. Interim Guidelines for Collecting, Handling, and Testing Clinical Specimens from Persons for Coronavirus Disease 2019 (COVID-19)   URL: https://www.cdc.gov/coronavirus/2019-ncov/lab/guidelines-clinical-specimens.html [accessed 2020-04-23]
    9. Sohrabi C, Alsafi Z, O'Neill N, Khan M, Kerwan A, Al-Jabir A, et al. Corrigendum to "World Health Organization declares Global Emergency: A review of the 2019 Novel Coronavirus (COVID-19)" [Int J Surg 76 (2020) 71-76]. Int J Surg 2020 Apr 15 [FREE Full text] [CrossRef] [Medline]
    10. Webber L, Jewett C. npr.org. 2020 Mar 18. Testing Swabs Run In Short Supply As Makers Try To Speed Up Production online news report   URL: https:/​/www.​npr.org/​sections/​health-shots/​2020/​03/​18/​817801222/​testing-swabs-run-in-short-supply-as-makers-try-to-speed-up-production [accessed 2020-03-25]
    11. McMichael T, Clark S, Pogosjans S, Kay M, Lewis J, Baer A, Public Health – Seattle & King County‚ EvergreenHealth‚ CDC COVID-19 Investigation Team. COVID-19 in a Long-Term Care Facility - King County, Washington, February 27-March 9, 2020. MMWR Morb Mortal Wkly Rep 2020 Mar 27;69(12):339-342 [FREE Full text] [CrossRef] [Medline]
    12. World Health Organization. 2020. Rational use of personal protective equipment for coronavirus disease (COVID-19): interim guidance, 27 February 2020   URL: https://apps.who.int/iris/handle/10665/331215 [accessed 2020-04-22]
    13. Jones PM. FDA regulation of LDTs--an update. MLO Med Lab Obs 2015 Sep;47(9):18-19. [Medline]
    14. Caliendo AM, Hanson KE. Point-Counterpoint: The FDA Has a Role in Regulation of Laboratory-Developed Tests. J Clin Microbiol 2016 Jan 20;54(4):829-833. [CrossRef]
    15. US Food and Drug Administration. 2020. Coronavirus (COVID-19) Update: FDA Provides More Regulatory Relief During Outbreak, Continues to Help Expedite Availability of Diagnostics [FDA statement]   URL: https:/​/www.​fda.gov/​news-events/​press-announcements/​coronavirus-covid-19-update-fda-provides-more-regulatory-relief-during-outbreak-continues-help [accessed 2020-03-25]
    16. UnitedHealth Group. 2020 Mar 25. UnitedHealth Group Study Clears Path for Self-Administered COVID-19 Test, Improving Testing Efficiency and Protecting Health Care Workers   URL: https:/​/www.​unitedhealthgroup.com/​newsroom/​2020/​2020-03-25-path-for-self-administered-covid-19-test.​html [accessed 2020-04-23]
    17. Branson BM. Home sample collection tests for HIV infection. JAMA 1998 Nov 18;280(19):1699-1701. [CrossRef] [Medline]
    18. Hobbs MM, van der Pol B, Totten P, Gaydos CA, Wald A, Warren T, et al. From the NIH: proceedings of a workshop on the importance of self-obtained vaginal specimens for detection of sexually transmitted infections. Sex Transm Dis 2008 Jan;35(1):8-13 [FREE Full text] [CrossRef] [Medline]
    19. Gaydos CA. Let's Take A "Selfie": Self-Collected Samples for Sexually Transmitted Infections. Sex Transm Dis 2018 Apr;45(4):278-279 [FREE Full text] [CrossRef] [Medline]
    20. To KKW, Tsang O, Chik-Yan Yip C, Chan K, Wu T, Chan J, et al. Consistent detection of 2019 novel coronavirus in saliva. Clin Infect Dis 2020 Feb 12:2020 [FREE Full text] [CrossRef] [Medline]
    21. Fernandes-Monteiro AG, Trindade GF, Yamamura AMY, Moreira OC, de Paula VS, Duarte ACM, et al. New approaches for the standardization and validation of a real-time qPCR assay using TaqMan probes for quantification of yellow fever virus on clinical samples with high quality parameters. Hum Vaccin Immunother 2015;11(7):1865-1871 [FREE Full text] [CrossRef] [Medline]
    22. MacGowan RJ, Chavez PR, Gravens L, Wesolowski LG, Sharma A, McNaghten AD, eSTAMP Study Group. Pilot Evaluation of the Ability of Men Who Have Sex with Men to Self-Administer Rapid HIV Tests, Prepare Dried Blood Spot Cards, and Interpret Test Results, Atlanta, Georgia, 2013. AIDS Behav 2018 Jan;22(1):117-126. [CrossRef] [Medline]
    23. Malosh R, Petrie J, Callear A, Monto A, Martin E. Home collection of nasal swabs for detection of influenza in the Household Influenza Vaccine Evaluation Study. medRxiv 2020 [FREE Full text] [CrossRef]
    24. Lipsitch M, Swerdlow DL, Finelli L. Defining the Epidemiology of Covid-19 — Studies Needed. N Engl J Med 2020 Mar 26;382(13):1194-1196. [CrossRef]


    Abbreviations

    COVID-19: coronavirus disease
    CRF: case report form
    Ct: cycle threshold
    DBS: dried blood spot
    EUA: Emergency Use Authorization
    FDA: Food and Drug Administration
    HIPPA: Health Insurance Portability and Accountability Act of 1996
    IgA: immunoglobulin A
    IgG: immunoglobulin G
    IgM: immunoglobulin M
    LDT: laboratory developed test
    NPS: nasopharyngeal swab
    OPS: oropharyngeal swab
    PCR: polymerase chain reaction
    PPE: personal protective equipment
    qPCR: quantitative polymerase chain reaction
    RNase P: ribonuclease P
    SARS-CoV-2: severe acute respiratory syndrome coronavirus 2
    STI: sexually transmitted infection


    Edited by G Eysenbach; submitted 02.04.20; peer-reviewed by R MacGowan, S Facente; comments to author 12.04.20; revised version received 14.04.20; accepted 19.04.20; published 24.04.20

    ©Patrick Sean Sullivan, Charles Sailey, Jodie Lynn Guest, Jeannette Guarner, Colleen Kelley, Aaron Julius Siegler, Mariah Valentine-Graves, Laura Gravens, Carlos del Rio, Travis Howard Sanchez. Originally published in JMIR Public Health and Surveillance (http://publichealth.jmir.org), 24.04.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Public Health and Surveillance, is properly cited. The complete bibliographic information, a link to the original publication on http://publichealth.jmir.org, as well as this copyright and license information must be included.