This paper is in the following e-collection/theme issue:

Surveillance Systems (430) Infoveillance, Infodemiology, Digital Disease Surveillance, Infodemic Management (1015) Innovative Methods in Public Health and Surveillance (307) Prevention and Health Promotion (899) Infectious Diseases (non-STD/STI) (1490)

Published on in Vol 8, No 12 (2022): December

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/37122, first published .
The Role of Heterogenous Real-world Data for Dengue Surveillance in Martinique: Observational Retrospective Study

The Role of Heterogenous Real-world Data for Dengue Surveillance in Martinique: Observational Retrospective Study

The Role of Heterogenous Real-world Data for Dengue Surveillance in Martinique: Observational Retrospective Study

Authors of this article:

Emmanuelle Sylvestre1, 2 Author Orcid Image ;   Elsa Cécilia-Joseph2 Author Orcid Image ;   Guillaume Bouzillé1 Author Orcid Image ;   Fatiha Najioullah3 Author Orcid Image ;   Manuel Etienne4 Author Orcid Image ;   Fabrice Malouines4 Author Orcid Image ;   Jacques Rosine5 Author Orcid Image ;   Sandrine Julié6 Author Orcid Image ;   André Cabié7, 8, 9 Author Orcid Image ;   Marc Cuggia1 Author Orcid Image
Article Authors Cited by (1) Tweetations (8) Metrics

    Original Paper

    1Laboratoire de Traitement du Signal et de l'Image (LTSI) - Unité Mixte de Recherche (UMR) 1099, Université de Rennes, Centre Hospitalier Universitaire Rennes, Institut national de la santé et de la recherche médicale (INSERM), Rennes, France

    2Centre de Données Cliniques, Centre Hospitalier Universitaire Martinique, Fort-de-France, Martinique

    3Laboratoire de Virologie, Centre Hospitalier Universitaire Martinique, Fort-de-France, Martinique

    4Centre de Démoustication et de Recherche Entomologique, Collectivité Territoriale de la Martinique – Agence Régionale de Santé, Fort-de-France, Martinique

    5Cellule Martinique, Santé Publique France, Saint-Maurice, France

    6Département d'Information Médicale, Service de Santé Publique, Centre Hospitalier Universitaire Martinique, Fort-de-France, Martinique

    7Infectious and Tropical Diseases Unit, Centre Hospitalier Universitaire Martinique, Fort-de-France, Martinique

    8Centre d'Investigation Clinique (CIC)-1424, Centre Hospitalier Universitaire Martinique, Institut national de la santé et de la recherche médicale (INSERM), Fort-de-France, Martinique

    9Pathogenesis and Control of Chronic and Emerging Infections (PCCEI), Université de Montpellier - Université des Antilles, Institut national de la santé et de la recherche médicale (INSERM) - Etablissement Français du Sang (EFS), Montpellier, France

    Corresponding Author:

    Emmanuelle Sylvestre, MD, PhD

    Centre de Données Cliniques

    Centre Hospitalier Universitaire Martinique

    CS 90632

    Fort-de-France, 97261

    Martinique

    Phone: 596 596553507

    Email: emmanuelle.sylvestre@chu-martinique.fr


    Background: Traditionally, dengue prevention and control rely on vector control programs and reporting of symptomatic cases to a central health agency. However, case reporting is often delayed, and the true burden of dengue disease is often underestimated. Moreover, some countries do not have routine control measures for vector control. Therefore, researchers are constantly assessing novel data sources to improve traditional surveillance systems. These studies are mostly carried out in big territories and rarely in smaller endemic regions, such as Martinique and the Lesser Antilles.

    Objective: The aim of this study was to determine whether heterogeneous real-world data sources could help reduce reporting delays and improve dengue monitoring in Martinique island, a small endemic region.

    Methods: Heterogenous data sources (hospitalization data, entomological data, and Google Trends) and dengue surveillance reports for the last 14 years (January 2007 to February 2021) were analyzed to identify associations with dengue outbreaks and their time lags.

    Results: The dengue hospitalization rate was the variable most strongly correlated with the increase in dengue positivity rate by real-time reverse transcription polymerase chain reaction (Pearson correlation coefficient=0.70) with a time lag of −3 weeks. Weekly entomological interventions were also correlated with the increase in dengue positivity rate by real-time reverse transcription polymerase chain reaction (Pearson correlation coefficient=0.59) with a time lag of −2 weeks. The most correlated query from Google Trends was the “Dengue” topic restricted to the Martinique region (Pearson correlation coefficient=0.637) with a time lag of −3 weeks.

    Conclusions: Real-word data are valuable data sources for dengue surveillance in smaller territories. Many of these sources precede the increase in dengue cases by several weeks, and therefore can help to improve the ability of traditional surveillance systems to provide an early response in dengue outbreaks. All these sources should be better integrated to improve the early response to dengue outbreaks and vector-borne diseases in smaller endemic territories.

    JMIR Public Health Surveill 2022;8(12):e37122

    doi:10.2196/37122

    Keywords

    dengue; surveillance; real-word data; Big Data; Caribbean; dengue-endemic region 


    Dengue is one of the most important vector-borne diseases worldwide, with 390 million infections, 96 million symptomatic cases, and 20,000 estimated deaths per year in >125 countries [1,2]. The disease is mostly endemic in tropical and subtropical regions (ie, Southeast Asia, the Americas, and the Pacific), with 4 billion people at risk [3]. In Latin America and the Caribbean, morbidity and mortality increased from 400,519 cases and 92 deaths in 2000 to >3.1 million cases and 1534 deaths in 2019 [4,5]. Dengue prevention and control in these regions rely on 2 main approaches: vector control programs and traditional surveillance, which is based on passive detection of symptomatic cases (inpatients and outpatients) [4,6]. Although both approaches are effective, they are expensive and are hampered by the delay between case occurrence and case reporting. Furthermore, some countries do not have routine vector control measures [7] and national epidemiological surveillance systems tend to underestimate the true disease burden of dengue [8].

    In Martinique, a French overseas territory in the Lesser Antilles with approximately 360,000 inhabitants, health authorities have launched the “Monitoring, warning and management of dengue outbreaks program” (Programme de surveillance, d’alerte et de gestion des épidémies de dengue [PSAGE]), in which vector control and traditional surveillance are combined. PSAGE identifies five main stages in dengue outbreaks: (1) sporadic transmission, (2) dengue clusters with or without an epidemiological link, (3) epidemic risk when the number of symptomatic cases is above the expected threshold, (4) dengue outbreak, and (5) return to normal. Vector surveillance still plays a role in this system; however, the change in PSAGE stage is mainly based on the number of symptomatic cases identified by general practitioners who are part of the French Sentinel Network surveillance system [9,10].

    Surveillance systems are a key public health tool to detect early cases of emerging infectious diseases, prevent outbreaks [11] among populations, and implement measures to reduce transmission [12]. Traditional surveillance systems are often expensive because of the time and resources required to process data collected from public health networks [13]. To improve these systems and reduce the delay between diagnosis and reporting, researchers have evaluated novel data sources, especially real-world data (ie, data not collected in experimental conditions [14]), such as emergency department visits, mobile data, and internet-based systems [15-18]. Other studies on surveillance and forecasting, especially those using climate data [19-21], have also shown promising results. Scientists mostly rely on correlation methods to test these data sources [22,23], but other approaches have also been tested, for instance Naive Bayes methods [24,25]. Most of these studies were conducted in Asia (70% of the global dengue burden) [2]. Studies in the Americas concerned large territories or countries, such as Brazil and Mexico [24,25], and in the Caribbean, they focused on the bigger islands of the Greater Antilles [21,26].

    The aim of this study, carried out in Martinique, was to investigate whether heterogeneous real-world data sources could help to reduce reporting delays and improve dengue monitoring in a smaller endemic region.


    Data Sources

    Overview

    We used several types of data that had been routinely collected during the study period (from January 1, 2007, to February 28, 2021): epidemiological surveillance reports from the French National Public Health Agency (Santé Publique France), reimbursement claims and laboratory data from Martinique University Hospital, entomological data from the Martinique Mosquito Control and Entomological Research Center (Centre de Démoustication et de Recherche Entomologique [CEDRE]), and relative search volumes (RSV) from Google Trends. Entomological, clinical, and laboratory data are available within 24 to 48 hours. Google RSV and epidemiological surveillance data are available in real time and at the end of each week, respectively. All used data were anonymized.

    Epidemiological Surveillance Data

    We obtained weekly dengue surveillance reports from the French Public Health Agency. These reports are based on data collected by general practitioners from the French Sentinel Network. They also provide the official start and end dates of each dengue outbreak and the weekly PSAGE stage during the outbreak. These reports are not continuously published but only if the dengue risk level is above stage 1 (ie, the baseline stage). We used the PSAGE stage described in each report to create the PSAGE ordinal variable with 4 levels. Indeed, although the PSAGE program has 5 levels, stage 5 (“back to normal”) was used only 5 times in the last 15 years, and experts prefer to use stage 1 (“sporadic transmission”) after stage 4 (“dengue outbreak”). Moreover, when stage 5 was used, it was for 1 week, except once in 2021, when it lasted 2 weeks. Thus, we combined stages 1 and 5 into a single stage (stage 1 or 5, sporadic transmission).

    Clinical and Laboratory Data

    We obtained weekly aggregated data from Martinique University Hospital: (1) inpatient data (age and diagnoses associated with dengue disease or dengue symptoms), (2) administrative data (outpatient medical consultations, hospitalizations, and emergency department visits), and (3) laboratory data—dengue virus (DENV) detection by real-time reverse transcriptase polymerase chain reaction (RT-PCR).

    All included diagnoses were coded using the French version of the International Classification of Diseases, 10th edition (ICD-10):

    • Dengue or severe dengue
    • Possible coding errors associated with dengue: fever and unspecified viral hemorrhagic fever
    • Severity symptoms: hemorrhage, shock, and dehydration
    • Thrombocytopenia
    • Hepatic symptoms: hepatitis, hepatomegaly, hepatic failure, and elevation of transaminase
    • Neurological symptoms: encephalitis and encephalopathy

    We selected these diagnoses with the help of infectious disease physicians. All reimbursement claims data were obtained from the Martinique University Hospital, where the only infectious disease department for the whole island is located. The relevant ICD-10 codes are listed in Multimedia Appendix 1.

    We normalized all administrative data as follows:

    where x is the weekly number of hospitalizations, consultations, or emergency department visits and min and are the minimum and maximum values observed in the data set, respectively.

    For laboratory data, we used the DENV positivity rate determined by RT-PCR. Laboratory results were concerned about both inpatients and outpatients because the Martinique University Hospital is the reference center for DENV screening using RT-PCR in Martinique.

    Entomological Data

    We used data from the CEDRE surveillance database, such as the weekly number of entomological interventions and where they were carried out. Entomological interventions were defined as all vector control interventions and measures taken by CEDRE: information and education of the households, physical vector control (ie, eliminating mosquito sites, such as old containers filled with water), and chemical vector control with insecticides [26]. This agency manages entomological surveillance and vector control in Martinique and collects data on each intervention.

    Google RSV

    We used data from Google Trends [27], which provides real-time and archived information on Google queries from 2004 onward. These queries are normalized by Google as RSV by dividing the total search volume for a query in a geographic location by the total number of queries in that region at a given point in time [28]. We used this tool to retrieve information on the search interest for keywords associated with dengue during our selected time frame (January 2007 to February 2021). However, we could not retrieve weekly data for the Martinique region, especially for the first years of the study period, because there were not always enough RSV (as indicated by the Google error message “Sorry, not enough search volume to show graphs”). Therefore, we based our methodology to retrieve Google Trends data on previously published methodology frameworks, indicating that Google Trends data should be retrieved for exactly the same period as the other data under study and as a single data set rather than as individual queries for each year [29]. As data for our study period were only available at monthly intervals, we considered that interest was constant over each week of the month for each query.

    For data retrieval, relevant keywords were selected with experts in the field. Normally, all spelling variations should be included in the research to limit the risk of missing data. However, in our case, combining all possible spelling variants of some keywords into a single query was impossible, and an error message from Google indicated that the available data were insufficient. Nevertheless, we retrieved results using the “topic” option from Google that includes various keywords associated with a category.

    As Martinique (and the other islands in the Lesser Antilles) are small regions, we tried 2 strategies to explore the geographic region of our keywords: we selected “Martinique” as the region in the tool and we added “Martinique” as a keyword in our query, with the region selected as “worldwide.” Moreover, we selected our keywords in 3 different languages (French, English, and Spanish) because the Lesser Antilles is a multilingual region.

    Data Processing

    Clinical and laboratory data were already aggregated into a structured database and did not require data processing. Similarly, data from Google queries are normalized by Google as RSV. Conversely, most of the information in the CEDRE database was unstructured and required processing. Indeed, the CEDRE database is a comprehensive database with some structured data (eg, the date of an entomological intervention), but the details associated with entomological interventions (ie, the type of insecticide used or the number of old containers removed) were in free text; we needed this information to count the number of weekly interventions. Therefore, we used rule-based natural language processing methods (ie, part-of-speech tags) to process the data and extract relevant information for our study. All statistical analyses were performed using R (version 4.1.0; R Foundation for Statistical Computing) [30] (tidytext [31],stopwords, and SnowballC packages).

    Statistical Analysis

    A total of 4 dengue outbreaks were recorded in Martinique between 2007 and 2021: from August 20, 2007, to January 14, 2008; from February 22, 2010, to October 25, 2010; from July 22, 2013, to April 14, 2014; and from November 18, 2019, to February 8, 2021. The fourth dengue outbreak was the largest in Martinique over the last 20 years.

    During the same period, there was a chikungunya outbreak in 2014, a Zika virus outbreak in 2016, the first COVID-19 wave in March 2020, and the second COVID-19 wave from September to December 2020. The last dengue outbreak was concomitant with the second COVID-19 wave. Consequently, the PSAGE stages did not vary much over the years, making it difficult to study correlations with this categorical variable. Therefore, it is necessary to find a good continuous estimator for time series analyses. To this end, we assessed the DENV RT-PCR positive rate performance for PSAGE stage prediction using a repeated stratified k-fold cross-validation approach. First, we divided the data into 10 stratified folds, then built a logistic regression model to predict the PSAGE stages. Finally, we repeated the process 10 times and evaluated its performance. The original PSAGE variable was an ordinal variable with 4 levels, but the data were not evenly distributed among the levels. Therefore, we ran 4 binary logistic regression analyses, rather than a single multinomial regression model, to assess how RT-PCR positive rates can predict each level. We calculated the predicted probability of a PSAGE stage by using the following equation:

    where X is the vector of the predictor values, β1 is the vector of the regression coefficients, and β0 is the intercept of the model. As the data set was imbalanced, we also used stratified sampling in the PSAGE stage for k-fold cross-validation.

    The metrics used to assess the logistic model performance were accuracy, specificity, precision, recall, F1-score, and area under the curve (AUC).

    Accuracy assesses the overall effectiveness of the logistic regression model and can be defined as the ratio of the correct number of predictions to the total number of predictions:

    where TP are true positive, TN are true negative, FP are false positive, and FN are false negative results.

    Specificity is the model’s capacity to predict that a week is not in the PSAGE stage and is defined as the ratio between correctly predicted negative classes and all items that are actually negative:

    where TN is true negative, and FP is false positive.

    Precision (or positive predictive value) is the agreement between the true stages and the stages predicted by the RT-PCR positive rate and is defined as the ratio between the correctly predicted positive classes and all items predicted to be positive:

    where TP is true positive, and FP is false positive.

    Recall (or sensitivity) is the model’s capacity to identify the true stages and is defined as the ratio between correctly predicted positive classes and all items that are actually positive:

    where TP is true positive, and FN is false negative.

    The F1-score is the harmonic mean of precision and recall. The AUC represents the capacity of the model to avoid false classification into a stage.

    To investigate the association between the RT-PCR positive rate and each data source, we plotted their time series. Finally, for each source, we estimated the Pearson correlation coefficient (r) and the cross-correlations between the weekly data and the DENV RT-PCR positive rate. The aim of the cross-correlation function is to investigate the relationship between time series and their lag values [32]. In our case, we wanted to determine whether the increase in the studied variables was correlated with the DENV RT-PCR positive rate and whether it preceded it. All statistical analyses were performed using R (version 4.1.0) [30]. For cross-correlations, significance is determined graphically when the lines are above (or below) the dotted blue line.

    Ethics Approval

    This study was approved by the local Ethics Committee of Martinique University Hospital (approval number 2022/177).


    RT-PCR Positive Rate Performance

    The accuracy and AUC values ranged between 0.83 and 0.95 and between 0.55 and 0.89, respectively. Overall, the model performed better at predicting sporadic transmission (stage 1 or 5: accuracy=0.83; AUC=0.84) and outbreak (stage 4: accuracy=0.89; AUC=0.89; Table 1).

    Table 1. DENVa RT-PCRb positive rate and PSAGEc stage prediction.
    MetricsPSAGE

    		Stage 1 or 5Stage 2Stage 3Stage 4
    Accuracy0.8280.8790.9530.888
    Specificity0.616110.96
    Precision0.827—d—0.742
    Recall0.936000.535
    F1-score0.878——0.612
    AUCe0.8380.5460.8280.888

    aDENV: dengue virus.

    bRT-PCR: real-time reverse transcriptase polymerase chain reaction.

    cPSAGE: Programme de surveillance, d’alerte et de gestion des épidémies de dengue.

    dNot enough data available to build a prediction model for these stages.

    eAUC: area under the curve.

    Hospital Data

    We normalized all hospital data to plot the time series to consider the different scales. As children and adults can be affected differently depending on the dengue infection type (primary vs secondary), we stratified our data sets based on the ward type (adult or pediatric).

    Administrative Data

    Adult hospitalizations (P=.01) and emergency department visits (P<.001) were significantly correlated with the DENV RT-PCR positive rate. We also observed a significant cross-correlation at −3 and −5 weeks, suggesting that the increase in emergency department visits preceded the increase in the DENV RT-PCR positive rate by 3 to 5 weeks. Table 2 shows the correlations and cross-correlations between the administrative data and DENV detection rate by RT-PCR. All cross-correlations between administrative data and DENV RT-PCR positive rate are listed in Multimedia Appendix 2.

    Table 2. Correlations and cross-correlations between administrative data and DENVa RT-PCRb positive rate.
    DataCorrelation (95% CI)P valueMax cross-correlationcTime lagd
    Hospitalizations

    		Total (n=506,992)−0.066 (−0.137 to 0.006).07−0.091−5 weeks

    		Adults (n=444,045)−0.095 (−0.165 to −0.023).01e−0.097−4 weeks

    		Children (n=62,947)0.067 (−0.004 to 0.139).060.118f−8 weeks
    Emergency department visits

    		Total (n=1,082,343)0.111 (0.039 to 0.181).0020.169−5 weeks

    		Adults (n=740,282)0.181 (0.11 to 0.25)<.0010.216−3 weeks

    		Children (n=342,061)0.046 (−0.025 to 0.118).210.107−5 weeks
    Consultations

    		Total (n=2,715,906)−0.065 (−0.137 to 0.007).08−0.067−2 weeks

    		Adults (n=2,467,565)−0.061 (−0.133 to 0.0105).09−0.097−5 weeks

    		Children (n=248,341)−0.046 (−0.118 to 0.026).21−0.087−5 weeks

    aDENV: dengue virus.

    bRT-PCR: real-time reverse transcriptase polymerase chain reaction.

    cMaximum cross-correlation.

    dTime lag that results in the maximum cross-correlation.

    eItalicized P values are significant.

    fItalicized cross-correlations are statistically significant (details in Multimedia Appendices 2-5).

    Inpatient Data

    We normalized inpatient data as the percentage of each diagnosis among all diagnoses for that year. The percentage of dengue diagnoses among inpatients was significantly associated with an increase in the DENV RT-PCR positive rate. We also detected a significant cross-correlation at −3 weeks, indicating that the increase in dengue diagnoses among hospitalized people preceded the increase in DENV RT-PCR positive rates by 3 weeks (Table 3). All cross-correlations between dengue diagnoses in inpatients and DENV RT-PCR positive rates are listed in Multimedia Appendix 3.

    Concerning dengue-related symptoms, thrombocytopenia and liver involvement in adults and children were associated with the DENV RT-PCR positive rate.

    The significant cross-correlation, at time lags ranging between −2 and −5 weeks, indicated that the increase in thrombocytopenia and liver dysfunction preceded the increase in DENV RT-PCR positive rates by 3 to 5 weeks (Table 4). All cross-correlations between dengue symptoms among inpatients and DENV RT-PCR positive rate are listed in Multimedia Appendices 4 and 5.

    The weekly hospitalization rates for dengue and thrombocytopenia during the study period are shown in Figure 1, with DENV RT-PCR positive rate, as a reference.

    Table 3. Correlations between dengue diagnoses inpatients and DENVa RT-PCRb positive rate.
    DataCorrelation (95% CI)P valueMax cross-correlationcTime lagd
    Total0.704 (0.665-0.738)<.001e0.710f−3 weeks
    Adults0.698 (0.659-0.733)<.0010.703−3 weeks
    Children0.672 (0.631-0.701)<.0010.675−3 weeks

    aDENV: dengue virus.

    bRT-PCR: real-time reverse transcriptase polymerase chain reaction.

    cMaximum cross-correlation.

    dTime lag that results in the maximum cross-correlation.

    eItalicized P values are significant.

    fItalicized cross-correlations are statistically significant (details in Multimedia Appendices 2-5).

    Table 4. Correlations between dengue symptoms among inpatients and dengue RT-PCRa positive rate.
    DataCorrelation (95% CI)P valueMax cross-correlationbTime lagc
    Symptoms

    		Total0.077 (0.005 to 0.148).04d0.081e−4 weeks

    		Adults0.071 (−0.001 to 0.142).050.0710 weeks

    		Children0.093 (0.021 to 0.16).010.127−4 weeks
    Coding errors

    		Total−0.096 (−0.167 to –0.024).009−0.098−1 week

    		Adults−0.072 (−0.143 to –1.12 ×10−4).05−0.086−2 weeks

    		Children−0.043 (−0.115 to 0.0285).24−0.0430 weeks
    Symptom severity

    		Total0.105 (0.033 to 0.175).0040.1050 weeks

    		Adults0.068 (−0.004 to 0.139).070.0680 weeks

    		Children0.263 (0.195 to 0.329)<.0010.279−4 weeks
    Thrombocytopenia

    		Total0.281 (0.213 to 0.346)<.0010.289−2 weeks

    		Adults0.235 (0.166 to 0.302)<.0010.242−2 weeks

    		Children0.269 (0.201 to 0.335)<.0010.288−4 weeks
    Liver dysfunction symptoms

    		Total0.152 (0.081 to 0.222)<.0010.179−5 weeks

    		Adults0.123 (0.0517 to 0.193)<.0010.153−5 weeks

    		Children0.152 (0.081 to 0.222)<.0010.147−5 weeks
    Neurological symptoms

    		Total−0.028 (−0.100 to 0.0435).44−0.061−7 weeks

    		Adults−0.045 (−0.117 to 0.0265).22−0.068−7 weeks

    		Children0.029 (−0.0427 to 0.101).430.034−6 weeks

    aRT-PCR: real-time reverse transcriptase polymerase chain reaction.

    bMaximum cross-correlation.

    cTime lag that results in the maximum cross-correlation.

    dItalicized P values are significant.

    eItalicized cross-correlations are statistically significant (details in Multimedia Appendices 2-5).

    ‎
    Figure 1. Weekly hospitalization rates for dengue and thrombocytopenia during the different Programme de surveillance, d’alerte et de gestion des épidémies de dengue (PSAGE) stages from January 2007 to February 2021. The DENV RT-PCR positive rate was used as a reference. Blue curves: weekly hospitalization rates for the indicated ICD-10 diagnoses. Green areas: PSAGE stage 2 (dengue clusters). Yellow areas: PSAGE stage 3 (epidemic risk). Red areas: PSAGE stage 4 (dengue outbreak). Red dashed lines: official dates of dengue outbreaks that were decided retrospectively by the French Public Health Agency at the end of each outbreak. DENV: dengue virus; RT-PCR: real-time reverse transcription polymerase chain reaction.
    View this figure

    Entomological Data

    The weekly number of entomological interventions was significantly (P<.001) associated with DENV RT-PCR positive rate (r=0.591; 95% CI 0.542-0.636). They were also significantly cross-correlated (0.627 at −2 weeks), indicating that their increase preceded an increase in the DENV RT-PCR positive rate by 2 weeks.

    We did not find any significant correlation or cross-correlation between the intervention zones and the RT-PCR positive rate.

    Google RSV

    We considered that interest was constant over each week of the month for each query to compute our weekly data, but RSV could have high variability across weeks. Therefore, we also compared monthly RSV to monthly DENV RT-PCR positive rates to assess whether our approach had a high impact on the results.

    Several Google keywords were significantly associated with the DENV RT-PCR positive rate. Overall, this association was stronger for the simplest combination of keywords, without spelling variations, especially for the keywords “dengue symptoms.” We could not assess some keyword combinations because of the lack of data. Furthermore, when Google Trends provided “Topics,” the results outperformed those obtained using manual combinations of keywords that included spelling, language, or accent variations. Keywords not restricted to the geographic region of “Martinique” (by using the Geographical region feature or by adding the keyword “Martinique” to the query) were not significantly associated with the DENV RT-PCR positive rate. We obtained the strongest significant cross-correlation using the topic “dengue” in the Martinique region (0.643 at the time lag of −3 weeks). This indicated that an increase in queries for this term in the Martinique region preceded the increase in the DENV RT-PCR positive rate by 3 weeks (Table 5). Conversely, we did not find any significant cross-correlation within meaningful time lag values for the term “mosquito” and its different spellings and language variations.

    For monthly correlations, the results were similar to weekly results (Table 6). All weekly correlations between Google Trends keywords and DENV RT-PCR positive rates are listed in Multimedia Appendix 6. All monthly correlations between Google Trends keywords and DENV RT-PCR positive rates are listed in Multimedia Appendix 7. All weekly cross-correlations between nonhospital data and DENV RT-PCR positive rate are listed in Multimedia Appendix 8. All monthly cross-correlations between Google Trends keywords and DENV RT-PCR positive rate are listed in Multimedia Appendix 9.

    The weekly estimates for nonhospital data during the study period are displayed in Figure 2, with the DENV RT-PCR positive rate as a reference.

    Table 5. Strongest correlations between Google Trends keywords and DENVa RT-PCRb positive rate.
    KeywordsCorrelation (95% CI)P valueMax cross-correlationcTime lagd
    Dengue

    		Keywords “dengue” + “dingue” and region “Martinique”0.597 (0.548-0.641)<.001e0.598f−1 week

    		Keywords “dengue” + “Martinique”0.534 (0.480-0.583)<.0010.611−6 weeks

    		Topic “dengue” and region “Martinique”0.637 (0.591-0.677)<.0010.643−3 weeks
    Dengue symptoms

    		Keyword “symptome dengue” and region “Martinique”0.412 (0.351-0.47)<.0010.435−3 weeks
    Mosquito

    		Keyword “mosquito” with various French spellings and region “Martinique”0.200 (0.130-0.268)<.0010.2000 weeks
    Aedes

    		Keywords “aedes” and region “Martinique”0.339 (0.273-0.401)<.0010.369−3 weeks

    		Topic “aedes” and region “Martinique”0.214 (0.591-0.677)<.0010.304−7 weeks

    aDENV: dengue virus.

    bRT-PCR: real-time reverse transcriptase polymerase chain reaction.

    cMaximum cross-correlation.

    dTime lag that results in the maximum cross-correlation.

    eItalicized P values are significant.

    fItalicized cross-correlations are statistically significant (details in Multimedia Appendices 2-5).

    Table 6. Strongest monthly correlations between Google Trends keywords and DENVa RT-PCRb positive rate.
    KeywordsCorrelation (95% CI)P valueMax cross-correlationcTime lagd
    Dengue

    		Keywords “dengue” + “dingue” and region “Martinique”0.632 (0.531-0.714)<.001e0.6320 months

    		Keywords “dengue” + “Martinique”0.592 (0.484-0.681)<.0010.643f−1 month

    		Topic “dengue” and region “Martinique”0.675 (0.583-0.749)<.0010.6750 months
    Dengue symptoms

    		Keyword “symptome dengue” and region “Martinique”0.436 (0.306-0.55)<.0010.453−1 month
    Mosquito

    		Keyword “mosquito” with various French spellings and region “Martinique”0.217 (0.004-0.068)<.0010.2170 weeks
    Aedes

    		Keywords “aedes” and region “Martinique”0.379 (0.243-0.501)<.0010.394−1 month

    		Topic “aedes” and region “Martinique”0.242 (0.095-0.379)<.0010.313−2 months

    aDENV: dengue virus.

    bRT-PCR: real-time reverse transcriptase polymerase chain reaction.

    cMaximum cross-correlation.

    bTime lag that results in the maximum cross-correlation.

    eItalicized P values are significant.

    fItalicized cross-correlations are statistically significant (details in Multimedia Appendices 2-5).

    ‎
    Figure 2. Weekly estimates for the indicated nonhospital data during the different Programme de surveillance, d’alerte et de gestion des épidémies de dengue (PSAGE) stages from January 2007 to February 2021. The DENV RT-PCR positive rate was used as a reference. Blue curves: weekly estimates for the strongest correlated Google keywords and entomological interventions. Green areas: PSAGE stage 2 (dengue clusters). Yellow areas: PSAGE stage 3 (epidemic risk). Red areas: PSAGE stage 4 (dengue outbreak). Red dashed lines: official dates of the outbreaks decided retrospectively by the French Public Health Agency at the end of each outbreak. DENV: dengue virus; RT-PCR: real-time reverse transcription polymerase chain reaction.
    View this figure

    Principal Findings

    This study demonstrates the potential of real-world data for dengue outbreak monitoring. It indicates that multiple heterogeneous data sources, such as clinical data, vector data, and novel Big Data streams, should be leveraged simultaneously because they can all play a role in improving traditional dengue surveillance systems. Moreover, some data, such as the weekly hospitalization rates for thrombocytopenia, the weekly number of entomological interventions, and Google keywords, were not only significantly correlated with the weekly DENV RT-PCR positive rates, but their increase preceded the increase in RT-PCR positive results by 2 to 4 weeks.

    An early response is crucial in dengue management because it can reduce mortality [18] and help stakeholders better anticipate needs and resources. In Martinique, the early signs identified in this study could be used to set up more hospital beds (including in the intensive care unit), increase staffing, particularly in emergency services and infectious diseases department, and increase the blood bank stock levels for patients with severe dengue who may need blood transfusions. Moreover, stakeholders could use them to justify requests for reinforcements from other territories (for Martinique, mostly from mainland France), medical equipment, and hospital staff. In addition, they could be used to notify earlier the Pan-American Health Organization, which is the Regional Office for the Americas of the World Health Organization [33], and help other islands to better prepare for an incoming outbreak.

    Previous studies have already investigated the role of entomological data [34], inpatient data [35], and internet data streams [36] in dengue management, but few have assessed all these data sources simultaneously. In this study, we found that they should all be considered together rather than individually. Vector-based data tend to be underused [37], despite their central place in dengue surveillance, although we observed a rather strong correlation between the number of weekly entomological interventions and the increase in DENV RT-PCR positive rates. Therefore, they should be better integrated into the dengue surveillance system to improve its efficiency because both clinical surveillance and vector-based surveillance are essential for optimal dengue management [38]. The role of internet search engines in dengue surveillance has been frequently addressed in recent years [23,39]. Most studies were carried out in Asia and in larger American countries, such as Mexico and Brazil [24,25], and used a different approach based on weekly extracted data, which was not possible in our case. However, we found that even in Martinique, a smaller territory with a smaller population and, thus, with a lower data volume from internet data streams, Google queries were still correlated with an increase in the DENV RT-PCR positive rate. This means that they can also be used as part of surveillance systems across the islands of the Lesser Antilles. However, the methodological framework [29] still needs to be adapted to the size of these territories, and the simplest keywords and Google topics, when available, should be preferred over multiple spelling variations. With these small adaptations, we propose a way to offset the limitations related to smaller territories to use internet data streams in this context because their interest in emerging disease surveillance has been demonstrated in previous studies [40,41]. Overall, for smaller territories, the challenge lies in the small population size that leads to a lower weekly signal variability, thus complicating covariance estimation (and consequently the use of correlation methods). As most studies evaluating real data sources for dengue surveillance were based on correlation methods [22,37,42], we needed to confirm that these approaches were still applicable using a smaller sample. Despite these limitations, we managed to identify relevant indicators from all data sources to improve monitoring.

    Moreover, most studies on real-world data sources used symptomatic cases as gold standard [37]. However, in practice, public health authorities do not rely solely on symptomatic cases for decision-making during an outbreak. Here, we compared our data sources to the actual gold standard used by stakeholders for decision-making, which is based on objective and subjective parameters and found a reliable objective proxy (ie, the weekly DENV RT-PCR positive rates) to assess our variables. Finally, dengue hospitalizations and the symptoms associated with severe dengue cases (thrombocytopenia and liver dysfunction symptoms) should be closely monitored in inpatients, especially in children, because they tend to precede the DENV RT-PCR positive rate increase by several weeks.

    Our study also highlighted homogenous time lags across different data sources, despite their heterogeneity. This further demonstrates the importance of considering them globally rather than individually, although some of these correlations were low or moderate. For instance, an increase in hospitalized patients with liver dysfunction symptoms could prompt physicians to pay closer attention to the dengue hospitalization rate because both precede the increase in DENV RT-PCR by 5 weeks and 3 weeks, respectively. The capacity to identify variables that precede the DENV RT-PCR positive rate increase is very relevant for dengue management because a rapid and early response can influence outbreak severity [18].

    Limitations

    Our method is promising but has some limitations. First, some correlations were very low, although they were statistically significant. Second, we did not include climate data because insufficient data were available for our time frame. Several studies have demonstrated the role of climate data (especially temperature, humidity, and rainfall) in dengue surveillance, but they were mostly carried out in Asian countries [43,44] and South America [45,46]. Few studies in the Caribbean region showed the role of rainfall and temperature in increasing the risk of dengue outbreaks. However, their time lags (between 7 weeks and 5 months) [47,48] were longer than the time lags we found for the other data sources. Nevertheless, this data source could have been relevant.

    Third, our laboratory data did not include private sector biology laboratories, because they did not use RT-PCR techniques before the COVID-19 pandemic in 2020. Before this date, dengue diagnosis in private sector laboratories was based on NS1 antigen detection and needed sometimes to be confirmed by the more sensitive RT-PCR test at the hospital laboratory. It should be noted that the weekly number of DENV RT-PCR tests increased over time. Therefore, we used the weekly positive rate and not the weekly number of RT-PCR tests. Similarly, the World Health Organization dengue case classification and guidelines for hospitalization changed during the study period [49], and this may have influenced the results. Nevertheless, the rate of hospitalized patients with a dengue diagnosis was more strongly correlated with the DENV RT-PCR positive rate in our study.

    Finally, concerning the entomological data, we only studied the correlation between the weekly number of interventions and the increase in the DENV RT-PCR positive rate, but we did not consider the number of mosquito clusters (ie, several clusters can be detected during 1 intervention). We focused on the simplest variable because vector control programs vary among the countries in this region [4,6], and we wanted to develop a common approach for all Caribbean territories. Furthermore, because entomological interventions tend to increase during outbreaks, we cannot rule out the influence of these practices on our results. Nevertheless, we could show that entomological interventions precede the increase in the DENV RT-PCR positive rate by 2 weeks.

    Our approach does not intend to replace traditional monitoring systems based on syndromic surveillance, but to reduce the delays in these systems by leveraging data that are already routinely collected. These new data sources are readily available and can be easily implemented in the existing surveillance systems with minimal cost and training. However, their ability to predict future dengue outbreaks need to be thoroughly assessed, especially in smaller territories in the Lesser Antilles.

    Conclusions

    Our study shows that real-world data are valuable data sources for dengue surveillance in Martinique. Several heterogeneous data sources are relevant, from clinical data to vector control data and Google Trends data. Their increase precedes the increase in dengue cases by several weeks, and therefore, they can help to improve traditional surveillance systems to provide an early response to dengue outbreaks. By improving the integration of many different sources, we might better respond to dengue outbreaks in endemic regions, as well as to other types of vector-borne diseases such as Zika and chikungunya.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    International Classification of Diseases, 10th edition, codes of the selected diagnoses for inpatient data.

    DOCX File , 16 KB
    ‎
    Multimedia Appendix 2

    Cross-correlations between administrative data and dengue virus real-time reverse transcription polymerase chain reaction positive rate.

    PNG File , 205 KB
    ‎
    Multimedia Appendix 3

    Cross-correlations between dengue diagnoses inpatients and dengue virus real-time reverse transcription polymerase chain reaction positive rate.

    PNG File , 70 KB
    ‎
    Multimedia Appendix 4

    Cross-correlations between general dengue symptoms among inpatients and dengue virus real-time reverse transcription polymerase chain reaction positive rate.

    PNG File , 204 KB
    ‎
    Multimedia Appendix 5

    Cross-correlations between specific dengue symptoms among inpatients and dengue virus real-time reverse transcription polymerase chain reaction positive rate.

    PNG File , 198 KB
    ‎
    Multimedia Appendix 6

    Weekly correlations between Google Trends keywords and dengue virus real-time reverse transcription polymerase chain reaction positive rate.

    DOCX File , 20 KB
    ‎
    Multimedia Appendix 7

    Monthly correlations between Google Trends keywords and dengue virus real-time reverse transcription polymerase chain reaction positive rate.

    DOCX File , 20 KB
    ‎
    Multimedia Appendix 8

    Weekly cross-correlations between nonhospital data and dengue virus real-time reverse transcription polymerase chain reaction positive rate.

    PNG File , 139 KB
    ‎
    Multimedia Appendix 9

    Monthly cross-correlations between Google Trends keywords and dengue virus real-time reverse transcription polymerase chain reaction positive rate.

    PNG File , 94 KB
    1. Bhatt S, Gething PW, Brady OJ, Messina JP, Farlow AW, Moyes CL, et al. The global distribution and burden of dengue. Nature 2013 Apr 25;496(7446):504-507 [FREE Full text] [CrossRef] [Medline]
    2. Stanaway JD, Shepard DS, Undurraga EA, Halasa YA, Coffeng LE, Brady OJ, et al. The global burden of dengue: an analysis from the Global Burden of Disease Study 2013. Lancet Infect Dis 2016 Jun;16(6):712-723 [FREE Full text] [CrossRef] [Medline]
    3. Brady OJ, Gething PW, Bhatt S, Messina JP, Brownstein JS, Hoen AG, et al. Refining the global spatial limits of dengue virus transmission by evidence-based consensus. PLoS Negl Trop Dis 2012;6(8):e1760 [FREE Full text] [CrossRef] [Medline]
    4. Torres JR, Orduna TA, Piña-Pozas M, Vázquez-Vega D, Sarti E. Epidemiological characteristics of dengue disease in Latin America and in the Caribbean: a systematic review of the literature. J Trop Med 2017;2017:8045435 [FREE Full text] [CrossRef] [Medline]
    5. Dengue. Pan American Health Organization.   URL: https://www.paho.org/en/topics/dengue [accessed 2022-02-07]
    6. Cafferata ML, Bardach A, Rey-Ares L, Alcaraz A, Cormick G, Gibbons L, et al. Dengue epidemiology and burden of disease in Latin America and the Caribbean: a systematic review of the literature and meta-analysis. Value Health Reg Issues 2013 Dec;2(3):347-356. [CrossRef] [Medline]
    7. Gómez-Dantés H, Willoquet JR. Dengue in the Americas: challenges for prevention and control. Cad Saude Publica 2009;25 Suppl 1:S19-S31 [FREE Full text] [CrossRef] [Medline]
    8. Shepard DS, Undurraga EA, Betancourt-Cravioto M, Guzmán MG, Halstead SB, Harris E, et al. Approaches to refining estimates of global burden and economics of dengue. PLoS Negl Trop Dis 2014 Nov;8(11):e3306 [FREE Full text] [CrossRef] [Medline]
    9. Dussart D, Gustave J, Lagathu G, Koulman L, Lordinot M, Martial J, et al. Programme de surveillance, d'alerte et de gestion des épidémies de dengue (Psage dengue) en Martinique. Santé Publique France. 2006.   URL: https:/​/www.​santepubliquefrance.fr/​maladies-et-traumatismes/​maladies-a-transmission-vectorielle/​dengue/​documents/​rapport-synthese/​programme-de-surveillance-d-alerte-et-de-gestion-des-epidemies-de-dengue-psage-dengue-en-martinique [accessed 2022-02-05]
    10. Flahault A, Blanchon T, Dorléans Y, Toubiana L, Vibert JF, Valleron AJ. Virtual surveillance of communicable diseases: a 20-year experience in France. Stat Methods Med Res 2006 Oct;15(5):413-421. [CrossRef] [Medline]
    11. Milinovich GJ, Williams GM, Clements AC, Hu W. Internet-based surveillance systems for monitoring emerging infectious diseases. Lancet Infect Dis 2014 Feb;14(2):160-168 [FREE Full text] [CrossRef] [Medline]
    12. Jajosky RA, Groseclose SL. Evaluation of reporting timeliness of public health surveillance systems for infectious diseases. BMC Public Health 2004 Jul 26;4:29 [FREE Full text] [CrossRef] [Medline]
    13. Wilson K, Brownstein JS. Early detection of disease outbreaks using the Internet. CMAJ 2009 Apr 14;180(8):829-831 [FREE Full text] [CrossRef] [Medline]
    14. Sherman RE, Anderson SA, Dal Pan GJ, Gray GW, Gross T, Hunter NL, et al. Real-world evidence - what is it and what can it tell us? N Engl J Med 2016 Dec 08;375(23):2293-2297. [CrossRef] [Medline]
    15. Elliot AJ, Hughes HE, Hughes TC, Locker TE, Shannon T, Heyworth J, et al. Establishing an emergency department syndromic surveillance system to support the London 2012 Olympic and Paralympic Games. Emerg Med J 2012 Dec;29(12):954-960. [CrossRef] [Medline]
    16. Heffernan R, Mostashari F, Das D, Besculides M, Rodriguez C, Greenko J, et al. New York City syndromic surveillance systems. MMWR Suppl 2004 Sep 24;53:23-27 [FREE Full text] [Medline]
    17. Ginsberg J, Mohebbi MH, Patel RS, Brammer L, Smolinski MS, Brilliant L. Detecting influenza epidemics using search engine query data. Nature 2009 Feb 19;457(7232):1012-1014. [CrossRef] [Medline]
    18. Katzelnick LC, Coloma J, Harris E. Dengue: knowledge gaps, unmet needs, and research priorities. Lancet Infect Dis 2017 Mar;17(3):e88-100 [FREE Full text] [CrossRef] [Medline]
    19. Polwiang S. The time series seasonal patterns of dengue fever and associated weather variables in Bangkok (2003-2017). BMC Infect Dis 2020 Mar 12;20(1):208 [FREE Full text] [CrossRef] [Medline]
    20. Koplewitz G, Lu F, Clemente L, Buckee C, Santillana M. Predicting dengue incidence leveraging internet-based data sources. A case study in 20 cities in Brazil. PLoS Negl Trop Dis 2022 Jan;16(1):e0010071 [FREE Full text] [CrossRef] [Medline]
    21. Souza J, Leung CK, Cuzzocrea A. An innovative big data predictive analytics framework over hybrid big data sources with an application for disease analytics. In: Proceedings of the 34th International Conference on Advanced Information Networking and Applications. 2020 Presented at: AINA '20; April 15-17, 2020; Caserta, Italy p. 669-680. [CrossRef]
    22. Anno S, Hara T, Kai H, Lee MA, Chang Y, Oyoshi K, et al. Spatiotemporal dengue fever hotspots associated with climatic factors in Taiwan including outbreak predictions based on machine-learning. Geospat Health 2019 Nov 06;14(2) [FREE Full text] [CrossRef] [Medline]
    23. Husnayain A, Fuad A, Lazuardi L. Correlation between Google Trends on dengue fever and national surveillance report in Indonesia. Glob Health Action 2019;12(1):1552652 [FREE Full text] [CrossRef] [Medline]
    24. Gluskin RT, Johansson MA, Santillana M, Brownstein JS. Evaluation of Internet-based dengue query data: Google Dengue Trends. PLoS Negl Trop Dis 2014 Feb;8(2):e2713 [FREE Full text] [CrossRef] [Medline]
    25. Romero-Alvarez D, Parikh N, Osthus D, Martinez K, Generous N, Del Valle S, et al. Google Health Trends performance reflecting dengue incidence for the Brazilian states. BMC Infect Dis 2020 Mar 26;20(1):252 [FREE Full text] [CrossRef] [Medline]
    26. Saide PM, Prokopec GV, Clennon J, Che-Mendoza A, Pan American Health Organization. Technical document for the implementation of interventions based on generic operational scenarios for Aedes aegypti control. International Development Research Centre. 2019.   URL: http://hdl.handle.net/10625/60176 [accessed 2022-06-25]
    27. Google Trends.   URL: https://trends.google.com [accessed 2022-01-25]
    28. Hswen Y, Zhang A, Ventelou B. Estimation of asthma symptom onset using internet search queries: lag-time series analysis. JMIR Public Health Surveill 2021 May 10;7(5):e18593 [FREE Full text] [CrossRef] [Medline]
    29. Mavragani A, Ochoa G. Google trends in infodemiology and infoveillance: methodology framework. JMIR Public Health Surveill 2019 May 29;5(2):e13439 [FREE Full text] [CrossRef] [Medline]
    30. R Core Team. R: a language and environment for statistical computing. R Foundation for Statistical Computing. 2021.   URL: http://www.r-project.org/index.html [accessed 2021-12-20]
    31. Silge J, Robinson D. tidytext: text mining and analysis using tidy data principles in R. J Open Source Softw 2016 Jul;1(3):37. [CrossRef]
    32. Shumway RH, Stoffer DS. Time Series Analysis and Its Applications: With R Examples. New York, NY, USA: Springer; 2011.
    33. Who We Are. Pan American Health Organization.   URL: https://www.paho.org/en/who-we-are [accessed 2022-06-29]
    34. Marques-Toledo CA, Bendati MM, Codeço CT, Teixeira MM. Probability of dengue transmission and propagation in a non-endemic temperate area: conceptual model and decision risk levels for early alert, prevention and control. Parasit Vectors 2019 Jan 16;12(1):38 [FREE Full text] [CrossRef] [Medline]
    35. Mello-Román JD, Mello-Román JC, Gómez-Guerrero S, García-Torres M. Predictive models for the medical diagnosis of dengue: a case study in Paraguay. Comput Math Methods Med 2019 Jul 29;2019:7307803 [FREE Full text] [CrossRef] [Medline]
    36. Klein GH, Guidi Neto P, Tezza R. Big Data and social media: surveillance of networks as management tool. Saude Soc 2017 Mar;26(1):208-217. [CrossRef]
    37. Sylvestre E, Joachim C, Cécilia-Joseph E, Bouzillé G, Campillo-Gimenez B, Cuggia M, et al. Data-driven methods for dengue prediction and surveillance using real-world and Big Data: a systematic review. PLoS Negl Trop Dis 2022 Jan;16(1):e0010056 [FREE Full text] [CrossRef] [Medline]
    38. Comprehensive Guideline for Prevention and Control of Dengue and Dengue Haemorrhagic Fever. Revised and expanded edition. World Health Organization, Regional Office for South-East Asia. 2011.   URL: https://apps.who.int/iris/handle/10665/204894 [accessed 2022-01-26]
    39. Verma M, Kishore K, Kumar M, Sondh AR, Aggarwal G, Kathirvel S. Google search trends predicting disease outbreaks: an analysis from India. Healthc Inform Res 2018 Oct;24(4):300-308 [FREE Full text] [CrossRef] [Medline]
    40. Cai O, Sousa-Pinto B. United States influenza search patterns since the emergence of COVID-19: infodemiology study. JMIR Public Health Surveill 2022 Mar 03;8(3):e32364 [FREE Full text] [CrossRef] [Medline]
    41. Gianfredi V, Bragazzi NL, Nucci D, Martini M, Rosselli R, Minelli L, et al. Harnessing big data for communicable tropical and sub-tropical disorders: implications from a systematic review of the literature. Front Public Health 2018 Mar 21;6:90 [FREE Full text] [CrossRef] [Medline]
    42. Syamsuddin M, Fakhruddin M, Sahetapy-Engel JT, Soewono E. Causality analysis of Google trends and dengue incidence in Bandung, Indonesia with linkage of digital data modeling: longitudinal observational study. J Med Internet Res 2020 Jul 24;22(7):e17633 [FREE Full text] [CrossRef] [Medline]
    43. Liu D, Guo S, Zou M, Chen C, Deng F, Xie Z, et al. A dengue fever predicting model based on Baidu search index data and climate data in South China. PLoS One 2019 Dec 30;14(12):e0226841 [FREE Full text] [CrossRef] [Medline]
    44. Puengpreeda A, Yhusumrarn S, Sirikulvadhana S. Weekly forecasting model for dengue hemorrhagic fever outbreak in Thailand. Eng J 2020 May 31;24(3):71-87. [CrossRef]
    45. Flamand C, Fabregue M, Bringay S, Ardillon V, Quénel P, Desenclos JC, et al. Mining local climate data to assess spatiotemporal dengue fever epidemic patterns in French Guiana. J Am Med Inform Assoc 2014 Oct;21(e2):e232-e240 [FREE Full text] [CrossRef] [Medline]
    46. Baquero OS, Santana LM, Chiaravalloti-Neto F. Dengue forecasting in São Paulo city with generalized additive models, artificial neural networks and seasonal autoregressive integrated moving average models. PLoS One 2018 Apr 2;13(4):e0195065 [FREE Full text] [CrossRef] [Medline]
    47. Gharbi M, Quenel P, Gustave J, Cassadou S, La Ruche G, Girdary L, et al. Time series analysis of dengue incidence in Guadeloupe, French West Indies: forecasting models using climate variables as predictors. BMC Infect Dis 2011 Jun 09;11:166 [FREE Full text] [CrossRef] [Medline]
    48. Lowe R, Gasparrini A, Van Meerbeeck CJ, Lippi CA, Mahon R, Trotman AR, et al. Nonlinear and delayed impacts of climate on dengue risk in Barbados: a modelling study. PLoS Med 2018 Jul;15(7):e1002613 [FREE Full text] [CrossRef] [Medline]
    49. Dengue guidelines for diagnosis, treatment, prevention and control : new edition. World Health Organization. Geneva, Switzerland: World Health Organization; 2009.   URL: https://apps.who.int/iris/handle/10665/44188 [accessed 2021-12-20]

    ‎
    AUC: area under the curve
    CEDRE: Centre de Démoustication et de Recherche en Entomologie
    DENV: dengue virus
    ICD-10: International Classification of Diseases, 10th edition
    PSAGE: Programme de surveillance, d’alerte et de gestion des épidémies de dengue
    RSV: relative search volumes
    RT-PCR: real-time reverse transcriptase polymerase chain reaction

    Edited by Y Khader; submitted 08.02.22; peer-reviewed by A Lamer, C Poirier, E Luellen, N Parikh; comments to author 19.03.22; revised version received 30.06.22; accepted 22.10.22; published 22.12.22

    Copyright

    ©Emmanuelle Sylvestre, Elsa Cécilia-Joseph, Guillaume Bouzillé, Fatiha Najioullah, Manuel Etienne, Fabrice Malouines, Jacques Rosine, Sandrine Julié, André Cabié, Marc Cuggia. Originally published in JMIR Public Health and Surveillance (https://publichealth.jmir.org), 22.12.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Public Health and Surveillance, is properly cited. The complete bibliographic information, a link to the original publication on https://publichealth.jmir.org, as well as this copyright and license information must be included.