This paper is in the following e-collection/theme issue:

Infoveillance, Infodemiology, Digital Disease Surveillance, Infodemic Management (1010) JMIR Theme Issue: COVID-19 Special Issue (2388) Infodemiology and Infoveillance (1270) Infectious Diseases (non-STD/STI) (1480) Outbreak and Pandemic Preparedness and Management (1673)

Published on in Vol 7, No 2 (2021): February

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/25651, first published .
The Influence of Media Coverage and Governmental Policies on Google Queries Related to COVID-19 Cutaneous Symptoms: Infodemiology Study

The Influence of Media Coverage and Governmental Policies on Google Queries Related to COVID-19 Cutaneous Symptoms: Infodemiology Study

The Influence of Media Coverage and Governmental Policies on Google Queries Related to COVID-19 Cutaneous Symptoms: Infodemiology Study

Authors of this article:

Solene Huynh Dagher1 Author Orcid Image ;   Guillaume Lamé2 Author Orcid Image ;   Thomas Hubiche3 Author Orcid Image ;   Khaled Ezzedine1, 4 Author Orcid Image ;   Tu Anh Duong1, 5 Author Orcid Image
Article Authors Cited by (9) Tweetations (4) Metrics

    Original Paper

    1Assistance Publique des Hôpitaux de Paris (AP-HP), Département de dermatologie, Hôpital Henri Mondor, Créteil, France

    2Laboratoire Génie Industriel, CentraleSupélec, Université Paris-Saclay, Gif-sur-Yvette, France

    3Département de dermatologie, Centre hospitalier universitaire de Nice, Nice, France

    4EA 7379, EpidermE, Université Paris-Est Créteil, Créteil, France

    5Chaire Avenir Santé numérique, Équipe 8 IMRB U955, INSERM, Université Paris-Est Créteil, Créteil, France

    Corresponding Author:

    Tu Anh Duong, MD, PhD

    Assistance Publique des Hôpitaux de Paris (AP-HP)

    Département de dermatologie

    Hôpital Henri Mondor

    51 avenue du Maréchal de Lattre de Tassigny

    Créteil, 94000

    France

    Phone: 33 149812512

    Email: tu-anh.duong@aphp.fr


    Background: During COVID-19, studies have reported the appearance of internet searches for disease symptoms before their validation by the World Health Organization. This suggested that monitoring of these searches with tools including Google Trends may help monitor the pandemic itself. In Europe and North America, dermatologists reported an unexpected outbreak of cutaneous acral lesions (eg, chilblain-like lesions) in April 2020. However, external factors such as public communications may also hinder the use of Google Trends as an infodemiology tool.

    Objective: The study aimed to assess the impact of media announcements and lockdown enforcement on internet searches related to cutaneous acral lesions during the COVID-19 outbreak in 2020.

    Methods: Two searches on Google Trends, including daily relative search volumes for (1) “toe” or “chilblains” and (2) “coronavirus,” were performed from January 1 to May 16, 2020, with the United States, the United Kingdom, France, Italy, Spain, and Germany as the countries of choice. The ratio of interest over time in “chilblains” and “coronavirus” was plotted. To assess the impact of lockdown enforcement and media coverage on these internet searches, we performed an interrupted time-series analysis for each country.

    Results: The ratio of interest over time in “chilblains” to “coronavirus” showed a constant upward trend. In France, Italy, and the United Kingdom, lockdown enforcement was associated with a significant slope change for “chilblain” searches with a variation coefficient of 1.06 (SE 0.42) (P=0.01), 1.04 (SE 0.28) (P<.01), and 1.21 (SE 0.44) (P=0.01), respectively. After media announcements, these ratios significantly increased in France, Spain, Italy, and the United States with variation coefficients of 18.95 (SE 5.77) (P=.001), 31.31 (SE 6.31) (P<.001), 14.57 (SE 6.33) (P=.02), and 11.24 (SE 4.93) (P=.02), respectively, followed by a significant downward trend in France (–1.82 [SE 0.45]), Spain (–1.10 [SE 0.38]), and Italy (–0.93 [SE 0.33]) (P<.001, P=0.004, and P<.001, respectively). The adjusted R2 values were 0.311, 0.351, 0.325, and 0.305 for France, Spain, Italy, and the United States, respectively, suggesting an average correlation between time and the search volume; however, this correlation was weak for Germany and the United Kingdom.

    Conclusions: To date, the association between chilblain-like lesions and COVID-19 remains controversial; however, our results indicate that Google queries of “chilblain” were highly influenced by media coverage and government policies, indicating that caution should be exercised when using Google Trends as a monitoring tool for emerging diseases.

    JMIR Public Health Surveill 2021;7(2):e25651

    doi:10.2196/25651

    Keywords

    chilblains; COVID-19; dermatology; Google Trends; infodemiology; lesion; media; media coverage; online health information; skin lesions; trend 


    The use of social media and search engines for information on diseases and their diagnosis increased considerably in the last decade [1-3]. Infodemiology can be defined as “the science of distribution and determinants of information in an electronic medium, specifically the Internet, or in a population, with the ultimate aim to inform public health and public policy” [4-6]. Queries on search engines including Google and tracking of specific health research terms could constitute an early warning signal for the emergence of diseases, as already shown during the COVID-19 pandemic [7,8].

    The first-described COVID-19 symptoms were fever, fatigue, dyspnea, dry cough, and anorexia [9]. Later, physicians described other symptoms associated with the disease, such as anosmia or acral cutaneous lesions [10]. A group of French dermatologists reported an outbreak of these lesions, describing them as erythemas with vesicles or pustules located on extremities (eg, chilblain-like lesions) in paucisymptomatic patients, in a WhatsApp group [11]; subsequently, several studies reported this uncommon cutaneous manifestation without confirming its association with COVID-19 [12,13]. Chilblain-like lesions were the most frequently reported cutaneous findings during COVID-19.

    Studies revealed a surge in individual Google searches related to chilblains in early 2020 during COVID-19 [14-16]. Kluger et al [14] and Hughes et al [15] reported an increase in searches during early March in France, the United States, and worldwide, suggesting a potential link between searches on chilblain-like lesions and an increased frequency of such lesions in the context of COVID-19. However, these studies do not consider alternative explanations for surges in these Google searches, concurrent with the curiosity generated by public announcements on new symptoms. Previous studies have highlighted the impact of these events on Google searches during COVID-19 [17]. As opposed to anosmia and other symptoms [18], chilblain-like lesions appear late during the infection, implying that internet queries are more likely to be affected by early media announcements.

    To assess the possibility of monitoring the dynamics of COVID-19 by analyzing internet searches, we first need to understand whether the increase in Google searches for chilblains reflect actual symptoms or mere curiosity after public announcements. In particular, in the context of an emerging infectious disease, it is important to investigate the impact of external factors, such as media coverage and strong government policies, on Google queries. Using Google Trends (GT), we sought to study the influence of public announcements related to chilblain-like lesions and government decisions (eg, lockdown enforcement) on searches related to chilblains during COVID-19.


    Study Design

    We used GT to measure internet searches on chilblain-like symptoms during COVID-19 and used these data to assess the impact of media announcements and government policy decisions on internet search behaviors in accordance with existing guidelines [19].

    Search Strategy

    To select keywords, we selected commonly used search terms related to chilblain-like lesions, such as “toe” or “frostbite,” in order to retrieve queries made by the general population. We did not include “finger,” since excessive use of sanitizers during the pandemic resulted in irritation and contact dermatitis. Furthermore, we measured searches of medical terms such as “chilblains” using both the singular and plural forms of the search term. We did not take misspellings into account. Since “toe” can be used in different contexts, we restricted our searches to the “health” category. We used quotation marks for queries including strings of >2 words (eg, “dedo del pie” in Spanish). Search strings included a combination of these terms with the “+” operator denoting the ”OR” logical function (Table 1). “Coronavirus” and “COVID-19” were searched in a separate query, also restricted to the “health” category.

    Table 1. Search inputs, date of lockdown enforcement, and date of the initial press release on acral lesions in France, Spain, Italy, Germany, the United Kingdom, and the United States.
     Data pointsFranceSpainItalyGermanyUnited KingdomUnited States
    Search inputOrteil + orteils + engelure +
    engelures    		sabañones + “dedo del pie” +
    “dedos de les pies” + erupciones + pies + moretones    		gelone + piedi +
    “dita dei piedi” + geloni    		zehen + Hautausschlag + flecken + frostbeulen + erfrierungentoe + toes + frostbite + chilblain + chilblains + “chill burn”toe + toes + frostbite + chilblain + chilblains + “chill burn”
    Lockdown enforcement dateMarch 17March 13March 9March 22March 23March 21a
    Press release dateApril 6April 9April 9April 20April 14April 14

    aIn the United States, we chose March 21 as the date of lockdown enforcement, since this date differed among states: California, March 19; Illinois, New Jersey, and New York, March 22; Ohio, March 23.

    We included high-income countries whose populations are familiar with search engines and where Google is the leading search engine. Furthermore, we included countries with different government responses to the pandemic and different announcements related to chilblain-like lesions, including the United States, the United Kingdom, Spain, Italy, France, and Germany. We translated the search terms in the five languages (English, French, Spanish, Italian, and German) using both internet-based translators and support from native speakers.

    Identification of External Factors

    First, we hypothesized a change in people's internet behavior immediately after the lockdown enforcement, since the measure was a major disruption to their daily routine. Second, we hypothesized that the first announcement of a potential association between chilblain-like lesions and COVID-19 could have led to curiosity-driven internet searches. Therefore, GT data on acral lesions were assessed and compared through 3 periods: (1) from early 2020 until the lockdown was enforced, (2) from lockdown enforcement to the date when the association between acral lesions and COVID-19 was first reported, and (3) from the date of the first report of the aforementioned association until May 16, 2020.

    For each country, we documented the dates of lockdown enforcement and the dates when an association between the acral lesions and COVID-19 was first reported (Table 1). The press releases or scientific communications on chilblain-like lesions are indicated in Table 2.

    Table 2. First nationwide media release and scientific communication related to chilblain-like lesions in France, Spain, Italy, Germany, the United Kingdom, and the United States.
    CountryFirst chilblain-like lesion–related communicationDate
    FranceScientific communication: [20]; press release: [21]April 6, 2020
    SpainScientific communication: [22]April 9, 2020
    ItalyPress release: [23,24]April 9, 2020
    United KingdomPress release: [25-27]April 14, 2020
    United StatesPress release: [28]April 14, 2020
    GermanyPress release: [29]April 20, 2020

    Generation of the Data Set

    GT data from January 1 to May 16, 2020, were extracted for all six countries. We selected January 1 as the starting date to assess baseline interest before the pandemic in Europe, and May 16 because it allowed for data collection before, during, and after the lockdown (varying depending on the government measures in each country).

    Day-to-day relative search volume (RSV) data were retrieved from GT on May 19, 2020. RSVs were calculated by GT as follows: search results are proportionate to the time and location of a query. Each data point is divided by the total searches from that geographical region and the time range it represents to compare relative popularity. The resulting numbers of a topic are then scaled 0-100 on the basis of its proportion to all searches on all topics.

    Time-Series Analysis

    For each country, the RSVs for acral lesions, COVID-19, and the ratio of the RSVs for acral lesions to those of COVID-19 were plotted from March 1 to May 16, 2020.

    To assess the impact of external factors including lockdown enforcement and press releases, we used a segmented linear regression model with the approach described by Lagarde [30]. The dependent variable was RSVs, and the independent variable was time. The dates of lockdown enforcement and press release in each country were included in the model as interventions to evaluate their impact on internet search behavior. Table 3 describes the variables in this model.

    The results are expressed as estimated variation coefficient (SE) values. Autocorrelation was expected owing to the nature of the data and confirmed through a Durbin-Watson test. Thus, regression analysis was performed using the Prais-Winsten method, a generalized least squares estimator. Statistical analysis was performed using R software (version 4.0.0, The R Foundation). All tests were two-tailed, and P.05 indicated significance.

    Media contamination among countries might have occurred herein. People in one country might be aware of chilblain-like COVID-19 symptoms through foreign media before their own national media reported such information. We conducted a sensitivity analysis to assess this phenomenon, using the date of the first public communication on chilblain-like symptoms (April 6, 2020) as the date of the press release (instead of the actual date of the first press release in each country).

    Table 3. Variables in the segmented linear regression model.
    VariablesDescriptionDetails
    Dependent variable: relative search volumeRelative search volumesExtracted from Google Trends
    Independent variables

    		TimeSecular trendNumber of days since January 1, 2020

    		Media announcementChange in level due to media announcementDichotomous variable indicating whether the first media announcement in each country had already occurred

    		Time since media announcementChange in trend due to media announcementNumber of days since the first media announcement in the country (0 before this date)

    		LockdownChange in level due to the lockdownDichotomous variable indicating whether the lockdown was already enforced in each country


    		Time since lockdown enforcementChange in trend due to the lockdownNumber of days since nationwide lockdown enforcement (0 before this date)

    RSV for COVID-19 or Acral Lesions

    The frequency of queries for acral lesion–related terms did not vary from baseline values between January 1 and March 1, 2020. COVID-19–related queries increased from March 1 (Figure 1), peaking in all six countries between March 10 and 20, 2020, corresponding to the pandemic outbreak and lockdown enforcement policies in Europe. In three countries (France, Spain, and the United States), acral lesion RSVs peaked immediately after press releases. The ratios between acral lesion RSVs and COVID-19 RSVs show a constant upward trend, suggesting a relative increase in acral lesion–related searches rather than for COVID-19–related searches (Figure 1).

    ‎
    Figure 1. Graphs representing chilblain-like lesion relative search volumes (RSV), COVID-19 RSV, and the ratio of chilblain-like lesion RSV to COVID-19 RSV for France, Italy, Spain, Germany, the United States, and the United Kingdom between March 1 and May 16, 2020. Dates of press release are indicated with yellow arrows.
    View this figure

    Interrupted Time-Series Analysis

    On segmented linear regression analysis, lockdown enforcement was associated with a significant slope change in acral lesion–related searches in France, Italy, and the United Kingdom, with variation coefficients of 1.06 (SE 0.42), 1.04 (SE 0.28), and 1.21 (SE 0.44), respectively. A nonsignificant upward trend was observed in Germany, the United States, and Spain (Figure 2).

    ‎
    Figure 2. Segmented linear regression model for acral lesion–related relative search volumes. The model integrates the dates of lockdown enforcement and acral lesion–related press releases for France, Italy, Spain, Germany, the United States, and the United Kingdom. RSV: relative search volume.
    View this figure

    RSVs significantly increased before press releases in France, Spain, Italy, and the United States, with variation coefficients of 18.95 (SE 5.77), 31.31 (SE 6.31), 14.57 (SE 6.33), and 11.24 (SE 4.93), respectively, with no significant changes in Germany and the United Kingdom (0.23 [SE 6.48]; P=.97 and –4.99 [SE 6.68]; P=.46, respectively). RSVs displayed a significant downward trend after press releases in France, Spain, and Italy (variation coefficients –1.82 [SE 0.45], –1.10 [SE 0.38], and –0.93 [SE 0.33], respectively). In the United States and the United Kingdom, RSVs displayed an upward trend after press releases, albeit in a nonsignificant manner (variation coefficients –0.09 [SE 0.42]; P=.83 and –0.72 [SE 0.53]; P=.18, respectively).

    Adjusted R2 values were 0.311, 0.351, 0.325, and 0.305 for France, Spain, Italy, and the United States, respectively, suggesting an average correlation; those for Germany and the United Kingdom were 0.017 and 0.147, respectively, suggesting a weak correlation (Tables 4 and 5).

    Table 4. Coefficient values and adjusted R2 values of the linear segmented regression model integrating dates of nationwide lockdown enforcement and of acral lesion–related press releases in France, Spain, and the United States.
    TrendsFranceSpainUnited States

    		Variation coefficient (SE)P valueVariation coefficient (SE)P valueVariation coefficient (SE)P value
    Constant23.89a (2.65)<.00137.77a (3.21)<.00168.08a (3.20)<.001
    Secular trend–0.05 (0.05).32–0.07 (0.07).35–0.16b (0.06).01
    Change in level after lockdown–7.45 (5.61).19–9.01 (5.87).13–1.38 (4.63).77
    Change in trend after lockdown1.06b (0.42).010.51 (0.33).120.49 (0.29).09
    Change in level after press releases18.95b (5.77).00131.31a (6.31)<.00111.24b (4.93).02
    Change in trends after press releases–1.82a (0.45)<.001–1.10b (0.38).004–0.09 (0.42).83
    Adjusted R20.311—c0.351—0.305—

    aP<.001

    bP<.05.

    cNot applicable.

    Table 5. Coefficient values and adjusted R2 values of the linear segmented regression model integrating dates of nationwide lockdown enforcement and of acral lesion–related press releases in the United Kingdom, Italy, and Germany.
    TrendsUnited KingdomaItalyGermany

    		Variation coefficient (SE)P valueVariation coefficient (SE)P valueVariation coefficient (SE)P value
    Constant58.76b (3.35)<.00167.7b (3.32)<.00178.14b (2.77)<.001
    Secular trend–0.06 (0.07).39–0.39b (0.08)<.001–0.07 (0.05).20
    Change in level after lockdown–12.24 (6.27).05–6.85 (5.81).243.21 (5.37).55
    Change in trend after lockdown1.21c (0.44).011.04b (0.28)<.0010.24 (0.27).37
    Change in level after press releases–4.99 (6.68).4614.57c (6.33).020.23 (6.48).97
    Change in trends after press releases–0.72 (0.53).18–0.93b (0.33)<.001–0.41 (0.41).31
    Adjusted R20.147—d0.325—0.017 —

    aA sensitivity analysis was performed considering April 6, 2020, as the date of press release. This modification did not improve the fit for 4 of 6 countries (France, Italy, the United States, and Spain). For Germany, the adjusted R2 value increased from 0.017 to 0.018; United Kingdom, from 0.147 to 0.209. We obtained the following estimates for model variables: constant 59.12 (SE 3.05; P<.001), secular trend –0.07 (SE 0.063; P=.26), change in level after lockdown –20.5 (SE 6.78; P=.003), change in trend after lockdown 2.90 (SE 0.75; P<.001), change in level after press releases –15.4 (SE 6.63; P=.02), and change in trend after press releases –2.34 (SE 0.787; P=.003).

    bP<.001

    cP<.05.

    dNot applicable.


    Principal Findings

    Our study shows that GT searches for chilblain-like lesions are influenced by lockdown enforcement and media coverage. Chilblain-like lesion–related searches were the highest in France, Spain, Italy, and the United States, seemingly affected by press releases about an outbreak of acral lesions.

    While a downward trend was observed in European countries after the press release, regression analysis revealed an upward trend in the United States. However, visual and regression analyses suggest that the model does not fit the US data well, probably owing to the time parameters selected for the model because the dates of lockdown enforcement, press releases, and disease progression differed among states in the United States. This could also reflect the variations in COVID-19 dynamics nationwide.

    In France, the United Kingdom, and Italy, the lockdown policies significantly impacted GT dynamics. Lockdown enforcement did not have a significant impact in other countries. In Germany, neither the lockdown nor press releases influenced individual searches related to acral lesions. In all other countries, individual RSV searches increased before the press release. Simultaneously, the search ratio for acral lesions vs COVID-19 remained high, indicating a high interest in acral lesions rather than in COVID-19.

    Studies reporting an increase in public interest in COVID-19 before the outbreak in several countries supported the potential role of GT as a surveillance tool [31]. However, for novel diseases such as COVID-19, media coverage or significant announcements by the World Health Organization may strongly influence generic searches. Studies have reported a correlation between new COVID-19 cases or deaths and queries related to COVID-19 symptoms (specific: fever, cough, or pneumonia; unspecific: anosmia or ageusia). However, media releases regarding new clinical signs also strongly influenced internet searches [32-34]. This calls into question the potential to successfully predict the pandemic by analyzing GT data. Regarding anosmia and ageusia, an increase in RSV searches related to acral lesions preceded public scientific communications [18,35,36]. Our results confirm the generation of public interest before press releases, with a peak corresponding to media coverage in several European countries; however, caution must be exercised when using GT as an epidemiological monitoring tool for new or unknown diseases.

    Beyond epidemic monitoring, our results illustrate the use of GT in monitoring the reactions of the general population to health-related communications during a period with a high incidence of anxiety and disrupted health care provision. Spikes in interest generated by public announcements on potential new manifestations of the disease should be matched with appropriate health-related information [37]. Some studies have revealed a change in search patterns during COVID-19 for a broad range of health-related topics, including otorhinolaryngologic, lung, or dermatological diseases [33,38,39]. These queries should be matched with appropriate health-related communication to ensure that people can easily obtain the right information and take appropriate action. The increase in searches for a broad range of health-related topics might also suggest that curiosity and inquisitiveness played an essential role in these internet searches, which would undermine attempts to use GT to identify changes in disease dynamics. Moreover, physicians might have also carried out internet searches for chilblains.

    We did not perform correlation analyses with the number of COVID-19–related deaths. Indeed, chilblain-like lesions are associated with mild or asymptomatic SARS-CoV-2 infection [40,41], thus undermining correlation analyses with the number of COVID-19–related deaths, and correlations with the number of detected COVID-19 cases are unreliable owing to the limited number of tests performed at the beginning of the pandemic in many countries. Therefore, caution must be exercised when performing correlation analyses between GT data on chilblain-like symptoms and COVID-19 progression.

    Limitations

    This study has some limitations of note. First, the results depend on the quality of the initial GT searches, especially keywords. Query RSVs vary greatly in accordance with the search terms. We attempted to pragmatically use search terms that could be used by medical practitioners (such as “chilblain”) and nonmedical individuals (such as “toes”). It was difficult to identify dermatological keywords for the study. We inquired about the potential terms the general population might have used to search for chilblain-like lesions (showing images of chilblains). Most of our participants with a nonmedical background would have searched “eczema” or “urticaria” on Google. In dermatology, it would be ideal to conduct the same study with individuals clicking on pictures resembling their cutaneous lesions [10].

    We used direct language translations and did not include misspellings, accents, and special character variations. Thus, we may have missed certain nuances and additional queries. However, we believe that using only the correct spelling might underestimate the RSV, making our results even more robust. To evaluate the potential limitation due to keywords, we assessed the results of “related queries” (top and rising) for the same dates and regions and compared them with GT search terms. It appears that “coronavirus” or “covid” is often associated with “toe” or “frostbite.” However, we intentionally excluded COVID-19–related keywords in order to capture searches performed by individuals who did not consider a potential association between acral lesions and COVID-19.

    Furthermore, our data set is limited to the pandemic's first wave between January and May 2020. Studies using these initial data should be repeated when more data are available to determine whether the results remain applicable for subsequent waves of the pandemic.

    In addition, our nationwide analyses did not consider the heterogeneity of the regional effects of the pandemic in these countries. This holds particularly true for Italy and the United States, which have been severely affected by the pandemic (eg, Lombardy and New York state, respectively). Thus, state-level analysis of pandemic hotspots might have yielded more reliable results. In some countries including Germany, the incidence of COVID-19 was relatively low. Another study limitation is our use of only one search engine; nonetheless, Google is the most frequently used internet search engine in these six countries [42].

    Moreover, internet users are not necessarily representative of the general population, especially in high-income countries with an increasingly elderly population. However, chilblain-like lesions are observed in young patients, who are more prone to searching information on the internet.

    Finally, the pathophysiological link between chilblain-like lesions and COVID-19 remains unclear [16,40,43] and is beyond the scope of this study.

    Conclusions

    This study suggests that during the first wave of COVID-19, public announcements and government policies served as driving factors for Google queries related to acral lesions. For emerging diseases, the use of GT to detect new symptoms and monitor disease progression is limited by high media coverage levels and government policies.

    Acknowledgments

    We are grateful to Dr Jason Shourick for his advice and Dr Charbel Skayem for English editing.

    Authors' Contributions

    SHD, GL, TH, KE, and TAD reviewed all the study data and ensured data integrity and accuracy of the data analysis. SHD and TAD conceived and designed the study. SHD acquired the data. All authors analyzed and interpreted the data. SHD, KE, and TAD drafted the manuscript. All authors critically revised the manuscript. SHD and GL performed the statistical analysis. TAD provided administrative, technical, and material support and supervised the study. All the authors reviewed and approved the final version submitted for publication.

    Conflicts of Interest

    None declared.

    1. Nuti SV, Wayda B, Ranasinghe I, Wang S, Dreyer RP, Chen SI, et al. The Use of Google Trends in Health Care Research: A Systematic Review. PLoS One 2014;9(10):e109583 [FREE Full text] [CrossRef] [Medline]
    2. Mavragani A, Ochoa G, Tsagarakis KP. Assessing the Methods, Tools, and Statistical Approaches in Google Trends Research: Systematic Review. J Med Internet Res 2018 Nov 06;20(11):e270 [FREE Full text] [CrossRef] [Medline]
    3. Bernardo TM, Rajic A, Young I, Robiadek K, Pham MT, Funk JA. Scoping Review on Search Queries and Social Media for Disease Surveillance: A Chronology of Innovation. J Med Internet Res 2013 Jul;15(7):e147 [FREE Full text] [CrossRef] [Medline]
    4. Mavragani A. Infodemiology and Infoveillance: Scoping Review. J Med Internet Res 2020 Apr 28;22(4):e16206 [FREE Full text] [CrossRef] [Medline]
    5. Eysenbach G. Infodemiology and Infoveillance: Framework for an Emerging Set of Public Health Informatics Methods to Analyze Search, Communication and Publication Behavior on the Internet. J Med Internet Res 2009;11(1):e11 [FREE Full text] [CrossRef] [Medline]
    6. Eysenbach G. Infodemiology and Infoveillance Tracking Online Health Information and Cyberbehavior for Public Health. Am J Prev Med 2011 May;40(5 Suppl 2):S154-S158. [CrossRef] [Medline]
    7. Rovetta A, Bhagavathula AS. COVID-19-Related Web Search Behaviors and Infodemic Attitudes in Italy: Infodemiological Study. JMIR Public Health Surveill 2020 May 05;6(2):e19374 [FREE Full text] [CrossRef] [Medline]
    8. Cousins HC, Cousins CC, Harris A, Pasquale LR. Regional Infoveillance of COVID-19 Case Rates: Analysis of Search-Engine Query Patterns. J Med Internet Res 2020 Jul 30;22(7):e19483 [FREE Full text] [CrossRef] [Medline]
    9. Wang L, Wang Y, Ye D, Liu Q. Review of the 2019 Novel Coronavirus (SARS-CoV-2) Based on Current Evidence. Int J Antimicrob Agents 2020 Jun;55(6):105948 [FREE Full text] [CrossRef] [Medline]
    10. Darlenski R, Tsankov N. COVID-19 Pandemic and the Skin: What Should Dermatologists Know? Clin Dermatol 2020;38(6):785-787 [FREE Full text] [CrossRef] [Medline]
    11. Duong TA, Velter C, Rybojad M, Comte C, Bagot M, Sulimovic L, et al. Did Whatsapp Reveal a New Cutaneous COVID-19 Manifestation? J Eur Acad Dermatol Venereol 2020 Aug;34(8):e348-e350 [FREE Full text] [CrossRef] [Medline]
    12. Bouaziz J, Duong T, Jachiet M, Velter C, Lestang P, Cassius C, et al. Vascular Skin Symptoms in COVID-19: a French Observational Study. J Eur Acad Dermatol Venereol 2020 Sep;34(9):e451-e452 [FREE Full text] [CrossRef] [Medline]
    13. Marzano AV, Genovese G. Response to: "Reply to 'Varicella-like exanthem as a specific COVID-19-associated skin manifestation: multicenter case series of 22 patients': To consider varicella-like exanthem associated with COVID-19, virus varicella zoster and virus herpes simplex must be ruled out". J Am Acad Dermatol 2020 Sep;83(3):e255-e256 [FREE Full text] [CrossRef] [Medline]
    14. Kluger N, Scrivener JN. The Use of Google Trends for Acral Symptoms During COVID-19 Outbreak in France. J Eur Acad Dermatol Venereol 2020 Aug;34(8):e358-e360. [CrossRef] [Medline]
    15. Hughes M, Rogers S, Lepri G, Bruni C, Matucci-Cerinic M. Further Evidence that Chilblains are a Cutaneous Manifestation of COVID-19 Infection. Br J Dermatol 2020 Sep;183(3):596-598 [FREE Full text] [CrossRef] [Medline]
    16. Kluger N. Why are Chilblains Underreported in Nordic Countries During the COVID-19 Pandemic? An Analysis of Google Trends. J Eur Acad Dermatol Venereol 2021 Feb;35(2):e100-e101 [FREE Full text] [CrossRef] [Medline]
    17. Sousa-Pinto B, Anto A, Czarlewski W, Anto J, Fonseca A, Bousquet J. Assessment of the Impact of Media Coverage on COVID-19-Related Google Trends Data: Infodemiology Study. J Med Internet Res 2020 Aug 10;22(8):e19611 [FREE Full text] [CrossRef] [Medline]
    18. Walker A, Hopkins C, Surda P. Use of Google Trends to Investigate Loss-of-Smell-Related Searches During the COVID-19 Outbreak. Int Forum Allergy Rhinol 2020 Jul;10(7):839-847 [FREE Full text] [CrossRef] [Medline]
    19. Mavragani A, Ochoa G. Google Trends in Infodemiology and Infoveillance: Methodology Framework. JMIR Public Health Surveill 2019 May 29;5(2):e13439 [FREE Full text] [CrossRef] [Medline]
    20. Le Syndicat National des Dermatologues-Vénéréologues (SNDV) alerte sur les manifestations cutanées du COVID 19. Syndicat National des Dermatologues - Vénéréologues. 2020 Apr 06.   URL: https://www.syndicatdermatos.org/wp-content/uploads/2020/04/cp-covid-peau-6-avril.pdf [accessed 2021-02-09]
    21. Pecnard J, Frouville M. Les dermatologues alertent sur de nouveaux symptômes cutanés du COVID-19. BFM TV. 2020 Apr 06.   URL: https:/​/www.​bfmtv.com/​sante/​les-dermatologues-alertent-sur-de-nouveaux-symptomes-cutanes-du-covid-19_AN-202004060271.​html [accessed 2021-02-09]
    22. Registro De Casos Compatibles COVID-19. Consejo General de Colegios Oficiales de Podólogos. 2020 Apr 09.   URL: https://cgcop.es/registro-de-casos-compatibles-covid-19/ [accessed 2021-02-09]
    23. No está demostrado que haya niños con sintomatología de Coronavirus en manos y pies. EITB.EUS. 2020 Apr 09.   URL: https:/​/www.​eitb.eus/​es/​noticias/​sociedad/​detalle/​7156303/​no-esta-demostrado-haya-ninos-sintomas-coronavirus-manos-pies/​ [accessed 2021-02-09]
    24. Detectadas lesiones dermatológicas en los pies de niños y adolescentes con coronavirus. 20Minutos. 2020 Apr 09.   URL: https:/​/www.​20minutos.es/​noticia/​4222618/​0/​detectadas-lesiones-dermatologicas-pies-ninos-adolescentes-coronavirus/​ [accessed 2021-02-09]
    25. Mullin G. NEW SIGN Bizarre marks on your feet could be ‘early coronavirus symptom’, experts discover. The Sun. 2020 Apr 14.   URL: https://www.thesun.co.uk/news/11392789/marks-on-feet-early-coronavirus-symptom/ [accessed 2021-02-09]
    26. Chalmers V. Could bruises on your FEET be a sign of coronavirus? Doctors suspect a link after patients with chickenpox-like lesions on their toes test positive for the killer infection - as another study warns headaches and feeling dizzy may also be signs of COVID-19. Daily Mail. 2020 Apr 14.   URL: https:/​/www.​dailymail.co.uk/​news/​article-8217901/​Could-bruises-FEET-sign-coronavirus-Doctors-suspect-link.​html [accessed 2021-02-09]
    27. Pochin C. Possible sign of coronavirus to look out for on feet - even if you don't have symptoms. Mirror. 2020 Apr 14.   URL: https://www.mirror.co.uk/lifestyle/health/possible-sign-coronavirus-look-out-21862683 [accessed 2021-02-09]
    28. Salo J. Foot sores could be an early sign of coronavirus, experts say. New York Post. 2020 Apr 14.   URL: https://nypost.com/2020/04/14/foot-sores-could-be-an-early-sign-of-coronavirus-experts-say/ [accessed 2021-02-09]
    29. Blaue Flecken an Zehen könnten auf Corona hindeuten. Bild. 2020 Apr 20.   URL: https:/​/www.​bild.de/​ratgeber/​gesundheit/​gesundheit/​coronavirus-blaue-flecken-an-zehen-koennen-auf-covid-19-hindeuten-70151296.​bild.​html [accessed 2021-02-09]
    30. Lagarde M. How to do (or not to do) ... Assessing the Impact of a Policy Change with Routine Longitudinal Data. Health Policy Plan 2012 Jan;27(1):76-83. [CrossRef] [Medline]
    31. Effenberger M, Kronbichler A, Shin JI, Mayer G, Tilg H, Perco P. Association of the COVID-19 Pandemic With Internet Search Volumes: A Google Trends Analysis. Int J Infect Dis 2020 Jun;95:192-197 [FREE Full text] [CrossRef] [Medline]
    32. Szmuda T, Ali S, Hetzger TV, Rosvall P, Słoniewski P. Are Online Searches for the Novel Coronavirus (COVID-19) Related to Media or Epidemiology? A Cross-sectional Study. Int J Infect Dis 2020 Aug;97:386-390 [FREE Full text] [CrossRef] [Medline]
    33. Walker MD, Sulyok M. Online Behavioural Patterns for Coronavirus Disease 2019 (COVID-19) in the United Kingdom. Epidemiol Infect 2020 Jun 05;148:e110 [FREE Full text] [CrossRef] [Medline]
    34. Bento AI, Nguyen T, Wing C, Lozano-Rojas F, Ahn Y, Simon K. Evidence From Internet Search Data Shows Information-Seeking Responses to News of Local COVID-19 Cases. Proc Natl Acad Sci U S A 2020 May 26;117(21):11220-11222 [FREE Full text] [CrossRef] [Medline]
    35. Panuganti BA, Jafari A, MacDonald B, DeConde AS. Predicting COVID-19 Incidence Using Anosmia and Other COVID-19 Symptomatology: Preliminary Analysis Using Google and Twitter. Otolaryngol Head Neck Surg 2020 Sep;163(3):491-497 [FREE Full text] [CrossRef] [Medline]
    36. Sousa-Pinto B, Anto A, Czarlewski W, Anto J, Fonseca J, Bousquet J. Assessment of the Impact of Media Coverage on COVID-19-Related Google Trends Data: Infodemiology Study. J Med Internet Res 2020 Aug 10;22(8):e19611 [FREE Full text] [CrossRef] [Medline]
    37. Lieberman-Cribbin W, Alpert N, Gonzalez A, Schwartz R, Taioli E. Three Months of Informational Trends in COVID-19 Across New York City. J Public Health (Oxf) 2020 Aug 18;42(3):448-450 [FREE Full text] [CrossRef] [Medline]
    38. Barbosa M, Morais-Almeida M, Sousa C, Bousquet J. The "Big Five" Lung Diseases in CoViD-19 Pandemic - a Google Trends analysis. Pulmonology 2021;27(1):71-72 [FREE Full text] [CrossRef] [Medline]
    39. Searle T, Al-Niaimi F, Ali FR. Google Searches in Patient Self-Care Increase During the COVID-19 Lockdown. J Am Acad Dermatol 2020 Nov;83(5):e349 [FREE Full text] [CrossRef] [Medline]
    40. Hubiche T, Le Duff F, Chiaverini C, Giordanengo V, Passeron T. Negative SARS-CoV-2 PCR in Patients With Chilblain-like Lesions. Lancet Infect Dis 2020 Jun 18 [FREE Full text] [CrossRef] [Medline]
    41. Hubiche T, Cardot-Leccia N, Le Duff F, Seitz-Polski B, Giordana P, Chiaverini C, et al. Clinical, Laboratory, and Interferon-Alpha Response Characteristics of Patients With Chilblain-like Lesions During the COVID-19 Pandemic. JAMA Dermatol 2020 Nov 25. [CrossRef] [Medline]
    42. The Top 500 Sites on the Web. Alexa.   URL: https://www.alexa.com/topsites/countries [accessed 2021-02-09]
    43. Herman A, Peeters C, Verroken A, Tromme I, Tennstedt D, Marot L, et al. Evaluation of Chilblains as a Manifestation of the COVID-19 Pandemic. JAMA Dermatol 2020 Sep 01;156(9):998-1003. [CrossRef] [Medline]

    ‎
    GT: Google Trends
    RSV: relative search volume

    Edited by G Eysenbach; submitted 10.11.20; peer-reviewed by B Sousa-Pinto, A Mavragani; comments to author 25.11.20; revised version received 15.12.20; accepted 22.01.21; published 25.02.21

    Copyright

    ©Solene Huynh Dagher, Guillaume Lamé, Thomas Hubiche, Khaled Ezzedine, Tu Anh Duong. Originally published in JMIR Public Health and Surveillance (http://publichealth.jmir.org), 25.02.2021.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Public Health and Surveillance, is properly cited. The complete bibliographic information, a link to the original publication on http://publichealth.jmir.org, as well as this copyright and license information must be included.