This paper is in the following e-collection/theme issue:

Longitudinal and Cohort Studies in Public Health (254) JMIR Theme Issue: COVID-19 Special Issue (2388) Outbreak and Pandemic Preparedness and Management (1673) JMH Theme Issue: COVID-19 and Mental Health: Impact and Interventions (371) Infectious Diseases (non-STD/STI) (1478) Depression and Mood Disorders; Suicide Prevention (1271) Anxiety and Stress Disorders (999) LGBTQ Issues (414)

Published on in Vol 10 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/47048, first published .
Depression and Anxiety Symptoms Among Cisgender Gay and Bisexual Men During the Onset of the COVID-19 Pandemic: Time Series Analysis of a US National Cohort Study

Depression and Anxiety Symptoms Among Cisgender Gay and Bisexual Men During the Onset of the COVID-19 Pandemic: Time Series Analysis of a US National Cohort Study

Depression and Anxiety Symptoms Among Cisgender Gay and Bisexual Men During the Onset of the COVID-19 Pandemic: Time Series Analysis of a US National Cohort Study

Authors of this article:

Chloe Mirzayi1 Author Orcid Image ;   Drew Westmoreland1 Author Orcid Image ;   Matthew Stief1 Author Orcid Image ;   Christian Grov1 Author Orcid Image
Article Authors Cited by Tweetations (2) Metrics

    Original Paper

    CUNY Graduate School of Public Health and Health Policy, New York, NY, United States

    Corresponding Author:

    Christian Grov, PhD

    CUNY Graduate School of Public Health and Health Policy

    55 W 125 Street

    New York, NY, 10027

    United States

    Phone: 1 6463640254

    Email: cgrov@sph.cuny.edu


    Background: The onset of the COVID-19 pandemic in the United States in March 2020 caused a dramatic change in the way many people lived. Few aspects of daily life were left undisrupted by the pandemic’s onset as well as the accompanying policies to control the spread of the disease. Previous research has found that the pandemic may have significantly impacted the mental health of lesbian, gay, bisexual, transgender, and queer (LGBTQ) individuals—potentially more so than other individuals. However, the pandemic did not affect all areas of the United States at the same time, and there may be regional variation in the impact of the onset of the pandemic on depressive symptoms among LGBTQ individuals.

    Objective: To assess regional variation of the impact of the pandemic, we conducted a time series analysis stratified by US geographic region to examine symptoms of depression and anxiety among a sample of primarily cisgender gay and bisexual men before and after the onset of the COVID-19 pandemic in the United States.

    Methods: In total, 5007 participants completed assessments as part of the Together 5000 study, an ongoing prospective cohort study. Depressive and anxiety symptoms were measured using the Patient Health Questionnaire-4. Patient Health Questionnaire-4 scores were graphed as a function of days from March 15, 2020. Locally estimated scatterplot smoothing trend lines were applied. A sieve-bootstrap Mann-Kendall test for monotonic trend was conducted to assess the presence and direction of trends in the scatterplots. We then compared the observed trends to those observed for 1 year prior (2018-2019) to the pandemic onset using data collected from the same sample.

    Results: Significant positive trends were detected for the Northeast (P=.03) and Midwest (P=.01) regions of the United States in the 2020 assessment, indicating that symptoms of anxiety and depression were increasing in the sample in these regions immediately prior to and during the onset of the pandemic. In contrast, these trends were not present in data from the 2018 to 2019 assessment window.

    Conclusions: Symptoms of anxiety and depression increased among the study population in the Northeast and Midwest during the beginning months of the COVID-19 pandemic, but similar increase was not observed in the South and West regions. These trends were also not found for any region in the 2018 to 2019 assessment window. This may indicate region-specific trends in anxiety and depression, potentially driven by the burden of the pandemic and policies that varied from region to region. Future studies should consider geographic variation in COVID-19 spread and policies as well as explore potential mechanisms by which this could influence the mental health of LGBTQ individuals.

    JMIR Public Health Surveill 2024;10:e47048

    doi:10.2196/47048

    Keywords

    COVID-19 pandemic; lesbian, gay, bisexual, transgender, and queer; LGBTQ; mental health; depression; anxiety; time series; gay and bisexual men; cisgender gay; pandemic; gay 


    The onset of the COVID-19 pandemic in the United States in early 2020 represented a nearly unprecedented disruption in daily life for many Americans. Widespread disruptions were present in nearly every facet of daily life, including in workplaces, schools, and social settings. Mandatory business closures and recommended social distancing were implemented with some heterogeneity in the United States. Many states in the Northeast, Midwest, and West implemented stay-at-home orders in March 2020 prior to Southern states, where the pandemic later took hold in the summer [1].

    Several large studies have linked the onset of the pandemic to a significant increase in the symptoms of depression and anxiety in US adults [2-5]. Other studies have found that lesbian, gay, bisexual, transgender, and queer (LGBTQ) people may be particularly vulnerable to developing symptoms of depression and anxiety relative to non-LGBTQ populations [6]. For instance, a study of cannabis users conducted during the pandemic found that the LGBTQ cannabis users were more likely to report symptoms of depression and anxiety [7]. Similarly, a national longitudinal cohort study of LGTBQ adults found increased anxiety and depression symptoms among participants after the beginning of the pandemic [8]. Additionally, a study of LGBTQ college students found that nearly half had unmet mental health needs during the first few months of the pandemic [6]. These findings may be due to being confined in uncomfortable home situations or isolation from friends, which may have disparate impacts on LGBTQ individuals compared to others [9]. However, other studies have found decreased anxiety symptoms and no differences in depressive symptoms before and after the start of the pandemic [10].

    Recently, researchers have proposed potential mechanisms by which the onset of the COVID-19 pandemic may have disproportionately affected LGBTQ people. A web-based study in Germany during the pandemic found that depressive symptoms were mediated by loneliness [11], while a study of Mexican LGBTQ people found that perceived social support also acted as a mediator [12]. Taken together, it appears that a lack of access to supportive friends and other members of the LGBTQ community, and the accompanying loneliness, may be one mechanism through which the COVID-19 pandemic, and associated lockdowns, had a greater impact on LGBTQ individuals compared to others.

    Despite several studies finding that LGBTQ people were more likely to experience symptoms of depression and anxiety with the onset of the COVID-19 pandemic, we have been unable to identify any studies that examined trends in symptoms and anxiety over time for the period. Time series studies have been used to examine trends in mental health leading up to and immediately following the 2016 US presidential election [13], in mental health referrals during the pandemic [14,15], and in suicide mortality also during the COVID-19 pandemic [16]. However, to our knowledge, no study has examined symptoms of depression and anxiety in an LGBTQ population during the onset of the COVID-19 pandemic in the United States using a time series approach.

    The aim of this study was to examine the effects of the onset of the first wave of the COVID-19 pandemic on a population of primarily gay and bisexual men, but also transgender men and transgender women as well as nonbinary people, using time series analysis. Given the heterogeneity of the burden of cases and in COVID-19 policies, analyses were stratified by US census region. We hypothesized that regions that were more impacted by the early onset of the COVID-19 pandemic or had more stringent pandemic control policies or recommendations (eg, the Northeast) would show an increase in symptoms of depression and anxiety as the pandemic progressed.


    Study Population

    Participants were members of Together 5000, a US national cohort of primarily cisgender gay and bisexual men at risk for HIV recruited from sexual networking applications. Members of the cohort complete yearly web-based surveys as well as at-home HIV testing beginning in 2017 and running through the onset of the pandemic. The yearly web-based surveys assessed a variety of health-related domains such as socioeconomic factors, drug and alcohol use, sexual behaviors, food and housing insecurity, and mental health measures. A detailed profile of the study procedures and participants has been published elsewhere [17].

    Measures

    Data Collection

    Data for this study were primarily taken from participants’ 24-month assessment. These assessments began on November 20, 2019 (–116 days), and ran through August 15, 2020 (+153 days)—with some participants completing their assessment prior to the onset of the COVID-19 pandemic in the United States and others completing it after. We defined the onset as March 15, 2020, which roughly coincides with the beginning of the week in which many local and state governments announced mandatory closure of nonessential businesses and schools [18-20].

    To establish whether a similar trend would be observed in prior yearly assessments, we compared 24-month results to participants’ 12-month assessment (all of which were conducted prior to the pandemic). Survey completion dates were calculated relative to March 15, 2019, and ranged from November 7, 2018 (–127 days), to June 24, 2019 (+101 days).

    Demographics

    On the baseline survey, race and ethnicity information was assessed using a list of common racial and ethnic categories for participants to select all that apply. Participants were also given the ability to specify their own race or ethnicity. These options were recoded to a 4-category variable representing Black, Hispanic, White, and multiracial or others. To assess current gender identity, participants were asked their assigned sex at birth as well as their current gender identity. Participants had the option of writing in their own gender identity. The variable was then recoded into 5 categories: cisgender man, cisgender woman, transgender man, transgender woman, or others or nonbinary. Finally, participants were asked to select the best option for their sexual orientation: gay, queer, or homosexual; bisexual; straight or heterosexual; or others. This variable was not recoded prior to analysis.

    Region

    Participants self-reported their zip codes at baseline and were able to provide updated zip codes during the 12- and 24-month assessments. These zip codes were coded into state of residence, which in turn were categorized according to US census regions [21].

    Patient Health Questionnaire-4

    The 4-item Likert-type Patient Health Questionnaire-4 (PHQ-4) was used to assess symptoms of anxiety and depression. The Patient Health Questionnaire-2, a measure of depression, and Generalized Anxiety Disorder-2, a measure of anxiety, constitute the PHQ-4. The reliability and validity of the PHQ-4 in the general population have been previously established [22]. The PHQ-4 is scored from 0 to 12, with an increasing score indicating increasingly severe anxiety and depressive symptomology. The continuous measure was used for analyses.

    Statistical Analysis

    PHQ-4 scores were stratified by US census region of residence and then plotted as a function of the survey completion date for participants completing the 24-month assessment, which ran from November 20, 2019, to August 15, 2020. A locally estimated scatterplot smoothing trend line with 95% CI was applied. A sieve-bootstrap Mann-Kendall test for monotonic trends was conducted to assess the presence and direction of trends in the scores. All steps of this analysis were then repeated for the 12-month assessment for comparison.

    Analyses were conducted in R (version 4.1.0; R Foundation for Statistical Computing). Plots and trend lines were created using the ggplot2 package [23], while the test for trend was conducted using the funtimes package [24].

    Ethical Considerations

    All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional review board (Institutional Review Board of the City University of New York Graduate School of Public Health and Health Policy, IRB file #2017-0893) and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. All participants provided informed consent for data collection at each assessment. Participant data were deidentified and stored in an encrypted closed network. Participants received US $25 Amazon gift cards for completing study assessments.


    In total, 5007 participants completed the 24-month assessment survey and resided in 1 of the 4 US census regions. An additional 22 participants completed the survey but resided in a US territory and were not included in these analyses. Of these 5007 participants, 784 (15.6%) resided in the Northeast, 780 (15.6%) resided in the Midwest, 2285 (45.6%) resided in the South, and 1158 (23.1%) resided in the West.

    Demographically, 507 (10.1%) participants were Black, 1213 (24.2%) were Hispanic, 2677 (53.5%) were White, and 610 (12.2%) were another race or multiracial. The mean age of the sample at the 24-month assessment was 32.9 (SD 7.5) years. The sample was primarily cisgender men with 4885 (97.6%) identifying as such, with the remaining 122 (2.4%) participants identifying as transgender men, transgender women, or nonbinary. A substantial proportion of the sample identified as gay, queer, or homosexual (n=4291, 85.7%) or bisexual (n=660, 13.2%), with the remainder identifying as others. Full demographics as well as PHQ-4 scores stratified by demographic variables are presented in Table 1.

    The mean PHQ-4 score at the 24-month assessment was 4.0 (SD 3.0), while the mean PHQ-4 score at the 12-month assessment was 3.7 (SD 2.4). A paired 2-tailed t test revealed this difference to be statistically significant (t4653=2.99; P=.019), indicating an overall increase in PHQ-4 scores between the 12-month assessment and the 24-month assessment.

    Survey completion dates for the 24-month assessment were calculated relative to the onset of the COVID-19 pandemic, with a 0 representing March 15, 2020. These dates ranged from November 20, 2019, to August 15, 2020. Individual participant Generalized Anxiety Disorder–Patient Health Questionnaire scores were then plotted as a function of survey completion dates stratified by US census region.

    The locally estimated scatterplot smoothing trend line in PHQ-4 scores for the Northeast revealed a trend downward in the days immediately prior to the onset of the pandemic with an upturn in scores following the onset (Figure 1). This trend was significant (τ=0.12; P=.03). A small, steady increase in scores was also observed among participants in the Midwest, beginning prior to the pandemic onset and continuing through to the summer (τ=0.14; P=.01). No trends are immediately apparent in the trend lines for the South and West, and tests for trends were not statistically significant (Table 2).

    To establish whether a similar trend would be observed in other yearly assessments, the same analysis was conducted for the 12-month assessment (Figure 2). Inspection of the figure reveals a decrease in scores for participants in the Northeast after March 15, 2019, followed by a sharp upturn at the end. Midwest participant scores decreased markedly shortly after March 15, 2019. A small, nonsignificant oscillation in scores was observed among Western participants. No clear trend was observed in scores among Southern participants. All tests for monotonic trends were nonsignificant for 2019 (all P>.05; Table 2), indicating, compared to 2020, there was no observed trend in PHQ-4 scores over time.

    Table 1. Demographics of a prospective US national cohort study of primarily cisgender gay and bisexual men from 2019 to 2020 stratified by US census region with PHQ-4a (anxiety and depressive symptoms) scores.
    DemographicsNortheast (n=784)Midwest (n=780)South (n=2285)West (n=1158)Total (N=5007)PHQ-4 score, mean (SD)
    Race or ethnicity, n (%)

    		Black77 (9.8)55 (7.1)330 (14.4)45 (3.9)507 (10.1)2.8 (3.3)

    		Hispanic158 (20.2)99 (12.7)580 (25.4)376 (32.5)1213 (24.2)3.1 (3.4)

    		White419 (53.4)544 (69.7)1146 (50.2)568 (49.1)2677 (53.5)3.7 (3.5)

    		Others or multiracial130 (16.6)82 (10.5)229 (10)169 (14.6)610 (12.2)3.5 (3.6)
    Gender, n (%)

    		Cisgender men758 (96.7)762 (97.7)2234 (97.8)1131 (97.7)4885 (97.6)3.4 (3.5)

    		Transgender men9 (1.1)5 (0.6)18 (0.8)7 (0.6)39 (0.8)5.7 (4.1)

    		Transgender women1 (0.1)3 (0.4)10 (0.4)7 (0.6)21 (0.4)1.8 (2.0)

    		Others or nonbinary16 (2)10 (1.3)23 (1)13 (1.1)62 (1.2)5.4 (4.1)
    Sexual orientation, n (%)

    		Gay, queer, or homosexual697 (88.9)678 (86.9)1926 (84.3)990 (85.5)4291 (85.7)3.5 (3.5)

    		Bisexual81 (10.3)96 (12.3)328 (14.4)155 (13.4)660 (13.2)3.3 (3.5)

    		Straight or heterosexual0 (0)2 (0.3)7 (0.3)4 (0.3)13 (0.3)3.5 (4.1)

    		Others6 (0.8)4 (0.5)24 (1.1)9 (0.8)43 (0.9)4.2 (3.9)
    Age (years), mean (SD)32.6 (7.5)33.5 (8.0)32.5 (8.1)33.5 (7.1)32.9 (7.9)N/Ab

    aPHQ-4: Patient Health Questionnaire-4.

    bN/A: not applicable.

    ‎
    Figure 1. US census region–stratified trends in PHQ-4 scores over time before and after the onset of the COVID-19 pandemic of a prospective US national cohort study of primarily cisgender gay and bisexual men in 2020. PHQ-4: Patient Health Questionnaire-4.
    Table 2. The sieve-bootstrap Mann-Kendall test for monotonic trend of Patient Health Questionnaire-4 (depression and anxiety symptoms) of a prospective US national cohort study of primarily cisgender gay and bisexual men from 2019 to 2020. Tests were conducted for each regional time series for each year. Positive τ indicates an increasing monotonic trend.
    Region20192020

    		τP valueτP value
    Northeast0.05.440.12.03
    Midwest0.00.960.14.01
    South0.01.830.00.96
    West0.07.260.03.50
    ‎
    Figure 2. US census region–stratified trends in PHQ-4 scores over time before and 1 year prior to the onset of the COVID-19 pandemic of a prospective US national cohort study of primarily cisgender gay and bisexual men in 2019. PHQ-4: Patient Health Questionnaire-4.

    Principal Findings

    The region-stratified time series analysis of symptoms of depression and anxiety in the days leading up to and following the onset of the COVID-19 pandemic in the United States revealed significant positive trends among participants in the Northeast and Midwest. These trends were not observed in the South or West, nor were they present the previous year.

    The disparate impact of the COVID-19 pandemic on the Northeast [25] as well as heterogeneous COVID-19 policies across the United States may explain the observed trends. Other studies have found that lockdown policies, along with adherence to them, may have resulted in increased depressive symptoms [26].

    Comparison to Prior Work

    The findings of significant positive trends in symptoms of depression and anxiety during the onset of the COVID-19 pandemic were consistent with similar studies that found an increased prevalence of depression and anxiety among the general population as well as LGBTQ people during the COVID-19 pandemic [2,6]. However, to our knowledge, this is the first time-series analysis of symptoms of anxiety and depression conducted in an LGBTQ population with data before and after the onset of the COVID-19 pandemic in the United States as well as the first study to identify a regional trend in this population.

    Other time series studies have shown the impact of the COVID-19 pandemic on related mental health constructs. A UK study found a significant decrease in referrals to mental health services during the start of the pandemic, although this study was not focused specifically on sexual minorities [14]. Another study of the general population found a decrease in emergency department visits for psychiatric issues [27]. The decrease in mental health service use combined with increased symptoms could indicate a clear, unmet need for mental health care during the beginning of the COVID-19 pandemic. It is important to consider that the pandemic may have had differential effects on sexual minority individuals based on stigma and vulnerabilities. For instance, young adults who had to return to their parents’ homes as a result of the pandemic were found to have faced greater psychological distress [28]. Future studies could explore whether the observed regional effects were modified by changes in living arrangement. Another potential effect modifier could be social support that other studies have found as an important protective effect for sexual minority populations against depressive symptoms [29].

    Limitations

    There are some limitations to this study. Survey completion dates were used in calculating days relative to March 15, 2020, and March 15, 2019. It is possible for participants to have started the survey, completed the PHQ-4, and then not completed the survey in its entirety until several days later; however, we do not believe this would have tremendously impacted responses in a meaningful way nor were there enough participants who started before March 15, 2020, and completed it after March 15, 2020, to have had a discernible impact on aggregate results. There also may be other important factors that affect the mental health of sexual minority populations that were not included in this study such as internalized homonegativity [30], social connectedness [31], and minority stress [32]. Finally, the study population was primarily cisgender gay and bisexual men and therefore does not represent the full spectrum of LGBTQ individuals.

    Conclusions

    We found evidence of increased depression and anxiety symptoms among a sample of primary cisgender gay and bisexual men during the initial onset of the COVID-19 pandemic in 2020 in the Midwest and Northeast regions of the United States. This trend was not similar among the same study population the previous year nor among participants in the South or West regions of the United States.

    Acknowledgments

    The authors thank the additional members of the Together 5000 study team: David Pantalone, Sarit A Golub, Viraj V Patel, Gregorio Millett, Don Hoover, Pedro Carneiro, Javier Lopez-Rios, Alexa D’Angelo, Fatima Zohra, Corey Morrison, and Michelle Dearolf. The authors also thank the program staff at the National Institutes for Health (NIH): Gerald Sharp, Sonia Lee, and Michael Stirratt and the members of our scientific advisory board: Michael Camacho, Demetre Daskalakis, Sabina Hirshfield, Jeremiah Johnson, Claude Mellins, and Milo Santos. While the NIH financially supported this research, the content is the responsibility of the authors and does not necessarily reflect the official views of the NIH. Together 5000 was funded by the NIH (UH3 AI 133675; principal investigator: CG). Other forms of support include the City University of New York Institute for Implementation Science in Population Health, the Einstein–Rockefeller–City University of New York Center for AIDS Research (P30 AI124414).

    Data Availability

    The data sets generated and analyzed during this study are available from the corresponding author on reasonable request.

    Authors' Contributions

    CM conceived the study, developed the methodology, conducted statistical analyses, created tables and figures, and wrote and edited the paper. DW conceived the study, advised on the methodology, and aided in editing the paper. MS administered the Together 5000 study and aided in the conceptualization of the study as well as editing the paper. CG supervised the Together 5000 study, acquired funding for the study, aided in study conceptualization, and edited the paper. All authors reviewed the final paper.

    Conflicts of Interest

    None declared.

    1. Mervosh S, Lu D, Swales V. See which states and cities have told residents to stay at home. The New York Times. 2020. URL: https://www.nytimes.com/interactive/2020/us/coronavirus-stay-at-home-order.html [accessed 2022-02-01]
    2. Ettman CK, Abdalla SM, Cohen GH, Sampson L, Vivier PM, Galea S. Prevalence of depression symptoms in US adults before and during the COVID-19 pandemic. JAMA Netw Open. 2020;3(9):e2019686. [FREE Full text] [CrossRef] [Medline]
    3. Twenge JM, Joiner TE. Mental distress among U.S. adults during the COVID-19 pandemic. J Clin Psychol. 2020;76(12):2170-2182. [FREE Full text] [CrossRef] [Medline]
    4. Riehm KE, Holingue C, Smail EJ, Kapteyn A, Bennett D, Thrul J, et al. Trajectories of mental distress among U.S. adults during the COVID-19 pandemic. Ann Behav Med. 2021;55(2):93-102. [FREE Full text] [CrossRef] [Medline]
    5. Daly M, Robinson E. Anxiety reported by US adults in 2019 and during the 2020 COVID-19 pandemic: population-based evidence from two nationally representative samples. J Affect Disord. 2021;286:296-300. [FREE Full text] [CrossRef] [Medline]
    6. Gonzales G, de Mola EL, Gavulic KA, McKay T, Purcell C. Mental health needs among lesbian, gay, bisexual, and transgender college students during the COVID-19 pandemic. J Adolesc Health. 2020;67(5):645-648. [FREE Full text] [CrossRef] [Medline]
    7. Gattamorta KA, Salerno JP, Islam JY, Vidot DC. Mental health among LGBTQ cannabis users during the COVID-19 pandemic: analysis of the COVID-19 cannabis health study. Psychol Sex Orientat Gend Divers. 2021;8(2):172-179. [FREE Full text] [CrossRef] [Medline]
    8. Flentje A, Obedin-Maliver J, Lubensky ME, Dastur Z, Neilands T, Lunn MR. Depression and anxiety changes among sexual and gender minority people coinciding with onset of COVID-19 pandemic. J Gen Intern Med. 2020;35(9):2788-2790. [FREE Full text] [CrossRef] [Medline]
    9. Gato J, Barrientos J, Tasker F, Miscioscia M, Cerqueira-Santos E, Malmquist A, et al. Psychosocial effects of the COVID-19 pandemic and mental health among LGBTQ+ young adults: a cross-cultural comparison across six nations. J Homosex. 2021;68(4):612-630. [CrossRef] [Medline]
    10. Parchem B, Wheeler A, Talaski A, Molock SD. Comparison of anxiety and depression rates among LGBTQ college students before and during the COVID-19 pandemic. J Am Coll Health. 2021:1-9. [CrossRef] [Medline]
    11. Herrmann WJ, Oeser P, Buspavanich P, Lech S, Berger M, Gellert P. Loneliness and depressive symptoms differ by sexual orientation and gender identity during physical distancing measures in response to COVID-19 pandemic in Germany. Appl Psychol Health Well Being. 2023;15(1):80-96. [FREE Full text] [CrossRef] [Medline]
    12. Lozano-Verduzco I, Vega-Cauich J, Mendoza-Pérez JC, Craig SL. Perceived social support and mental health indicators of a Mexican LGBT sample during the COVID-19 pandemic. Int J Ment Health Addict. 2023:1-18. [FREE Full text] [CrossRef] [Medline]
    13. Krueger EA, Westmoreland DA, Choi SK, Harper GW, Lightfoot M, Hammack PL, et al. Mental health among Black and Latinx sexual minority adults leading up to and following the 2016 U.S. presidential election: results from a natural experiment. LGBT Health. 2021;8(7):454-462. [FREE Full text] [CrossRef] [Medline]
    14. Chen S, She R, Qin P, Kershenbaum A, Fernandez-Egea E, Nelder JR, et al. The medium-term impact of COVID-19 lockdown on referrals to secondary care mental health services: a controlled interrupted time series study. Front Psychiatry. 2020;11:585915. [FREE Full text] [CrossRef] [Medline]
    15. Bauer-Staeb C, Davis A, Smith T, Wilsher W, Betts D, Eldridge C, et al. The early impact of COVID-19 on primary care psychological therapy services: a descriptive time series of electronic healthcare records. EClinicalMedicine. 2021;37:100939. [FREE Full text] [CrossRef] [Medline]
    16. Leske S, Kõlves K, Crompton D, Arensman E, de Leo D. Real-time suicide mortality data from police reports in Queensland, Australia, during the COVID-19 pandemic: an interrupted time-series analysis. Lancet Psychiatry. 2021;8(1):58-63. [FREE Full text] [CrossRef] [Medline]
    17. Grov C, Westmoreland DA, Carneiro PB, Stief M, MacCrate C, Mirzayi C, et al. Recruiting vulnerable populations to participate in HIV prevention research: findings from the Together 5000 cohort study. Ann Epidemiol. 2019;35:4-11. [FREE Full text] [CrossRef] [Medline]
    18. Thometz K. Gov. Pritzker orders closure of all Illinois schools, including CPS, over coronavirus concerns. WTTW News. 2020. URL: https:/​/news.​wttw.com/​2020/​03/​13/​gov-pritzker-orders-closure-all-illinois-schools-including-cps-over-coronavirus-concerns [accessed 2022-02-22]
    19. Pereira S. Breaking: De Blasio announces NYC schools will close through at least April 20th. Gothamist. 2020. URL: https://gothamist.com/news/breaking-nyc-schools-will-close-monday-until-least-april-20th [accessed 2022-02-22]
    20. Camera L. Seattle public schools close due to coronavirus. US News & World Report. 2020. URL: https:/​/www.​usnews.com/​news/​education-news/​articles/​2020-03-11/​seattle-public-schools-close-due-to-coronavirus-first-major-system-to-announce-prolonged-closure [accessed 2022-02-22]
    21. Census regions and divisions of the United States. U.S. Department of Commerce Economics and Statistics Administration. URL: https://www2.census.gov/geo/pdfs/maps-data/maps/reference/us_regdiv.pdf [accessed 2024-01-09]
    22. Löwe B, Wahl I, Rose M, Spitzer C, Glaesmer H, Wingenfeld K, et al. A 4-item measure of depression and anxiety: validation and standardization of the Patient Health Questionnaire-4 (PHQ-4) in the general population. J Affect Disord. 2010;122(1-2):86-95. [CrossRef] [Medline]
    23. Wickham H. ggplot2: Elegant Graphics for Data Analysis. New York. Springer-Verlag; 2016.
    24. Lyubchich V, Gel YR, Brenning A, Chu C, Huang X, Islambekov U, et al. Package 'funtimes'. Functions for Time Series Analysis V 80. 2021. URL: https://cran.r-project.org/web/packages/funtimes/funtimes.pdf [accessed 2024-01-09]
    25. Oster AM, Kang GJ, Cha AE, Beresovsky V, Rose CE, Rainisch G, et al. Trends in number and distribution of COVID-19 hotspot counties—United States, March 8-July 15, 2020. MMWR Morb Mortal Wkly Rep. 2020;69(33):1127-1132. [FREE Full text] [CrossRef] [Medline]
    26. Sommerlad A, Marston L, Huntley J, Livingston G, Lewis G, Steptoe A, et al. Social relationships and depression during the COVID-19 lockdown: longitudinal analysis of the COVID-19 social study. Psychol Med. 2021:1-10. [FREE Full text] [CrossRef] [Medline]
    27. Hernández-Calle D, Martínez-Alés G, Mediavilla R, Aguirre P, Rodríguez-Vega B, Bravo-Ortiz MF. Trends in psychiatric emergency department visits due to suicidal ideation and suicide attempts during the COVID-19 pandemic in Madrid, Spain. J Clin Psychiatry. 2020;81(5):20l13419. [FREE Full text] [CrossRef] [Medline]
    28. Salerno JP, Doan L, Sayer LC, Drotning KJ, Rinderknecht RG, Fish JN. Changes in mental health and well-being are associated with living arrangements with parents during COVID-19 among sexual minority young persons in the U.S. Psychol Sex Orientat Gend Divers. 2023;10(1):150-156. [CrossRef] [Medline]
    29. Jacmin-Park S, Rossi M, Dumont L, Lupien SJ, Juster RP. Mental health and social support of sexual and gender diverse people from Québec, Canada during the COVID-19 crisis. LGBT Health. 2022;9(3):151-160. [CrossRef] [Medline]
    30. Davidson K, McLaren S, Jenkins M, Corboy D, Gibbs PM, Molloy M. Internalized homonegativity, sense of belonging, and depressive symptoms among Australian gay men. J Homosex. 2017;64(4):450-465. [CrossRef] [Medline]
    31. Tüzün Z, Başar K, Akgül S. Social connectedness matters: depression and anxiety in transgender youth during the COVID-19 pandemic. J Sex Med. 2022;19(4):650-660. [FREE Full text] [CrossRef] [Medline]
    32. Fulginiti A, Rhoades H, Mamey MR, Klemmer C, Srivastava A, Weskamp G, et al. Sexual minority stress, mental health symptoms, and suicidality among LGBTQ youth accessing crisis services. J Youth Adolesc. 2021;50(5):893-905. [CrossRef] [Medline]

    ‎
    LGBTQ: lesbian, gay, bisexual, transgender, and queer
    PHQ-4: Patient Health Questionnaire-4

    Edited by A Mavragani; submitted 06.03.23; peer-reviewed by J Xu, C Waller; comments to author 22.09.23; revised version received 08.11.23; accepted 16.12.23; published 26.01.24.

    Copyright

    ©Chloe Mirzayi, Drew Westmoreland, Matthew Stief, Christian Grov. Originally published in JMIR Public Health and Surveillance (https://publichealth.jmir.org), 26.01.2024.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Public Health and Surveillance, is properly cited. The complete bibliographic information, a link to the original publication on https://publichealth.jmir.org, as well as this copyright and license information must be included.