Published on in Vol 10 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/50944, first published .
Identifying Effective Components of a Social Marketing Campaign to Improve Engagement With Express Sexual Health Services Among Gay, Bisexual, and Other Men Who Have Sex With Men: Case Study

Identifying Effective Components of a Social Marketing Campaign to Improve Engagement With Express Sexual Health Services Among Gay, Bisexual, and Other Men Who Have Sex With Men: Case Study

Identifying Effective Components of a Social Marketing Campaign to Improve Engagement With Express Sexual Health Services Among Gay, Bisexual, and Other Men Who Have Sex With Men: Case Study

1Division of Infectious Diseases, The Miriam Hospital, , Providence, RI, , United States

2Department of Epidemiology, School of Public Health, Brown University, , Providence, RI, , United States

3Open Door Health, Rhode Island Public Health Institute, , Providence, RI, , United States

4Department of Behavioral and Social Sciences, School of Public Health, Brown University, , Providence, RI, , United States

5Department of Medicine, Warren Alpert Medical School, Brown University, , Providence, RI, , United States

6The Allen Company, Inc, , Jackson, MS, , United States

Corresponding Author:

Laura C Chambers, MPH, PhD


Background: Little is known about how best to reach people with social marketing messages promoting use of clinical HIV and sexually transmitted infection (STI) services.

Objective: We evaluated a multiplatform, digital social marketing campaign intended to increase use of HIV/STI testing, treatment, and prevention services among gay, bisexual, and other men who have sex with men (MSM) at an LGBTQ+ (lesbian, gay, bisexual, transgender, queer, and/or questioning) community health center.

Methods: We evaluated engagement with a social marketing campaign launched by Open Door Health, the only LGBTQ+ community health center in Rhode Island, during the first 8 months of implementation (April to November 2021). Three types of advertisements encouraging use of HIV/STI services were developed and implemented on Google Search, Google Display, Grindr, and Facebook. Platforms tracked the number of times that an advertisement was displayed to a user (impressions), that a user clicked through to a landing page that facilitated scheduling (clicks), and that a user requested a call to schedule an appointment from the landing page (conversions). We calculated the click-through rate (clicks per impression), conversion rate (conversions per click), and the dollar amount spent per 1000 impressions and per click and conversion.

Results: Overall, Google Search yielded the highest click-through rate (7.1%) and conversion rate (7.0%) compared to Google Display, Grindr, and Facebook (click-through rates=0.4%‐3.3%; conversion rates=0%‐0.03%). Although the spend per 1000 impressions and per click was higher for Google Search compared to other platforms, the spend per conversion—which measures the number of people intending to attend the clinic for services—was substantially lower for Google Search (US $48.19 vs US $3120.42-US $3436.03).

Conclusions: Campaigns using the Google Search platform may yield the greatest return on investment for engaging MSM in HIV/STI services at community health clinics. Future studies are needed to measure clinical outcomes among those who present to the clinic for services after viewing campaign advertisements and to compare the return on investment with use of social marketing campaigns relative to other approaches.

JMIR Public Health Surveill 2024;10:e50944

doi:10.2196/50944

Keywords



As of 2020, there were nearly 1.1 million people known to be living with HIV infection in the United States [1], and the rate of sexually transmitted infection (STI) diagnoses increased by 7% from 2017 to 2021 [2]. Although gay, bisexual, and other men who have sex with men (MSM) are estimated to represent only 4%‐6% of men in the United States [3], they represented 72% of men newly diagnosed with HIV in 2020 [1] and 36% of gonorrhea cases as well as primary and secondary syphilis cases in 2021 [2]. Additionally, while the annual number of new HIV infections diagnosed among MSM in the United States has decreased since 2017, substantial racial/ethnicity disparities in HIV diagnosis [4] and HIV pre-exposure prophylaxis (PrEP) access [5] persist. As such, efforts to achieve the national goal of reducing HIV incidence by at least 90% by 2030 [6] will be unsuccessful without reducing the incidence among MSM, and especially MSM of color, through comprehensive engagement with biomedical HIV prevention and treatment services.

Several social media platforms have been widely used by health departments and community-based organizations to disseminate health information, engage with MSM, and promote uptake of HIV and STI prevention and treatment services [7-12]. However, little is known about what messages work—and through which platforms—for generating appropriate levels of user engagement, diffusion of information across social networks [13], and ultimately, uptake of clinical services. Consistent with these challenges, researchers have sought to identify predictors of user engagement with digital content [14-17]. Studies suggest that impactful social marketing campaigns will contain positive sentiments, content about PrEP and mental health, and understandable information regarding intervention effectiveness, while avoiding solicitation of direct engagement by asking questions, posting during or after typical business hours, and content about dating [15,18-20]. However, little implementation research has been conducted into understanding how people engage with and react to social marketing messages [13].

Given that many public health organizations have limited marketing budgets but serve populations with great need, it is important to understand which social media platforms are most suitable for engaging MSM digitally. Understanding which platforms yield the greatest return on investment is also important for promoting uptake of HIV/STI services among people at highest risk of infection. To help fill this knowledge gap, we evaluated a multiplatform, digital social marketing campaign implemented by an LGBTQ+ (lesbian, gay, bisexual, transgender, queer, and/or questioning) community health center to increase utilization of express HIV/STI services at the clinic.


Setting

Open Door Health implemented the social marketing campaign in Providence, the capital city of Rhode Island. Open Door Health is the first and only LGBTQ+ community health center in the state and is located in the Providence ZIP code with the highest incidence of new HIV diagnoses. In Rhode Island, most new HIV diagnoses are among MSM and residents of Providence County. Among MSM, the majority of new HIV diagnoses are among those in their 20s and 30s, with young Black/African American and Hispanic/Latino MSM increasingly affected [21].

Timeline

Open Door Health launched the social marketing campaign in April 2021. We evaluated engagement with the campaign across platforms during the first 8 months of implementation (April to November 2021). For context, in 2021, residents aged 16 years and older statewide became eligible for COVID-19 vaccination in mid-April, many restrictions on businesses and gatherings were eased in early May, and most restrictions on businesses and vaccinated residents were lifted by late May.

Population

The goal of the social marketing campaign was to increase utilization of express HIV and STI services at Open Door Health. The clinic specializes in providing primary health care for the state’s sexual and gender minority communities. Open Door Health also provides comprehensive sexual health care, including HIV and STI screening, prevention, and treatment services. Patients without symptoms or a known or suspected exposure to infection may access “express” HIV/STI services, which include HIV/STI screening without a physical examination and are provided on a walk-in basis or with a scheduled appointment.

Social Marketing Campaign

Campaign advertisements were developed by a marketing company, in consultation with clinic leadership and the community advisory board, based on the findings from a series of individual in-depth interviews and focus group discussions with local MSM (previously described in detail [22]). The campaign included three types of advertisements: “Right Place,” “Got You Covered,” and “Punchline” (Figure 1). Each advertisement type included multiple variations on the text, images, and format (Figures S1-S3 in Multimedia Appendix 1).

Figure 1. Open Door Health campaign advertisement types, including “Right Place,” “Got You Covered,” and “Punchline” (from left to right).

The advertisements were developed for and implemented on Google, Grindr, and Facebook. Instagram was not included because patients reported using Facebook at higher rates than Instagram. Google advertisements included two approaches: (1) search campaign advertisements that appeared as a text-based advertisement at the top of the results page for a keyword (Figure S4 in Multimedia Appendix 1) and (2) display campaign advertisements that appeared as combinations of headlines, images, and descriptive text on the Google Display Network, a collection of over 2 million partner websites where advertisements can appear as banners or sidebars while users browse other content. Google Display campaign advertisements were responsive (ie, automatically adjusted their size, appearance, and format to fit available space) and targeted to users based on a proprietary algorithm intended to maximize user engagement. Grindr and Facebook advertisements were a combination of headlines, images, and descriptive text targeted to users based on location, demographics, interests, and other profile information. Grindr advertisements were displayed as small or medium banners or full-screen interstitials. Facebook advertisements were displayed in a sidebar on the website or in the desktop and mobile feeds as sponsored content. All platforms took people who clicked on the advertisement to a landing page specific to that advertisement type (Figures S5-S7 in Multimedia Appendix 1). Although the text-based advertisements of the Google Search campaign were not specific to one of the advertisement types, people who clicked on the advertisements were taken to one of the three landing pages.

Some platforms allowed for re-engagement of users who had viewed an advertisement but did not engage with it by clicking on it. In a process called retargeting, a piece of code attached an anonymous, undetectable browser cookie to every user who viewed an advertisement. After those users left the platform on which they originally viewed the advertisement, the cookie could trigger a digital advertising platform to show another advertisement on a different platform. For example, a user may have been presented with an advertisement on Grindr that they did not click on, so a Google Display campaign advertisement may then appear on other websites.

All three advertisement types were implemented on Google Search and Google Display; the “Right Place” and “Got You Covered” advertisement types were implemented on Grindr; and the “Right Place” and “Punchline” advertisement types were implemented on Facebook. Users were able to click through an advertisement to a landing page where they could request a phone call to schedule an appointment at the clinic.

Measures

Platforms generally tracked the number of users to whom an advertisement was shown (reach), the number of times that an advertisement was displayed to a user (impressions), the number of times that a user clicked through an advertisement to a landing page where they could request a phone call to schedule an appointment (clicks), and the number of phone calls requested from that landing page (conversions). To measure campaign engagement for specific advertisement and platform combinations, we calculated (1) the click-through rate (defined as the number of clicks divided by the number of impressions), (2) the conversion rate (defined as the number of conversions divided by the number of clicks), and (3) the dollar amount spent per 1000 impressions and per click and conversion.

Data Analyses

We summarized the reach, impressions, clicks, conversions, spend, click-through rate, conversion rate, spend per 1000 impressions, spend per click, and spend per conversion for the social marketing campaign by platform overall, by advertisement type, and by specific advertisement.

Ethical Considerations

The Brown University Institutional Review Board determined that this secondary analysis of deidentified Open Door Health data did not meet the federal definition of human subjects research in Title 45 Code of Federal Regulations Part 46.102(e)(1), and therefore, review was not necessary (application number 3079).


The 8-month social media campaign implemented by Open Door Health in Providence, Rhode Island, included 3 types of advertisements tailored and implemented across 3 social media platforms, with US $29,711.84 in total spend and yielding a total of 2,536,405 impressions, 35,022 clicks, and 225 conversions across advertisement types and platforms. Considering all advertisement types combined, Google Search yielded the highest click-through rate (7.1%) and conversion rate (7.0%) compared to Google Display, Grindr, and Facebook (click-through rates=0.4%‐3.3%; conversion rates=0%‐0.03%; Table 1). Although spend per 1000 impressions and per click was higher for Google Search than other platforms, the spend per conversion was substantially lower for Google Search (US $48.19 vs US $3120.42‐US $3436.03). Of note, Grindr had the second highest click-through rate (3.3%) after Google Search, while Google Display had the lowest spend per 1000 impressions (US $4.87) and Grindr had the lowest spend per click (US $0.36).

Table 1. Open Door Health campaign results by advertisement type and social media platform (April 1 to November 30, 2021).
Ad typea and measurePlatform
Google SearchbGoogle DisplayGrindrFacebook
All
Reach, nNot measuredNot measuredNot measured302,000
Impressions, n44,728706,063531,2181,254,396
Clicks, n3180293017,36011,552
Conversions, n221103
Spend (US $)10,650.213436.036264.339361.27
Click-through rate (%)7.110.413.270.92
Conversion rate (%)6.950.030.000.03
Spend/1000 impressions (US $)238.114.8711.797.46
Spend/click (US $)3.351.170.360.81
Spend/conversion (US $)48.193436.03Undefined3,120.42
Right place
Reach, nNot measuredNot measuredNot measured229,227
Impressions, n38,628211,401266,9101,019,206
Clicks, n2678104984618454
Conversions, n195002
Spend (US $)9297.411183.883129.226923.02
Click-through rate (%)6.930.503.170.83
Conversion rate (%)7.280.000.000.02
Spend/1000 impressions (US $)240.695.6011.726.79
Spend/click (US $)3.471.130.370.82
Spend/conversion (US $)47.68UndefinedUndefined3461.51
Got you covered
Reach, nNot measuredNot measuredNot measured —c
Impressions, n3252231,393264,308 —
Clicks, n26013488899 —
Conversions, n1610 —
Spend (US $)708.581773.033135.11
Click-through rate (%)8.000.583.37 —
Conversion rate (%)6.150.070.00 —
Spend/1000 impressions (US $)217.897.6611.86 —
Spend/click (US $)2.731.320.35 —
Spend/conversion (US $)44.291773.03Undefined —
Punchline
Reach, nNot measuredNot measured —72,773
Impressions, n2848263,269 —235,190
Clicks, n242533 —3098
Conversions, n100 —1
Spend (US $)644.22479.12 —2438.25
Click-through rate (%)8.500.201.32
Conversion rate (%)4.130.00 —0.03
Spend/1000 impressions (US $)226.201.82 —10.37
Spend/click (US $)2.660.90 —0.79
Spend/conversion (US $)64.42Undefined —2438.25

aAll ads for each campaign were combined.

bGoogle Search campaign included text-only ads that were not specific to an ad type. However, people who clicked on the text-only ad were taken to a landing page designed for one of the ad types. Results are presented by landing page type.

cDid not run.

The overall pattern by social media platform was generally consistent for each of the advertisement types. However, it is important to keep in mind that the initial advertisements viewed through Google Search were text-based; it was the landing page for people who clicked on the text-based advertisements that was tailored to a specific advertisement type. The results for specific advertisements within each advertisement type are available in Tables S1-S3 in Multimedia Appendix 1.


In the first 8 months of a multiplatform digital social marketing campaign to increase utilization of express HIV/STI services at an LGBTQ+ community health center, Google Search yielded higher click-through and conversion rates (both about 7%) than Google Display, Grindr, and Facebook (0%‐3%). The cost of advertising per impression and click was notably higher for Google Search compared to other platforms; however, the cost per conversion—which measures the number of patients intending to present to the clinic for services—was markedly lower for Google Search (about US $48) than other platforms (more than US $3000). Grindr had the second highest click-through rate (about 3%), but none of the clicks resulted in requests for a call with the clinic.

Importantly, the goal of the social media campaign was to increase utilization of express HIV/STI services at Open Door Health. Although we were able to measure the number of patients intending to present for services, additional research on subsequent presentation to the clinic and services ultimately received is critical for further evaluating the impact of the campaign. It will also be important to evaluate the sociodemographics of the patients who present to the clinic as a result of each advertisement to learn whether certain advertisements resonate more with specific populations at high risk of HIV and STI, such as MSM of color. While overall engagement with the advertisements was similar across the advertisement types included in the campaign, the specific populations engaging with each advertisement type may have differed. Additionally, some advertisement types were not implemented on Grindr and Facebook due to limited initial user engagement with other advertisements on those platforms; it is possible these additional advertisements would have performed differently on those platforms.

In this study, we demonstrated a straightforward approach for calculating the return on investment for advertising dollars when designing tailored campaigns in the context of limited resources. Although Google Search yielded the greatest return on investment of the four platforms, the cost per conversion was relatively high (nearly US $50). However, the target population for the campaign is at highest risk for HIV acquisition in Rhode Island, and spending of up to US $379,668 to prevent one HIV infection is considered cost saving per US Centers for Disease Control and Prevention guidance [23]. In future studies, it will be important to measure clinical outcomes among those reached by the campaign who present to the clinic for services and to compare this return on investment with that of other approaches to increase uptake of HIV and STI prevention and treatment services to inform decisions regarding where to invest limited budgets.

In conclusion, social marketing campaigns using the Google Search platform, and thereby displaying the ads based on HIV- or STI-related search terms, may have the greatest return on investment for prompting phone calls with the clinic to schedule appointments for HIV/STI services, which we expect is most likely to result in presentation to the clinic for services. Although Grindr generated many initial clicks, this did not translate into phone calls with the clinic. However, engagement on Grindr likely increased awareness of the clinic that contributed to future retargeting and engagement on other platforms, such as Google. Thus, spending on Grindr and other platforms may be useful for improving reach and building community trust, which may subsequently improve the conversion rate through Google Search; future research in this area is needed.

Acknowledgments

LCC was supported, in part, by the National Institute on Drug Abuse (grant T32DA013911) and the National Institute of Mental Health (R25MH083620).

Data Availability

Deidentified data can be made available upon request and in compliance with the policies and procedures of Open Door Health and Brown University.

Authors' Contributions

WCG and ASN contributed to the study conceptualization; LCC, WCG, KA, and ASN were in charge of the methodology; LCC and KA conducted the formal analysis; YM, PAC, CSC, KA, and ASN did the investigation; data curation was performed by LCC, YM, and KA; LCC and WCG wrote the original draft; all authors reviewed and edited the manuscript; KA was in charge of the visualization; ASN supervised the study; project administration was carried out by LCC, YM, and CSC.

Conflicts of Interest

WCG is an editorial board member of JMIR Public Health and Surveillance. The other authors have no conflicts of interest to declare.

Multimedia Appendix 1

Additional advertisement images and results by specific advertisement.

DOCX File, 8374 KB

  1. Diagnoses of HIV infection in the united states and dependent areas 2020. US Centers for Disease Control and Prevention. 2022. URL: https://www.cdc.gov/hiv/library/reports/hiv-surveillance/vol-33/index.html [Accessed 2023-04-01]
  2. Reported STDs in the United States. US Centers for Disease Control and Prevention. 2021. URL: https://www.cdc.gov/nchhstp/newsroom/fact-sheets/std/std-us-2021.html#affected-by-STDs [Accessed 2023-04-01]
  3. Mauck DE, Gebrezgi MT, Sheehan DM, et al. Population-based methods for estimating the number of men who have sex with men: a systematic review. Sex Health. Nov 2019;16(6):527-538. [CrossRef] [Medline]
  4. Estimated HIV incidence and prevalence in the United States, 2017-2021: national profile. US Centers for Disease Control and Prevention. 2023. URL: https://www.cdc.gov/hiv/library/reports/hiv-surveillance/vol-28-no-3/content/national-profile.html [Accessed 2024-04-01]
  5. Monitoring selected national HIV prevention and care objectives by using HIV surveillance data - United States and 6 dependent areas 2021. US Centers for Disease Control and Prevention. 2023. URL: https://www.cdc.gov/hiv/library/reports/hiv-surveillance/vol-28-no-4/index.html [Accessed 2024-04-01]
  6. Fauci AS, Redfield RR, Sigounas G, Weahkee MD, Giroir BP. Ending the HIV epidemic: a plan for the United States. JAMA. Mar 5, 2019;321(9):844-845. [CrossRef] [Medline]
  7. Huang E, Marlin RW, Young SD, Medline A, Klausner JD. Using Grindr, a smartphone social-networking application, to increase HIV self-testing among Black and Latino men who have sex with men in Los Angeles, 2014. AIDS Educ Prev. Aug 2016;28(4):341-350. [CrossRef] [Medline]
  8. Ross C, Shaw S, Marshall S, et al. Impact of a social media campaign targeting men who have sex with men during an outbreak of syphilis in Winnipeg, Canada. Can Commun Dis Rep. Feb 4, 2016;42(2):45-49. [CrossRef] [Medline]
  9. Lampkin D, Crawley A, Lopez TP, Mejia CM, Yuen W, Levy V. Reaching suburban men who have sex with men for STD and HIV services through online social networking outreach: a public health approach. J Acquir Immune Defic Syndr. May 1, 2016;72(1):73-78. [CrossRef] [Medline]
  10. Su JY, Holt J, Payne R, Gates K, Ewing A, Ryder N. Effectiveness of using Grindr to increase syphilis testing among men who have sex with men in Darwin, Australia. Aust N Z J Public Health. Jun 2015;39(3):293-294. [CrossRef] [Medline]
  11. Sun CJ, Stowers J, Miller C, Bachmann LH, Rhodes SD. Acceptability and feasibility of using established geosocial and sexual networking mobile applications to promote HIV and STD testing among men who have sex with men. AIDS Behav. Mar 2015;19(3):543-552. [CrossRef] [Medline]
  12. Chan PA, Towey C, Poceta J, et al. Online hookup sites for meeting sexual partners among men who have sex with men in Rhode Island, 2013: a call for public health action. Public Health Rep. 2016;131(2):264-271. [CrossRef] [Medline]
  13. Cao B, Gupta S, Wang J, et al. Social media interventions to promote HIV testing, linkage, adherence, and retention: systematic review and meta-analysis. J Med Internet Res. Nov 24, 2017;19(11):e394. [CrossRef] [Medline]
  14. Veale HJ, Sacks-Davis R, Weaver ER, Pedrana AE, Stoové MA, Hellard ME. The use of social networking platforms for sexual health promotion: identifying key strategies for successful user engagement. BMC Public Health. Feb 6, 2015;15:85. [CrossRef] [Medline]
  15. Card KG, Lachowsky N, Hawkins BW, Jollimore J, Baharuddin F, Hogg RS. Predictors of facebook user engagement with health-related content for gay, bisexual, and other men who have sex with men: content analysis. JMIR Public Health Surveill. Apr 6, 2018;4(2):e38. [CrossRef] [Medline]
  16. Kite J, Foley BC, Grunseit AC, Freeman B. Please like me: Facebook and public health communication. PLoS One. 2016;11(9):e0162765. [CrossRef] [Medline]
  17. Rus HM, Cameron LD. Health communication in social media: message features predicting user engagement on diabetes-related Facebook pages. Ann Behav Med. Oct 2016;50(5):678-689. [CrossRef] [Medline]
  18. Underhill K, Morrow KM, Colleran C, et al. Explaining the efficacy of pre-exposure prophylaxis (PrEP) for HIV prevention: a qualitative study of message framing and messaging preferences among us men who have sex with men. AIDS Behav. Jul 2016;20(7):1514-1526. [CrossRef] [Medline]
  19. Mimiaga MJ, Closson EF, Battle S, et al. Reactions and receptivity to framing HIV prevention message concepts about pre-exposure prophylaxis for Black and Latino men who have sex with men in three urban US cities. AIDS Patient Care STDS. Oct 2016;30(10):484-489. [CrossRef] [Medline]
  20. Mustanski B, Ryan DT, Sanchez T, Sineath C, Macapagal K, Sullivan PS. Effects of messaging about multiple biomedical and behavioral HIV prevention methods on intentions to use among US MSM: results of an experimental messaging study. AIDS Behav. Sep 2014;18(9):1651-1660. [CrossRef] [Medline]
  21. HIV, sexually transmitted infections, viral hepatitis, and tuberculosis surveillance report 2022. 2024. URL: https://health.ri.gov/publications/surveillance/2022/HIVSTI.pdf [Accessed 2024-04-01]
  22. Goedel WC, Sutten Coats C, Sowemimo-Coker G, et al. Gay and bisexual men’s recommendations for effective digital social marketing campaigns to enhance HIV prevention and care continuity. AIDS Behav. May 2021;25(5):1619-1625. [CrossRef] [Medline]
  23. HIV cost-effectiveness. US Centers for Disease Control and Prevention. URL: https://www.cdc.gov/hiv/programresources/guidance/costeffectiveness/index.html [Accessed 2024-04-01]


LGBTQ+: lesbian, gay, bisexual, transgender, queer, and/or questioning
MSM: men who have sex with men
PrEP: pre-exposure prophylaxis
STI: sexually transmitted infection


Edited by Amaryllis Mavragani; submitted 17.07.23; peer-reviewed by Angel Algarin, Rajesh Kumar, Steven John; final revised version received 20.05.24; accepted 21.05.24; published 23.08.24.

Copyright

© Laura C Chambers, Yelena Malyuta, William C Goedel, Philip A Chan, Cassandra Sutten Coats, Ken Allen, Amy S Nunn. Originally published in JMIR Public Health and Surveillance (https://publichealth.jmir.org), 23.8.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Public Health and Surveillance, is properly cited. The complete bibliographic information, a link to the original publication on https://publichealth.jmir.org, as well as this copyright and license information must be included.