Published on 16.04.20 in Vol 6, No 2 (2020): Apr-Jun
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/16494, first published Oct 08, 2019.
An Internet-Based, Peer-Delivered Messaging Intervention for HIV Testing and Condom Use Among Men Who Have Sex With Men in India (CHALO!): Pilot Randomized Comparative Trial
Background: Leveraging internet-based communication tools (eg, messaging apps, SMS text messaging, and email) may be an effective avenue for delivery of HIV prevention messages to men who have sex with men (MSM) in India, but there are limited models for such internet-based interventions.
Objective: The CHALO! pilot was an online educational and behavioral intervention aimed to determine the feasibility, acceptability, and preliminary impact of a peer-delivered, internet-based messaging intervention for HIV testing and consistent condom use for MSM in India. The messages addressed barriers to HIV testing and condom use and were theoretically based on the information-motivation-behavioral skills model.
Methods: Between February and March 2015, we recruited, enrolled, and randomized 244 participants via online advertisements on mobile dating apps and Facebook. Eligible men (18 years or older, sexually active with other men, and self-reported HIV-negative or unknown status) were randomized to receive educational and motivational messages framed as either approach (ie, a desirable outcome to be achieved) or avoidance (an undesirable outcome to be avoided) over 12 weeks via internet-based messaging platforms. Participants completed online surveys at baseline and immediately postintervention.
Results: Participants were similar across arms with respect to sociodemographic and behavioral characteristics. Over 82.0% (200/244) of participants were retained (ie, viewed final messages), and 52.3% (130/244) of them completed the follow-up survey. Of those completing the follow-up survey, 82.3% (107/130) liked or strongly liked participating in CHALO!. The results showed a significant increase in self-reported HIV testing in the past 6 months from baseline to follow-up (41/130, 31.5% to 57/130, 43.8%; P=.04). When including those who reported intentions to test, this percentage increased from 44.6% (58/130) at baseline to 65.4% (85/130) at follow-up (P<.01). When examining intentions to test among those without prior HIV testing, intentions increased from 32% (16/50) of the sample at baseline to 56% (28/50) of the sample at follow-up (P=.02). Condom use during anal sex did not significantly change from baseline to follow-up. HIV testing and condom use did not significantly differ between approach and avoidance conditions at follow-up.
Conclusions: As one of the first studies of an online HIV prevention intervention for Indian MSM, CHALO! was feasible to implement by a community-based organization, was acceptable to participants, and demonstrated potential to improve HIV testing rates.
JMIR Public Health Surveill 2020;6(2):e16494
India has the third largest population of people living with HIV globally, with an estimated 2.1 million infected persons, and more than 80,000 new infections occurring annually . Globally and in India, HIV disproportionately affects men who have sex with men (MSM), who are designated a key priority population by the Indian health ministry for targeted HIV prevention interventions [ ]. HIV prevalence among MSM in India is 10 to 15 times higher than in the general population (4.3% vs 0.3%, respectively) [ ], and although MSM are conservatively estimated to make up less than 2% of the population, they comprise over 20% of HIV-infected individuals [ , ]. Thus, current interventions for Indian MSM have been limited in their reach and impact [ ], partly because of the social stigma associated with same sex behaviors and marginalization [ , ]. The cultural emphasis on heterosexual marriage and traditional family structure, coupled with the constant fear of one’s sexuality being outed [ - ], drive many MSM underground and out of the purview of various HIV interventions currently being implemented. To reduce the burden of HIV among Indian MSM, rapid development and wide-scale dissemination of interventions promoting effective prevention strategies are urgently needed.
Currently, over 430 million individuals in India access the internet, with 95% using mobile devices. Although access is currently greater among individuals younger than 35 years and those with higher incomes , these gaps are quickly closing, given the rapid decline in the cost of smartphones and data plans and the increasing availability of free Wi-Fi spots. Globally and in India, MSM are increasingly using internet-based communication technologies (ICTs; eg, Facebook, geolocation-based mobile dating apps, and email)—to socialize, seek sexual and romantic partners, and find a sense of community [ - ]. Conducting traditional face-to-face HIV prevention outreach for MSM can be challenging within stigmatized settings, but given the increasing use of technology by MSM to find partners and supportive social networks, ICTs now allow for an unprecedented opportunity to engage Indian MSM into HIV prevention, linkage to care, and other support services. Data indicate that the populations that can be reached online are in dire need of increased access to prevention services. Recent studies of MSM reached online in India have found that, among sexually active MSM, over 50% had never had an HIV test, a quarter had not been tested in more than 12 months, and between 40% and 80% were not out to others about their sexuality [ , ]. Thus, ICT-based interventions for MSM could dramatically improve the health of MSM in India and globally by helping support behavior change for HIV prevention (eg, HIV testing and condom use) [ ].
International organizations, including India’s National AIDS Control Organization, recognize the public health potential of ICTs and have called for the development and implementation of ICT-based HIV prevention strategies . Besides evidence of their being acceptable to MSM, ICTs also offer considerable scalability and efficiency of wide reach with high impact potential, even with relatively low-intensity interventions [ , ]. Technology-based, peer-led approaches could be used to enhance efforts by community-based and other organizations for dissemination of health messages and service availability [ ]. Thus, rather than an alternative medium for implementation of existing interventions designed for face-to-face contact, social media may be a game changer to engage MSM in India [ ]. A meta-analysis found that social media interventions were effective in increasing HIV testing; however, none of the studies were conducted in a low-income country [ ]. Two recent systematic reviews describing internet-based interventions for HIV care continuum found diverse models targeting HIV testing and prevention; however, most (over 85%) were in well-resource settings [ , ]. Few effective, scalable, and low-cost ICT-based interventions targeting HIV testing and prevention exist for low-income countries [ - ], and no published data are available on the effectiveness of ICT-based approaches in India or other South Asian countries.
In addition to the paucity of data about internet-based interventions in low-income settings for any population, there is little empirical data to guide health communication, that is, messaging, for online dissemination to increase HIV testing and condom use. Two messaging approaches, often called frames are widely used in health communication: the first, called approach or gain framed, highlights the benefits of engaging in a specific health behavior and the second, called avoidance or loss framed, focuses on negative consequences. Metanalytic reviews have indicated that gain-framed messaging is more effective in promoting prevention behavior, but loss-framed messaging may be more effective in promoting screening or illness detection behavior [- ]. However, it is unclear which framing strategy is most effective when promoting a comprehensive approach to HIV prevention that includes promoting both HIV testing and condom use. Prior research from a high-income country (United States) has found mixed results with regard to condom use intentions [ , ] and HIV testing behaviors [ ]. However, to our knowledge, no published data exist with regard to the framing effects of health messages for HIV testing and condom use for MSM or for any other populations in India or other low-income countries.
To help close the gap in the use of ICT for public health purposes in India and address the high HIV prevention needs of Indian MSM, the CHALO! (Let’s Go!) pilot study developed and tested the feasibility, acceptability, and preliminary impact of an ICT-based HIV prevention intervention to increase HIV testing and consistent condom use among MSM reached on internet-based social and dating platforms in Mumbai, India. CHALO! also tested whether prevention messages using an approach frame (ie, messages highlighting a desirable outcome to be achieved or benefits of engaging in testing and condom use) were more effective in increasing HIV testing and consistent condom use behaviors compared with messages using an avoidance frame (ie, HIV infection as an outcome to be avoided or consequences of not engaging in a behavior). Our central hypothesis was that a peer-delivered, ICT-based behavioral intervention can efficiently identify and reach sexually active Indian MSM, enroll them into an exclusively online study, motivate them to seek in-person health services (ie, HIV testing), and modify health promotion behaviors (increase consistent condom use). This study was a peer-delivered intervention that recruited participants online and then disseminated HIV prevention messages via internet-based messaging platforms.
Study Design and Overview
The study was conducted in partnership with the Humsafar Trust (HST), one of India’s largest community-based organizations based in Mumbai, providing culturally sensitive clinical and social services to sexual and gender minority populations. CHALO! was a two-arm, parallel, randomized (1:1 randomization) comparative effectiveness trial comparing two message-framing strategies (avoidance- and approach-framed messages) to promote HIV testing and consistent condom use. Messages were delivered by four peer-outreach staff (two per arm) via email, a private Facebook group, or WhatsApp (as chosen by the participant). Participants received the intervention messages twice a week for 12 weeks. In addition to the messaging, other intervention components were (1) the ability to communicate with the peer outreach staff via their chosen messaging modality and (2) a mobile-friendly Web page containing information on accessing MSM-sensitive, free HIV testing in Mumbai; free condoms and instructions on use; and a listing of available services for MSM at HST (eg, counseling, sexually transmitted infection [STI] treatment, and support groups). We used self-administered online surveys at baseline and 12-week postintervention for study assessments. The study was approved by the Humsafar Trust’s and Albert Einstein College of Medicine’s institutional review board.
The study took place online, between February and June 2015, targeting MSM living in Mumbai—India’s largest city with a population of over 18 million, and a city with one of the highest HIV burdens in India. Mumbai accounted for over 19,000 new HIV diagnoses in 2016-2017 [, ], with the prevalence of HIV among MSM estimated to be 7%. At the time of the study, Mumbai had high internet connectivity, with an abundance of free or low-cost Wi-Fi spots, low-cost internet cafes, and mobile service providers offering internet and data plans for mobile phones at a relatively low cost. For this pilot, we recruited participants from two of India’s most used MSM-specific dating sites (which have now become the most commonly used avenues for MSM meets in urban India [ , ]) and from HST-operated Facebook pages. HST has three drop-in centers and a central office in the three major subdivisions of Mumbai, where HIV and STI testing, sexual health and psychosocial counseling, and linkage-to-care services are available. At the time of the study, HST was the only established community organization providing such services to MSM.
Eligible individuals were aged at least 18 years, identified as male, reported anal sex with another male partner in the past 2 years, lived in Mumbai, were fluent in either English or Hindi, self-reported being HIV negative or unaware of their status (ie, never tested or never received results), and provided a valid contact (email, mobile phone number, or Facebook ID—validated by a response to a confirmation message). Individuals were excluded if they reported being a staff member or any type of outreach worker for HST. Participants were screened into the study using an online screening survey.
The CHALO! pilot drew on theories from health psychology (information-motivational-behavioral [IMB] skills theory [, ]) and health communication (Prospect Theory) [ ]. The IMB model posits that fostering information acquisition, increasing motivation, and enhancing behavioral skills are needed to change behaviors (eg, HIV testing and condom use). We used the IMB model to inform the specific message contents used in the intervention. We next used the Prospect Theory to frame the messages for each arm. Framing effects are a central tenet of the Prospect Theory [ ], which posits that decision making is affected by the manner in which choices are presented; for example, behavioral science has demonstrated differences in health screening behaviors and other health-related decisions, when options for engaging in a health-related activity are framed in terms of potential benefits (gain frame) compared with potential harm (loss frame [ - ]). As past research suggests a significant impact of messaging framing on HIV testing behaviors [ ], we incorporated tenets of this theory to help ensure that CHALO! messages were framed in a manner that would promote optimal decision making and behavior change with regard to HIV testing and consistent condom use. Messages in CHALO! were framed to either an approach frame (ie, highlighting a desirable outcome to be achieved or benefits of engaging in HIV testing or consistent condom use) or to an avoidance frame (ie, focusing attention on a negative outcome to be avoided or consequences of not engaging in HIV testing or not using condoms) [ , ].
We used a participatory process with an interdisciplinary team at HST to develop all components of the intervention in an iterative process over a 3-month period. The core team members at HST consisted of 8 individuals: 2 community-based researchers, 2 HIV testing and counseling staff members, an HIV-positive peer patient navigator, and 3 peer outreach workers experienced in using MSM dating websites and apps for outreach to MSM in Mumbai. This intervention development team informed all aspects of the study including study design, participant eligibility, recruitment and retention, study measures, intervention implementation, and evaluation.
Target Selection and Message Development
The intervention target selection (ie, which barriers to address) and message development and refinement process was a community-led multiphase and iterative process occurring over a 2-day workshop with an interdisciplinary team: 3 facilitators (HST research staff members experienced in conducting HIV-related trainings) and 10 participants (HST’s community advisory board members and peer outreach workers experienced in outreach and care linkage for >5 years and with online MSM dating apps), and HIV counseling and testing staff. The members had diverse sexual identities common in India (gay, bisexual, kothi, and panthi) [, ], genders (male, female, and hijra or transgender individuals), and demographic characteristics (with regard to education, age, and primary language used (English or Hindi). Three members of the group were people living with HIV.
We used open space technology to facilitate communication and participation by all workshop members . Open space technique is a process that has been used across disciplines to help ensure inclusion of diverse attitudes and experiences and has been used to facilitate identification of challenges or barriers to a task or behavior (eg, HIV testing) and identification of potential solutions to overcome them. For this study, workshop members first identified challenges to HIV testing and consistent condom use, and then mapped these to the IMB domains (ie, the targets). The following targets were identified within the IMB model:
- Information: information about HIV transmission and prevention with condoms and logistical information (eg, testing locations and hours)
- Motivation: risk perception and stigma
- Behavioral skills: how to access or make an appointment for free testing
Next, after receiving a brief orientation to approach and avoidance messaging frames, participants in small groups developed short social marketing messages that could be disseminated online addressing the above-identified targets or provided solutions for overcoming the barrier (eg, a webpage vetted to be MSM friendly listing free HIV testing centers, which addressed lack of knowledge about safe HIV testing venues). Workshop participants developed between three and five messages for every identified target for both approach and avoidance frames. Thus, we developed approximately 25 to 30 messages for each message frame (approach and avoidance). All messages were transcreated into English or Hindi based on the original language (eg, messages initially developed in Hindi were then transcreated into English, and conversely, from English into Hindi). We used transcreation (as opposed to translation) to retain the essence of the original message , while the text was then refined using a consensus approach to further ensure comprehension and equivalency in meaning, sentiment, and framing. Next, 30 peer staff and MSM community members at the HST drop-in center (not involved in the workshop) voted for their favorite top 3 messages for each factor in each of the approach and avoidance frames. Finally, we selected the top 1 or 2 messages receiving the most votes for each target within each frame for use in the intervention, resulting in 15 messages for each arm: 8 messages focused on HIV testing and 7 messages focused on condom use. Here are two examples of messages used (avoidance and approach):
It doesn’t matter if you sleep with only 4 or 5. It only takes one. Not using condoms puts you at risk for HIV. Avoid HIV by using condoms!
Whether you ride from the front seat or back seat, you both need a helmet. Use a condom either way. Keep yourself and your partner healthy!
Peer Recruitment and Training
HST research staff selected 4 MSM peer outreach workers for the intervention who were fluent in Hindi and English and reported comfort and experience with using online dating apps, Facebook, and email and not involved with development of the messages. Chosen peers had previously received training in HIV-related communication and community engagement and were experienced in HIV-related outreach in Mumbai. For this pilot, the peer outreach worker received additional specific training on online research ethics, maintaining confidentiality and privacy, and communicating via online tools. Two peer outreach workers were randomly assigned to each arm. Peers were then randomly assigned to serve as the online peer outreach worker for half the participants within their assigned arm. Each peer was responsible for sending intervention messages to their assigned participants and to communicate with participants if and when a participant chose to initiate any communication. There was no cross-arm communication from the peer outreach workers to participants in the arm to which they were not assigned.
First, from February to March 2015, recruitment advertisements were disseminated on a popular MSM-specific dating website, a geosocial networking mobile app, and on HST-operated Facebook pages. Potential participants clicked through the ads to complete an online consent and eligibility screener; if eligible, they automatically continued to the baseline survey. After confirming the contact information provided, participants were randomized 1:1 to either the approach- or avoidance-framed conditions.
Next, from March to June, 2015, the 4 peer outreach workers (two per arm) sent a standardized introductory message via the participant’s chosen communication modality (ie, email, WhatsApp, or private Facebook group), followed by intervention messages 2 or 3 times per week for 12 weeks. Each set of 15 messages was sent out twice over the 12 weeks to help ensure that participants viewed them and reinforce the information contained within the messages. Thus, after the first set of 15 messages were sent out, another round of the same 15 messages was sent again. Messages for all participants were sent by the peer outreach worker on the same days and times each week. Participants were also able to communicate with their assigned peer outreach worker for any reason via multiple modalities (text message, email, Facebook Messenger, or phone call), but only if the participant initiated the contact. This was to avoid being overly intrusive and prevent potential intervention fatigue based on input from the peer staff. Participants then received a final intervention message and a personal link to the follow-up survey. All messages were sent with arm-specific links to the study webpage, with additional information about HIV testing, condom use, and HST services. We compensated participants with Amazon India vouchers worth INR 300 (approximately US $4.75) on successful completion of baseline survey and INR 400 (approximately US $6.30) on successful completion of the final follow-up assessment.
At baseline, we collected information on age, monthly income, preferred language (indicated by language of survey taken—English or Hindi), and an account of household members.
Sexual Identity and Behaviors
We assessed sexual identity with mutually exclusive categories often used in India (panthi, kothi, double decker, gay or homosexual, bisexual, and straight or heterosexual [- ]), but because very few respondents selected panthi, kothi, or double decker, we collapsed these categories into gay or homosexual. We asked about participants’ level of outness, whether they had sex with or were attracted to men (none, some, or most), if they had a primary male sexual partner (Yes or No), and the number of male sexual partners in the past year.
To assess the HIV testing outcomes, we asked at baseline and follow-up, “When was your last HIV test?” with response categories of less than 1 month ago, 2 to 6 months ago, 7 to 12 months ago, more than 12 months ago, and never. We then dichotomized the responses for analysis to 6 months vs all others based on the recommended testing guidelines for MSM . To ascertain testing intentions during and immediately after the intervention ended, we asked, “Do you intend to test in the next 3 months?” (at baseline) and “Do you intend to test in the next month?” (at follow-up) with the answer options of yes or no.
Consistent Condom Use
Condom use outcomes was assessed at both baseline and follow-up using the question “In the last three months, how often have you used condoms during anal sex?”, with the response options of always, Most of the time, sometimes, rarely, and Never for analyses, we dichotomized responses as always vs inconsistent (including all the other response options).
To evaluate acceptability, identify implementation challenges, and elicit suggestions to refine CHALO!, we collected field notes from (1) our weekly project meetings with the research team, (2) peer outreach staff during and at the end of study, and (3) two focus groups of CHALO! participants (n=6-8 per group) after intervention completion. Peer intervention staff also elicited feedback via email, WhatsApp, or Facebook Messenger from those not completing the follow-up assessment to evaluate reasons for survey noncompletion.
To determine feasibility, we assessed three process measures: (1) enrollment data (number of individuals completing the screening survey, the proportion eligible, and the proportion enrolling into the study); (2) retention (measured by a composite indicator consisting of WhatsApp and Facebook message viewed indicators, participant responses to reminder emails about completing the follow-up assessment, or completion of the follow-up assessment), and (3) completion rate (proportion of participants completing the follow-up assessment). We also assessed the relationship between completion of the follow-up assessment and baseline participant characteristics using the chi-square, Fisher exact, or t tests as appropriate.
To determine acceptability, we tabulated the Likert scale responses to questions about how much the group liked participating in CHALO! and used the chi-square test to examine differences between conditions. We thematically analyzed and coded the field notes and the brief open-ended responses on the follow-up survey based on three general categories: what was most liked, what was most disliked, and suggestions for improving the intervention. Two team members independently coded the responses, and discrepancies were resolved through discussion.
To determine early efficacy, we undertook several steps. We first described the sample using frequencies and means and examined potential differences in baseline characteristics and behaviors using the chi-square and t tests, as appropriate. To assess the intervention’s early impact, we examined potential changes in four outcomes: (1) composite of HIV testing plus intention to test, (2) HIV testing alone, (3) intention to test for HIV, and (4) consistent condom use. We first compared the two arms among those completing the postintervention assessment using chi-square tests. Next, we conducted a pooled pre-post analysis (ie, within-subjects and across time) for HIV testing, intention to test for HIV, and consistent condom use using the McNemar test.
From February 2015 to March 2015, 982 individuals clicked through the advertised links, 357 (36.4%) individuals completed the online screening survey, of whom 244 (68.3%) were eligible; all eligible individuals enrolled (244/244, 100.0%) and were randomly assigned 1:1 to either the avoidance- or approach-framed conditions (122 in each arm;).
Baseline participant characteristics by group assignment appear in. Overall, majority of participants were aged between 18 and 29 years (156/244, 63.9%), had monthly incomes of over INR 18,001 (155/244, 63.5%), and lived with other family members (151/244, 61.9%). Most individuals identified as gay or homosexual (175/244, 71.7%) or bisexual (63/244, 25.8%), nearly a quarter (56/244, 23.0%) were not out to anyone, and almost half (128/244, 52.5%) had never visited HST for any reason. Half of the participants (122/244, 50.0%) had a main male partner, and the overall sample reported a mean of 3.7 (SD 5) male sexual partners in the past 12 months. Half of all participants (128/244, 52.5%) chose to receive intervention messages via email, 35.7% (87/244) via WhatsApp, and 11.5% (28/244) through a private Facebook group. There were no significant differences at baseline between conditions with regard to any of the demographic characteristics, chosen mode for message delivery, or preferred language ( ).
|Characteristics||Total (N=244)||Approach condition (n=122)||Avoidance condition (n=122)|
|Age (years), n (%)a|
|18-29||156 (63.9)||77 (63.1)||79 (64.8)|
|30-41||64 (26.2)||33 (27)||31 (25.4)|
|42 and above||24 (9.8)||11 (9)||12 (9.8)|
|Monthly income (Indian Rupees), n (%)a|
|Rs 3000-9000 (approximately US $50-150)||55 (22.5)||28 (23)||27 (22.1)|
|Rs 9001-18,000 (approximately US $150-300)||33 (13.5)||15 (12.3)||18 (14.8)|
|> Rs 18,001 (> approximately US $300)||155 (63.5)||79 (64.8)||77 (63.1)|
|Household members, n (%)a|
|Alone||33 (13.5)||20 (16.4)||13 (10.6)|
|Friends or nonrelative roommate||31 (12.7)||15 (12.3)||16 (13.1)|
|Boyfriend, husband, male partner||9 (2.3)||2 (1.6)||7 (5.7)|
|Joint family (eg, parents, siblings, relatives)||151 (61.9)||77 (63.1)||74 (60.7)|
|Wife (female) or own children||14 (5.7)||7 (5.7)||7 (5.7)|
|Preferred language, n (%)a|
|English||225 (92.2)||113 (92.6)||112 (91.8)|
|Hindi||19 (7.8)||9 (7.4)||10 (8.2)|
|Sexual orientation, n (%)a|
|Gay, homosexual, or queer||175 (71.7)||88 (72.1)||87 (71.3)|
|Bisexual||63 (25.8)||31 (25.4)||32 (26.2)|
|Straight or heterosexual||8 (3.3)||4 (3.3)||4 (3.3)|
|Level of outness, n (%)a|
|No one||56 (23.0)||27 (22.1)||29 (23.7)|
|Some people||144 (59.0)||73 (59.8)||71 (58.2)|
|Most people||44 (18.0)||22 (18)||22 (18)|
|Aware of Humsafar Trust (lesbian, gay, bisexual, transgender, and queer + community based organization), n (%)a||222 (91.0)||109 (89.3)||113 (92.6)|
|Have never visited Humsafar Trust, n (%)a||128 (52.5)||67 (54.9)||61 (50)|
|Has a main male partner, n (%)a||122 (50.0)||62 (50.8)||60 (49.2)|
|Number of male sexual partners in past year, mean (SD)||3.7 (5)||3.1 (3.2)||4.5 (6.4)|
|Access to intervention contents, n (%)a|
|Personal smartphone||136 (55.7)||66 (54.1)||70 (57.4)|
|Home computer||73 (29.9)||39 (32)||34 (27.9)|
|Work computer||20 (8.2)||9 (7.3)||11 (9)|
|Friend’s computer||7 (2.9)||6 (4.9)||1 (0.8)|
|Internet cafe||3 (1.2)||1 (0.8)||2 (1.6)|
|Mode of message delivery, n (%)a|
|128 (52.5)||60 (49.1)||68 (55.7)|
|Private Facebook group||28 (11.5)||15 (12.3)||13 (10.7)|
|87 (35.7)||46 (37.7)||41 (33.6)|
aPercentages do not add up to 100% for all variables because of rounding.
Feasibility and Retention
Overall, 82.0% (200/244) of the enrolled participants were retained through the end of the intervention (). The postintervention assessment link was clicked on by 62.7% (153/244) participants and was completed by 53.3% (130/244) participants. There were no significant differences between conditions in the proportion of participants retained, accessing the follow-up assessment, and completing the follow-up assessment. There were also no significant differences in baseline demographic and behavioral characteristics among those retained or completing the follow-up assessment, except with regard to sexual orientation ( ). Participants identifying as gay were more likely than those identifying as bisexual or straight to complete the follow-up assessment: 59.2% (103/174) for gay, 41% (26/63) for bisexual, and 13% (1/8) for straight; P<.01.
Intervention Acceptability and Suggestions for Improvement
Of the 130 participants completing the postintervention assessment, 106 (81.5%) liked or strongly liked their experience in CHALO!, 17.9% (19/106) neither liked nor disliked their experience, and only 4.7% (5/106) disliked or strongly disliked their experience in CHALO! Content analysis of free-text responses about what participants liked most about CHALO! revealed the following themes: the intervention was useful and provided supportive information; messages were engaging or motivating; created a sense of community and acceptance; and made them feel good about helping their community by participating in the study. With regard to what participants least liked about CHALO!, individuals reported the survey was too long or redundant, reported feeling that messages were not frequent enough, or had comments pertaining to the graphical appearance of the messages. Suggestions for improvement included having a larger social media presence, continuing the messaging for a longer duration, expanding topics, and using audiovisual or interactive graphics (eg, video clips). Field notes and feedback from the peer outreach staff indicated that the most common reason for not completing the follow-up assessment was not finding the online Amazon India incentives useful.
Of the participants completing the postintervention assessment (n=130), similar proportions of participants overall and in both conditions reported sharing the received digital messages with their friends (24% in both groups). In addition, 24% of individuals reported knowing someone else participating in CHALO! Only 6.1% (8/130) reported both knowing someone else in CHALO! and sharing the digital messages in general (which may or may not have been with the other CHALO participants).
shows the results of HIV testing outcomes for those who completed the follow-up survey (N=130). At baseline, 31.5% (41/130) of participants reported HIV testing in the past 6 months; at follow-up, 43.8% (57/130) of them reported having been tested (P=.04). When including those who reported intentions to test, this percentage increased from 44.6% (58/130) at baseline to 65.4% (85/130) at follow-up (P<.01). Finally, when examining intentions to test in the next month, among those without prior HIV testing, intentions increased from 32% (16/50) of the sample at baseline to 56% (28/50) of the sample at follow-up (P=.02).
At follow-up, fewer participants in approach vs avoidance reported being HIV tested in the past 6 months (26/68, 38% vs 31/68, 50%; P=.18) or intended to get an HIV test among those not tested in the past 6 months (47% vs 58%; P=.21), but these differences were not statistically significant ().
|Outcomes||Pre-post analysis||Approach||Avoidance||P valuea|
|N||Baseline, n (%)||Follow-up, n (%)||P valueb||N||Baseline, n (%)||Follow-up, n (%)||N||Baseline, n (%)||Follow-up, n (%)|
|HIV tested in the past 6 months (self-reported)||130||41 (31.5)||57 (43.8)||.04||68||22 (32)||26 (38)||62||19 (31)||31 (50)||.18|
|HIV tested in the past 6 months (self-reported) or intent to test||130||58 (44.6)||85 (65.4)||<.01||68||32 (47)||41 (60)||62||26 (42)||44 (71)||.20|
|Intent to HIV test among those not tested in the past 6 months||50||16 (32)||28 (56)||.02||28||10 (36)||15 (54)||22||6 (27)||13 (59)||.21|
|Always used condoms||76||47 (62)||46 (61)||.71||36||24 (64)||24 (64)||40||23 (58)||22 (55)||.41|
|Condom use at the last anal sex encounter in the past 3 months||76||58 (76)||53 (70)||.29||36||28 (78)||29 (81)||40||27 (67)||23 (58)||.18|
aComparison between approach vs avoidance at follow-up.
bComparison between baseline and follow-up.
cCondom use is among those reporting anal sex in past 3 months.
Among those having had anal sex in the past 3 months (n=76), the percentage of participants reporting always using a condom did not change overall (47/76, 62% at baseline vs 46/76, 61% at follow-up; P=.45), and there were no differences by arm (). There were also no significant differences in condom use at the last anal sex encounter between baseline and follow-up or between arms at follow-up ( ).
Using a community-based participatory research process, we developed and implemented an internet-based HIV prevention intervention for MSM in India. The findings from this pilot study showed that the CHALO! intervention delivery model was feasible to implement by a community-based organization and acceptable to participants, particularly those identifying as gay or homosexual. The intervention also demonstrated preliminary evidence for improving HIV testing and intention to test for HIV across both trial arms by self-report, with a greater increase in the avoidance-framed arm. However, the intervention had no impact on condom use.
To our knowledge, this is the first HIV-related intervention for MSM in India conducted exclusively online, using internet-based platforms to recruit, enroll, deliver a behavioral intervention, and follow-up participants longitudinally. We were able to reach and retain diverse MSM participants with respect to their sociodemographic characteristics, sexual identity, and level of outness. To our knowledge, almost all previous HIV-related intervention studies and service delivery programs in India have primarily relied on in-person approaches to initial outreach, and there exists only one published study that used mobile phones, but integrated the mobile device with in-person approaches for reaching individuals and delivering interventions . A few other studies using diverse ICT-based platforms and intervention procedures have evaluated whether internet-based platforms can increase HIV testing among MSM in other low- and middle-income countries and, in general, have found overall positive effects, although none of them have been conducted in India or other South Asian countries and few are readily scalable with limited resources [ , - ].
Our pilot study extends the literature by demonstrating the potential utility of a peer-delivered messaging intervention in a low-income country setting. Our findings also support the feasibility of implementing online interventions for MSM in India, with other recent data showing the ability to rapidly engage diverse Indian MSM online, including in rural areas . Fully powered internet-based intervention studies are warranted to examine the impact of these online models with more objective measures of HIV testing and assessment of downstream outcomes of linkage to care (for both treatment and prevention). In addition, HIV prevention studies of longer duration of fully online interventions in India and other low-income settings are needed to understand long-term retention and program effectiveness. Unlike online interventions that rely on specific software platforms or require high technical expertise and resources, the CHALO! intervention model—including the rigorous community-based development process for message creation—may also serve as a model for future ICT-based interventions that are able to accommodate the constantly shifting sociotechnical landscape [ ].
The use of message framing to inform online HIV-related messages has not previously been investigated anywhere; this study suggests that online educational and outreach interventions may need to consider the manner in which information is presented, depending on the health behavior being targeted. We found differences by study arm in the reports of HIV testing and intention to test, suggesting an influence of the message frame. Although both groups had significant increases in HIV testing outcomes from baseline to follow-up, we observed a greater increase among participants randomized to the avoidance-framed arm. This finding is consistent with the Prospect Theory , which posits that decision making is affected by framing effects. This study provides further support that framing effects may be dependent on whether the behavior is diagnostic (eg, HIV testing) or preventive (eg, condom use), which is consistent with previous studies [ , , , ]. In addition, framing effects on HIV testing behaviors may also be moderated by prior testing experiences; for example, avoidance- or negative-framed messages may work better for those who have never been tested for HIV but approach or positive-framed messages may work better for individuals previously tested for HIV [ , ], although we are unaware of any studies examining this issue. Although we were precluded from examining these types of potential effects stratified by prior testing history because of the small sample size, future studies could further examine these interactions to inform more tailored messaging interventions.
The CHALO! pilot did not have an impact on reported condom use behaviors. Increasing and sustaining condom use over time have been challenging across different contexts globally and interventions have had mixed findings [, , ]. This may be because of condom use being a complex behavior and one that requires the cooperation of the individual and their partner(s). Condom use is influenced by a variety of complex factors, including skills to use a condom, risk perception, influence of substances, community norms, desire for intimacy, stigma, and situational factors [ - ]. Thus, messaging alone is insufficient to address all these barriers. We hypothesize that CHALO! increased reported HIV testing behaviors but not condom use because obtaining an HIV test, in general, is an infrequent event compared with having sex. In addition, getting an HIV test may be more within the control of an individual’s decision making, whereas for using condoms they have to also rely on the preferences and decisions of the partner(s) [ , ]. Given the continued challenges in promoting and sustaining consistent condom use over time, other prevention modalities such as HIV pre-exposure prophylaxis (PrEP) and further development of online educational, outreach, and behavioral interventions are warranted. Although no single prevention modality will work for all, PrEP provides another highly effective option that is user centered. Notwithstanding other barriers to PrEP implementation, including awareness, access, cost, and provider-related obstacles, future research should examine the use of online interventions to promote PrEP adoption to MSM and other key populations in low- and middle-income countries.
This study should be interpreted in light of its limitations. First, our measures were self-reported, which may have introduced social desirability bias. However, given that we only observed changes in HIV testing and not for condom use, as well as the relatively anonymous nature of participant enrollment, social desirability may have played a limited role. Future studies with more objective measures are nevertheless needed. Second, this study recruited MSM online who reported living in Mumbai and thus may not be generalizable to online MSM elsewhere in India, particularly in settings that may not have MSM-sensitive physical services or a wide range of HIV testing sites available. Third, men who identified as bisexual and straight had low retention, indicating this pilot intervention likely had minimal impact on these groups who may be at higher risk for HIV [, ]. Future internet-based interventions for HIV prevention may benefit from taking into account sexual identity and tailoring contents specific to bisexual- and straight-identifying MSM. Finally, there could have been potential contamination between the study arms, given that a quarter of participants reported sharing the digital messages and a quarter knew of others participating in the study. Given the nature of online interventions with commonly used platforms, some degree of contamination is inevitable, and further research is needed to understand how best to measure and minimize contamination in online studies. Studies with larger samples are also needed to examine the impact of contamination on outcomes. However, a strength of social media and online interventions is their ability to rapidly diffuse information, and thus research is needed to understand how interventions could leverage the possibility of contamination as a strength rather than a limitation.
As one of the first studies of an online HIV intervention in India, this pilot study demonstrated preliminary efficacy for increasing self-reported HIV testing in an urban sample of MSM reached online, with the potential for wide national reach and high feasibility and acceptability. Given the continued structural challenges in engaging MSM in public health efforts (eg, stigma at various levels and lack of MSM-affirmative health care), changes in how MSM socialize and find partners and the suboptimal HIV testing rates—particularly in stigmatized settings—ICT-based intervention delivery models present new opportunities to engage MSM with or at high risk of HIV into care and prevention. Our findings signal the need for efficacy testing of this type of scalable intervention in a fully powered trial with objective measures of actual HIV testing and assessing its impact on downstream outcomes of linkage to care and prevention services.
The authors would like to thank all the participants, Vivek Anand, Rohan Pujari, Cameron Kamath, Mayank Bisht, and other HST staff members in making this study possible, and Nataly Rios in assisting with preparation of this manuscript. This study was supported in part by a pilot grant from the Albert Einstein College of Medicine’s Global Health Center, National Institutes of Health (NIH) K23MH102118 (principal investigator VP), the Einstein-Rockefeller-CUNY Center for AIDS Research (NIH P30AI051519), and NIH R25DA023021 (principal investigator JA). The funding sources had no role in the study design, conduct of the study, data collection or analysis, interpretation of results, manuscript preparation, or decision to submit the manuscript for publication.
Conflicts of Interest
Editorial note: This pilot randomized study was not prospectively registered. The editor granted an exception to ICMJE rules for prospective registration of randomized trials because the risk of bias appears low and the study was considered formative. However, readers are advised to carefully assess the validity of any potential explicit or implicit claims related to primary outcomes or effectiveness, as retrospective registration does not prevent authors from changing their outcome measures retrospectively.
Baseline demographic characteristics of intervention participants completing and not completing the postassessment survey (N=244).DOCX File , 14 KB
CONSORT-EHEALTH checklist (V 1.6.1).PDF File (Adobe PDF File), 434 KB
- National AIDS Control Organization. New Delhi, India: Ministry of Health and Family Welfare, Government of India; 2017. 2016-2017 Annual Report URL: http://naco.gov.in/sites/default/files/NACO%20ANNUAL%20REPORT%202016-17.pdf [accessed 2019-09-21]
- National AIDS Control Organization. India: National AIDS Control Organization; 2017. National Strategic Plan, 2017-24 URL: http://naco.gov.in/national-strategic-plan-hivaids-and-sti-2017-24 [accessed 2019-09-21]
- Mehta SH, Lucas GM, Solomon S, Srikrishnan AK, McFall AM, Dhingra N, et al. HIV care continuum among men who have sex with men and persons who inject drugs in India: barriers to successful engagement. Clin Infect Dis 2015 Dec 1;61(11):1732-1741 [FREE Full text] [CrossRef] [Medline]
- Thomas B, Mimiaga MJ, Kumar S, Swaminathan S, Safren SA, Mayer K. HIV in Indian MSM: reasons for a concentrated epidemic & strategies for prevention. Indian J Med Res 2011 Dec;134(6):920-929 [FREE Full text] [CrossRef] [Medline]
- Safren SA, Martin C, Menon S, Greer J, Solomon S, Mimiaga MJ, et al. A survey of MSM HIV prevention outreach workers in Chennai, India. AIDS Educ Prev 2006 Aug;18(4):323-332. [CrossRef] [Medline]
- Thomas B, Mimiaga MJ, Mayer KH, Perry NS, Swaminathan S, Safren SA. The influence of stigma on HIV risk behavior among men who have sex with men in Chennai, India. AIDS Care 2012;24(11):1401-1406 [FREE Full text] [CrossRef] [Medline]
- Tomori C, McFall AM, Srikrishnan AK, Mehta SH, Solomon SS, Anand S, et al. Diverse rates of depression among men who have sex with men (MSM) across India: insights from a multi-site mixed method study. AIDS Behav 2016 Feb;20(2):304-316 [FREE Full text] [CrossRef] [Medline]
- Sivasubramanian M, Mimiaga MJ, Mayer KH, Anand VR, Johnson CV, Prabhugate P, et al. Suicidality, clinical depression, and anxiety disorders are highly prevalent in men who have sex with men in Mumbai, India: findings from a community-recruited sample. Psychol Health Med 2011 Aug;16(4):450-462 [FREE Full text] [CrossRef] [Medline]
- Pappas G, Khan O, Wright J, Khan S, O'Neill J. Males who have sex with males (MSM) and HIV/AIDS in India: the hidden epidemic. AIDS Pub Policy J 2001;16(1):4-17 [FREE Full text]
- Telecom Regulatory Authority of India. 2017. The Indian Telecom Services Performance Indicators. July - September, 2017 URL: https://22.214.171.124/sites/default/files/PIR_July_Sept_28122017.pdf [accessed 2020-03-25]
- Ayala G, Makofane K, Santos G, Beck J, Do TD, Hebert P, et al. Access to basic HIV-related services and PrEP acceptability among men who have sex with men worldwide: barriers, facilitators, and implications for combination prevention. J Sex Transm Dis 2013;2013:953123 [FREE Full text] [CrossRef] [Medline]
- Beyrer C, Karim QA. The changing epidemiology of HIV in 2013. Curr Opin HIV AIDS 2013 Jul;8(4):306-310. [CrossRef] [Medline]
- Sullivan PS, Grey JA, Rosser BR. Emerging technologies for HIV prevention for MSM: what we have learned, and ways forward. J Acquir Immune Defic Syndr 2013 Jun 1;63(Suppl 1):S102-S107 [FREE Full text] [CrossRef] [Medline]
- Justumus P, Colby D, Anh TM, Balestre E, Becquet R, Orne-Gliemann J. Willingness to use the internet to seek information on HIV prevention and care among men who have sex with men in Ho Chi Minh City, Vietnam. PLoS One 2013;8(8):e71471 [FREE Full text] [CrossRef] [Medline]
- Wilkerson JM, Di Paola A, Rawat S, Patankar P, Rosser BR, Ekstrand ML. Substance use, mental health, HIV testing, and sexual risk behavior among men who have sex with men in the state of Maharashtra, India. AIDS Educ Prev 2018 Apr;30(2):96-107 [FREE Full text] [CrossRef] [Medline]
- Patel VV, Dange A, Rawat S, Arnsten JH, Piña C, Golub SA, et al. Barriers to HIV testing among men who have sex with men in India reached online: implications for interventions. J Acquir Immune Defic Syndr 2018 Aug 1;78(4):e30-e34 [FREE Full text] [CrossRef] [Medline]
- Noar SM, Willoughby JF. eHealth interventions for HIV prevention. AIDS Care 2012;24(8):945-952 [FREE Full text] [CrossRef] [Medline]
- Rietmeijer CA, McFarlane M. Electronic media and STI prevention. In: The New Public Health and STD/HIV Prevention. New York, NY: Springer; 2013:165-175.
- Centola D. Social media and the science of health behavior. Circulation 2013 May 28;127(21):2135-2144. [CrossRef]
- Rosser BR, Wilkerson JM, Smolenski DJ, Oakes JM, Konstan J, Horvath KJ, et al. The future of internet-based HIV prevention: a report on key findings from the Men's INTernet (MINTS-I, II) Sex Studies. AIDS Behav 2011 Apr;15(Suppl 1):S91-100 [FREE Full text] [CrossRef] [Medline]
- Cao B, Gupta S, Wang J, Hightow-Weidman LB, Muessig KE, Tang W, et al. Social media interventions to promote HIV testing, linkage, adherence, and retention: systematic review and meta-analysis. J Med Internet Res 2017 Nov 24;19(11):e394 [FREE Full text] [CrossRef] [Medline]
- Muessig KE, Nekkanti M, Bauermeister J, Bull S, Hightow-Weidman LB. A systematic review of recent smartphone, internet and web 2.0 interventions to address the HIV continuum of care. Curr HIV/AIDS Rep 2015 Mar;12(1):173-190 [FREE Full text] [CrossRef] [Medline]
- Maloney KM, Bratcher A, Wilkerson R, Sullivan PS. Electronic and other new media technology interventions for HIV care and prevention: a systematic review. J Int AIDS Soc 2020 Jan;23(1):e25439 [FREE Full text] [CrossRef] [Medline]
- Young SD, Cumberland WG, Lee S, Jaganath D, Szekeres G, Coates T. Social networking technologies as an emerging tool for HIV prevention: a cluster randomized trial. Ann Intern Med 2013 Sep 3;159(5):318-324 [FREE Full text] [CrossRef] [Medline]
- Kemp CG, Velloza J. Implementation of eHealth interventions across the HIV care cascade: a review of recent research. Curr HIV/AIDS Rep 2018 Dec;15(6):403-413 [FREE Full text] [CrossRef] [Medline]
- Young SD, Cumberland WG, Nianogo R, Menacho LA, Galea JT, Coates T. The HOPE social media intervention for global HIV prevention in Peru: a cluster randomised controlled trial. Lancet HIV 2015 Jan;2(1):e27-e32 [FREE Full text] [CrossRef] [Medline]
- Anand T, Nitpolprasert C, Kerr SJ, Muessig KE, Promthong S, Chomchey N, et al. A qualitative study of Thai HIV-positive young men who have sex with men and transgender women demonstrates the need for eHealth interventions to optimize the HIV care continuum. AIDS Care 2017 Jul;29(7):870-875. [CrossRef] [Medline]
- Rothman AJ, Martino SC, Bedell BT, Detweiler JB, Salovey P. The systematic influence of gain-and loss-framed messages on interest in and use of different types of health behavior. Pers Soc Psychol Bull 1999;25(11):1355-1369. [CrossRef]
- Shen L, Dillard JP. The influence of behavioral inhibition/approach systems and message framing on the processing of persuasive health messages. Commun Res 2007;34(4):433-467. [CrossRef]
- Gallagher KM, Updegraff JA. Health message framing effects on attitudes, intentions, and behavior: a meta-analytic review. Ann Behav Med 2012 Feb;43(1):101-116. [CrossRef] [Medline]
- Garcia-Retamero R, Cokely ET. Effective communication of risks to young adults: using message framing and visual aids to increase condom use and STD screening. J Exp Psychol Appl 2011 Sep;17(3):270-287. [CrossRef] [Medline]
- Richardson JL, Milam J, McCutchan A, Stoyanoff S, Bolan R, Weiss J, et al. Effect of brief safer-sex counseling by medical providers to HIV-1 seropositive patients: a multi-clinic assessment. AIDS 2004 May 21;18(8):1179-1186. [CrossRef] [Medline]
- Apanovitch AM, McCarthy D, Salovey P. Using message framing to motivate HIV testing among low-income, ethnic minority women. Health Psychol 2003 Jan;22(1):60-67. [CrossRef] [Medline]
- Dasgupta RK, DasGupta D. Queering Digital India: Activisms, Identities, Subjectivities. Edinburgh: Edinburgh University Press; 2018.
- Eveslage B, Shah P, Parker C, George B, Baishya J. Density Mapping of Dating App Users Across Time and Space in Mumbai, India. In: Proceedings of the 22nd International AIDS Conference. 2018 Presented at: AIDS'18; July 23-27, 2018; Amsterdam, Netherlands URL: https://programme.aids2018.org/PAGMaterial/eposters/6691.pdf
- Fisher JD, Fisher WA. Changing AIDS-risk behavior. Psychol Bull 1992 May;111(3):455-474. [CrossRef] [Medline]
- Fisher JD, Fisher WA, Williams SS, Malloy TE. Empirical tests of an information-motivation-behavioral skills model of AIDS-preventive behavior with gay men and heterosexual university students. Health Psychol 1994 May;13(3):238-250. [CrossRef] [Medline]
- Kahneman D, Tversky A. Prospect theory: An analysis of decision under risk. In: Ziemba WT, editor. Handbook Of The Fundamentals Of Financial Decision Making: Part I. Singapore: World Scientific; 2013:99-127.
- Tversky A, Kahneman D. The framing of decisions and the psychology of choice. Science 1981 Jan 30;211(4481):453-458. [CrossRef] [Medline]
- Reyna VF. A theory of medical decision making and health: fuzzy trace theory. Med Decis Making 2008;28(6):850-865 [FREE Full text] [CrossRef] [Medline]
- Rothman AJ, Salovey P, Antone C, Keough K, Martin CD. The influence of message framing on intentions to perform health behaviors. J Exp Soc Psychol 1993 Sep;29(5):408-433. [CrossRef]
- Patel VV, Mayer KH, Makadon HJ. Men who have sex with men in India: a diverse population in need of medical attention. Indian J Med Res 2012 Oct;136(4):563-570 [FREE Full text] [Medline]
- Solomon SS, Mehta SH, Srikrishnan AK, Vasudevan CK, Mcfall AM, Balakrishnan P, et al. High HIV prevalence and incidence among MSM across 12 cities in India. AIDS 2015 Mar 27;29(6):723-731 [FREE Full text] [CrossRef] [Medline]
- Owen H. Open Space Technology: A User's Guide. San Francisco: Berrett-Koehler Publishers; 2008.
- Risku H, Pichler T, Wieser V. Transcreation as a translation service: process requirements and client expectations. Across Lang Cult 2017 Jun;18(1):53-77. [CrossRef]
- Ministry of Health & Family Welfare, Government of India. National AIDS Control Organization. India: National AIDS Control Organization; 2015 Jul. National Guidelines for HIV Testing URL: http://www.naco.gov.in/sites/default/files/National_Guidelines_for_HIV_Testing_21Apr2016.pdf [accessed 2018-11-30]
- Mimiaga MJ, Thomas B, Biello K, Johnson BE, Swaminathan S, Navakodi P, et al. A pilot randomized controlled trial of an integrated in-person and mobile phone delivered counseling and text messaging intervention to reduce HIV transmission risk among male sex workers in Chennai, India. AIDS Behav 2017 Nov;21(11):3172-3181 [FREE Full text] [CrossRef] [Medline]
- Anand T, Nitpolprasert C, Ananworanich J, Pakam C, Nonenoy S, Jantarapakde J, et al. Innovative strategies using communications technologies to engage gay men and other men who have sex with men into early HIV testing and treatment in Thailand. J Virus Erad 2015 Apr 1;1(2):111-115 [FREE Full text] [Medline]
- Anand T, Nitpolprasert C, Trachunthong D, Kerr SJ, Janyam S, Linjongrat D, et al. A novel Online-to-Offline (O2O) model for pre-exposure prophylaxis and HIV testing scale up. J Int AIDS Soc 2017 Mar 13;20(1):21326 [FREE Full text] [CrossRef] [Medline]
- Anand T, Nitpolprasert C, Phanuphak N. Online-to-offline models in HIV service delivery. Curr Opin HIV AIDS 2017 Sep;12(5):447-457 [FREE Full text] [CrossRef] [Medline]
- Kliner M, Knight A, Mamvura C, Wright J, Walley J. Using no-cost mobile phone reminders to improve attendance for HIV test results: a pilot study in rural Swaziland. Infect Dis Poverty 2013 Jun 14;2(1):12 [FREE Full text] [CrossRef] [Medline]
- Blas MM, Alva IE, Carcamo CP, Cabello R, Goodreau SM, Kimball AM, et al. Effect of an online video-based intervention to increase HIV testing in men who have sex with men in Peru. PLoS One 2010 May 3;5(5):e10448 [FREE Full text] [CrossRef] [Medline]
- Li DH, Brown CH, Gallo C, Morgan E, Sullivan PS, Young SD, et al. Design considerations for implementing eHealth behavioral interventions for HIV prevention in evolving sociotechnical landscapes. Curr HIV/AIDS Rep 2019 Aug;16(4):335-348. [CrossRef] [Medline]
- Block LG, Keller PA. When to accentuate the negative: The effects of perceived efficacy and message framing on intentions to perform a health-related behavior. J Mark Res 2018 Dec 20;32(2):192-203. [CrossRef]
- Pérez A, Santamaria EK, Operario D. A systematic review of behavioral interventions to reduce condomless sex and increase HIV testing for Latino MSM. J Immigr Minor Health 2018 Oct;20(5):1261-1276 [FREE Full text] [CrossRef] [Medline]
- Bauermeister JA, Tingler RC, Demers M, Connochie D, Gillard G, Shaver J, et al. Acceptability and preliminary efficacy of an online HIV prevention intervention for single young men who have sex with men seeking partners online: the myDEx Project. AIDS Behav 2019 Nov;23(11):3064-3077. [CrossRef] [Medline]
- Card KG, Lachowsky NJ, Cui Z, Shurgold S, Armstrong HL, Rich AJ, et al. An event-level analysis of the interpersonal factors associated with condomless anal sex among gay, bisexual, and other men who have sex with men (MSM) with online-met partners. AIDS Educ Prev 2017 Apr;29(2):154-174 [FREE Full text] [CrossRef] [Medline]
- Chakrapani V, Shunmugam M, Newman PA, Kershaw T, Dubrow R. HIV status disclosure and condom use among HIV-positive men who have sex with men and hijras (male-to-female transgender people) in India: implications for prevention. J HIV AIDS Soc Serv 2015 Mar 3;14(1):26-44. [CrossRef]
- Li H, Xue L, Tucker JD, Wei C, Durvasula M, Hu W, et al. Condom use peer norms and self-efficacy as mediators between community engagement and condom use among Chinese men who have sex with men. BMC Public Health 2017 Aug 7;17(1):641 [FREE Full text] [CrossRef] [Medline]
- Musinguzi G, Bastiaens H, Matovu JK, Nuwaha F, Mujisha G, Kiguli J, et al. Barriers to condom use among high risk men who have sex with men in Uganda: a qualitative study. PLoS One 2015;10(7):e0132297 [FREE Full text] [CrossRef] [Medline]
- Chakrapani V, Boyce P, Newman PA, Kavi AR. Contextual influences on condom use among men who have sex with men in India: subjectivities, practices and risks. Cult Health Sex 2013;15(8):938-951. [CrossRef] [Medline]
- Ramakrishnan L, Ramanathan S, Chakrapani V, Goswami P, Deshpande S, Yadav D, et al. Comparison of sexual risk, HIV/STI prevalence and intervention exposure among men who have sex with men and women (MSMW) and men who have sex with men only (MSMO) in India: implications for HIV prevention. AIDS Behav 2015 Dec;19(12):2255-2269 [FREE Full text] [CrossRef] [Medline]
- Mayer KH, Gangakhedkar R, Sivasubramanian M, Biello KB, Abuelezam N, Mane S, et al. Differing identities but comparably high HIV and bacterial sexually transmitted disease burdens among married and unmarried men who have sex with men in Mumbai, India. Sex Transm Dis 2015 Nov;42(11):629-633 [FREE Full text] [CrossRef] [Medline]
|HST: Humsafar Trust|
|ICT: internet-based communication technology|
|MSM: men who have sex with men|
|NIH: National Institutes of Health|
|PrEP: pre-exposure prophylaxis|
|STI: sexually transmitted infection|
Edited by G Eysenbach; submitted 08.10.19; peer-reviewed by Y Guo, J Patterson; comments to author 31.10.19; revised version received 08.02.20; accepted 22.02.20; published 16.04.20
©Viraj V V Patel, Shruta Rawat, Alpana Dange, Corina Lelutiu-Weinberger, Sarit A Golub. Originally published in JMIR Public Health and Surveillance (http://publichealth.jmir.org), 16.04.2020.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Public Health and Surveillance, is properly cited. The complete bibliographic information, a link to the original publication on http://publichealth.jmir.org, as well as this copyright and license information must be included.