The Karma system is currently undergoing maintenance (Monday, January 29, 2018).
The maintenance period has been extended to 8PM EST.

Karma Credits will not be available for redeeming during maintenance.
Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 03.05.18 in Vol 4, No 2 (2018): Apr-Jun

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/9088, first published Sep 29, 2017.

This paper is in the following e-collection/theme issue:

    Original Paper

    Recommendations for the Development of a Mobile HIV Prevention Intervention for Men Who Have Sex With Men and Hijras in Mumbai: Qualitative Study

    1The Humsafar Trust, Mumbai, India

    2School of Public Health, University of Texas Health Science Center at Houston, Houston, TX, United States

    3School of Public Health, University of Minnesota, Minneapolis, MN, United States

    4Minnesota Department of Health, Minneapolis, MN, United States

    5University of California San Francisco Center for AIDS Prevention Studies, San Francisco, CA, United States

    *these authors contributed equally

    Corresponding Author:

    J Michael Wilkerson, MPH, PhD

    School of Public Health

    University of Texas Health Science Center at Houston

    7000 Fannin St, Ste 2620

    Houston, TX,

    United States

    Phone: 1 713 500 9974

    Email:


    ABSTRACT

    Background: As Internet and mobile phone use expands in India, there is an opportunity to develop mobile health (mHealth) interventions for marginalized populations, including men who have sex with men (MSM) and hijras (transgender women), hesitant to access traditional health care systems.

    Objective: The purpose of this study was to determine if an mHealth intervention was acceptable to MSM and hijras living in Mumbai, and if so, what features would be useful in targeting the prevention of HIV acquisition and to increase the quality of life among persons living with HIV/AIDS.

    Methods: Data from 4 focus groups with MSM and interviews with 4 hijras, 10 health service providers, and 8 mHealth developers were thematically analyzed.

    Results: Once the need for an mHealth intervention was confirmed, comments about features were organized into 3 themes: content, interface, and retention. Content subthemes included providing sex education for younger community members, providing information about STIs, and providing information and social support for persons living with HIV. Interface subthemes included presenting content using pictures; using videos to present stories of role models; using push notifications for testing, appointment, and medication reminders; using geolocation to link to just-in-time services; and using telemedicine to increase access to health service providers and community services. The 5 retention subthemes included keeping it fun, using gaming mechanics, developing content in regional languages, protecting confidentiality, and linking to social networking apps.

    Conclusions: These findings may help inform mHealth development in India.

    JMIR Public Health Surveill 2018;4(2):e46

    doi:10.2196/publichealth.9088

    KEYWORDS



    Introduction

    The National AIDS Control Organization estimates the prevalence of HIV among adults in India as 0.3% [1]. Among men who have sex with men (MSM) and hijras (transgender women), the prevalence of HIV is estimated to be 4.3% and 7.5%, respectively [1,2]. These relatively high rates of HIV among MSM and hijras have been attributed to individual-level risk behaviors like high rates of sexual concurrency (wherein individuals have multiple overlapping sexual partners) and low rates of condom use [3,4]. Additionally, MSM and hijras often face stigma, discrimination, and, in some cases, criminalization [5-7]. Due to fear of social recrimination, MSM and hijras may be unwilling to engage with health service providers, leaving them with unmet health care needs [7]. Some evidence suggests interventions using mobile health (mHealth) technology may increase access to health care in developing countries such as India [8]. Therefore, Indian MSM and hijras may also benefit from mHealth interventions.

    In developing countries, including India, mHealth interventions have historically made use of short message service (SMS) technology [9-14]. However, the mobile technology market in India is complicated by governmental regulations, including a National Customer Preference Register, that limit the number of SMS messages sent and received per day [15]. Due to these limitations, researchers investigating the effects of SMS mHealth interventions in India have obtained mixed results [16,17]. It is estimated that in 2018 there will be 530 million mobile phone users in India, nearly twice that of the United States [18]. Given the challenges of harnessing SMS messaging for health interventions, researchers instead should consider the burgeoning mobile phone market within India as a means of advancing the field of mHealth, particularly in support of the unique health needs of MSM and hijras [19]. The difficulties in harnessing SMS technology for mHealth interventions make mobile phone technology such as Internet-enabled apps a viable option for public health interventionists.

    In Western countries, many mHealth interventions capitalize on mobile phones to deliver HIV prevention messaging and needs assessments for high-risk MSM. Preferred content often includes information about HIV and sexually transmitted infections (STIs), proper condom use, behavioral risk reduction strategies, and partner communication strategies [20,21]. For persons living with HIV/AIDS (PLHA), preferred content includes information about health care providers and treatment, especially regarding linkage and retention into care and medication adherence [22,23]. Additional features include use of geolocation of HIV testing centers; automated reminders for testing, appointment, and medication adherence; use of existing public or private social networking apps and chat rooms to increase social support; links to role model videos; self-assessment tools; access to sexual health experts; referrals to health service providers; and telemedicine [22,24-27].

    The successes and innovations of mobile phone–based mHealth interventions in Western populations make a strong case for developing such interventions for MSM and hijras in India. Thus, in this paper we report qualitative findings from a formative research study with high-risk Indian MSM and hijras, health service providers with MSM and hijra clientele, and mHealth developers to determine what content and features they would like to be included in an mHealth intervention to prevent new HIV infections and increase the quality of life among PLHA. To the best of our knowledge, there is no information about the preferred features of an mHealth intervention targeting high-risk MSM and hijras in India.


    Methods

    Study Population and Recruitment

    We used a convenience sample to recruit study participants based on key informants identified by the research team and The Humsafar Trust, one of India’s largest nongovernmental organizations that advocates for the rights of sexual and gender minority people. We used snowball sampling [22,25] to recruit MSM into focus groups. Approximately 6 individuals were in each focus group. Hijras and health service providers were asked to participate in individual interviews. Eligibility criteria for MSM and hijras included being 18 years or older, living in Mumbai, and having used Internet-enabled technology (ie, laptop, desktop, tablet, or mobile phone) to meet male sex partners [28]. Health service providers included medical doctors, nurses, mental health providers, and outreach workers who had a significant number of MSM and hijra clients and who felt confident in their ability to speak about using technology to interact with patients. mHealth developers were recruited from an mHealth conference listserv. Conference organizers allowed the research team access to the email addresses of all attendees. Developers who had experience working with Indian populations were asked to contact the research team. Upon completion of focus group or interview, participants received Rs 300 (US $7). All study procedures were approved by the institutional review boards of all authors’ home institutions and the Indian Government.

    The median age of the 24 MSM who participated in focus groups was 27 (interquartile range, IQR, 24 to 33) years. Most of them (21/24, 88%) were college educated. Nearly all the MSM (23/24, 99%) identified as gay or homosexual. About a third of them (9/24, 38%) were out about their sexual or gender identity to most or all the people they knew, 21% (5/24) were out to about half the people they knew, and 42% (10/24) of MSM participants were out to only a few people or no one at all.

    The median age of the 4 hijras who participated in individual interviews was 25 (IQR 22 to 29) years. Three were college educated and all identified as hijras. Three were out to most of the people they knew as a hijra, while 1 was out to about half the people she knew.

    The median age of the 10 health service providers who participated in individual interviews was 31 (IQR 28 to 38) years. Half of them (5/10, 50%) were college educated; 8 of the health service providers identified as men, 1 as a woman, and 1 preferred not to identify. On average, the health service providers had worked in prevention for 6.2 (SD 5.4) years and with MSM or hijras specifically for 5.3 (SD 4.9) years.

    The median age of the 8 mHealth developers who participated in individual interviews was 39 (IQR 32 to 44) years, and all were college-educated men. On average, the mHealth developers had worked in mHealth for 4.0 (SD 2.9) years and had worked in India on average for 3.3 (SD 2.9) years. All the developer participants believed that mHealth interventions could be useful, although they acknowledged that developing such a tool for the Indian context would be challenging due to differences in languages spoken, literacy, and access to technology.

    Study Procedures

    Prior to data collection, a member of the research team reviewed consent forms with all participants. After consenting but prior to the start of the qualitative data collection, participants completed a brief demographic questionnaire. Four focus groups [29] were conducted with MSM who used technology to meet male sex partners. Because it was difficult to identify hijras who use technology to meet sex partners—perhaps due to differences in income between MSM and hijras—the few who were identified were interviewed individually. Topics discussed in focus groups and interviews were similar. Both began with a discussion about participants’ experiences using technology to meet sex partners and concluded with a discussion about suggestions for an HIV/STI prevention mHealth intervention. Additionally, we interviewed 10 health service providers who had experience working with MSM and hijra patients. The interviews focused on the ways health service providers and their organizations might use technology-based interventions to address the health needs of MSM and hijras. Each focus group lasted approximately 1.5 hours, and each individual interview lasted approximately 1 hour. Although focus groups and interviews were conducted in the preferred language of participants (Marathi, Hindi, or English), most focus groups and interviews occurred in English. During the focus groups, participants often switched between English and either Hindi or Marathi. Copies of the semistructured focus group and interview protocols are available upon request from the corresponding author.

    Data Analysis

    All focus groups and interviews were audiorecorded and transcribed. When participants spoke Hindi or Marathi, the recordings were translated into English by staff at The Humsafar Trust. The first and third authors, who are fluent in Marathi, Hindi, and English, compared the translated transcripts for accuracy. Because many focus group and interview participants spoke in English at least some of the time, the words of participants were retained for analysis. The English portions of the transcripts were not altered to adhere to English grammar rules. The English transcripts were entered into NVivo 10 (QSR International Pty Ltd) for content analysis [30]. Independently, the first and second authors coded all transcripts for distinct themes based on the meaning of words or phrases and then came together to compare codes and arrive at a common coding taxonomy by examining codes for frequency, strength, and relationship. The taxonomy was presented to and vetted by the entire research team to arrive at a final taxonomy, which was used to code all transcripts.


    Results

    Three overarching themes emerged from the data that were relevant to the development of an mHealth HIV prevention intervention for Indian MSM: content, interface, and retention features of the intervention.

    Content

    Content recommendations for an mHealth intervention included providing sex education for youth, providing information about STIs, and providing information and social support for PLHA. Because sex education is not uniformly taught in schools, participants suggested mHealth could provide missing sex education. Topics such as gender, identity, and sexuality as well as HIV/STI facts, proper condom use, and condom use negotiation skills were identified as being the most salient.

    The way sex should be done, condom should be used and it should be done at safe place, all this should be shown.
    [Hijra]

    Participants also expressed a need for an intervention to address reasons why younger MSM and hijras might engage in condomless anal sex (barebacking), including possible coercion by older partners and perceived HIV status of a potential sex partner based on their appearance.

    When I was 17, people used to persuade me to have bareback sex. Thankfully, I was aware of not having sex but they used to say, “Do it, nothing [bad] would happen.” So, the young guys would want to try out everything so that they might just fall for it.
    [MSM]
    If you smell good, wear good perfume, have nice underwear, and if you are physically clean then you are considered to be [HIV negative].
    [MSM]

    Participants viewed an mHealth intervention as a tool to provide accurate information on STIs. MSM and hijra participants recommended that the intervention have adequate information on STIs to aid in the identification of STIs prior to having sex with a potential partner. The health service providers shared this view and acknowledged that an mHealth intervention could also bridge gaps in understanding that health service providers have about STIs. Health service providers expected an mHealth intervention to promote a fear-based approach to STIs with graphic pictures of infections to scare the community members into practicing safer sex; however, MSM and hijras expressed an aversion to this approach. Thus, while there was agreement about the need for information about STIs, health service providers and MSM and hijras had divergent views on how best to deliver the information.

    MSM, hijras, and health service providers viewed an mHealth intervention as a potential source of information and support for PLHA. Topics included ways to improve positive living, including medication adherence, how to contact a health care worker in cases of emergency hospitalizations, information about health centers offering various services for PLHA, and an online support group for respondents. Participants suggested that an mHealth intervention could connect individuals with health care workers who could provide support to PLHA in case of emergency as well as routine hospitalizations and with other persons living with the virus.

    Sometimes PLHA and MSM community people [are] hospitalized and they don’t have their family members with them. At that time, there is a major problem with their care... so if we can do it by app...we can get free or voluntary caretakers for them. This would be the most important support for PLHA community.
    [Health service provider]

    Participants felt community support was needed for PLHA because of the stigma and discrimination associated with living with HIV. An online community would ensure privacy.

    Interface

    Interface recommendations for an mHealth intervention included presenting content using pictures; using videos to present stories of role models; using push notifications for testing, appointment, and medication reminders; using geolocation to link to just-in-time (JIT) services; and using telemedicine to increase access to health care providers and community services.

    Nearly all participants agreed that mHealth interventions should have minimal text if MSM and hijras were to use it regularly. They suggested presenting information in pictorial formats. Some participants’ expressed concerns about text-heavy content were potential user short attention spans and limited literacy, particularly among members of the hijra community.

    Normally in our community, so many uneducated people are there and they cannot be able to know how this app would to be used.
    [Hijra]

    Health service providers agreed with these observations, noting that pictorial messages can aid in recall.

    People generally understand the messages through pictures. When he sees the picture, he will try to recall that, “Yes, I have seen it somewhere.” So pictures should be used much.
    [Health service provider]

    Overreliance on written communication could impede understanding and utility of health messaging. Images or videos were a preferred method of messaging. Community participants expressed that an mHealth intervention could also explore areas beyond the traditional ambit of health education by using role models within the community and focusing on relationships with partners. An mHealth intervention could have role model stories from persons who have navigated stigmatizing environments to form successful social and romantic relationships with other MSM and hijras. An mHealth intervention could also provide role models of PLHA by describing the journey toward accepting one’s HIV positive status and living a happy and successful life.

    [Include] videos on how people have become comfortable having HIV. Messages from role models. Some honest interview of what stages of approval [self-acceptance] the person has gone through... Something on lines of, “I was really angry, I was revengeful and I changed.”
    [MSM]

    Because of barriers to using SMS, push notifications when used selectively were an acceptable alternative. Because it was sometimes difficult to remember to test routinely or to remember other medical appointments, participants felt an mHealth intervention could be used to promote testing among community members by setting reminders. Reminders were perceived as being particularly useful for hijra sex workers as their working schedules often affect regular testing. For PLHA, push notifications were viewed as an acceptable method for reminders to take antiretroviral or other medications.

    Participants were enthusiastic about the possibilities to access information on community events and JIT services. The most mentioned JIT services that the participants wished to see included were information on sexual and gender minority–serving nongovernmental organizations and testing centers, health care providers, counselors, legal aid, and helplines.

    Some health service providers recommended telemedicine for mental health counseling and to broaden outreach, particularly to MSM and hijras who were closeted and hard to reach. One health care provider articulated the financial challenge to this approach while also highlighting the potential benefit.

    Telemedicine broadens the outreach. [There is] considerable investment in the cost of equipment, [but] support would be counseling for mental health issues, since gay men don't find it easy to open up to everyone.
    [Health service provider]

    While health service providers and community participants acknowledged the infrastructure costs to begin offering telemedicine, the suggestions could allow an mHealth intervention to be accessed by a greater number of clients.

    Retention

    Retention recommendations for an mHealth intervention included keeping it fun, developing content in regional languages, protecting confidentiality, and linking to social networking apps. Community participants insisted that the mHealth intervention be fun; otherwise, they felt members of the community would not access it regularly. They were wary of an intervention that was too serious because they felt that the members of the community would quickly lose interest in it. Another suggestion was to employ gaming mechanics. For example, 1 participant recommended employing a reward system for engaging in health-promoting behavior (ie, using a condom after last intercourse or getting tested for HIV).

    There was a strong emphasis on use of local languages. English words could be misunderstood and would make the intervention inaccessible to members of the community who are less fluent in English. Both health service providers and members of the community expressed concern about the excessive use of English. For them, it was important that intervention developers embrace the multiculturalism of India.

    Participants said protecting confidentiality on an mHealth intervention would be critical. Participants highlighted the stigma that the community faces and shared instances of how stigma affects uptake of services by the community. Participants stated that confidentiality would be a key aspect influencing use of an mHealth intervention by the community. Mindful that homosexuality is still illegal and highly stigmatized in India, participants said that if the intervention looked “too gay” or included nude content then it could potentially out users as sexual or gender minorities and discourage increased use of the intervention, as a substantial proportion of the community are closeted.

    You should just have a logo and that’s about it. Logo or the identity interface should not have a gay feel. Even the name of the app can’t be too gay. And if there is a way that a person could hide the app, saying like you have this antivirus software where when it gets camouflage with something else.
    [MSM]

    MSM and hijras, in particular, were in favor of having access codes to ensure that the app remains private and confidential. However, they expressed concerns about information still being visible in instances of pop-up notifications. Participants recommended that confidentiality statements be featured prominently.

    An additional recommendation to make the intervention more interactive and increase retention was to incorporate social networking. Participants described using various types of social media (eg, Facebook, Twitter) to improve reach. Some participants recommended that an mHealth intervention be linked to popular instant messaging apps (eg, Whatsapp) and dating apps (eg, PlanetRomeo) to allow messages to be delivered instantly by using instant message features on these apps for sending out health messages. By linking the intervention to preexisting social networking apps, an intervention could seamlessly be incorporated into participants’ lives rather than being another app they may forget to check.


    Discussion

    Principal Findings

    Interventions using mHealth are becoming more feasible in India because of a burgeoning market for mobile technology and use of the Internet [18,19]. Although a demographic digital divide exists with millennials from higher income brackets being more likely to be mobile phone and Internet users [31], trends suggest a rapidly expanding technological market as products become more affordable. This creates new opportunities to develop culturally relevant mobile health (mHealth) interventions for a variety of health issues including HIV prevention.

    Although many of the features identified by participants were similar to those reported in the literature using data from Western countries, there were some differences, including minimal use of text, the ability to deliver content in multiple regional languages, and concerns about confidentiality due to stigma and criminalization of homosexuality. For an mHealth intervention to be used by Indian MSM and hijra communities, it needs to feel safe, private, trustworthy, and confidential. To feel credible, it needs to include numerous safeguards to ensure confidentiality of the users and not appear “too gay.” An mHealth intervention could be an avenue for strengthening care and support services to MSM and hijra PLHA. Features such as reminders could improve adherence to medication and routine health care checkups. An intervention could also provide much needed emotional and physical support to PLHA. If the app mediated mental health counseling and access to JIT services and community events, it could empower members of the community to make informed choices about their health and sexuality.

    Strengths and Limitations

    A strength of this study is the increased credibility resulting from triangulating data from focus groups with MSM and individual interviews with hijras, health service providers, and mHealth developers. However, data were collected only from persons living in Mumbai, so transferability to other Indian or South and Southeast Asian contexts, particularly to rural Indian contexts, is unknown. In addition, we were only able to recruit 4 hijras who had experience using technology to meet male sex partners. Similar to formative studies from Western countries, a limitation is that the focus was on preventive education, testing, and medication adherence rather than the on the entire continuum of care [27,32].

    Conclusion

    Although participants recommended keeping the intervention simple, they also suggested a lot of content and features. When developing an intervention, it will be important for researchers, practitioners, and developers to remain cognizant of the trade-off between developing an intervention that will achieve the desired health outcome and addressing the diverse needs of potential users of the intervention. While members of the community and health service providers have some divergent opinions on content and retention features, there is broad support for the development of an mHealth intervention to prevent HIV transmission and support persons living with the virus. Where differing views exist, such as use of pictures of graphic STIs, additional research is needed to ensure uptake of messaging. However, it should be noted that fear-based messaging techniques for HIV prevention have been shown to be ineffective [33]. Although our findings do not represent a framework for a particular intervention, practitioners and researchers developing interventions for Indian MSM and hijras should consider the wishes of the community if they decide to incorporate mobile technology into their prevention efforts.

    Conflicts of Interest

    None declared.

    References

    1. National AIDS Control Organisation: Annual Report 2015-16.   URL: http://naco.gov.in/sites/default/files/Annual%20Report%202015-16_NACO.pdf [accessed 2018-04-14] [WebCite Cache]
    2. National AIDS Control Organisation: India HIV estimations 2015.   URL: http://www.naco.gov.in/sites/default/files/India%20HIV%20Estimations%202015.pdf [accessed 2018-04-14] [WebCite Cache]
    3. Solomon SS, Srikrishnan AK, Sifakis F, Mehta SH, Vasudevan CK, Balakrishnan P, et al. The emerging HIV epidemic among men who have sex with men in Tamil Nadu, India: geographic diffusion and bisexual concurrency. AIDS Behav 2010 Oct;14(5):1001-1010 [FREE Full text] [CrossRef] [Medline]
    4. Setia MS, Lindan C, Jerajani HR, Kumta S, Ekstrand M, Mathur M, et al. Men who have sex with men and transgenders in Mumbai, India: an emerging risk group for STIs and HIV. Indian J Dermatol Venereol Leprol 2006;72(6):425-431 [FREE Full text] [Medline]
    5. Li DH, Rawat S, Rhoton J, Patankar P, Ekstrand ML, Rosser BRS, et al. Harassment and violence among men who have sex with men (MSM) and hijras after reinstatement of India sodomy law. Sex Res Soc Policy 2016 Dec 17;14(3):324-330. [CrossRef]
    6. Mimiaga MJ, Reisner SL, Closson EF, Perry N, Perkovich B, Nguyen T, et al. Self-perceived HIV risk and the use of risk reduction strategies among men who engage in transactional sex with other men in Ho Chi Minh City, Vietnam. AIDS Care 2013 Aug;25(8):1039-1044 [FREE Full text] [CrossRef] [Medline]
    7. Satpathy M. Emerging healthcare issues and needs of young MSM and TG in India: needs assessment from multi-stakeholders perspective. BMC Infectious Diseases 2012;12(Suppl 1):1. [CrossRef]
    8. Beratarrechea A, Lee AG, Willner J, Jahangir E, Ciapponi A, Rubinstein A. The impact of mobile health interventions on chronic disease outcomes in developing countries: a systematic review. Telemed e-Health 2014;20(1):75-82.
    9. Burton J, Brook G, McSorley J, Murphy S. The utility of short message service (SMS) texts to remind patients at higher risk of STIs and HIV to reattend for testing: a controlled before and after study. Sex Transm Infect 2014 Feb;90(1):11-13. [CrossRef] [Medline]
    10. Chib A, Wilkin H, Ling LX, Hoefman B, Van Biejma H. You have an important message! Evaluating the effectiveness of a text message HIV/AIDS campaign in Northwest Uganda. J Health Commun 2012;17 Suppl 1:146-157. [CrossRef] [Medline]
    11. Curioso WH, Quistberg DA, Cabello R, Gozzer E, Garcia PJ, Holmes KK, et al. It's time for your life: how should we remind patients to take medicines using short text messages? AMIA Annu Symp Proc 2009;2009:129-133 [FREE Full text] [Medline]
    12. da Costa TM, Barbosa BJP, Gomes ECDA, Sigulem D, de Fatima Marin H, Filho AC, et al. Results of a randomized controlled trial to assess the effects of a mobile SMS-based intervention on treatment adherence in HIV/AIDS-infected Brazilian women and impressions and satisfaction with respect to incoming messages. Int J Med Inform 2012 Apr;81(4):257-269 [FREE Full text] [CrossRef] [Medline]
    13. Dowshen N, Kuhns LM, Gray C, Lee S, Garofalo R. Feasibility of interactive text message response (ITR) as a novel, real-time measure of adherence to antiretroviral therapy for HIV+ youth. AIDS Behav 2013 Jul;17(6):2237-2243. [CrossRef] [Medline]
    14. Furberg RD, Uhrig JD, Bann CM, Lewis MA, Harris JL, Williams P, et al. Technical implementation of a multi-component, text message-based intervention for persons living with HIV. JMIR Res Protoc 2012 Nov 16;1(2):e17 [FREE Full text] [CrossRef] [Medline]
    15. Telecom Regulatory Authority of India. Indian Telecom services performance indicators: April-June 2009   URL: http://www.trai.gov.in/Default.asp [WebCite Cache]
    16. Rodrigues R, Shet A, Antony J, Sidney K, Arumugam K, Krishnamurthy S, et al. Supporting adherence to antiretroviral therapy with mobile phone reminders: results from a cohort in South India. PLoS One 2012 Aug;7(8):e40723 [FREE Full text] [CrossRef] [Medline]
    17. Shet A, Costa AD, Kumarasamy N, Rodrigues R, Rewari BB, Ashorn P, et al. Effect of mobile telephone reminders on treatment outcome in HIV: evidence from a randomised controlled trial in India. BMJ 2014 Oct 24;347(aug06 2):g5978-g5978. [CrossRef]
    18. Zenith. Smartphone penetration to reach 66% in 2018   URL: https://www.zenithmedia.com/smartphone-penetration-reach-66-2018/ [WebCite Cache]
    19. International Telecommunication Union. ITU ICT facts and figures 2016   URL: https://www.itu.int/en/ITU-D/Statistics/Documents/facts/ICTFactsFigures2016.pdf [WebCite Cache]
    20. Cordova D, Bauermeister JA, Fessler K, Delva J, Nelson A, Nurenberg R, et al. A community-engaged approach to developing an mHealth HIV/STI and drug abuse preventive intervention for primary care: a qualitative study. JMIR Mhealth Uhealth 2015 Dec;3(4):e106 [FREE Full text] [CrossRef] [Medline]
    21. Jennings L, Gagliardi L. Influence of mHealth interventions on gender relations in developing countries: a systematic literature review. Int J Equity Health 2013 Oct 16;12:85-104 [FREE Full text] [CrossRef] [Medline]
    22. Horvath KJ, Alemu D, Danh T, Baker JV, Carrico AW. Creating effective mobile phone apps to optimize antiretroviral therapy adherence: perspectives from stimulant-using HIV positive men who have sex with men. JMIR Mhealth Uhealth 2016 Apr 15;4(2):e48 [FREE Full text] [CrossRef] [Medline]
    23. Kirk GD, Himelhoch SS, Westergaard RP, Beckwith CG. Using mobile health technology to improve HIV care for persons living with HIV and substance abuse. AIDS Res Treat 2013;2013:194613 [FREE Full text] [CrossRef] [Medline]
    24. Grandin M. Improving therapeutic success through personalised mobile health tools. Int J Integrated Care 2014;14:90-91.
    25. Hightow-Weidman LB, Fowler B, Kibe J, McCoy R, Pike E, Calabria M, et al. HealthMpowerment.org: development of a theory-based HIV/STI website for young black MSM. AIDS Educ Prev 2011 Feb;23(1):1-12 [FREE Full text] [CrossRef] [Medline]
    26. Muessig KE, Nekkanti M, Bauermeister J, Bull S, Hightow-Weidman LB. A systematic review of recent smartphone, Internet and Web 2.0 interventions to address the HIV continuum of care. Curr HIV/AIDS Rep 2015 Jan 28;12(1):173-190. [CrossRef] [Medline]
    27. Sullivan PS, Jones J, Kishore N, Stephenson R. The roles of technology in primary HIV prevention for men who have sex with men. Curr HIV/AIDS Rep 2015 Dec;12(4):481-488. [CrossRef] [Medline]
    28. Wilkerson JM, Patankar P, Rawat SM, Simon RBR, Shukla KM, Rhoton J, et al. Recruitment strategies of Indian men who have sex with men in the state of Maharashtra into an online survey. Int J Sex Health 2016;28(3):221-227 [FREE Full text] [CrossRef] [Medline]
    29. Krueger R, Casey M. Focus Groups: A Practical Guide for Applied Research. 4th edition. Thousand Oaks: Sage Publications, Inc; 2009.
    30. Weber R. Basic Content Analysis. 2nd edition. Newburry Park: Sage Publications; 1990.
    31. Pew Research Center. Smartphone ownership and Internet usage continues to climb in emerging economies   URL: http:/​/assets.​pewresearch.org/​wp-content/​uploads/​sites/​2/​2016/​02/​pew_research_center_global_technology_report_final_february_22__2016.​pdf [WebCite Cache]
    32. Simoni JM, Kutner BA, Horvath KJ. Opportunities and challenges of digital technology for HIV treatment and prevention. Curr HIV/AIDS Rep 2015 Sep 28;12(4):437-440. [CrossRef] [Medline]
    33. Albarracín D, Gillette JC, Earl AN, Glasman LR, Durantini MR, Ho M. A test of major assumptions about behavior change: a comprehensive look at the effects of passive and active HIV-prevention interventions since the beginning of the epidemic. Psychol Bull 2005 Nov;131(6):856-897 [FREE Full text] [CrossRef] [Medline]


    Abbreviations

    IQR: interquartile range
    JIT: just-in-time
    MSM: men who have sex with men
    PLHA: persons living with HIV/AIDS
    SMS: short message service
    STI: sexually transmitted infection


    Edited by G Eysenbach; submitted 29.09.17; peer-reviewed by J Simoni, I Fakoya, M Downing, S Aggarwal; comments to author 03.12.17; revised version received 17.02.18; accepted 17.03.18; published 03.05.18

    ©Shruta Rawat, J Michael Wilkerson, Sylvia M Lawler, Pallav Patankar, BR Simon Rosser, Kanjani Shukla, Seyram Butame, Maria L Ekstrand. Originally published in JMIR Public Health and Surveillance (http://publichealth.jmir.org), 03.05.2018.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Public Health and Surveillance, is properly cited. The complete bibliographic information, a link to the original publication on http://publichealth.jmir.org, as well as this copyright and license information must be included.