Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 09.01.20 in Vol 6, No 1 (2020): Jan-Mar

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/15078, first published Jun 17, 2019.

This paper is in the following e-collection/theme issue:

    Original Paper

    Correlates of Successful Enrollment of Same-Sex Male Couples Into a Web-Based HIV Prevention Research Study: Cross-Sectional Study

    1The Center for Sexuality and Health Disparities, School of Nursing, University of Michigan, Ann Arbor, MI, United States

    2Department of Systems, Population and Leadership, School of Nursing, University of Michigan, Ann Arbor, MI, United States

    3Office of Public Health Studies, Myron B Thompson School of Social Work, University of Hawai’i at Manoa, Honolulu, HI, United States

    Corresponding Author:

    Rob Stephenson, PhD

    The Center for Sexuality and Health Disparities

    School of Nursing

    University of Michigan

    400 North Ingalls

    Ann Arbor, MI, 48109

    United States

    Phone: 1 7346150149

    Email: rbsteph@umich.edu


    ABSTRACT

    Background: The recognition of the role of primary partners in HIV transmission has led to a growth in dyadic-focused HIV prevention efforts. The increasing focus on male couples in HIV research has been paralleled by an increase in the development of interventions aimed at reducing HIV risk behaviors among male couples. The ability to accurately assess the efficacy of these interventions rests on the ability to successfully enroll couples into HIV prevention research.

    Objective: This study aimed to explore factors associated with successful dyadic engagement in Web-based HIV prevention research using recruitment and enrollment data from a large sample of same-sex male couples recruited online from the United States.

    Methods: Data came from a large convenience sample of same-sex male couples in the United States, who were recruited through social media venues for a Web-based, mixed method HIV prevention research study. The analysis examined the demographic factors associated with successful dyadic engagement in research, measured as both members of the dyad meeting eligibility criteria, consenting for the study, and completing all study processes.

    Results: Advertisements generated 221,258 impressions, resulting in 4589 clicks. Of the 4589 clicks, 3826 individuals were assessed for eligibility, of which 1076 individuals (538/1913, 28.12% couples) met eligibility criteria and were included in the study. Of the remaining 2740 ineligible participants, 1293/3826 (33.80%) were unlinked because their partner did not screen for eligibility, 48/2740 (1.75%) had incomplete partner data because at least one partner did not finish the survey, 22/2740 (0.80%) were ineligible because of 1 partner not meeting the eligibility criteria. Furthermore, 492/3826 (12.86%) individuals were fraudulent. The likelihood of being in a matched couple varied significantly by race and ethnicity, region, and relationship type. Men from the Midwest were less likely to have a partner who did not complete the survey. Men with college education and those who labeled their relationships as husband or other (vs boyfriend) were more likely to have a partner who did not complete the survey.

    Conclusions: The processes used allowed couples to independently progress through the stages necessary to enroll in the research study, while limiting opportunities for coercion, and resulted in a large sample with relative diversity in demographic characteristics. The results underscore the need for additional considerations when recruiting and enrolling, relative to improving the methods associated with these research processes.

    JMIR Public Health Surveill 2020;6(1):e15078

    doi:10.2196/15078

    KEYWORDS



    Introduction

    Background

    There is now substantial evidence for the role of male dyads in the US HIV epidemic, with primary partners identified as the source of approximately one-third [1] to two-thirds [2] of new HIV infections. Given these estimates, a significant paradigm shift in HIV prevention is needed. Programmatic efforts have traditionally focused on men who have sex with men (MSM), in particular, gay-identifying men as individuals rather than dyads, with a focus on casual sex as a risk for HIV acquisition. As a result of this individualistic approach, HIV prevention efforts have largely ignored the risk of HIV transmission that occurs within primary partnerships. Within the context of same-sex male couples’ relationships, various research findings have illustrated high rates of sexual risk behavior for HIV (with primary and casual partners), low rates of disclosure of potentially risky episodes with casual partners to primary partners, and reduced frequency of HIV testing [3-9]. Historically, HIV prevention efforts have focused on reducing the number of casual sex partners [10], indirectly messaging a false sense of protection associated with primary partners [11,12].

    There have been recent attempts to address this disproportionate focus on individualistic approaches to HIV prevention by focusing on the dyads and their relationship. Couples HIV testing and counseling (CHTC), originally developed for heterosexual couples in sub-Saharan Africa [13], has been adapted for same-sex male couples [14], as a Centers for Disease Control and Prevention Public Health Strategy [15]. There are several examples of dyadic interventions that aim to address HIV risk among same-sex male couples. Connect with Pride was an intervention for methamphetamine-using, black/African American male dyads that involved 7 in-person sessions to address issues, such as communication, joint problem solving, and condom negotiation [16]. 2GETHER was an intervention for young male couples aged 18 to 29 years, which involved 4 interactive weekly sessions focusing on enhancing communication skills, coping with relationship stress, applying problem-solving techniques to relationship issues, and formulating an agreement to reduce their risk for HIV [17]. Posttest decreases in sexual risk behaviors, increases in skills related to HIV prevention, and improvements in relationship investment were observed. We Prevent is a novel intervention for 15- to 19-year-old male dyads, which is currently being piloted in the United States [18], involving telehealth-delivered sessions to increase relationship communication skills around HIV prevention. The Male Couples Agreement Project is an electronic health tool kit intervention for male couples with a foundation in relationship science, including sexual agreements, sexual health education, and HIV prevention [19,20], and Stronger Together focuses on improving engagement in HIV care and antiretroviral treatment adherence among serodiscordant male couples by combining in-person CHTC with dyadic adherence counseling [21]. Although these interventions have the potential to improve relational dynamics and safeguard male couples against HIV and other sexually transmitted infections, the ability to successfully test the efficacy of these interventions rests on the ability to successfully enroll male couples into HIV prevention research. Representation of diverse samples of same-sex male couples—in terms of age, race, ethnicity, and relationship length—in dyadic HIV prevention interventions is critical for measuring the success of these projects and moving forward toward improving them.

    Few studies have addressed the challenges encountered in recruiting same-sex male couples into research. To enroll a couple into research requires both members of the couple to successfully navigate parallel processes: both must screen for eligibility, provide consent, and complete some other data collection activity (eg, study survey) to enroll into a research project. These processes must be conducted separately to address and prevent coercion among partners to participate in research projects, especially when there are financial incentives for participation. Successful participation often requires the couple to share information (ie, partner A must inform partner B that they have completed their consent form) or to coordinate (ie, they must jointly schedule a study visit). At a minimum, both members of the couple must agree to participate in the research study, knowing that their partner will also be participating. These processes may result in studies obtaining a potentially selective group of couples with more functional communication styles or couples with reduced levels of conflict. In their study of 260 partnered gay/bisexual men recruited in New York City, Starks et al [22] found those who did not refer their partners were older, wealthier, and in longer relationships, whereas participants who successfully recruited their partners were significantly more satisfied in their relationship. This selectivity is important to consider in light of evidence illustrating associations between poor relationship characteristics and HIV prevention outcomes [3,5,23-27].

    Objective

    Missing from the literature is an understanding of the factors associated with successful enrollment of same-sex male couples in Web-based HIV prevention research studies. Although limited research has identified relationship factors associated with referring partners into Web-based HIV research, other factors associated with successful dyadic engagement in other parts of the research process (ie, eligibility and consent) have yet to be investigated. In general, Web-based studies may be associated with higher degrees of selectivity bias, with recent evidence suggesting that white MSM are more likely to join a Web-based study than black and Hispanic MSM [28]. The identification of such selectivity biases is equally important for Web-based research with couples. If Web-based HIV prevention research is to be successful in identifying unique risk factors or prevention opportunities for same-sex male couples, then research must be able to successfully enroll diverse samples of couples. This study used recruitment and enrollment data from a large sample of same-sex male couples, recruited online from the United States, to explore factors associated with successful dyadic enrollment in Web-based HIV prevention research. This new information has the potential to shape recruitment and research designs for enrollment of dyadic HIV research.


    Methods

    Recruitment and Inclusion Criteria

    Project Couples Health and Attitudes toward Preexposure Prophylaxis (CHAPS) is a mixed method Web-based study examining attitudes toward pre-exposure prophylaxis (PrEP) use and patterns of PrEP use among concordant seronegative and serodiscordant same-sex male couples in the United States. Participants were recruited through targeted Web-based advertisements and postings on commonly used social media websites and dating websites and mobile apps. Social media websites used for recruitment were Facebook and Instagram. Dating websites and mobile apps used for recruitment were Scruff and Grindr. Advertisements included images of a diverse (in age, race, and ethnicity) range of same-sex male couples, with text that promoted a study on the health of same-sex male couples (ie, Are you and your man on the same page about HIV prevention? We want to know, take our survey!). The advertisements did not mention PrEP to avoid recruiting a sample biased toward those with particular interests in or attitudes about PrEP. The advertisements included a link that led interested individuals to a landing page with detailed information about the study and a Web-based eligibility screener.

    First, individual-level eligibility was established for both partners of the couple, and this had to have been met by both for enrollment. Individual eligibility self-reporting as (1) a cisgender male (assigned male at birth and currently identifies as male), (2) being in a relationship with another cisgender male for 3 or more months, (3) having an HIV seronegative or unknown status or known HIV seropositive status, and (4) having had condomless anal sex with their primary relationship partner within the last 3 months. Once eligible, an individual would then proceed to the consent webpage outlining the content and process of the study. Once consent was provided, the individual (partner A) would then be directed to the partner referral system, which entailed providing contact information (email and telephone number) and a name or nickname for his partner (partner B). Partner B would then receive an email informing him that his partner (partner A) had signed up for the study and had provided his contact information, along with a link to a landing page to access the same screener and consent process.

    The link provided to partner B was connected to partner A’s metadata, such that they both were assigned the same random study ID number as a hidden data field (as a couple). Once partner B had completed the same eligibility screener and consent process, partner B was then asked to provide contact information for his partner (partner A), to enable crossmatching of partner contact details.

    Couple serostatus was also considered. Given the focus on PrEP, only concordant seronegative and serodiscordant couples were eligible. Once both A and B had completed the screener, their responses to the question on serostatus were compared. Couples who reported concordant seropositive status were deemed ineligible for the study.

    Following successful completion of the eligibility and consent process by both partners A and B, as well as identification of concordant seronegative or serodiscordant HIV status, individual emails were sent to each partner of the couple, asking them to independently and individually complete a Web-based survey via a link. The survey Web link contained the same random study ID number they were assigned during eligibility screener to help link partners A and B’s completed survey responses. Each partner was compensated US $50 for his time to complete the survey; compensation was not dependent on both partners completing the survey. The study protocol was approved by the University of Michigan Institutional Review Board (HUM00125711).

    Matching and Verification of Participants

    Upon completion of their individual surveys, couples’ responses were compared with verify that they were real couples. First, individual surveys were linked as couples via the identifier included in the survey link. Couple status was verified using the relationship and contact information provided by each individual. A verified couple had to match on at least 4 of the following 6 criteria (identified through questions asked in the eligibility screener): (1) partner’s age (± 1 year), (2) partner’s birthday month, (3) relationship length, (4) anal sex without a condom within the last 3 months, (5) initials of partner’s first and last name, and (6) last 4 digits of partner’s cell phone number. Matching of couple data was manually reviewed and checked for matching: each couple was assigned a score from 1 to 6, which represented the number of criteria on which they matched in their surveys.

    Detecting Fraudulent Activity

    All participant data were also manually reviewed and checked for mismatch, duplication, and fraud. Inconsistent information, such as name, internet protocol address, zip code, email, or phone number, was flagged for further inquiry. Participants were contacted directly by study staff for confirmation of their identity and relationship status. Individuals were classified as fraudulent if their identity could not be verified.

    Match Status Categories

    On the basis of the results of verification and matching, participants were categorized into 4 groups: eligible couple, incomplete, ineligible, and unlinked. Eligible couples comprised couples in which both relationship partners were eligible, consented, passed verification, and completed the study survey. Incompletes included couples in which 1 or both partners did not finish the study survey. Ineligibles were couples in which 1 partner met individual-level eligibility criteria and consented, whereas the other partner either did not meet this eligibility criteria or did not consent. Unlinked was defined as cases in which only 1 partner completed the enrollment process (eligible, consented, and completed the study survey), whereas the other did not enter the screening and enrollment process.

    Study Survey

    The survey was distributed via Qualtrics (Qualtrics International Inc) through an anonymous link embedded with a unique identifier that linked couples, and it took partners, on average, 35 min to complete. The survey contained a variety of measures geared toward understanding the dyadic patterns relative to PrEP. The aim of this study was to examine the factors associated with achieving a successfully matched and verified couple recruited online. The analysis models a 4-category outcome variable, representing the 4 possibilities encountered from enrollment: eligible couples (the reference category), ineligible, incomplete, and unlinked. Data analysis comprised individual-level data in which every line of data is an individual, to facilitate the inclusion of participants for whom no partner data were received (eg, unlinked). A multinomial model is fit for the 4-category matching status outcome. Key covariates included the sociodemographic characteristics of individuals: education, employment, housing status, race and ethnicity, age, relationship length, and relationship type. Relationship type was categorized to compare more informal relationship types (boyfriend or other) with more formal relationship types (husband or partner). The analysis was conducted in STATA v.15 [29].


    Results

    CHAPS advertisements generated 221,258 impressions (number of times it was shown on a social medial page), resulting in 4589 clicks (number of times the advertisement was clicked on: these may not be unique to individuals). Of the 4589 clicks, 3826 individuals were assessed for eligibility, of which 1076 individuals (538/1913, 28.12% couples) were matched eligible and included in the study. Of the remaining 2740 participants, 1293/3826 (33.80%) were unlinked because of their partner not enrolling into the screening, 48/2740 (1.75%) had incomplete partner data because at least 1 partner did not finish the survey, 22/2740 (0.80%) were ineligible because of 1 partner not meeting the eligibility criteria. Furthermore, 492/3826 (12.86%) individuals were fraudulent, and 885/3826 (23.13%) started the screening but did provide any responses; therefore, they were deemed invalid. Fraudulent and invalid participants were removed from the sample, resulting in a sample of 2449 individuals, which includes 538 eligible and verified couples. Those who had missing data (n=911) from key covariates, including region, education, housing, and relationship length, were dropped from dataset, resulting in a final analysis sample of 1538 individuals.

    Characteristics of the analysis sample (N=1538) are described in Table 1.

    The sample was largely white (1140/1538, 74.12%) and between the ages of 25 and 34 years (875/1538, 56.89%). A majority of participants were from the South (495/1538, 32.18%) and the Midwest (457/1538, 29.71%) regions. A majority of individuals were college graduates (521/1538, 33.86%) or had graduate degrees (392/1538, 25.48%), worked full time (1215/1538, 79.00%), and lived in their own housing (1237/1538, 80.42%). Finally, 35.89% (552/1538) of the sample identified as boyfriends and 34.39% (529/1538) identified as husbands, with the largest portion of relationship lengths being between 1 and 3 years (494/1538, 32.12%) and more than 5 years (524/1538, 34.07%).

    White-Hispanic participants were significantly more likely to have a partner who was ineligible for the study (relative risk ratio [RRR]=4.94; 95% CI 1.15-21.26) or to be in the incomplete partner status (RRR=2.55; 95% CI 1.02-6.42) compared with being in the eligible couple category. Those who reported being from the Midwest (RRR=0.25; 95% CI 0.08-0.72) were less likely to be in the incomplete category than have an eligible partner. Men with a college education or above (RRR=2.82; 95% CI 1.02-7.80) and having a husband/partner for a relationship type (RRR=2.35; 95% CI 1.06-5.25) were more likely to be in the incomplete category than have an eligible partner. There were no significant associations with the remaining covariates across the match status outcomes.

    Results of the multinomial model are shown in Table 2.

    Table 1. Descriptive statistics for participants and demographic variables (N=1538).
    View this table
    Table 2. Multinomial logistic regression results for couple match status (N=1538).
    View this table

    Discussion

    Principal Findings

    The results illustrate several important facets of the recruitment of same-sex male couples into Web-based HIV prevention research. First, advertising through social media to recruit couples generated 3826 individuals who completed the eligibility screener. Of these, only 538 couples (1076 individuals) were successfully engaged in research (eligible, consented, completed a survey, and were matched with their partner). Therefore, 72% of responses failed to generate successfully matched couples. This has significant resource implications given that the majority of social media recruitment involves paid advertising. Project CHAPS intentionally used images of same-sex male couples, which included representation of diverse ages, races, and ethnicities. These advertisements were based on those used previously to successfully enroll online samples of over 400 same-sex male couples in the United States [30]. However, further work is warranted to explore same-sex male couples’ perceptions and desired content for online recruitment advertising, to help facilitate the creation of advertisements with optimal appeal to help with enrollment into Web-based research studies.

    Of importance, almost 34.00% (523/1538) of participants had partners who did not initiate the screening and enrollment process, whereas failure of having a partner not complete the survey only accounted for 2% (35/1538) of unmatched couples and a partner being ineligible accounted for less than 1% (12/1538) of the unmatched couples. Therefore, once both partners made it through the eligibility screener, there was a very high likelihood that they would become a successfully matched couple who would both complete the study survey. This suggests a need to strengthen partner referral methods early on in the study engagement process. Providing individuals with detailed information on the study that they can share with their partner, which clearly outlines the steps that their partner needs to take, is a fundamental step in increasing dyadic recruitment. Of course, this process must be careful not to cross over into coercion: systems need to be maintained, which allow both partners to independently screen and consent for studies.

    The ability to identify and match couples was enhanced by the use of a series of fraud detection techniques, based on the standards recommended by Bauermeister et al [31]. An additional fraud technique was implemented, which is specific to the enrollment of dyads. Once surveys were completed, responses to 6 key questions regarding relationship and partner characteristics were compared: those who matched on fewer than 4 responses were deemed not to be a real couple. This form of couple verification has been recommended as a mechanism for reducing the degree of fraud in dyadic Web-based research [32]. However, further work is required to inform the content of couple verification surveys. Questions must represent a range of partner and relationship characteristics that partners may be expected to know, but these must also be sensitive enough to identify fraudulent couples.

    Few factors were significantly associated with the successful engagement of male dyads, contrary to the work of Starks et al [22], which showed significant differences in partner referral into a research study be age, wealth, and relationship length. The likelihood of being an eligible couple versus having an ineligible partner, incomplete partner, or an unlinked partner did not vary by relationship length, suggesting our recruitment and enrollment methods were successful at engaging couples at range of relationship stages. Men who reported themselves as being in a more formal union (ie, husbands) were more likely to have a partner who did not complete the screening and enrollment process. This seems counter intuitive as it may be expected that those in more formal unions may have developed stronger, or at least more familiar, communication styles that may lend themselves to successful enrollment in HIV research. However, it is possible that engagement in research about relationships and/or HIV prevention may not be one of those shared interests and values among partners. Although further research is required to understand this result, ideally qualitative work that examines perceptions of enrolling in HIV prevention research from a range of couple types, it is possible that more formal and established couples do not see themselves as at risk for HIV and therefore do not see the research as being suitable for them. Previous research has identified that coupled MSM perceive lower levels of HIV risk [5], and this may shape how couples view their eligibility or desire to enroll in an HIV prevention study.

    White-Hispanic men were more likely to have an ineligible partner or a partner who did not complete the screening process. This result may reflect the myriad of interpersonal and structural barriers that men of color experience in enrolling in research. The sample for this study is overwhelmingly non-Hispanic white, limiting the ability to understand whether the ability to enroll in a survey for male couples varies for racial and ethnic minority couples. It seems plausible that couples with African American men may also be more likely to face difficulties in enrolling as couples in HIV prevention research, but the very small number of African American men in this study precludes such analysis. The advertisements used for CHAPS included a diverse range of races and ethnicities; however, this still resulted in a predominantly non-Hispanic white sample. Further qualitative work—with diverse racial and ethnic samples of same-sex male couples—would be needed to fully understand the perceptions of Web-based dyadic HIV prevention research, as well as their needs and desires that would lead them to participate in future studies.

    It is important to note that Project CHAPS was a cross-sectional survey and did not require the participants to take part in an intervention or to take follow-up surveys over a period of time. Although this study has identified factors associated with successful enrollment into a 1-time survey, it is likely that factors shaping the ability of couples to actively participate in intervention research may differ. This may be particularly true for interventions that require members of the dyad to take the intervention together (ie, couples’ counseling–focused interventions). There may also be differential follow-up over time among couples, with only 1 member of the couple completing follow-up surveys, leading to limitations to dyadic data analysis. Although this paper identifies processes for enrolling couples into surveys, further work is required to understand whether the process required for successful participation of couples in intervention-focused research differs.

    Conclusions

    This study is not without limitations. Using cross-sectional data from a convenience sample precludes us from making causal inferences or generalizing our results to other same-sex male couples in the United States, who may or may not use social media platforms or geospatial mobile apps. The collection of personal identifying information may have prompted social desirability to inaccurately report data on their partners or relationship characteristics. Although participants were instructed to complete the survey separately from their partners, it is possible that couples answered questions together, potentially influencing each other’s responses and overestimating the degree to which couples truly matched their knowledge of each other and their relationship. The sample was overwhelmingly non-Hispanic white, limiting the ability to make inferences about specific strategies for enrolling racial and ethnic minority couples into HIV prevention research. Given the higher incidence of HIV among MSM of color, work is clearly needed to understand the barriers that racial-ethnic minority male couples may experience in enrolling and participating in HIV prevention research.

    Despite these limitations, the results presented here provide important new information on the processes required to successfully enroll same-sex male couples into Web-based HIV prevention research. The steps used in CHAPS allowed couples to independently progress through the stages necessary to enroll in the research study while limiting opportunities for coercion and resulted in a large, diverse sample (>500 couples). The results underscore the need for additional considerations when recruiting and enrolling, relative to improving the methods associated with these research processes. Further research is needed and is beneficial to fully understand the perceptions of same-sex male couples toward Web-based research. This information is vital for the continued refinement of dyadic recruitment and engagement methods.

    Acknowledgments

    This work was supported by the National Institute of Mental Health under Grant R21 MH111445 (Co-PIs RS and JM).

    Conflicts of Interest

    None declared.

    References

    1. Goodreau SM, Carnegie NB, Vittinghoff E, Lama JR, Sanchez J, Grinsztejn B, et al. What drives the US and Peruvian HIV epidemics in men who have sex with men (MSM)? PLoS One 2012;7(11):e50522 [FREE Full text] [CrossRef] [Medline]
    2. Sullivan PS, Salazar L, Buchbinder S, Sanchez TH. Estimating the proportion of HIV transmissions from main sex partners among men who have sex with men in five US cities. AIDS 2009 Jun 1;23(9):1153-1162. [CrossRef] [Medline]
    3. Gomez AM, Beougher SC, Chakravarty D, Neilands TB, Mandic CG, Darbes LA, et al. Relationship dynamics as predictors of broken agreements about outside sexual partners: implications for HIV prevention among gay couples. AIDS Behav 2012 Aug;16(6):1584-1588. [CrossRef] [Medline]
    4. Hoff CC, Beougher SC, Chakravarty D, Darbes LA, Neilands TB. Relationship characteristics and motivations behind agreements among gay male couples: differences by agreement type and couple serostatus. AIDS Care 2010 Jul;22(7):827-835 [FREE Full text] [CrossRef] [Medline]
    5. Stephenson R, White D, Darbes L, Hoff C, Sullivan P. HIV testing behaviors and perceptions of risk of HIV infection among MSM with main partners. AIDS Behav 2015 Mar;19(3):553-560 [FREE Full text] [CrossRef] [Medline]
    6. Stall R, Mills TC, Williamson J, Hart T, Greenwood G, Paul J, et al. Association of co-occurring psychosocial health problems and increased vulnerability to HIV/AIDS among urban men who have sex with men. Am J Public Health 2003 Jun;93(6):939-942. [CrossRef] [Medline]
    7. Chakravarty D, Hoff CC, Neilands TB, Darbes LA. Rates of testing for HIV in the presence of serodiscordant UAI among HIV-negative gay men in committed relationships. AIDS Behav 2012 Oct;16(7):1944-1948 [FREE Full text] [CrossRef] [Medline]
    8. Mitchell JW, Petroll AE. Patterns of HIV and sexually transmitted infection testing among men who have sex with men couples in the United States. Sex Transm Dis 2012 Nov;39(11):871-876 [FREE Full text] [CrossRef] [Medline]
    9. Phillips G, Hightow-Weidman LB, Arya M, Fields SD, Halpern-Felsher B, Outlaw AY, et al. HIV testing behaviors of a cohort of HIV-positive racial/ethnic minority YMSM. AIDS Behav 2012 Oct;16(7):1917-1925. [CrossRef] [Medline]
    10. Kelly JA, St Lawrence JS, Diaz YE, Stevenson LY, Hauth AC, Brasfield TL, et al. HIV risk behavior reduction following intervention with key opinion leaders of population: an experimental analysis. Am J Public Health 1991 Feb;81(2):168-171. [CrossRef] [Medline]
    11. Pruitt KL, White D, Mitchell JW, Stephenson R. Sexual agreements and intimate-partner violence among male couples. International Journal of Sexual Health 2015;27(4):429-441. [CrossRef]
    12. Goldenberg T, Clarke D, Stephenson R. 'Working together to reach a goal': MSM's perceptions of dyadic HIV care for same-sex male couples. J Acquir Immune Defic Syndr 2013 Nov 1;64(Suppl 1):S52-S61 [FREE Full text] [CrossRef] [Medline]
    13. Chomba E, Allen S, Kanweka W, Tichacek A, Cox G, Shutes E, Rwanda Zambia HIV Research Group. Evolution of couples' voluntary counseling and testing for HIV in Lusaka, Zambia. J Acquir Immune Defic Syndr 2008 Jan 1;47(1):108-115. [CrossRef] [Medline]
    14. Sullivan PS, Stephenson R, Grazter B, Wingood G, Diclemente R, Allen S, et al. Adaptation of the African couples HIV testing and counseling model for men who have sex with men in the United States: an application of the ADAPT-ITT framework. Springerplus 2014;3:249 [FREE Full text] [CrossRef] [Medline]
    15. Stephenson R, Grabbe KL, Sidibe T, McWilliams A, Sullivan PS. Technical Assistance Needs for Successful Implementation of Couples HIV Testing and Counseling (CHTC) Intervention for Male Couples at US HIV Testing Sites. AIDS Behav 2016 Apr;20(4):841-847. [CrossRef] [Medline]
    16. Wu E, El-Bassel N, McVinney LD, Hess L, Remien RH, Charania M, et al. Feasibility and promise of a couple-based HIV/STI preventive intervention for methamphetamine-using, black men who have sex with men. AIDS Behav 2011 Nov;15(8):1745-1754 [FREE Full text] [CrossRef] [Medline]
    17. Newcomb ME, Macapagal KR, Feinstein BA, Bettin E, Swann G, Whitton SW. Integrating HIV Prevention and Relationship Education for Young Same-Sex Male Couples: A Pilot Trial of the 2GETHER Intervention. AIDS Behav 2017 Aug;21(8):2464-2478 [FREE Full text] [CrossRef] [Medline]
    18. Gamarel KE, Darbes LA, Hightow-Weidman L, Sullivan P, Stephenson R. The development and testing of a relationship skills intervention to improve HIV prevention uptake among young gay, bisexual, and other men who have sex with men and their primary partners (we prevent): Protocol for a randomized controlled trial. JMIR Res Protoc 2019 Jan 2;8(1):e10370 [FREE Full text] [CrossRef] [Medline]
    19. Mitchell J, Lee J, Traynor S, Feaster D, Sullivan P, Stephenson R. Findings from a web-based, randomized controlled trial of an eHealth prevention toolkit to encourage at-risk, HIV-negative male couples to establish and adhere to a sexual agreement. 2017 Nov 13 Presented at: 13th International AIDS Impact Conference; 2017; Cape Town, South Africa.
    20. Mitchell JW, Lee J, Godoy F, Asmar L, Perez G. HIV-discordant and concordant HIV-positive male couples' recommendations for how an eHealth HIV prevention toolkit for concordant HIV-negative male couples could be improved to meet their specific needs. AIDS Care 2018 Jun;30(sup2):54-60 [FREE Full text] [CrossRef] [Medline]
    21. Stephenson R, Suarez NA, Garofalo R, Hidalgo MA, Hoehnle S, Thai J, et al. Project Stronger Together: Protocol to Test a Dyadic Intervention to Improve Engagement in HIV Care Among Sero-Discordant Male Couples in Three US Cities. JMIR Res Protoc 2017 Aug 31;6(8):e170 [FREE Full text] [CrossRef] [Medline]
    22. Starks TJ, Millar BM, Parsons JT. Correlates of Individual Versus Joint Participation in Online Survey Research with Same-Sex Male Couples. AIDS Behav 2015 Jun;19(6):963-969 [FREE Full text] [CrossRef] [Medline]
    23. Marsack J, Kahle E, Suarez NA, Mimiaga MJ, Garofalo R, Brown E, et al. Relationship Characteristics and Dyadic Approaches to HIV Health-Enhancing Behaviours Among a Sample of Same-Sex Male Couples From Three US Cities. J Relatsh Res 2018 May 23;9:e10. [CrossRef]
    24. Mimiaga MJ, Suarez N, Garofalo R, Frank J, Ogunbajo A, Brown E, et al. Relationship Dynamics in the Context of Binge Drinking and Polydrug Use Among Same-Sex Male Couples in Atlanta, Boston, and Chicago. Arch Sex Behav 2019 May;48(4):1171-1184. [CrossRef] [Medline]
    25. Parsons JT, Starks TJ. Drug use and sexual arrangements among gay couples: frequency, interdependence, and associations with sexual risk. Arch Sex Behav 2014 Jan;43(1):89-98. [CrossRef] [Medline]
    26. Mitchell JW, Harvey SM, Champeau D, Seal DW. Relationship factors associated with HIV risk among a sample of gay male couples. AIDS Behav 2012 Feb;16(2):404-411 [FREE Full text] [CrossRef] [Medline]
    27. Mitchell JW, Stephenson R. HIV-Negative Partnered Men's Willingness to Use Pre-Exposure Prophylaxis and Associated Factors Among an Internet Sample of US HIV-Negative and HIV-Discordant Male Couples. LGBT Health 2015 Mar;2(1):35-40 [FREE Full text] [CrossRef] [Medline]
    28. Sullivan PS, Khosropour CM, Luisi N, Amsden M, Coggia T, Wingood GM, et al. Bias in online recruitment and retention of racial and ethnic minority men who have sex with men. J Med Internet Res 2011 May 13;13(2):e38 [FREE Full text] [CrossRef] [Medline]
    29. StataCorp. Stata Statistical Software: Release 15. College Station, TX: StataCorp LLC 2017.
    30. Stephenson R, Freeland R, Sullivan SP, Riley E, Johnson BA, Mitchell J, et al. Home-Based HIV Testing and Counseling for Male Couples (Project Nexus): A Protocol for a Randomized Controlled Trial. JMIR Res Protoc 2017 May 30;6(5):e101 [FREE Full text] [CrossRef] [Medline]
    31. Bauermeister JA, Pingel E, Zimmerman M, Couper M, Carballo-Diéguez A, Strecher VJ. Data Quality in web-based HIV/AIDS research: Handling Invalid and Suspicious Data. Field methods 2012 Aug 1;24(3):272-291 [FREE Full text] [CrossRef] [Medline]
    32. Mitchell J, Lee J, Stephenson R. Metadata Correction of: How Best to Obtain Valid, Verifiable Data Online From Male Couples? Lessons Learned From an eHealth HIV Prevention Intervention for HIV-Negative Male Couples. JMIR Public Health Surveill 2016 Sep 26;2(2):e155 [FREE Full text] [CrossRef] [Medline]


    Abbreviations

    CHAPS: Couples Health and Attitudes toward Preexposure Prophylaxis
    CHTC: Couples HIV testing and counseling
    MSM: men who have sex with men
    PrEP: pre-exposure prophylaxis
    RRR: relative risk ratio


    Edited by H Bradley; submitted 17.06.19; peer-reviewed by E Op de Coul, M Newcomb, S Lang; comments to author 08.10.19; revised version received 28.10.19; accepted 11.11.19; published 09.01.20

    ©Rob Stephenson, Tanaka MD Chavanduka, Stephen Sullivan, Jason W Mitchell. Originally published in JMIR Public Health and Surveillance (http://publichealth.jmir.org), 09.01.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Public Health and Surveillance, is properly cited. The complete bibliographic information, a link to the original publication on http://publichealth.jmir.org, as well as this copyright and license information must be included.