Background: Companies use brand websites as a promotional tool to engage consumers on the web, which can increase product use. Given that some products are harmful to the health of consumers, it is important for marketing associated with these products to be subject to public health surveillance. However, terms of service (TOS) governing the use of brand website content may impede such important research.
Objective: The aim of this study is to explore the TOS for brand websites with public health significance to assess possible legal and ethical challenges for conducting research on consumer product websites.
Methods: Using Statista, we purposefully constructed a sample of 15 leading American tobacco, alcohol, psychiatric pharmaceutical, fast-food, and gun brands that have associated websites. We developed and implemented a structured coding system for the TOS on these websites and coded for the presence versus absence of different types of restriction that might impact the ability to conduct research.
Results: All TOS stated that by accessing the website, users agreed to abide by the TOS (15/15, 100%). A total of 11 out of 15 (73%) websites had age restrictions in their TOS. All alcohol brand websites (5/15, 33%) required users to enter their age or date of birth before viewing website content. Both websites for tobacco brands (2/15, 13%) further required that users register and verify their age and identity to access any website content and agree that they use tobacco products. Only one website (1/15, 7%) allowed users to display, download, copy, distribute, and translate the website content as long as it was for personal and not commercial use. A total of 33% (5/15) of TOS unconditionally prohibited or put substantial restrictions on all of these activities and/or failed to specify if they were allowed or prohibited. Moreover, 87% (13/15) of TOS indicated that website access could be restricted at any time. A total of 73% (11/15) of websites specified that violating TOS could result in deleting user content from the website, revoking access by having the user’s Internet Protocol address blocked, terminating log-in credentials, or enforcing legal action resulting in civil or criminal penalties.
Conclusions: TOS create complications for public health surveillance related to e-marketing on brand websites. Recent court opinions have reduced the risk of federal criminal charges for violating TOS on public websites, but this risk remains unclear for private websites. The public health community needs to establish standards to guide and protect researchers from the possibility of legal repercussions related to such efforts.
A growing proportion of morbidity and mortality globally can be attributed to the commercialization of products that are harmful to health. Products such as tobacco, alcohol, fast food, and firearms account for an increasing proportion of preventable deaths, a trend referred to as the industrial epidemic . For example, globally, there were 2.8 million deaths associated with alcohol consumption and over 8.1 million deaths associated with tobacco consumption in 2017 [ ]. Dietary risk factors (including diets high in sodium, low in vegetables, low in fruit, low in whole grains, low in nuts and seeds, and low in seafood omega-3) caused 10.9 million deaths in 2017 [ ]. In the United States alone, in 2015, firearms were responsible for over 36,000 deaths [ ] and caused 612,000 deaths between 1999 and 2017 [ ].
The industries that manufacture these products continue to rely heavily on marketing to attract and retain consumers to maintain and grow their profit margins; these actions contribute to the overall burden of disease caused by their products . Although estimates of the marketing expenditures of the firearms industry are not currently available, tobacco, alcohol, and fast-food companies spend billions, often tens of billions of dollars, on advertising each year [ - ]. There is substantial evidence to suggest that exposure to tobacco, alcohol, food, and firearm marketing increases the desire to use, intentions to use, and/or actual use of advertised products [ , - ]. Children and adolescents are particularly susceptible to advertising and promotional efforts, given their developmental stage, and are more likely to adopt attitudes and preferences congruent with advertisements after exposure [ ]. In instances where products can have detrimental effects on health, advertising becomes a major public health concern.
The research literature on marketing practices for potentially harmful products at the point of sale, on television, and in print media is longstanding and robust [, , , , , , - ]. The placement of advertising and promotional efforts is, however, increasingly dominated by the web-based domain [ ], which provides the possibility of reaching more than 4.5 billion people in the world with internet access [ ]. Companies are transferring traditional marketing principles to the internet as e-marketing by using websites, social media, and web-based marketplaces to increase connections with potential customers.
Advertising on brand websites has already started to attract the attention of researchers. Research on alcohol brand websites, for example, has documented strategies that utilize youth culture, including computer games, competitions, downloadable content, sponsored parties, fashion shows, and sporting events . Tobacco internet marketing has also been highlighted as a surveillance priority [ ]. Descriptive research has found that tobacco brand websites offer sweepstakes; event promotions; video advertising; and contests involving music creation, lyric writing, creative design, and other arts to engage users on the web [ - ]. Food and beverage websites have been found to contain gamified content that is designed specifically for children and often includes games that highlight branded content (adver-games), branded downloadable content, viral content, and unlimited commercials [ - ]. However, no research has assessed the marketing content of gun websites, although recent research characterizing firearm advertising on Twitter and YouTube has been published [ ]. Both firearm manufacturers and social media influencers on these platforms promoted guns for recreational and military use, and used patriotic and law enforcement themes. Importantly, this research also revealed that social media posts, particularly YouTube posts, often connect viewers to firearm manufacturer websites [ ]. Previous research has established that brand websites are filled with promotions and advertising strategies meant to interactively engage users in a way that is not possible with print media or even television commercials.
The use of e-marketing is also potentially problematic because it is more difficult for regulatory authorities to monitor and regulate web-based space, resulting in less oversight [, ]. The enforcement guidelines of the Food and Drug Administration (FDA) for the 2010 Tobacco Control Act states that it will conduct surveillance of internet promotions to ensure compliance with advertising and promotion restrictions, although it is unclear how this is carried out in light of terms of service (TOS) and authorization restrictions [ ]. It is possible that companies are taking advantage of the less regulated web-based world to employ more aggressive advertising strategies that are already restricted in other media. For instance, researchers have found that some content on UK alcohol brand websites may violate UK broadcasting codes because of the likelihood that it would appeal to underage consumers [ ]. There is a need for regulatory authorities to ensure that there is no gap in oversight of web-based commercial spaces. Surveillance has been referred to as the foundation of public health [ ], and monitoring and curtailing advertising of potentially harmful and intrinsically harmful products is an important aspect of public health practice.
E-marketing, although clearly a source of concern for public health, poses challenges for researchers. Websites are the property of corporations that draft TOS that can legally shape how site users are allowed to engage with content. The Law Dictionary defines terms and conditions (abbreviated TOS) as “Special and general arrangement, rule, requirements, standards, etc. Forming integral parts of a contract or agreement” . Website TOS typically take on 2 forms: click-wrap agreements and browse-wrap agreements. Click-wrap agreements require that the user clicks a box or otherwise actively indicates that he or she assents to the TOS before he or she is able to access website content [ ]. Browse-wrap agreements, on the other hand, do not require the user to actively agree to the TOS. Instead, the TOS are located somewhere on the web page, which is usually accessible by a link at the bottom of the page. Courts have ruled inconsistently regarding whether TOS legally constitute notice, which is required for a contract to be binding, although click-wrap agreements have been upheld more routinely than browse-wrap agreements [ - ]. The legally ambiguous nature of TOS makes it unclear if the prohibitions often outlined in these terms are legally binding, and research has shown that they are rarely read or understood [ - ].
Frischmann and Selinger  maintained that the length and complexity of TOS are intentional design features. They described TOS contracts as “techno-social tools for engineering human beings to behave automatically, like simple machines.” TOS contracts are take-it-or-leave-it contracts, where users can either accept terms or not access the website. This means that website users gain nothing by reading many pages of legal jargon, as they have no power to change the terms of the contract, and are able to reduce the cognitive cost of the encounter by ignoring TOS [ ]. Frischmann and Selinger [ ] state that website designers function as choice architects by shaping the choices that users are presented with and that TOS are subject to this design influence as much as website content is. As the choice regarding TOS is to accept the TOS or not use the website, unthinking, constant acceptance becomes the norm as people become programmed to agree [ ]. Legal scholar Margaret Jane Radin additionally raises concerns regarding boilerplatecreep, where private entities, such as corporations, gradually replace law from public spaces such as governments and social institutions with their own law that is designed to benefit the private entity rather than the public good [ ]. These concerns that TOS are intentionally designed to deflect website user attention and at the same time benefit private entities underlies the importance of better understanding the content of TOS contracts and how they may influence research.
When TOS are actually read, it becomes clear that many activities necessary to conduct research are often restricted. Preliminary exploration found TOS on brand websites that prohibit users, for example, from downloading (eg, saving copies of content for future reference) and sharing material, tasks necessary to conduct research. The terms of entry into web-based spaces designed by corporations are more explicit and seem to hold the potential for greater enforcement in the web-based domain as compared with conditions for entry into retail spaces in the physical environment. The uncertain legal nature of TOS may also impact the comfort level of the researchers who study web-based spaces, and some researchers have expressed fear that this uncertainty might have chilling effects on research .
Goal of This Study
Little attention has been paid to establishing appropriate norms for entering web-based spaces for the purpose of understanding the space in and of itself. Although a recent publication  discusses the content of TOS on social media websites, focusing on both automated and manual data scraping of user content, conducting research on consumer product websites is somewhat different. Content analyses would not necessitate scraping and do not document user content the way social media research does. TOS on consumer product websites require the same kind of consideration that TOS on social media websites have received. The Association of Computing Machinery, a professional organization for computing scientists, has already started to discuss if it is ethical to violate TOS during the process of data collection of publicly available information [ , ]. The association has even appealed to the court in an amicus curiae briefing, arguing that researchers should be legally allowed to conduct research on public web-based spaces [ ]. This issue also needs to be considered by public health researchers.
Currently, researchers are leaving themselves potentially vulnerable to legal issues by conducting research that might violate the TOS of websites. Given the public health importance of monitoring product marketing in web-based spaces, in this study, we describe the types of activities that are and are not allowed by TOS across multiple product types and what types of restrictions are being put on website access. We also consider how this might differ by product type and discuss implications of restrictions included in TOS for research and the ethical and legal ramifications of not adhering to TOS, given recent litigation.
Setting and Sample
We searched Statista, the “statistics portal for market data, market research, and market studies”  for the top branded consumer products in 5 domains relevant to public health: tobacco (cigarettes), alcohol (beer and distilled spirits), firearms, prescription psychiatric drugs, and fast food. In addition to the industrial epidemic products described earlier, we included prescription drug websites because of the heavy use of direct-to-consumer marketing [ ], a practice only allowed in the United States and New Zealand [ ], and the association between exposure to this marketing and subsequent desire to use such drugs [ - ]. We choose to focus on psychiatric drugs due to the high prevalence of use among American adults [ ]. To identify the top brands in these domains, we searched Statista for the top brands in the United States by market share for each product. When data on market shares by brand were not available, we searched for top brands by revenue from sales. We selected the highest ranked brands that listed the law governing their TOS as a state within the United States and that had an official website. Official websites were defined as websites created by the actual company rather than a fan group or a specific retailer. We restricted our study to US companies that listed a location within the United States as governing their TOS because we wanted to control for some variance in TOS by the country that the company operated in, as regional laws and requirements may differ by country.
For cigarette brands, the 3 US market leaders, Marlboro, Newport, and Camel, were all American companies with official websites created by the company. Marlboro and Newport were selected for the sample. Camel was excluded because both Camel and Newport were owned by R. J. Reynolds Tobacco Company and had the same TOS. Data on US market leaders for beer brands showed that Bud Light and Coors Light occupied the largest portion of the beer market and were retained for the sample. Statista did not have data on distilled spirits as a general category; however, it had existing data on the top whiskey brands by market share, with Jack Daniels, Crown Royal, Fireball, and Jim Beam being the market leaders. The British company Diageo owns Crown Royal and was excluded, whereas Fireball, Jack Daniels, and Jim Beam were retained as US-owned brands. Although Statista did not have data on the top market leaders in the firearms industry, it did provide data on the estimated global revenue for firearms made for the US market, which was used as a proxy for establishing the leading companies. The top 3 firearm manufacturers—Remington, Smith and Wesson, and Sturm Ruger—are all US companies with official websites and were retained for this sample. Similarly, the top companies producing psychiatric drugs were also determined using Statista data on revenue from top-selling psychiatric drugs in the United States. The top brand, Lyrica, was retained for the sample. The second brand, Vyvanse, stated in its TOS that it is governed by British, rather than American law, and the website was excluded from the sample for this reason. Invega Sustenna was retained as this brand had an official website, and the jurisdiction listed in its TOS was within the United States. Revenue from sales was also used to determine the top fast-food brands. McDonalds, Starbucks, and Subway were retained for this sample as the jurisdiction listed in their TOS was within the United States, and all the brands had official websites (). In total, 15 websites were included in the sample.
|Product type and metric used/Top brands listed||Webcite reference for the brands selected||Date of last TOSa update (as of July 2018)||Date of last TOS update (as of July 2020)|
|Cigarettes, market share of the leading US cigarette brands in 2016 (%)|
|Marlboro, 41||||May 2014||May 2014|
|Newport, 13||||August 17, 2017||August 17, 2017|
|Beer, domestic beer market share of the leading brands in the United States in 2017 (%)|
|Bud Light, 18||||No date provided||January 1, 2020|
|Coors Light, 10||||May 22, 2018||January 1, 2020|
|Whiskey, US market share of the leading whiskey brands in2017 through 2018, based on dollar sales (%)|
|Jack Daniels, 13||||March 15, 2018||March 15, 2018|
|Crown Royal, 12||—||—||—|
|Fireball, 8||||June 21, 2017||June 21, 2017|
|Jim Beam, 8||||October 29, 2008||January 31, 2020|
|Firearms, estimated global revenue made annually for the US civilian market (million US $)|
|Remington Outdoor, 939||||April 1, 2017||No date provided|
|Smith and Wesson, 552||||April 1, 2017||June 1, 2020|
|Sturm Ruger, 551||||September 1, 2010||September 1, 2010|
|Psychiatric drugs, selected top psychiatric drugs’ US revenue in 2016 (million US $)|
|Lyrica, 4.4||||No date provided||No date provided|
|Invega Sustenna, 1.3||||November 4, 2016||November 4, 2016|
|Fast food, leading quick service restaurants in the United States in 2016, based on retail sales (billion US $)|
|McDonalds, 36.4||||March 13, 2017||March 13, 2017|
|Starbucks, 15.8||||October 27, 2017||October 2019|
|Subway, 14.0||||June 14, 2018||January 1, 2020|
aTOS: terms of service.
bNot included in the sample.
Official websites for each brand were located by searching the brand name with the word website in Google. Each website was opened, and restrictions on website access, such as pop-up windows and registration pages, were documented. The TOS were located, typically by scrolling to the bottom of the website homepage and looking for a link called terms of service or some other equivalent. TOS from each website were copied and pasted into Microsoft Word. All TOS were saved to Webcite (with the exception of the Marlboro website TOS, which blocked Webcite from saving its content) and were also downloaded and saved as PDFs.
All TOS were downloaded and coded in Microsoft Word (Word version 16.34) employing line-by-line open coding. After reading the TOS and conducting an initial round of coding for major themes, codes were discussed with the study team at multiple meetings, and codes were added and refined per group discussion (). Codes were developed based on how specific aspects of TOS could impact research. The primary coder (CW) has considerable experience with both qualitative and quantitative coding. After the primary coder completed coding, 2 additional coders (KS and MM) independently reviewed and confirmed all codes. Discrepancies were discussed and resolved during email exchanges between the coders and the broader research team. The proportion of websites employing each code was calculated in Microsoft Excel (Excel version 16.37), and differences and themes by product type were qualitatively assessed because of the small sample size.
Codes that emerged from the qualitative process and corresponding examples.
- ≥21 years, legal age of product consumption, ≥18 years of age or ≥age of majority, ≥13 years with parental consent, ≥13 years, or no age restrictions
Other access restrictions
- Users must be a user of our product to access this website, and/or users must agree to receive promotional materials
Accepting TOS (terms of service)
- By accessing this website, users agree to abide by the TOS (use of all capital letters were sometimes used to emphasize this point)
TOS can change at any time
- Users acknowledge that TOS can change at any time, users will be notified of changes to TOS, or users are expected to check TOS for any changes during each website visit
Restrictions on sharing account information
- It is the user’s responsibility to keep log-in credentials confidential
User information accuracy
- All information provided by the user must be accurate
Prohibited and allowable user actions with website material
- A series of codes indicating when or if copying, displaying, distributing, downloading, transmitting, translating, and republishing is prohibited or allowed
Applicable local laws
- Users agree to abide by applicable local laws while using this website
Choice of law
- TOS are interpreted and governed by the laws in, for example, North Carolina
Restrict user access
- The company can restrict user access to this website for any reason at any time
- Commercial, personal, private, noncommercial, etc
Actions taken if user violates TOS
- Having the user’s internet protocol address blocked, taking legal action against the user, and/or deleting user content from the website
Access and Restrictions
All tobacco (2/2, 100%) and alcohol (5/5, 100%) websites presented with a pop-up window or a registration page when users first enter the website. Both tobacco websites had registration windows, whereas all 5 alcohol websites had pop-up windows. Pop-ups on alcohol websites only required the user to input a date of birth or confirm that they were aged ≥21 years, with no verification process. Two alcohol websites also asked for geographical location. All but 3 websites (12/15, 80%)—2 firearm websites and 1 pharmaceutical website—explicitly stated an age requirement for user access (). Both tobacco websites additionally required that registrants be tobacco users, with 1 tobacco website also requiring that users sign up for a mailing list and be willing to receive promotional material. No other websites had additional restrictions apart from age.
|Product type||Age ≥21 years||Legal age of product consumption||Age ≥18 years||Age ≥13 years with parental consent if under 18 years or the legal age of majority||Age ≥13 years||No age restrictions|
|Tobacco (n=2), TOSa number, n (%)||2 (100)||0 (0)||0 (0)||0 (0)||0 (0)||0 (0)|
|Alcohol (n=5), TOS number, n (%)||2 (40)||3 (60)||0 (0)||0 (0)||0 (0)||0 (0)|
|Pharmaceuticals (n=2), TOS number, n (%)||0 (0)||0 (0)||1 (50)||0 (0)||0 (0)||1 (50)|
|Fast food (n=3), TOS number, n (%)||0 (0)||0 (0)||0 (0)||3 (100)||0 (0)||0 (0)|
|Firearms (n=3), TOS number, n (%)||0 (0)||0 (0)||0 (0)||0 (0)||1 (33)||2 (67)|
aTOS: terms of service.
The TOS for 10 websites (10/15, 67%; 2 tobacco, 4 alcohol, 1 pharmaceutical, 2 fast food, and 1 firearm) held users responsible for keeping their log-in credentials (should they create an account) private, and the TOS for 6 websites (6/15, 40%) specified that information used to create an account must be accurate (2 tobacco, 2 alcohol, and 2 food). The Newport TOS, for instance, states, “You must sign-up online to create an account to access and use the Site. You agree not to use any false, inaccurate, or misleading information when signing up for your accounts.” Newport is also the only website in the sample that specifies that they independently verify that registrants are aged ≥21 years.
All website TOS (15/15,100%) had language stating that accessing the website required users to accept the TOS, and all but one pharmaceutical company (14/15, 93%) said that the TOS could change at any time and that users may or may not be notified of this fact ().
|Product type||By accessing the website, users agree to the TOSa||TOS can change at any time||The user is responsible for checking the TOS for changes and is bound by the changes||Website will post announcements when the TOS change and users are bound by the changes||Used all capitalization to emphasize that by accessing the website, the user agrees to the TOS|
|Tobacco (n=2), TOS number, n (%)||2 (100)||2 (100)||1 (50)||1 (50)||0 (0)|
|Alcohol (n=5), TOS number, n (%)||5 (100)||5 (100)||4 (80)||1 (20)||3 (60)|
|Pharmaceuticals (n=2), TOS number, n (%)||2 (100)||1 (50)||1 (50)||0 (0)||0 (0)|
|Fast food (n=3), TOS number, n (%)||3 (100)||3 (100)||2 (67)||1 (33)||1 (33)|
|Firearms (n=3), TOS number, n (%)||3 (100)||3 (100)||3 (100)||0 (0)||2 (67)|
aTOS: terms of service.
Local Laws, Jurisdiction, and Restricting Access
Language requiring users to comply with applicable local laws in addition to the terms stated in the TOS was common (2 tobacco, 4 alcohol, 1 pharmaceutical, 2 fast food, and 3 firearms; 12/15, 80%). All TOS (15/15, 100%) also specified a state within the United States whose laws would govern and interpret the TOS and serve as a location for any future litigation. Virginia, North Carolina, Missouri, Illinois, Kentucky, New York, New Jersey, Washington, Connecticut, and Massachusetts (10 states) were listed for the 15-website sample used in this study.
With only 2 exceptions (1 pharmaceutical and 1 alcohol; 13/15, 87%), all websites stated that they could revoke a user’s access at any time, without providing a justification. A total of 73% (11/15) TOS listed specific consequences for breaking or violating the TOS, including having the user’s internet protocol address blocked so they could no longer access the website; pursuing legal action against the user, resulting in civil or criminal penalties; terminating log-in credentials; and deleting user content from the website (2 tobacco, 3 alcohol, 2 pharmaceutical, 2 fast food, and 2 firearms).
Allowable and Prohibited Actions With Website Content
Each TOS further specified what users were and were not allowed to do with the content of the website. Most of the TOS prohibited using website content for commercial purposes, and all but 3 TOS specified that website material could only be used for personal or individual or noncommercial purposes (1 tobacco, 4 alcohol, 2 pharmaceutical, 2 fast food, and 3 firearms; 12/15, 80%).
Website TOS described specific restrictions on how website content could be used (). A total of 33% (5/15) TOS unconditionally or near unconditionally prohibited or put substantial restrictions on all of these activities (2 tobacco) and/or failed to specify if they were allowed or prohibited (2 alcohol and 1 food). Substantial restrictions, for instance, were found on the Marlboro website, which stated that there might be instances where users are given explicit permission to use website content outside of the site, but that this use could only be for personal noncommercial purposes and only applied when users were given explicit permission on the web page. A total of 73% (11/15) websites prohibited distributing website content or required prior permission to distribute materials. Moreover, 53% (8/15) websites allowed users to engage in at least one activity that exceeded simply viewing of website material (eg, download, copy, or distribute) for personal or individual noncommercial purposes and often explicitly stated that downloaded content must retain all copyrights and trademarks and may only be allowed in limited circumstances (4 alcohol, 1 pharmaceutical, 2 fast food, and 1 firearm). The same set of websites also prohibited users from sharing website content with others. One pharmaceutical company also fell into this category but additionally allowed distribution for noncommercial purposes. Many website TOS did not specify if displaying (4/15, 27%), downloading (5/15, 33%), copying (3/15, 20%), and translating (8/15, 53%) website content was allowed. Only 1 website in the sample (Invega Sustenna) allowed users to display, download, copy, distribute, and translate website content as long as it was for personal and not commercial use.
|Brand name||Display website content||Download website content||Copy website content||Distribute website content||Translate website content|
|Marlboro||Prohibited||In circumstances where specific sections of the website say you can use website materials offline, it must be for personal noncommercial purposes||Prohibited||Prohibited||Prohibited|
|Newport||Prohibited||Prohibited (all actions other than viewing are prohibited unless otherwise specified)||Prohibited||Prohibited (all actions other than viewing are prohibited unless otherwise specified)||Prohibited (all actions other than viewing are prohibited unless otherwise specified)|
|Bud Light||Prohibited without prior permission||Not specified||Prohibited without prior permission||Prohibited without prior permission||Not specified|
|Coors Light||Not specified||Not specified||Not specified||Prohibited without prior permission||Not specified|
|Jim Beam||Prohibited without prior permission||Allowed for noncommercial, lawful, and personal use with copyright retained||Prohibited without prior permission||Prohibited without prior permission||Prohibited without prior permission|
|Jack Daniels||Not specified||Allowable for one copy for personal, noncommercial use with copyright retained||Prohibited for commercial use||Prohibited for commercial use||Prohibited|
|Fireball||Prohibited without prior permission||Allowable for personal, noncommercial use with copyright retained and no modifications||Not specified||Prohibited without prior permission||Not specified|
|Lyrica||Prohibited without prior permission||Allowable for noncommercial individual references with copyright retained||Allowable for noncommercial individual references with copyright retained||Prohibited without prior permission||Not specified|
|Invega Sustenna||Prohibited for commercial use without prior permission||Allowable for personal, noncommercial purposes with copyrights retained||Prohibited for commercial use without prior permission||Allowable for personal, noncommercial purposes with copyrights retained||Prohibited for commercial use without prior permission|
|McDonalds||Allowable for personal, noncommercial purposes||Not specified||Prohibited for commercial use||Prohibited for commercial use||Prohibited|
|Starbucks||Not specified||Not specified||Not specified||Prohibited||Not specified|
|Subway||Prohibited for commercial use||Not specified||Prohibited without prior permission||Prohibited without prior permission||Prohibited without prior permission|
|Remington Outdoor||Allowable occasionally with an insubstantial portion of the content for noncommercial purposes with copyrights retained and including “Used with permission from Remington”||Prohibited||Prohibited||Allowable occasionally with an insubstantial portion of the content for noncommercial purposes with copyrights retained and including “Used with permission from Remington”||Not specified|
|Sturm Ruger||Prohibited without prior permission||Allowable for personal and authorized commercial use||Allowable for personal and authorized commercial use||Prohibited without prior permission||Not specified|
|Smith and Wesson||Not specified||Allowable for personal, noncommercial, and informational use||Prohibited without prior permission||Prohibited||Not specified|
Our exploration of TOS has revealed several important conclusions and raised some significant insights that we will discuss in the context of recent litigation: (1) research on web-based spaces is complicated by the existence of TOS in that they restrict activities necessary for research; (2) commercial entities are creating spaces on the web and some use TOS to try to restrict access to those spaces; and (3) research on private web-based spaces is ethically justifiable, regardless of whether the activities necessary to conduct this research are allowed under TOS agreements, but this research is legally questionable, so how should researchers proceed? Companies already have the financial power to aggressively market their products both on and off the web; in addition, they also have the power to define what is and is not allowed regarding the use of their website material via TOS [, ]. This power apparently allows companies to restrict access to websites and restrict specific activities one can do with the website material. Some of the restricted activities are necessary to conduct research, and the existence of TOS calls into question the legality of conducting such research. Researchers, then, may be left feeling unsure of how to conduct necessary monitoring of web-based commercial spaces without risking legal action [ ].
TOS are complicated and cloud the legality of research on consumer product websites. It is important for regulatory agencies to have data on websites to make informed marketing regulations. The FDA, for instance, calls on members of the public, including researchers, to report marketing violations in Section 3.1.4 of the Tobacco Control Act Enforcement Manual ; however, performing basic tasks to document content and marketing strategies on the web is made difficult or impossible if researchers are bound by TOS such as those outlined. It is notable that these TOS potentially restrict many of the activities needed to conduct a basic content analysis ( ), a research method that provides details on the content and marketing strategies employed on websites. For instance, researchers need to save and share website content for content coding, analysis, and potentially for later reporting. All activities that are necessary to conduct a content analysis (which we defined as displaying, downloading, copying, distributing, and translating) were only explicitly allowed by one website TOS. Such restrictions were also noted during an evaluation of TOS on social media websites [ ]. Website content changes frequently, and not saving content, which typically requires downloading, would likely result in lost data, which would be untenable for effective surveillance or academic analytic processes. Translation is also sometimes necessary for international work assessing websites used in other countries, necessitating both translation and sharing content with others, activities often prohibited by TOS.
Most of the explored TOS also state that the company can restrict access at any time, sometimes for any reason. If a company chooses to do this in the midst of data collection, it could impose a significant barrier. None of the TOS in this sample provided any information regarding an appeals process to contest restricted access. It is possible that some companies might intentionally restrict access if they think a user is accessing the website for research purposes that might reflect badly on the company, using their TOS-stated right to restrict access at any time and/or for any reason as a rationale.
Researchers could try to create a protocol that would follow the TOS for all the commercial websites they were interested in studying. However, attempting this could be difficult, as TOS can vary considerably across websites and include legal jargon [, ]. Researchers could limit their sample based on websites that allow the required research activities; however, this would likely result in an unrepresentative sample and could exclude websites where TOS tends to prohibit more activities, such as tobacco websites. It is possible that companies employing more problematic marketing tactics might have more restrictive TOS, and those are the companies that are most important to monitor.
In addition, one of the most consistent finding across product type is terms stating that website content can only be used for personal, noncommercial use. It is unclear if research fits in this category. It seems fairly clear that it is not personal, as the purpose of research is to disseminate findings to the scientific community and the public. At the same time, it is also clear that public health research is not a commercial pursuit: profit is not the goal of the endeavor. None of the TOS in our small sample and only one in the larger sample of social media sample examined by Fiesler et al  explicitly address the use of websites for research purposes; therefore, it remains unclear if research activities are prohibited by corporations or not. Fiesler et al [ ] conclude that TOS on consumer websites, such as TOS on social media websites, are “ambiguous and largely devoid of context,” making them difficult to understand and abide by. Arguments using the First Amendment’s protection of free speech have been raised recently in the Supreme Court, and although the court did not consider those arguments, it is possible that they could be called upon if needed [ ].
We must then attempt to untangle what companies claim is binding in their TOS, compared with what the US courts have upheld as legally binding during litigation to better understand if researchers are truly bound by the limitations imposed by TOS. The Computer Fraud and Abuse Act (CFAA) is a federal law that prohibits accessing a computer without authorization or in a manner that exceeds authorization, which can be interpreted as a federal prohibition on TOS violations . The recent memorandum opinion published by the US District Court for the District of Columbia in the case of Sandvig v. Barr [ ] stated that merely violating TOS on public websites does not constitute a breach of the CFAA for exceeding authorized access to a computer and, therefore, cannot trigger federal criminal charges. In this case, researchers and journalists asked the court for clarity in a pre-enforcement challenge if the work they wanted to conduct (analyzing if algorithms on hiring websites discriminate based on race, gender, age, or other attributes by creating fictitious user profiles) would violate the CFAA and trigger criminal charges. The court stated that in cases where any user can access a website, even if users are required to create a username and password for access (ie, the website is public), violating the TOS is not a CFAA violation. Although this is certainly good news for researchers who want to conduct research on public websites, the court clarified that TOS violations may still trigger federal and state civil charges. Such violations would amount to the web-based equivalent of trespassing; however, as long as researchers are not inflicting damage by slowing down website operations, preventing other user access, or tampering with content, it is unclear what damages companies could request compensation for.
Variability in the jurisdictions selected for governing the TOS and litigation may impact what state civil charges companies could bring for researcher trespass. Companies largely control the state where litigation will occur, and different states may have different laws governing what constitutes trespass and the consequences for trespassing. This introduces more uncertainty in terms of what research activities could result in civil charges.
Although the memorandum in Sandvig v. Barr offers researchers conducting research on public websites reassurances, the issue of research on private websites remains of questionable legality. In light of recent litigation, it is also possible that companies will restrict access to their websites and create private spaces where research activities continue to be more limited. Tobacco companies already restrict access to their websites and even require authentication of provided information. A researcher may not be able to gain access to view the selected tobacco website content without providing false information to register (eg, falsely identify themselves as a smoker). Doing so would serve as a breach of TOS because of the requirement that registrants be tobacco users and provide only true information. Violating TOS by conducting research activities that require downloading, sharing, and so on, on a private website may also still constitute a violation of the CFAA, which can trigger federal criminal charges. Tobacco websites were the only websites that are considered private in this sample, and these websites prohibited or severely restricted all the activities necessary to conduct a content analysis.
If researchers are convinced of the public health need to surveil private websites but are not able to do so while adhering to TOS, there are potentially incompatible legal and ethical issues to weigh. The ethical issues raised by such surveillance research are limited to the extent that surveillance activities do not seek to analyze interaction between users but rather seek to document the content of the website as it is designed by companies. In other words, it is a commercial entity rather than an individual who is being surveilled. From an ethical perspective, it is arguable that corporate actions do not warrant the same protection as human subjects, with the result that corporations may not be able to claim the right to autonomy from research participation. There is precedence for treatment of commercial organizations differently from individuals in research; company names are often used in academic publication, and there is no existing standard stating that companies should not have identifiable information disclosed.
The legal issues underlying research on websites vary in magnitude depending on whether the website is public, where anyone can create log-in credentials or access website content without a log-in, or private, where websites require authentication of provided information and apply constraints regarding who is allowed to create log-in credentials. The legal issue of research on public websites appears to be more limited. The biggest threat, violation of the CFAA, has been largely removed, and civil charges at the state or federal level seem unlikely when no damage is done to the websites of interest. Research on public websites should be encouraged and expanded to provide the public health community with a better understanding of e-marketing tactics and opportunities to inform marketing regulations that would better protect public health. This is especially important in the present moment when research requiring face-to-face interaction is limited by the ongoing pandemic. The legal issue of research on private websites presents a greater challenge. Even if a court was to eventually rule that violating TOS on private websites for public health research is not a violation of the CFAA, being sued and facing the litigation that follows is time consuming and has the potential to hurt the credibility and reputation of the researcher. Such damage might reduce the likelihood of promotion or achieving tenure if it is costly for the institution to defend the researcher. This is particularly problematic for private tobacco websites, as the tobacco industry has a long history of targeted and aggressive marketing of a product that is intrinsically harmful to users. Although account requirements may ostensibly be to responsibly keep out youth and nonsmokers, it also limits the access of the researchers and makes their access potentially illegal. Further, there is nothing stopping other companies that sell harmful products from putting up similar restrictions.
This study has also revealed the involvement of research institutions and universities as key stakeholders in decisions regarding research involving TOS violations. The expectations for researchers need to be clearly defined and understood in the various relevant offices of the university such that important research can be undertaken in such a way that the institution is comfortable with and can (and will) stand behind the researchers in the case of industry action. Currently, these issues are beyond the scope of what institutional review boards perceive as their purview, leaving researchers with few resources for guidance on questions of both ethics and legal issues .
We would conclude that violating TOS to conduct public health research on product websites is not ethically questionable; rather, given the public health significance of e-marketing, we may be ethically bound to conduct such research, regardless of whether it occurs on public or private websites. This conclusion has similarly been reached by the Association for Computing Machinery's Committee on Professional Ethics in their Code of Ethics and Professional Conduct, which states that TOS and other internet regulations should be followed unless there is a “compelling ethical justification to do otherwise” . The code goes on to state that those who violate TOS for ethical or any other reasons “must accept responsibility for that action and for its consequences” [ ]. How, then, should researchers proceed with research on private product websites in a way that minimizes or eliminates legal risks? An important question is whether researchers are in any way precluded from TOS restrictions. Beyond this general question, researchers could contact companies and request permission to study their website. Although this option might grant researchers access, it would also put the company on notice that research is being conducted, and there is no great incentive for companies to agree to surveillance. It is critical that the public health community establish standards for such researchers to enable the continuation of this important work in ways that the researchers and institutions involved are protected.
This study explored a small and purposefully selected sample of commercial product website TOS. It is possible that we missed variability in TOS that might be present on other types of websites. We also limited our sample to US companies, and TOS for companies within the United States might be different from the website TOS for companies in other countries, and caution should be used when attempting to generalize these results. The TOS observed during this study were downloaded and analyzed in July 2018. As of July 2020, 7 websites have updated their TOS. A brief review of updated TOS shows that very little has changed in terms of allowable activities with website material. The only exception to this was Jim Beam. Jim Beam added a clause that “You may print or download one copy of a reasonable number of pages of this Website for your own personal, noncommercial use and not for further reproduction, publication, or distribution” and some language allowing app download. We also employed confirmatory coding, rather than blind double-coding, which may have biased the second coder. Given that we were unable to access the content for tobacco websites, we were unable to conduct a content analysis to determine if our hypothesis that websites with more problematic content would be those with stricter TOS was correct.
In addition, none of the coders were lawyers, although lawyers were consulted to ensure that terms were coded appropriately and their significance was understood. As noted by others who have studied TOS and other similar contracts, terms can approach incomprehensibility, even for legal experts [, , ]. We discussed our findings and the legal implications of violating TOS for research with a lawyer and 2 law students at the Cyberlaw Clinic at the Harvard Law School, who validated that the legal landscape is continuously changing and it is currently unclear if creating false accounts on private websites (in the context of gaining access to a tobacco website) would be considered a violation of the CFAA. The US government has never charged a researcher for violating TOS in the course of their research, and the recent Sandvig decision certainly reduces the risk of this for research on public websites; however, the risk of violating the CFAA while researching private websites such as tobacco websites remains unclear.
E-marketing on brand websites is an important area for public health surveillance to monitor; however, TOS complicate this endeavor by restricting access and prohibiting activities needed to conduct research. Recent court opinions have reduced the risk of federal criminal charges for violating TOS on public websites, but this risk remains unclear for private websites. Researchers already engaged in research on private websites are putting themselves in danger of being sued, and their affiliated institutions may or may not support them in court. It is critical that the public health community establishes standards for conducting research on e-marketing that supports this important public health issue.
This work was supported by funding from Bloomberg Philanthropies’ Bloomberg Initiative to Reduce Tobacco Use and the Practical Ethics Grant from the Johns Hopkins Berman Center for Bioethics. CW was supported by T32 CA009314 during publication development. Christopher Bavitz, Juris Doctor; William Walker; and Leo Ding from the Cyberlaw Clinic at the Harvard School of Law assisted with legal research and reviewed this manuscript to ensure that the legal context the authors provided was accurate.
Conflicts of Interest
MD holds equity in Sickweather Inc and has received consulting fees from Bloomberg LP and Good Analytics Inc. These organizations did not have any role in the study design, data collection and analysis, decision to publish, or preparation of the article. MBM serves as a paid expert witness in litigation sponsored by the Public Health Advocacy Institute against RJ Reynolds. This arrangement has been reviewed and approved by the Johns Hopkins University in accordance with its conflict of interest policies.
- Majnoni DB. Épidémies industrielles. Commentaire. 1995. URL: https://www.commentaire.fr/boutique/achat-d-articles/epidemies-industrielles-4517 [accessed 2018-09-25]
- GBD 2017 Risk Factor Collaborators. Global, regional, and national comparative risk assessment of 84 behavioural, environmental and occupational, and metabolic risks or clusters of risks for 195 countries and territories, 1990-2017: a systematic analysis for the Global Burden of Disease Study 2017. Lancet 2018 Nov 10;392(10159):1923-1994 [FREE Full text] [CrossRef] [Medline]
- FastStats - Injuries Internet. Centers for Disease Control and Prevention National Center for Health Statistics. 2017. URL: https://www.cdc.gov/nchs/fastats/injury.htm [accessed 2018-09-25]
- WONDER Underlying Cause of Death, 1999-2018. Centers for Disease Control and Prevention. 2018. URL: http://wonder.cdc.gov/ucd-icd10.html [accessed 2020-04-06]
- Jahiel RI. Corporation-induced diseases, upstream epidemiologic surveillance, and urban health. J Urban Health 2008 Jul;85(4):517-531 [FREE Full text] [CrossRef] [Medline]
- Federal Trade Commission Cigarette Report for 2016. Federal Trade Commission. 2018. URL: https://www.ftc.gov/system/files/documents/reports/federal-trade-commission-cigarette-report-2016-federal-trade-commission-smokeless-tobacco-report/ftc_cigarette_report_for_2016_0.pdf [accessed 2018-06-04]
- Self-Regulation in the Alcohol Industry: Report of the Federal Trade Commission. Federal Trade Commission. 2014. URL: https://www.ftc.gov/system/files/documents/reports/self-regulation-alcohol-industry-report-federal-trade-commission/140320alcoholreport.pdf [accessed 2018-10-29]
- Ventola CL. Direct-to-consumer pharmaceutical advertising: therapeutic or toxic? P T 2011 Oct;36(10):669-684 [FREE Full text] [Medline]
- Harris J, Schwartz M, Munsell S. Fast Food Facts 2013: Measuring Progress in Nutrition and Marketing to Children and Teens. Yale Rudd Cent Food Policy Obes. 2013. URL: https://www.rwjf.org/content/dam/farm/reports/reports/2013/rwjf408549 [accessed 2018-10-28]
- Lovato C, Watts A, Stead LF. Impact of tobacco advertising and promotion on increasing adolescent smoking behaviours. Cochrane Database Syst Rev 2011 Oct 5(10):CD003439 [FREE Full text] [CrossRef] [Medline]
- de Bruijn A, Tanghe J, de Leeuw R, Engels R, Anderson P, Beccaria F, et al. European longitudinal study on the relationship between adolescents' alcohol marketing exposure and alcohol use. Addiction 2016 Oct;111(10):1774-1783. [CrossRef] [Medline]
- Gordon R, Harris F, Marie Mackintosh A, Moodie C. Assessing the cumulative impact of alcohol marketing on young people's drinking: cross-sectional data findings. Addict Res Theory 2010 Sep 7;19(1):66-75. [CrossRef]
- Kelly B, King MPsy L, Chapman Mnd K, Boyland E, Bauman AE, Baur LA. A hierarchy of unhealthy food promotion effects: identifying methodological approaches and knowledge gaps. Am J Public Health 2015 Apr;105(4):e86-e95. [CrossRef] [Medline]
- Andreyeva T, Kelly I, Harris J. Exposure to food advertising on television: associations with children's fast food and soft drink consumption and obesity. Econ Hum Biol 2011 Jul;9(3):221-233. [CrossRef] [Medline]
- Dixon H, Scully M, Niven P, Kelly B, Chapman K, Donovan R, et al. Effects of nutrient content claims, sports celebrity endorsements and premium offers on pre-adolescent children's food preferences: experimental research. Pediatr Obes 2014 Apr;9(2):e47-e57. [CrossRef] [Medline]
- Wintemute G. Where the guns come from: the gun industry and gun commerce. Future Children 2002;12(2):54. [CrossRef]
- Avery RJ, Eisenberg MD, Simon KI. The impact of direct-to-consumer television and magazine advertising on antidepressant use. J Health Econ 2012 Sep;31(5):705-718. [CrossRef] [Medline]
- Daubresse M, Hutfless S, Kim Y, Kornfield R, Qato DM, Huang J, et al. Effect of direct-to-consumer advertising on asthma medication sales and healthcare use. Am J Respir Crit Care Med 2015 Jul 1;192(1):40-46 [FREE Full text] [CrossRef] [Medline]
- Layton JB, Kim Y, Alexander GC, Emery SL. Association between direct-to-consumer advertising and testosterone testing and initiation in the united states, 2009-2013. J Am Med Assoc 2017 Mar 21;317(11):1159-1166 [FREE Full text] [CrossRef] [Medline]
- Cairns G, Angus K, Hastings G, Caraher M. Systematic reviews of the evidence on the nature, extent and effects of food marketing to children. A retrospective summary. Appetite 2013 Mar;62:209-215. [CrossRef] [Medline]
- Jernigan D, Noel J, Landon J, Thornton N, Lobstein T. Alcohol marketing and youth alcohol consumption: a systematic review of longitudinal studies published since 2008. Addiction 2017 Jan;112(Suppl 1):7-20. [CrossRef] [Medline]
- Moore D, Lee S. How advertising influences consumption impulses: the role of visualization, anticipated emotions, taste anticipation, and hedonic rationalization. J Advert 2012;41(3):107-120. [CrossRef]
- DiFranza JR, Wellman RJ, Sargent JD, Weitzman M, Hipple BJ, Winickoff JP, Tobacco Consortium‚ Center for Child Health Research of the American Academy of Pediatrics. Tobacco promotion and the initiation of tobacco use: assessing the evidence for causality. Pediatrics 2006 Jun;117(6):e1237-e1248. [CrossRef] [Medline]
- Wellman RJ, Sugarman DB, DiFranza JR, Winickoff JP. The extent to which tobacco marketing and tobacco use in films contribute to children's use of tobacco: a meta-analysis. Arch Pediatr Adolesc Med 2006 Dec;160(12):1285-1296. [CrossRef] [Medline]
- Pucci LG, Siegel M. Exposure to brand-specific cigarette advertising in magazines and its impact on youth smoking. Prev Med 1999 Nov;29(5):313-320. [CrossRef] [Medline]
- Gilpin EA, White MM, Messer K, Pierce JP. Receptivity to tobacco advertising and promotions among young adolescents as a predictor of established smoking in young adulthood. Am J Public Health 2007 Aug;97(8):1489-1495. [CrossRef] [Medline]
- Pierce JP, Choi WS, Gilpin EA, Farkas AJ, Berry CC. Tobacco industry promotion of cigarettes and adolescent smoking. J Am Med Assoc 1998 Feb 18;279(7):511-515. [CrossRef] [Medline]
- Pechmann C, Levine L, Loughlin S, Leslie F. Impulsive and self-conscious: adolescents' vulnerability to advertising and promotion. J Public Policy Mark 2018 Oct 18;24(2):202-221. [CrossRef]
- Biener L, Siegel M. Tobacco marketing and adolescent smoking: more support for a causal inference. Am J Public Health 2000 Mar;90(3):407-411. [CrossRef] [Medline]
- Tickle JJ, Hull JG, Sargent JD, Dalton MA, Heatherton TF. A structural equation model of social influences and exposure to media smoking on adolescent smoking. Basic Appl Soc Psych 2010 Jun 7;28(2):117-129. [CrossRef]
- The Role of the Media in Promoting and Reducing Tobacco Use. Tobacco Control Monograph No 19. Department of Health and Human Services, National Institutes of Health, National Cancer Institute. 2008. URL: https://cancercontrol.cancer.gov/brp/tcrb/monographs/19/m19_complete.pdf [accessed 2018-07-27]
- Nakajima S. State of Online Advertising Worldwide. The Free Library. 2016. URL: https://www.thefreelibrary.com/State+of+online+advertising+worldwide.-a0489758447 [accessed 2018-09-26]
- Clement J. Worldwide Digital Population as of January. Statista. 2020. URL: https://www-statista-com.proxy1.library.jhu.edu/statistics/617136/digital-population-worldwide/ [accessed 2020-05-03]
- Cooke E, Hastings G, Wheeler C, Eadie D, Moskalewicz J, Dabrowska K. Marketing of alcohol to young people: a comparison of the UK and Poland. Eur Addict Res 2004;10(1):1-7. [CrossRef] [Medline]
- Cruz T. Monitoring the tobacco use epidemic IV. The vector: Tobacco industry data sources and recommendations for research and evaluation. Prev Med 2009 Jan;48(1 Suppl):S24-S34. [CrossRef] [Medline]
- Ilakkuvan V, Cantrell J, Vallone D. 'Action. Adventure. Special offers.': how Marlboro engages consumers on its website. Tob Control 2014 Sep;23(5):455-456. [CrossRef] [Medline]
- Astuti P, Assunta M, Freeman B. Raising generation 'A': a case study of millennial tobacco company marketing in Indonesia. Tob Control 2018 Jul;27(e1):e41-e49. [CrossRef] [Medline]
- Weiger CV, Smith K, Hong AY, Cohen JE. Cigarette packs with urls leading to tobacco company websites: content analysis. J Med Internet Res 2020 Jun 9;22(6):e15160 [FREE Full text] [CrossRef] [Medline]
- Trimble D, Welding K, Smith KC, Cohen J. Smoke and scan: a content analysis of qr code-directed websites found on cigarette packs in China. Nicotine Tob Res 2020 Oct 8;22(10):1912-1916. [CrossRef] [Medline]
- Hurwitz L, Montague H, Wartella E. Food marketing to children online: a content analysis of food company websites. Health Commun 2017 Mar;32(3):366-371. [CrossRef] [Medline]
- Moore E, Rideout V. The online marketing of food to children: is it just fun and games? J Public Policy Mark 2018 Oct 10;26(2):202-220. [CrossRef]
- Feasby J, Brady J, Farrell A, Wong S, Mendelson R. Online marketing of food and beverages to children. Can J Diet Pract Res 2011 Jul;72(2):59. [CrossRef]
- Jordan L, Kalin J, Dabrowski C. Characteristics of gun advertisements on social media: systematic search and content analysis of Twitter and YouTube posts. J Med Internet Res 2020 Mar 27;22(3):e15736 [FREE Full text] [CrossRef] [Medline]
- Ribisl KM. The potential of the internet as a medium to encourage and discourage youth tobacco use. Tob Control 2003 Jun;12(Suppl 1):i48-i59 [FREE Full text] [CrossRef] [Medline]
- Freeman B, Chapman S. Gone viral? Heard the buzz? A guide for public health practitioners and researchers on how Web 2.0 can subvert advertising restrictions and spread health information. J Epidemiol Community Health 2008 Sep;62(9):778-782. [CrossRef] [Medline]
- Enforcement Action Plan for Promotion and Advertising Restrictions Internet. Silver Spring. 2010. URL: https://www.fda.gov/media/79017/download [accessed 2020-07-13]
- Gordon R. An audit of alcohol brand websites. Drug Alcohol Rev 2011 Nov;30(6):638-644. [CrossRef] [Medline]
- Hoffman B. Searching eyes: privacy, the state, and disease surveillance in America. J Health Politics Policy Law 2009 Dec 16;34(6):1079-1082. [CrossRef]
- What is Terms and Conditions? Black's Law Dictionary. 2020. URL: https://thelawdictionary.org/terms-and-conditions/ [accessed 2020-10-29]
- Schnabel v Trilegiant Corp. Justia Cases. 2012 Sep 07. URL: https://cases.justia.com/federal/appellate-courts/ca2/11-1311/11-1311-2012-09-07.pdf?ts=1410918474 [accessed 2018-10-29]
- Register.com Inc Plaintiff-appellee, v Verio, Inc Defendant-appellant, 356 F.3d 393 (2d Cir 2004). Justia US Law. 2004. URL: https://law.justia.com/cases/federal/appellate-courts/F3/356/393/539823/ [accessed 2018-10-29]
- Bagley A, Brown J. Limited consumer privacy protections against the layers of big data. Santa Clara High Technol Law J 2015;31(3):483-526 [FREE Full text]
- Casetext. 2012 Dec 11. URL: https://casetext.com/case/hancock-v-am-tel-tel-co [accessed 2020-07-13]
- Casetext. 2014 Aug 18. URL: https://casetext.com/case/nguyen-v-barnes-noble-inc [accessed 2020-07-13]
- Specht v Netscape Communications Corp 150 F Supp 2d 585. Justia US Law. 2001 Jul 5. URL: https://law.justia.com/cases/federal/district-courts/FSupp2/150/585/2468233/ [accessed 2020-07-13]
- Obar JA, Oeldorf-Hirsch A. The biggest lie on the internet: ignoring the privacy policies and terms of service policies of social networking services. Inform Commun Soc 2018 Jul 3;23(1):128-147. [CrossRef]
- Steinfeld N. 'I agree to the terms and conditions': (how) do users read privacy policies online? An eye-tracking experiment. Comput Human Behav 2016 Feb;55:992-1000. [CrossRef]
- Frischmann B, Selinger E. Engineering humans with contracts. In: Re-Engineering Humanity. Cambridge, UK: Cambridge University Press; 2018:60-80.
- Radin M. Boilerplate, consumers’ rights, and the rule of law. In: Boilerplate: The Fine Print, Vanishing Rights, and the Rule of Law. Princeton, New Jersey: Princeton University Press; 2012:14-47.
- Weller K, Kinder-Kurlanda K. To share or not to share?: ethical challenges in sharing social media-based research data. In: Internet Research Ethics for the Social Age: New Challenges, Cases, and Contexts. New York, USA: Peter Lang; 2017:115-129.
- Fiesler C, Beard N, Keegan B. No Robots, Spiders, or Scrapers: Legal and Ethical Regulation of Data Collection Methods in Social Media Terms of Service. Association for the Advancement of Artificial Intelligence. URL: https://cmci.colorado.edu/~cafi5706/ICWSM2020_datascraping.pdf [accessed 2020-04-21]
- Vaccaro K, Hamilton K, Karahalios K, Langbort C, Sandvig C. Agree or Cancel? Research and Terms of Service Compliance. In: Ethics Work Ethics Stud Sociotechnical Syst a Big Data World. 2015 Presented at: AMC'15; October 17-21, 2015; Chicago, USA URL: https://www.researchgate.net/publication/335327933_Agree_or_Cancel_Research_and_Terms_of_Service_Compliance
- Vitak J, Shilton K, Ashktorab Z. Beyond the Belmont Principles: Ethical Challenges, Practices, and Beliefs in the Online Data Research Community. In: Association for Computing Machinery Digital Library. 2016 Presented at: ACM'16; February 2-6, 2016; Vancouver, BC p. 953. [CrossRef]
- Siegel A, Grosso A, Rasch M, Jarvis R. Brief for Amicus Curiae United States Technology Policy Committee of the ACM in Support of Neither Party Internet. The Supreme Court of the United States. 2020. URL: https://www.supremecourt.gov/DocketPDF/19/19-783/147196/20200708104631325_Amicus%20Brief.pdf [accessed 2020-07-13]
- The Statistics Portal. Statista. 2018. URL: https://www-statista-com.ezp.welch.jhmi.edu/ [accessed 2018-07-18]
- Kang H, An S. How direct-to-consumer drug websites convey disease information: analysis of stigma-reducing components. J Health Commun 2013;18(12):1477-1491. [CrossRef] [Medline]
- Abel GA, Penson RT, Joffe S, Schapira L, Chabner BA, Lynch TJ. Direct-to-consumer advertising in oncology. Oncologist 2006 Feb;11(2):217-226 [FREE Full text] [CrossRef] [Medline]
- Antidepressant Use Among Adults: United States, 2015-2018. Centers for Disease Control and Prevention. URL: https://www.cdc.gov/nchs/products/databriefs/db377.htm#:~:text=During%202015%E2%80%932018%2C%2013.2%25%20of%20Americans%20aged%2018%20and,over%20(24.3%25)%20took%20antidepressants [accessed 2020-11-19]
- Terms and Conditions of Use. New Port Pleasures. 2017. URL: https://www.newport-pleasure.com/FooterLinks/TermsOfUse [accessed 2018-07-19] [WebCite Cache]
- Terms and Conditions Internet. Budlight. 2018. URL: https://www.budlight.com/en/terms-conditions.html [accessed 2018-07-19] [WebCite Cache]
- Miller Coors Terms and Conditions of Use. Miller Coors. 2018. URL: https://www.millercoors.com/legal/terms [accessed 2018-07-19] [WebCite Cache]
- American Outdoor Brands Corporation Website Privacy Notice and Policy. American Outdoor Brands Corporation. 2017 Apr. URL: https://www.webcitation.org/711rDsxHR [accessed 2018-07-19] [WebCite Cache]
- Terms and Conditions for McDonald's Online Services (USA). McDonald's. 2018. URL: https://www.mcdonalds.com/us/en-us/terms-and-conditions.html [accessed 2018-07-19] [WebCite Cache]
- Hoffmann A, Jones A. Recasting justice for internet and online industry research ethics. In: Internet Research Ethics for the Social Age: New Cases and Challenges. New York, USA: Peter Lang; 2016:3-19.
- Fiesler C, Lampe C, Bruckman A. Reality and Perception of Copyright Terms of Service for Online Content Creation. In: 19th American Computing Machinery Conference. 2016 Presented at: ACM'16; October 2-4, 2016; Washington, DC. [CrossRef]
- Reidenberg J, Breaux T, Cranor L, French B, Grannis A, Graves J, et al. Disagreeable privacy policies: mismatches between meaning and users understanding. SSRN J 2014. [CrossRef]
- Sandvig v Barr. ACLU. 2020. URL: https://www.aclu.org/sandvig-v-barr-memorandum-opinion [accessed 2020-05-12]
- Hughes W. Computer Fraud and Abuse Act of 1986. United States Congress. 1986. URL: https://www.congress.gov/bill/99th-congress/house-bill/4718 [accessed 2020-07-14]
- Vitak J, Proferes N, Shilton K, Ashktorab Z. Ethics regulation in social computing research: examining the role of institutional review boards. J Empir Res Hum Res Ethics 2017 Dec;12(5):372-382. [CrossRef] [Medline]
- Association for Computing Machinery's Code of Ethics and Professional Conduct. Association for Computing Machinery's Committee on Professional Ethics. 2018. URL: https://ethics.acm.org/ [accessed 2020-04-21]
- Luger E, Moran S, Rodden T. Consent for All: Revealing the Hidden Complexity of Terms and Conditions. In: SIGCHI Conference on Human Factors in Computing Systems. 2013 Presented at: CHI'13; April 27, 2013; Paris, France. [CrossRef]
|CFAA: Computer Fraud and Abuse Act|
|FDA: Food and Drug Administration|
|TOS: terms of service|
Edited by G Eysenbach; submitted 19.08.20; peer-reviewed by L Jordan, A Phillips; comments to author 01.10.20; revised version received 13.10.20; accepted 28.10.20; published 02.12.20Copyright
©Caitlin Weiger, Katherine C Smith, Joanna E Cohen, Mark Dredze, Meghan Bridgid Moran. Originally published in JMIR Public Health and Surveillance (http://publichealth.jmir.org), 02.12.2020.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Public Health and Surveillance, is properly cited. The complete bibliographic information, a link to the original publication on http://publichealth.jmir.org, as well as this copyright and license information must be included.