This paper is in the following e-collection/theme issue:

Infoveillance, Infodemiology, Digital Disease Surveillance, Infodemic Management (1050) Information Quality in Digital Media (347) Quality/Credibility of eHealth Information and Trust Issues (544) Information Seeking, Information Needs (481)

Published on in Vol 10 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/50031, first published .
Web-Based Information on Spinal Cord Stimulation: Qualitative Assessment of Publicly Accessible Online Resources

Web-Based Information on Spinal Cord Stimulation: Qualitative Assessment of Publicly Accessible Online Resources

Web-Based Information on Spinal Cord Stimulation: Qualitative Assessment of Publicly Accessible Online Resources

Authors of this article:

Tiev Miller1, 2 Author Orcid Image ;   Ali Hosseinzadeh1 Author Orcid Image ;   Thomas Thordarson1 Author Orcid Image ;   Tamila Kalimullina1 Author Orcid Image ;   Soshi Samejima3 Author Orcid Image ;   Claire Shackleton1, 2 Author Orcid Image ;   Raza Malik1, 2 Author Orcid Image ;   Martín Calderón-Juárez1, 2 Author Orcid Image ;   Rahul Sachdeva1, 2 Author Orcid Image ;   Andrei Krassioukov1, 2, 4 Author Orcid Image
Article Authors Cited by Tweetations (2) Metrics

    Original Paper

    1International Collaboration on Repair Discoveries, The University of British Columbia, Vancouver, BC, Canada

    2Division of Physical Medicine and Rehabilitation, Department of Medicine, The University of British Columbia, Vancouver, BC, Canada

    3Department of Rehabilitation Medicine, University of Washington, Seattle, WA, United States

    4Spinal Cord Program, GF Strong Rehabilitation Centre, Vancouver Coastal Health, Vancouver, BC, Canada

    *these authors contributed equally

    Corresponding Author:

    Andrei Krassioukov, MD, PhD

    International Collaboration on Repair Discoveries

    The University of British Columbia

    818 West 10th Avenue

    Vancouver, BC, V5Z 1M9

    Canada

    Phone: 1 604 675 8810

    Email: andrei.krassioukov@vch.ca


    Background: Despite the growing accessibility of web-based information related to spinal cord stimulation (SCS), the content and quality of commonly encountered websites remain unknown.

    Objective: This study aimed to assess the content and quality of web-based information on SCS.

    Methods: This qualitative study was prospectively registered in Open Science Framework. Google Trends was used to identify the top trending, SCS-related search queries from 2012 to 2022. Top queried terms were then entered into separate search engines. Information found on websites within the first 2 pages of results was extracted and assessed for quality using the DISCERN instrument, the Journal of the American Medical Association benchmark criteria, and the Health on the Net Foundation code of conduct certification. Website readability and SCS-related information were also assessed.

    Results: After exclusions, 42 unique sites were identified (scientific resources: n=6, nonprofit: n=12, for-profit: n=20, news or media: n=2, and personal or blog: n=2). Overall, information quality was moderate (DISCERN). Few sites met all the Journal of the American Medical Association benchmark criteria (n=3, 7%) or had Health on the Net Foundation certification (n=7, 16%). On average, information was difficult to read, requiring a 9th- to 10th-grade level of reading comprehension. Sites described SCS subcategories (n=14, 33%), indications (n=38, 90%), contraindications (n=14, 33%), side effects or risks (n=28, 66%), device considerations (n=25, 59%), follow-up (n=22, 52%), expected outcomes (n=31, 73%), provided authorship details (n=20, 47%), and publication dates (n=19, 45%). The proportion of for-profit sites reporting authorship information was comparatively less than other site types (n=3, 15%). Almost all sites focused on surgically implanted SCS (n=37, 88%). On average, nonprofit sites contained the greatest number of peer-reviewed reference citations (n=6, 50%). For-profit sites showed the highest proportion of physician or clinical referrals among site types (n=17, 85%) indicating implicit bias (ie, auto-referral).

    Conclusions: Overall, our findings suggest the public may be exposed to incomplete or dated information from unidentifiable sources that could put consumers and patient groups at risk.

    JMIR Public Health Surveill 2024;10:e50031

    doi:10.2196/50031

    Keywords

    access to information; consumer health information; internet; spinal cord stimulation; web-based information; communication; quality; readability; Google Trends; misinformation; synthesis 


    Background

    Spinal cord stimulation (SCS) is an emerging therapeutic approach that has been used as an intervention to address chronic pain [1,2], paralysis, and autonomic dysfunctions [3,4] resulting from injury and disease. SCS delivers electrical stimulation to the spinal cord using invasive or noninvasive interfaces. Groundbreaking pilot studies involving individuals with paralysis after spinal cord injury have demonstrated the potential benefits of SCS for improving functional recovery [5,6], resulting in a growing demand for information related to SCS among various consumer or patient groups, their caregivers, and the general public [7]. In the absence of evidence-based guidelines and standardized treatment options, people living with long-term disease and disability are likely to turn to other sources of information (eg, web-based search results), and potentially alternative treatment options (eg, advertised devices and surgical procedures), to help manage their condition. However, web-based information on SCS has not been evaluated in depth.

    Currently, the US Food and Drug Administration [8] has only approved the use of epidural spinal cord stimulation (ESCS; ie, surgically implanted) to manage failed back surgery syndrome, refractory angina pectoris, peripheral arterial disease, complex regional pain syndrome, painful diabetic neuropathy as well as nonsurgical low back pain. Whether publicly accessible websites curating information on SCS provide clear indications (or contraindications) for the intended use (or potential risk) of this therapeutic modality remains unknown. Over the next decade, medical consumerism is projected to grow as people seeking treatment become more knowledgeable and active in their care through the expansion of web-based resources and the availability of medical information [9]. As the marketing of SCS to treat or manage various conditions expands concomitantly with the fragmentation of web-based medical information [10] and the gradual erosion of routine patient-to–health care provider interactions [11], patients may become more vulnerable to predatory marketing strategies that inflate the benefits of SCS while obscuring or underreporting its potential harms [12]. This market-driven shift by which medical information is being provided and subsequently accessed may engender patient consumerism and potentially enhance the pecuniary opportunities for SCS device manufacturers and health care providers [13].

    Rationale

    Many internet searches are health-related (eg, 4.5% of 6.75 million daily searches in 2003) and are usually conducted using the most popular search engines (eg, Google) [14,15] rather than by directly accessing individual websites exclusively dedicated to the provision of medical information. Though the amount of published research on the topic of SCS has risen exponentially in the past decade [7], the pervasiveness of health-related misinformation on publicly accessible web-based platforms has grown in tandem [13,16]. Previous studies have shown that misinformation is commonly encountered on sites describing disease prevalence [10,17], evaluation [18], available treatment options [19], and medical management recommendations [20-22].

    Misinformation may present as information that is either lacking in critical detail, misleading or factually incorrect, or out-of-date and not substantiated by current evidence [16]. The amount, quality, and relevance of the information returned by a given search engine query may vary substantially [23]. Website order in a returned search is also important, as preferential positioning determines what information (eg, medical treatment and management) is accessed first, independent of content [24] and quality [25]. Most user traffic (ie, 92%) is often confined to the top results found within the first search page, with roughly one-third of all user traffic attributed to the first listed result [26]. Furthermore, the provision of health-related information on websites with substantial user traffic is often inconsistent with evidence-based guidelines and best practice recommendations [25,27]. As the pursuit and use of web-based health-related information continues to outpace and even remodel conventional patient-to-health care provider interactions [11,13], it is important that web-based information is critically appraised.

    Objectives

    The objectives of this qualitative study were (1) to systematically map web-based resources containing SCS-related information using common search methods that are openly and freely available to the general public and (2) to assess the content and quality of information regarding the use of SCS for the treatment or management of health conditions or symptoms.


    Ethical Considerations

    Ethics approval was not required for this study, as it did not involve human participants.

    Search Strategy and Inclusion Criteria

    This study was prospectively registered in Open Science Framework [28]. A pilot search was conducted to identify the most popular search terms (worldwide) within the last decade (2012 to 2022) for the topic “spinal cord stimulator” using Google Trends (Figure 1). All searches were performed using a United States IP designation to standardize the country-specific origin of returned results for each search engine [17]. A detailed description of the search strategy using the highest trending search queries (ie, “spinal stimulator” and “spinal cord stimulator”) is provided in the Search Strategy section in Multimedia Appendix 1 [17,28-77].

    ‎
    Figure 1. Search term identification. (A) Search terms with relevance to spinal cord stimulation were identified using Google Trends. Topic search using the term “spinal cord stimulator” was used to identify the top related queries: 1=spinal stimulator, 2=spinal cord stimulator, 3=spinal stimulation, and 4=spinal cord stimulation. Among the top queried terms, 1=spinal stimulator and 2=spinal cord stimulator ranked the highest in terms of relative search term popularity. (B) Search interest for the topic term “spinal cord stimulator” by global region indicated the United States (n=100), followed by Ireland (n=53), Laos (n=45), Australia (n=45), and United Kingdom (n=30) had the highest proportion of all queries (ie, not the highest number of queries) for this topic term within the specified timeframe (2012-2022).

    This study considered publicly accessible websites providing information on SCS. Websites were categorized as scientific resources (ie, academic institutions and government organizations), nonprofit or foundations or advocacy organizations, for-profit or private sector or industry, news or media, or independent sources or personal blogs in accordance with subcategorizations previously outlined by Fisher et al [17]. Sites were not excluded on the basis of origin or date. Peer-reviewed papers or book chapters hosted by journal publisher websites were not included in the data extraction. Evidence suggests the general public may be unable to interpret or understand all scientific content found within peer-reviewed literature (ie, accessibility or readability of information) [78]. As this content has already been subjected to professional scrutiny from subject-area experts and editorial revision of considerable rigor or is altogether inaccessible (eg, paywall restricted), this information was not evaluated. Advertisement sites that did not include information relevant to SCS were also excluded.

    Data Extraction

    Data were extracted by 2 independent authors, and discrepancies were resolved through discussion or consensus with a third author. Extracted data included website type [17], characteristics (ie, site title, address [URL], publication date or most recent update, author names and credentials, country of origin or geographical designation, alternate accessibility options (format), and number of peer-reviewed reference citations), and SCS-related information provided (ie, SCS definition or summary, indications, contraindications, side effects or risks, device considerations, follow-up, outcomes, intended audience [consumer or caregiver, researcher or clinician, or both], and referral to a health care professional [eg, physician and therapist] or clinic).

    Quality and Readability

    In accordance with methods described in previous studies [17,18], the quality of the information provided on each website was assessed by 2 independent authors using the DISCERN instrument [29], the Journal of the American Medical Association (JAMA) benchmark criteria [30], and Health on the Net Foundation (HON) code of conduct certification [31]. Readability for each site was determined using the Flesch-Kincaid indices [32]. These assessments are described in detail in the Quality and Readability Assessments section in Multimedia Appendix 1.

    Data Synthesis

    Data extracted from websites were tabulated and aggregated according to site type. Websites were also explored for high-frequency keywords. Webpages were imported as PDF to NVivo software (version 12; QRS International Pty Ltd) and archived for further analysis using the NCapture extension in Google Chrome. Website text from imported PDF files was then used to generate word clouds and frequency tables. Descriptive analyses were performed using SPSS software (version 28; IBM Corp). Average scores and ratings for each site type are expressed as mean and SD, median and IQR, or frequencies (n) and proportions (%) for continuous, ordinal, and dichotomous levels of data, respectively.


    Screening and Search Term Frequency

    Using the term “spinal stimulator” in the first search and “spinal cord stimulator” in the second search (Figure 1), a total of 202 results were returned (Google: n=56, Baidu: n=39, Yahoo: n=58, and Bing: n=49). After exclusions (ie, duplicates, advertisements, and sites unrelated to SCS), a total of 57 unique websites were identified. Of these, 15 were host sites for peer-reviewed journal papers (n=8), book chapters (n=4), or patent applications (n=3) and were thus excluded from the main synthesis. Of the remaining 42 sites, the majority were categorized as for-profit (n=20) followed by nonprofit (n=12), scientific resource (n=6), news or media (n=2), and personal or blog site types (n=2). A flow diagram outlining the screening procedure is provided in Table 1.

    Word frequencies for each search term used (ie, spinal, cord, and stimulator) are provided in Table 2 and Figure S1 in Multimedia Appendix 1. Word cloud and word frequency summaries are also provided in Figure S1 in Multimedia Appendix 1. Word frequency summaries showed that the occurrence of individual words comprising the search topic (ie, “spinal,” “cord,” and “stimulator”) was among the most frequent. This suggests the returned search results are likely to be an accurate representation of the web-based resources and SCS-related information that consumers would encounter irrespective of the search engine used [79,80]. Average occurrence (ie, frequency) of all 3 search terms was highest for scientific resource sites (spinal: mean 25.7, SD 16; cord: mean 23.7, SD 14.5; and stimulator: mean 13.8, SD 13.3), while proportional usage (ie, relative to all other words) was highest among personal or blog sites for the terms “spinal” (mean 4.4, SD 2.7) and “stimulator” (mean 3.5, SD 3.2) and news or media sites for the term “cord” (mean 5.4, SD 6.8).

    Table 1. Search results and website selection.
    Screening procedureSearch engine

    		Google, n (%)Baidu, n (%)Yahoo, n (%)Bing, n (%)
    Initial search results (n=202)56 (28)39 (19)58 (29)49 (24)
    Unique sites after duplicates (n=57)23 (40)15 (26)6 (11)13 (23)
    Eligibility criteria not met

    		Journal papers (n=8)3 (37)5 (63)—a—

    		Book chapters (n=4)2 (50)—1 (25)1 (25)

    		Patent applications (n=3)—3 (100)——

    		Included websites (n=42)18 (43)7 (17)5 (12)12 (28)

    aNot available.

    Table 2. Quality, readability, and search term frequency.
    Website categoryScientific resource (n=6)Nonprofit (n=12)For-profit (n=20)News or media (n=2)Personal or blog (n=2)
    DISCERN, median (IQR)

    		Item 1 (clear aims)5 (5-5)5 (5-5)5 (5-5)5 (5-5)5 (5-5)

    		Item 2 (achieved aims)5 (5-5)5 (5-5)5 (5-5)5 (5-5)5 (5-5)

    		Item 3 (relevant)5 (4.5-5)5 (5-5)5 (5-5)5 (5-5)5 (5-5)

    		Item 4 (information source)1 (1-2)1 (1-5)1 (1-1)3 (1-3)1 (1-1)

    		Item 5 (publication date)2 (1-5)5 (1-5)1 (1-1)5 (5-5)1 (1-1)

    		Item 6 (balanced and unbiased)5 (3.25-5)5 (1.5-5)1.5 (1-3)2.5 (2-2.5)3 (2-3)

    		Item 7 (additional information sources)2 (1-3.5)3 (1-5)1 (1-3)3 (1-3)2.5 (1-2.5)

    		Item 8 (areas of uncertainty)3.5 (2.75-5)3 (1-5)3 (2-3.75)4 (4-4)2 (1-2)

    		Item 9 (defines treatment)5 (4.75-5)4 (1.25-5)5 (4-5)3 (1-3)3 (1-3)

    		Item 10 (describes benefits)5 (5-5)5 (1.5-5)5 (2-5)5 (5-5)5 (5-5)

    		Item 11 (describes risks)5 (1-5)4 (1-5)2 (1-5)3.5 (2-3.5)1 (1-1)

    		Item 12 (no treatment or usual care outcomes)1 (1-2)1 (1-4)1 (1-1.75)1 (1-1)3 (1-3)

    		Item 13 (effect on quality of life)5 (4.5-5)5 (1-5)5 (2.25-5)5 (5-5)5 (5-5)

    		Item 14 (alternative treatment choices)2 (1-5)1.5 (1-5)1 (1-5)2 (1-2)3 (1-3)

    		Item 15 (shared decision-making support)3 (2.75-5)3 (1-4)3 (3-3.75)3 (3-3)3 (1-3)

    		Item 16 (overall)3.5 (2.75-4)3 (2.25-4)3 (2-3)2 (2-2)2.5 (2-2.5)
    JAMAa benchmark criteria, median (IQR)

    		Benchmark 1 (authorship)1 (0.38-1)1 (0.63-1)0 (0-0.38)1 (1-1)1 (1-1)

    		Benchmark 2 (attribution)0 (0-0.25)0 (0-1)0 (0-0)0 (0-0)0 (0-0)

    		Benchmark 3 (currency)1 (0.75-1)1 (1-1)1 (1-1)0.75 (0.5-0.75)1 (1-1)

    		Benchmark 4 (disclosure)0 (0-0.25)0.5 (0-1)0 (0-0.5)0.25 (0-0.25)0 (0-0)

    		Benchmark (total)2 (0.88-2.5)2.75 (2-3)1.25 (1-1.9)2 (1.5-2)2 (2-2)
    HONb code of conduct certificate, n (%)2 (33)4 (33)1 (5)0 (0)0 (0)
    Readability, mean (SD)

    		Flesch reading ease score47.13 (11.54)52.19 (7.84)45.73 (10.66)43.80 (16.69)60.00 (19.94)

    		Flesch-Kincaid grade level8.63 (1.72)7.95 (1.18)9.39 (1.88)15.15 (9.26)6.70 (3.54)
    Search term word frequency, mean (SD)

    		“Spinal” frequency25.67 (16.02)14.33 (13.39)18.65 (19.22)12.00 (15.56)11.00 (12.73)

    		“Spinal” (%)4.07 (2.18)2.79 (2.07)3.19 (1.89)0.85 (0.47)4.42 (2.71)

    		“Cord” frequency23.67 (14.51)13.92 (13.03)17.40 (17.50)10.50 (13.44)9.00 (9.90)

    		“Cord” (%)3.94 (2.26)2.77 (2.00)3.03 (1.79)5.36 (6.84)3.78 (1.81)

    		“Stimulator” frequency13.83 (13.27)4.83 (6.82)11.95 (13.26)9.00 (11.31)9.50 (12.02)

    		“Stimulator” (%)1.70 (1.48)0.88 (1.37)1.91 (1.43)0.70 (0.25)3.48 (3.15)

    aJAMA: Journal of the American Medical Association.

    bHON: Health on the Net Foundation.

    Readability

    A summary of readability is provided in Table 2 and Table S1 in Multimedia Appendix 1. Readability indices across all sites indicated that information was difficult on average and required a 9th- to 10th-grade level of reading comprehension (reading ease: mean 48.4, SD 10.8 and grade: mean 9, SD 2.7). News or media required the highest level of reading comprehension (mean 15.2, SD 9.3), and personal or blog sites required the lowest level of reading comprehension (mean 6.7, SD 3.5).

    Quality

    A summary of information quality (ie, DISCERN, JAMA scores, and HON code of conduct certification) is provided in Table 2 and Figure S2 and Table S2 in Multimedia Appendix 1. Based on DISCERN rating criteria, just over one-third of all sites were rated as having high overall quality (n=16, 38%), with the remainder rated as having moderate (n=19, 45%) or low (n=7, 16%) overall quality. Scientific resources (median 3.5, IQR 2-3) and news or media sites (median 2, IQR 2-2) showed the highest and lowest overall DISCERN scores, respectively. Few sites met all 4 JAMA benchmark criteria (n=3, 7%). Nonprofit (median 2.75, IQR 2-3) and for-profit sites (median 1.25, IQR 1-1.9) showed the highest and lowest benchmark totals, respectively. HON code of conduct certification was present in less than a quarter of all sites (n=7, 16%), with the majority attributed to nonprofit sites (n=4, 9%).

    Website Characteristics

    Tabulated website characteristics are summarized in Tables S3 and S4 in Multimedia Appendix 1. Publication dates (or latest revision date) were reported for less than half (19/42, 45%) of all websites and was proportionately lowest among for-profit sites (5/20, 25%) compared to other site types. Author names, aliases, and credentials were provided in less than half of all sites (20/42, 47%), and authorship disclosure was also proportionately lowest among for-profit sites (3/20, 15%) compared to others. Site addresses included designation in the United States (30/42, 71%), Canada (1/42, 2%), and Australia (1/42, 2%) or did not provide a location (10/42, 23%). Relative to other site types, the proportion of sites that provided a geographical designation was highest among for-profit sites (19/42, 45%). Just under half of all websites provided alternate content accessibility options (ie, PDF, audio, and video; 20/42, 47%). Some sites also featured pop-up notifications and advertisements (9/42, 21%). On average, nonprofit sites contained the greatest number of reference citations (mean 11.1, SD 27.1) followed by scientific resources (mean 1.2, SD 2.9).

    Website Information

    Website information is summarized in Tables S3 and S5 in Multimedia Appendix 1. Most websites were intended for consumers and caregivers (n=27, 64%), with the remainder intended to serve as resources for clinicians and researchers (n=1, 2%) or both (n=14, 33%). Site information pertained to the use of ESCS (n=37, 88%), both transcutaneous SCS and ESCS (n=2, 4%), or did not define SCS type (n=3, 7%). Sites also provided summary information or a definition of SCS (n=37, 88%) and described SCS subcategories (n=14, 33%), indications (n=38, 90%), contraindications (n=14, 33%), side effects or risks (n=28, 66%), device considerations (n=25, 59%), follow-up (n=22, 52%), and outcome-related information (n=31, 73%). Most sites featured physician or clinical referral (n=26, 61%). Relative to other site types, for-profit sites showed the highest proportion of referrals (17/20, 85%).


    Principal Findings

    This study provides a novel qualitative synthesis of publicly available web-based information on the topic of SCS. For-profit websites were the most commonly encountered. Website quality ratings varied between site types suggesting that the reporting (or omission) of important quality criteria (eg, authorship, information source, and publication date) was site-type dependent. For-profit sites were rated as having relatively lower quality than nonprofit or scientific resource sites based on quality criteria (ie, JAMA benchmarks and HON code of conduct certification). The proportion of for-profit sites reporting authorship was comparatively less than nonprofit and scientific resource sites. The average number of peer-reviewed reference citations identified within for-profit sites was also comparably less frequent than that of nonprofit and scientific resource sites. These findings are largely consistent with other studies of web-based information that report similar discrepancies in the provision of authorship and information sources [17,18]. This suggests that consumers may be exposed to web-based information on SCS that originates from unidentified authors and sources. While two-thirds of all websites mentioned potential risks or side effects of SCS, only one-third described possible contraindications for SCS. Moreover, the majority of websites specifically targeted consumers or their caregivers and featured clinical or physician referral for SCS. Relative to other site types, for-profit sites constituted the largest proportion of referrals indicating potential information bias and consumer-directed marketing of SCS [13]. This is a cause for concern, as the selective provision of SCS-related information from undisclosed sources may potentially place consumers and patient groups at unnecessary risk and consequently diminish their capacity to make informed health care decisions.

    Limitations

    This study has several limitations. First, returned search results were limited by geographical location (ie, IP designation within the United States based on geographical trends for the search topic “spinal cord stimulator”) and may lack generalizability across regions and therefore introduce bias unintentionally. This study also incorporated the use of Baidu, the second-most commonly used search engine by international ranking at the time the search was conducted, in conjunction with other common search engines (ie, Google, Bing, and Yahoo). Although Baidu is the most commonly used web-based resource for medical information seekers following the withdrawal of Google from China in 2010 [81], the additive benefit of using this search engine and associated indices (eg, Baidu Index) to include a broader user demographic and potentially enhance search result generalizability remains inconclusive.

    For-profit websites were the most commonly encountered site type, representing approximately half of all included sites (n=20, 48%). However, it is unclear whether the developers of these sites allocated funding and resources to increase user traffic and enhance website visibility through the use of strategic search engine optimization techniques (eg, content management systems; schematic data structuring; and technical optimizations to improve URL structure, loading, navigation, and internal linking). Although the results of the word frequency summary potentially suggest the use of word frequency–based ranking algorithms, the way these search engines ultimately select which resources to display in a given list of returned search results remains unknown. Future studies may investigate whether academic institutions and government and nongovernment organizations (ie, scientific resources) that curate high-quality, evidence-based medical information actually benefit from devoting funds and organizational resources to increase website user traffic and visibility via technical optimization (eg, site content and search engine compatibility) or by other means (eg, endorsement by influential people and use of slogans, catchphrases, logographic designs, and multimedia to enhance site awareness and recognition and to demonstrate expertise, authority, and trustworthiness).

    Several tools were used to provide a robust quality assessment of the information encountered on various websites (ie, DISCERN, JAMA, and HON code of conduct). Although this approach is largely consistent with previous studies of web-based medical information, among these assessments, there are both redundant components (eg, authorship, attribution, and disclosure) as well as quality criteria that are unique to each of the tools used (eg, financial disclosure and advertising). Future studies may consider the use of more recent assessments comprising these and other essential criteria for evaluating the quality of information encountered on websites and web-based resources.

    Additionally, the data extracted reflects publicly accessible information from the first 2 pages of returned results for 2 top trending search terms. Though not exhaustive (ie, all possible websites providing information on SCS), the search methodology used was intended to simulate scenario-specific consumer behavior (ie, seeking SCS-related information). Future studies may consider an alternate methodological approach involving divergent user-behavior scenarios.

    Conclusions

    Publicly available web-based information on SCS mainly targets consumers and their caregivers. We found that almost all sites focused on surgically implanted SCS with less than half providing authorship details and publication dates. Most websites mentioned risks or side effects of SCS, yet few websites described possible contraindications. Sites curated by for-profit entities featured clinical or physician referral for SCS more often than other site types indicating implicit bias. This suggests that the public is likely to be exposed to incomplete, potentially misleading, or out-of-date information from unidentified sources regarding the use of SCS. For-profit sites were also encountered more frequently than nonprofit and scientific resource sites, suggesting the content and technical format of sites featuring higher-quality medical information are not optimized to enhance user traffic and search engine visibility. To avoid the spread of misinformation that could potentially harm certain consumer or patient groups, sites featuring evidence-based information on the current use of SCS should declare authorship, ensure the evidence is frequently updated, and consider using search engine optimization techniques that enable preferential site positioning for commonly used search terms.

    Acknowledgments

    TM is supported by postdoctoral fellowship awards jointly funded by Michael Smith Health Research BC, the Canadian Institutes for Health Research (CIHR), and the Rick Hansen Foundation (RHF). TK is supported by a Canada Graduate Scholarship through the CIHR and a WorkSafeBC research trainee award. MC-J is supported by a Paralyzed Veterans of America (PVA) postdoctoral fellowship award and the RHF. SS is supported by a PVA postdoctoral fellowship award, the RHF, and the Wings for Life Spinal Cord Research Foundation (WFLSCRF). RM is supported by a PVA postdoctoral fellowship award, a CIHR-funded fellowship award, and the RHF. CS is supported by a PVA postdoctoral fellowship award, a CIHR postdoctoral fellowship award, and the RHF. RS is supported by the WFLSCRF and the US Department of Defense. AK is the endowed chair in the Division of Physical Medicine and Rehabilitation within the Faculty of Medicine at the University of British Columbia and is supported through grant funding provided by WFLSCRF, International Spinal Research Trust, Praxis, US Department of Defense, RHF, Onward, SpineX, Convatec, and Coloplast. Laboratory resources used for conducting the study were purchased with prior funding support from the Canadian Foundation for Innovation and the British Columbia Knowledge Translation Foundation.

    Authors' Contributions

    TM, RS, and AK conceptualized the study; TM, AH, TT, TK, and MC-J conducted the analyses; TM drafted the paper; and all authors reviewed and approved the final version.

    Conflicts of Interest

    RS is a paid consultant at SpineX Inc, a medtech startup building spinal cord stimulation devices. This author contributed to the conception and final review of the study and had no role in developing the study methodology nor in the identification, extraction, and interpretation of the study data. All other authors have no potential conflicts of interest to declare.

    Multimedia Appendix 1

    Supplementary figures and tables.

    DOCX File , 311 KB
    1. Traeger AC, Gilbert SE, Harris IA, Maher CG. Spinal cord stimulation for low back pain. Cochrane Database Syst Rev. 2023;3 (3):CD014789. [CrossRef] [Medline]
    2. O'Connell NE, Ferraro MC, Gibson W, Rice AS, Vase L, Coyle D, et al. Implanted spinal neuromodulation interventions for chronic pain in adults. Cochrane Database Syst Rev. 2021;12 (12):CD013756. [FREE Full text] [CrossRef] [Medline]
    3. García AM, Serrano-Muñoz D, Taylor J, Avendaño-Coy J, Gómez-Soriano J. Transcutaneous spinal cord stimulation and motor rehabilitation in spinal cord injury: a systematic review. Neurorehabil Neural Repair. 2020;34 (1):3-12. [FREE Full text] [CrossRef] [Medline]
    4. Samejima S, Shackleton C, Miller T, Moritz CT, Kessler TM, Krogh K, et al. Mapping the iceberg of autonomic recovery: mechanistic underpinnings of neuromodulation following spinal cord injury. Neuroscientist. 2023.:10738584221145570. [FREE Full text] [CrossRef] [Medline]
    5. Fyfe I. Breakthrough technology restores function after complete paralysis. Nat Rev Neurol. 2022;18 (4):187. [CrossRef] [Medline]
    6. Angeli C, Rejc E, Boakye M, Herrity A, Mesbah S, Hubscher C, et al. Targeted selection of stimulation parameters for restoration of motor and autonomic function in individuals with spinal cord injury. Neuromodulation. 2023.:S1094-7159(23)00148-4. [FREE Full text] [CrossRef] [Medline]
    7. Laskin JJ, Waheed Z, Thorogood NP, Nightingale TE, Noonan VK. Spinal cord stimulation research in the restoration of motor, sensory, and autonomic function for individuals living with spinal cord injuries: a scoping review. Arch Phys Med Rehabil. 2022;103 (7):1387-1397. [FREE Full text] [CrossRef] [Medline]
    8. Indications for use. US Food and Drug Administration. 2017. URL: https://www.accessdata.fda.gov/cdrh_docs/pdf3/P030017S275C.pdf [accessed 2022-12-28]
    9. Zimlichman E, Nicklin W, Aggarwal R, Bates DW. Health care 2030: the coming transformation. NEJM Catalyst. 2021;2 (2):1-11. [FREE Full text] [CrossRef]
    10. Cuan-Baltazar JY, Muñoz-Perez MJ, Robledo-Vega C, Pérez-Zepeda MF, Soto-Vega E. Misinformation of COVID-19 on the internet: infodemiology study. JMIR Public Health Surveill. 2020;6 (2):e18444. [FREE Full text] [CrossRef] [Medline]
    11. Tan SS, Goonawardene N. Internet health information seeking and the patient-physician relationship: a systematic review. J Med Internet Res. 2017;19 (1):e9. [FREE Full text] [CrossRef] [Medline]
    12. Donohue J. A history of drug advertising: the evolving roles of consumers and consumer protection. Milbank Q. 2006;84 (4):659-699. [FREE Full text] [CrossRef] [Medline]
    13. Khullar D, Darien G, Ness DL. Patient consumerism, healing relationships, and rebuilding trust in health care. JAMA. 2020;324 (23):2359-2360. [CrossRef] [Medline]
    14. Fox S, Duggan M. Health online 2013. Pew Research Center. 2013. URL: https://www.pewresearch.org/internet/2013/01/15/health-online-2013/ [accessed 2022-12-28]
    15. Eysenbach G, Kohler C. What is the prevalence of health-related searches on the World Wide Web? Qualitative and quantitative analysis of search engine queries on the internet. AMIA Annu Symp Proc. 2003;2003:225-229. [FREE Full text] [Medline]
    16. Khullar D. Social media and medical misinformation: confronting new variants of an old problem. JAMA. 2022;328 (14):1393-1394. [CrossRef] [Medline]
    17. Fisher JH, O'Connor D, Flexman AM, Shapera S, Ryerson CJ. Accuracy and reliability of internet resources for information on idiopathic pulmonary fibrosis. Am J Respir Crit Care Med. 2016;194 (2):218-225. [FREE Full text] [CrossRef] [Medline]
    18. Kreutzer EP, Sauer S, Kriegsmann M, Staemmler H, Egerer G, Kriegsmann K. Accuracy and reliability of internet resources for information on monoclonal gammopathy of undetermined significance—what information is out there for our patients? Cancers (Basel). 2021;13 (18):4508. [FREE Full text] [CrossRef] [Medline]
    19. Ved R, Cobbold N, Igbagiri K, Willis M, Leach P, Zaben M. Online patient information on vagus nerve stimulation: how reliable is it for facilitating shared decision making? Seizure. 2017;50:125-129. [FREE Full text] [CrossRef] [Medline]
    20. Borgmann H, Wölm JH, Vallo S, Mager R, Huber J, Breyer J, et al. Prostate cancer on the web—expedient tool for patients' decision-making? J Cancer Educ. 2017;32 (1):135-140. [CrossRef] [Medline]
    21. Bruce JG, Tucholka JL, Steffens NM, Neuman HB. Quality of online information to support patient decision-making in breast cancer surgery. J Surg Oncol. 2015;112 (6):575-580. [FREE Full text] [CrossRef] [Medline]
    22. Ferreira G, Traeger AC, Machado G, O'Keeffe M, Maher CG. Credibility, accuracy, and comprehensiveness of internet-based information about low back pain: a systematic review. J Med Internet Res. 2019;21 (5):e13357. [FREE Full text] [CrossRef] [Medline]
    23. Zuccon G, Koopman B, Palotti J. Diagnose this if you can. In: Hanbury A, Kazai G, Rauber A, Fuhr N, editors. Advances in Information Retrieval. Cham. Springer; 2015;562-567.
    24. Miller T, Stockley R, Drummond A, Watkins C, Georgiou R, Ahuja K, et al. Online advice for the symptomatic management of post-stroke fatigue: a scoping review. J Psychosom Res. 2022;162:111039. [CrossRef] [Medline]
    25. Meric F, Bernstam EV, Mirza NQ, Hunt KK, Ames FC, Ross MI, et al. Breast cancer on the world wide web: cross sectional survey of quality of information and popularity of websites. BMJ. 2002;324 (7337):577-581. [FREE Full text] [CrossRef] [Medline]
    26. The value of Google result positioning. Chitika. 2013. URL: https://chitika.com/google-positioning-value [accessed 2024-01-18]
    27. Peterson S, Rainey N, Weible K. Who writes this stuff? musculoskeletal information quality and authorship of popular health websites: a systematic review. Musculoskelet Sci Pract. 2022;60:102563. [CrossRef] [Medline]
    28. Miller T, Hosseinzadeh A, Thordarson T, Kalimullina T, Calderón-Juárez M, Samejima S, et al. Publicly accessible web-based information on spinal cord stimulation: a scoping review. Open Science Framework. 2022. URL: https://osf.io/vf5dt [accessed 2024-01-18]
    29. Charnock D, Shepperd S, Needham G, Gann R. DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Community Health. 1999;53 (2):105-111. [FREE Full text] [CrossRef] [Medline]
    30. Silberg WM, Lundberg GD, Musacchio RA. Assessing, controlling, and assuring the quality of medical information on the internet: caveant lector et viewor—let the reader and viewer beware. JAMA. 1997;277 (15):1244-1245. [Medline]
    31. Boyer C, Baujard V, Geissbuhler A. Evolution of health web certification through the HONcode experience. Stud Health Technol Inform. 2011;169:53-57. [Medline]
    32. Terblanche M, Burgess LJ. Examining the readability of patient-informed consent forms. Open Access J Clin Trials. 2010;2:157-162. [FREE Full text] [CrossRef]
    33. Nuti SV, Wayda B, Ranasinghe I, Wang S, Dreyer RP, Chen SI, et al. The use of Google Trends in health care research: a systematic review. PLoS One. 2014;9 (10):e109583. [FREE Full text] [CrossRef] [Medline]
    34. Fleiss JL, Levin B, Paik MC. The measurement of interrater agreement. In: Statistical Methods for Rates and Proportions. Somerset. John Wiley & Sons, Inc; 2004. .
    35. Flesch R. A new readability yardstick. J Appl Psychol. 1948;32 (3):221-233. [CrossRef] [Medline]
    36. Sivanesan E. Spinal cord stimulator. John Hopkins Medicine. 2022. URL: https:/​/www.​hopkinsmedicine.org/​health/​treatment-tests-and-therapies/​treating-pain-with-spinal-cord-stimulators [accessed 2022-12-28]
    37. Nichols T, Mandybur G, Orlando M. Spinal cord stimulation. Mayfield Brain & Spine. 2021. URL: https://mayfieldclinic.com/pe-stim.htm [accessed 2022-12-28]
    38. Back pain and spinal cord stimulation. WebMD. 2020. URL: https://www.webmd.com/pain-management/spinal-cord-stimulation [accessed 2022-12-28]
    39. Treating pain with spinal cord stimulators. University of Rochester Medical Center. URL: https://www.urmc.rochester.edu/encyclopedia/content.aspx?contenttypeid=134&contentid=126 [accessed 2022-12-28]
    40. Anderson WS. Spinal cord stimulator removal: Q and A with a neurosurgeon. John Hopkins Medicine. URL: https:/​/www.​hopkinsmedicine.org/​health/​treatment-tests-and-therapies/​spinal-cord-stimulator-removal-qa [accessed 2022-12-28]
    41. Spinal cord stimulator trial and implantation. UTHealth Houston Neurosciences. URL: https:/​/med.​uth.edu/​neurosciences/​conditions-and-treatments/​spine-disorders-and-back-pain/​spinal-cord-stimulator-trial-and-implant/​ [accessed 2022-12-28]
    42. Mehta M. Disadvantages and risks of spinal cord stimulation. Spine-health. 2016. URL: https:/​/www.​spine-health.com/​treatment/​pain-management/​disadvantages-and-risks-spinal-cord-stimulation [accessed 2022-12-28]
    43. Anderson B, Cockroft KM. Spinal cord stimulation. American Association of Neurological Surgeons. URL: https://www.aans.org/en/Patients/Neurosurgical-Conditions-and-Treatments/Spinal-Cord-Stimulation [accessed 2022-12-28]
    44. Spinal cord stimulation (video animation). Pain Medicine Consultants. URL: https://www.painmedicineconsultants.com/contents/spinal-cord-stimulation-video-animation [accessed 2022-12-28]
    45. Spinal Cord Team. Are spinal cord stimulators safe? What you need to know. SpinalCord.com. 2020. URL: https://www.spinalcord.com/blog/spinal-cord-stimulator-problems-to-know-about [accessed 2022-12-28]
    46. Spinal cord stimulator. Wikipedia. 2022. URL: https://en.wikipedia.org/wiki/Spinal_cord_stimulator [accessed 2022-12-28]
    47. Senza Spinal Cord Stimulation (SCS) system—P130022/S042. Food & Drug Administration. 2022. URL: https:/​/www.​fda.gov/​medical-devices/​recently-approved-devices/​senza-spinal-cord-stimulation-scs-system-p130022s042 [accessed 2022-12-28]
    48. Kamhi LM. Spinal cord stimulation: risks and benefits. HealthCentral. 2017. URL: https://www.healthcentral.com/pain-management/spinal-cord-stimulation-advantages-risks-who-candidate [accessed 2022-12-27]
    49. Spinal cord stimulation for chronic back pain video. Spine-health. URL: https://www.spine-health.com/video/spinal-cord-stimulation-chronic-back-pain-video [accessed 2022-12-28]
    50. Spinal cord stimulation for chronic back and neck pain. Spine-health. 2016. URL: https:/​/www.​spine-health.com/​treatment/​pain-management/​spinal-cord-stimulation-chronic-back-and-neck-pain [accessed 2022-12-28]
    51. McKenzie-Brown AM, Pritzlaff SG. Spinal cord stimulation: placement and management. UpToDate. 2022. URL: https://www.uptodate.com/contents/spinal-cord-stimulation-placement-and-management [accessed 2022-12-28]
    52. Spinal cord stimulation. Mount Sinai. 2022. URL: https://www.mountsinai.org/health-library/surgery/spinal-cord-stimulation [accessed 2022-12-28]
    53. Thomson S. Spinal cord stimulation's role in managing chronic disease symptoms. International Neuromodulation Society. 2019. URL: https://www.neuromodulation.com/spinal-cord-stimulation [accessed 2022-12-28]
    54. Spinal Cord Stimulator (SCS) systems. Boston Scientific. 2022. URL: https://www.bostonscientific.com/en-US/patients-caregivers/device-support/scs.html [accessed 2022-12-28]
    55. A non-opioid alternative. Medtronic. 2022. URL: https:/​/www.​medtronic.com/​us-en/​patients/​treatments-therapies/​spinal-cord-stimulation-chronic-pain/​therapy-overview.​html [accessed 2022-12-22]
    56. Spinal cord stimulation. Precision Brain, Spine, & Pain. 2022. URL: https:/​/www.​precisionhealth.com.au/​healthcare-services/​advanced-neurosurgery-spinal-surgery/​procedures-and-surgery/​spinal-cord-stimulation/​ [accessed 2022-12-28]
    57. Spinal cord stimulation. UCSF Health. 2022. URL: https://www.ucsfhealth.org/treatments/spinal-cord-stimulation [accessed 2022-12-28]
    58. Spinal cord stimulator surgery—the risks and recovery time. Southern Pain Clinic. 2017. URL: https://southernpainclinic.com/blog/spinal-cord-stimulator-surgery-the-risks-and-recovery-time/ [accessed 2022-12-28]
    59. Spinal Cord Stimulation (SCS). Nura Precision Pain Management. 2022. URL: https://www.nuraclinics.com/treatments/neuromodulation/neurostimulation/spinal-cord-stimulation-scs/ [accessed 2022-12-28]
    60. Spinal cord stimulation implant. UPMC. 2022. URL: https://www.upmc.com/services/neurosurgery/spine/treatment/pain-management/stimulation [accessed 2022-12-28]
    61. Spinal cord stimulator implant in Austin, TX. Advanced Pain Care. 2022. URL: https://austinpaindoctor.com/spinal-cord-stimulator [accessed 2024-12-28]
    62. Spinal cord stimulator. Segura Neuroscience & Pain Center. 2022. URL: https://segurapaincenter.com/treatments/spinal-cord-stimulator/ [accessed 2022-12-28]
    63. Kamhi LM. Spinal cord stimulators: procedure and recovery. Spineuniverse. 2021. URL: https://www.spinediagnostic.com/blog/spinal-cord-stimulators-procedure-and-recovery/ [accessed 2022-12-28]
    64. Spinal cord stimulator. USA Spine Care & Orthopedics. 2019. URL: https://www.usaspinecare.com/spinal_orthopedic_procedures/spinal-cord-stimulators/ [accessed 2022-12-28]
    65. Spinal cord stimulation systems healthcare professionals. Medtronics. 2021. URL: https:/​/www.​medtronic.com/​us-en/​healthcare-professionals/​products/​neurological/​spinal-cord-stimulation-systems.​html [accessed 2022-12-28]
    66. What you need to know about spinal cord stimulator surgery. Florida Surgery Consultants. 2022. URL: https://www.floridasurgeryconsultants.com/spinal-cord-stimulator-surgery-everything-you-should-know/ [accessed 2022-12-28]
    67. Deuk. Spinal cord stimulator review: disadvantages and risks of the surgery implant. Deuk Spine Institute. 2022. URL: https://deukspine.com/spinal-cord-stimulator-review/ [accessed 2022-12-28]
    68. Pain management with spinal cord stimulation therapy. Comprehensive Pain Management Specialists. 2022. URL: https://sdcpms.com/pain-management-with-spinal-cord-stimulation-therapy/ [accessed 2022-12-28]
    69. Spinal cord stimulation—surgical procedure. Krembil Brain Institute. 2022. URL: https:/​/www.​uhn.ca/​Krembil/​Treatments_Procedures/​Spinal_Cord_Stimulation_Procedure/​Pages/​surgical_procedure.​aspx [accessed 2022-12-28]
    70. Spinal cord stimulator trial/implants. Pain Treatment Centers of America. 2022. URL: https://www.ptcoa.com/spinal-cord-stimulator-trial-implants [accessed 2022-12-28]
    71. The next era of personalization: WaveWriter Alpha™ spinal cord stimulation system. Boston Scientific. 2022. URL: https://tinyurl.com/4fehueez [accessed 2022-12-28]
    72. Rolling Hills Medical. 2022. URL: https://rollinghillsmedical.com/types-of-spinal-cord-stimulators/ [accessed 2022-12-28]
    73. Living with a spinal cord stimulator: answers to FAQs. Arizona Pain. 2020. URL: https://arizonapain.com/living-with-a-spinal-cord-stimulator/ [accessed 2022-12-28]
    74. Spine stimulator for pain. Mayo Clinic. 2015. URL: https://www.youtube.com/watch?v=WCNcTfV3frY&ab_channel=MayoClinic [accessed 2022-12-28]
    75. Weiss M, Mohr H. Spinal-cord stimulators help some patients, injure others. NBC News. 2018. URL: https:/​/www.​nbcnews.com/​health/​health-care/​spinal-cord-stimulators-help-some-patients-injure-others-n940131 [accessed 2022-12-28]
    76. Steeldove. Anyone tried spinal cord stimulation for chronic pain? Mayo Clinic. 2018. URL: https://tinyurl.com/bdpsecwa [accessed 2024-02-09]
    77. Oxendine E. What is a spinal cord stimulator? Wisegeek. 2022. URL: https://www.wise-geek.com/what-is-a-spinal-cord-stimulator.htm [accessed 2022-02-18]
    78. Plavén-Sigray P, Matheson GJ, Schiffler BC, Thompson WH. The readability of scientific texts is decreasing over time. Elife. 2017;6:e27725. [FREE Full text] [CrossRef] [Medline]
    79. Wang L, Wang J, Wang M, Li Y, Liang Y, Xu D. Using internet search engines to obtain medical information: a comparative study. J Med Internet Res. 2012;14 (3):e74. [FREE Full text] [CrossRef] [Medline]
    80. Finkelstein L, Gabrilovich E, Matias Y, Rivlin E, Solan Z, Wolfman G. Placing search in context: the concept revisited. 2001 Presented at: Proceedings of the 10th International Conference on World Wide Web; May 1-5, 2001, 2001;406-414; Hong Kong. URL: https://dl.acm.org/doi/10.1145/371920.372094 [CrossRef]
    81. Wang T, Xia Q, Chen X, Jin X. Use of Baidu Index to track Chinese online behavior and interest in kidney stones. Risk Manag Healthc Policy. 2020;13:705-712. [FREE Full text] [CrossRef] [Medline]

    ‎
    ESCS: epidural spinal cord stimulation
    HON: Health on the Net Foundation
    JAMA: Journal of the American Medical Association
    SCS: spinal cord stimulation

    Edited by O Leal Neto; submitted 17.06.23; peer-reviewed by J McGowan, C Jones; comments to author 16.12.23; revised version received 26.12.23; accepted 08.01.24; published 23.02.24.

    Copyright

    ©Tiev Miller, Ali Hosseinzadeh, Thomas Thordarson, Tamila Kalimullina, Soshi Samejima, Claire Shackleton, Raza Malik, Martín Calderón-Juárez, Rahul Sachdeva, Andrei Krassioukov. Originally published in JMIR Public Health and Surveillance (https://publichealth.jmir.org), 23.02.2024.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Public Health and Surveillance, is properly cited. The complete bibliographic information, a link to the original publication on https://publichealth.jmir.org, as well as this copyright and license information must be included.