Background: In this age of social media, any news—good or bad—has the potential to spread in unpredictable ways. Changes in public sentiment have the potential to either drive or limit investment in publicly funded activities, such as scientific research. As a result, understanding the ways in which reported cases of scientific misconduct shape public sentiment is becoming increasingly essential—for researchers and institutions, as well as for policy makers and funders. In this study, we thus set out to assess and define the patterns according to which public sentiment may change in response to reported cases of scientific misconduct. This study focuses on the public response to the events involved in a recent case of major scientific misconduct that occurred in 2014 in Japan—stimulus-triggered acquisition of pluripotency (STAP) cell case.
Objectives: The aims of this study were to determine (1) the patterns according to which public sentiment changes in response to scientific misconduct; (2) whether such measures vary significantly, coincident with major timeline events; and (3) whether the changes observed mirror the response patterns reported in the literature with respect to other classes of events, such as entertainment news and disaster reports.
Methods: The recent STAP cell scandal is used as a test case. Changes in the volume and polarity of discussion were assessed using a sampling of case-related Twitter data, published between January 28, 2014 and March 15, 2015. Rapidminer was used for text processing and the popular bag-of-words algorithm, SentiWordNet, was used in Rapidminer to calculate sentiment for each sample Tweet. Relative volume and sentiment was then assessed overall, month-to-month, and with respect to individual entities.
Results: Despite the ostensibly negative subject, average sentiment over the observed period tended to be neutral (−0.04); however, a notable downward trend (y=−0.01 x +0.09; R ²=.45) was observed month-to-month. Notably polarized tweets accounted for less than one-third of sampled discussion: 17.49% (1656/9467) negative and 12.59% positive (1192/9467). Significant polarization was found in only 4 out of the 15 months covered, with significant variation month-to-month (P<.001). Significant increases in polarization tended to coincide with increased discussion volume surrounding major events (P<.001).
Conclusions: These results suggest that public opinion toward scientific research may be subject to the same sensationalist dynamics driving public opinion in other, consumer-oriented topics. The patterns in public response observed here, with respect to the STAP cell case, were found to be consistent with those observed in the literature with respect to other classes of news-worthy events on Twitter. Discussion was found to become strongly polarized only during times of increased public attention, and such increases tended to be driven primarily by negative reporting and reactionary commentary.
With the rise of social network services (SNS), all news events, no matter how large or small, have become subject to intense public scrutiny and debate [, ]. Of course, this has gone on in some form or another since the advent of civilization. However, the democratization, reach, and consequence of public scrutiny has never before been realized to the degree seen today [ - ]. Indeed, although assessment of public opinion has traditionally been the domain of pollsters and social scientists, social media analytics are increasingly being seen as a reliable alternative [ ]. With a large and increasingly diverse demographic base, Twitter has been shown to be reasonably representative in terms of demographics [ , ] and public sentiment [ ], especially with respect to breaking news [ - ].
Recent investigations into communication on Twitter have uncovered common, generalizable patterns in the way sentiment changes in response to the emergence of notable events—namely, that increases in public attention are coincident with increases in negative sentiment . Such patterns follow known dynamics associated with media sensationalism [ , ] and have been observed across a broad spectrum of mass media topics, including entertainment, sports, business, politics, and natural disasters [ ]. Sensationalism has also been found to be a problem in the reporting of medical science [ ]. This is of particular concern given the profound and lasting impact on the direction of public policy that sensationalist reporting might have [ ]. And although studies have examined the role of the traditional news media in shaping public opinion as it relates to medical science and policy [ ], no studies to date have explored whether such dynamics would apply to the presumably expert-driven communications on Twitter.
One area of particular interest is scientific misconduct, particularly in the areas of academic and medical science. Scientific misconduct concerns more than just a given researcher or institution; damage to public perception of, and goodwill toward scientific research itself is a driving concern . Most academic research institutions derive the bulk of their research budgets from public spending, and so a loss of reputation can have a direct and far-ranging impact. Academic institutions invest heavily in anticipation of future academic trends and research demands [ ]; consequently, unanticipated changes in public policy or funding may result in large, unrecoupable capital expenditures and lost opportunity [ ]. Understanding the specific dynamics governing public response to reports of scientific misconduct on social media is therefore invaluable.
Stimulus-Triggered Acquisition of Pluripotency Cell Case
Here, we assess and define the patterns according to which public sentiment may change in response to reports of academic scientific misconduct on Twitter. This study focuses on public response to a recent and widely covered case of scientific misconduct—the stimulus-triggered acquisition of pluripotency (STAP) cell case that occurred in Japan in 2014 . The STAP cell case is used in this study, as this represents the major scientific misconduct in the era of SNS and was well mentioned by the mainstream media such as Nature, Science, New York Times, Cable News Network (CNN), and British Broadcasting Corporation (BBC). In this case, media reports focused on Ms Obokata, an upcoming biochemist, who attracted as much attention for her achievements, as for her gender and youth. Attention also focused on notable coauthors, Dr Y Sasai, Dr T Wakayama, and Dr C Vacanti, as well as the sponsoring institution, Riken.
Here, we have demonstrated that Twitter response to the STAP case tended to generally stay neutral, but specifically skew negative as discussion polarity and volume increased. Our results are consistent with those observed in studies covering other topics of interest . These findings suggest that changes in public sentiment toward any major event—cases of scientific misconduct included—might be as much a function of the attention received as it is a function of the theme or merits of any specific case.
For the purpose of this analysis, an event timeline was constructed based on primary reports and press-releases [, ]. Where such data were lacking, secondary sources were vetted and compiled [ , - ]. All data obtained were used and reported according to the terms and privacy policies of the respective data sources. Where such no such policy existed, data were assumed to be public domain.
Twitter data (“Tweets”) were obtained directly from Apple’s now defunct subsidiary, Topsy . According to Twitter, “a Tweet...is a message of 140 characters or less that is public by default” [ ]. For the purposes of this study, the data obtained was handled according to established ethical precedent regarding public domain social media content, that is, consent of the authors was neither required nor obtained [ ]. Our search covered a full 14 months, beginning with the day of Riken’s press release concerning STAP (January 29, 2014) and ending March 31, 2015. Prior research has demonstrated that datasets derived using a limited set of focused keywords are suitable for the purpose of analyzing public sentiment regarding a specific issue or brand [ ]. In order to minimize collection of irrelevant Tweets, the following minimum set of search criteria were chosen: obokata OR 小保方 OR #obokata OR #小保方. Other, potentially relevant terms, such as “STAP” and “Riken” were excluded at this stage after having been found to return results that were likely to be either redundant or irrelevant.
An automated platform for downloading and processing Tweets was developed using RStudio . Using this platform, we obtained a sample set consisting of all English-language Tweets covering the relevant timeframe polled at a rate of n=100 Tweets every 3 h. All content as well as associated metadata (eg, author name, date, and number of retweets) were downloaded. This initial, raw dataset contained N=12,925 Tweets in total. Full-text was retained for qualitative analysis.
Initial processing of data was conducted programmatically within RStudio. This included formatting and transformation of the downloaded data into tables. Downloaded tables were saved and processed using Excel 2013. This included the programmatic identification and removal of all Tweets containing non-English characters or text. In addition, all Tweets were manually checked to remove irrelevant or spam posts, resulting in a final dataset of n=9467 Tweets total.
For the purpose of sentiment classification, RapidMiner version 6.3, Enterprise Edition (Rapid-I GmbH, Dortmund, Germany) was used. The following preprocessing steps were followed (). These steps are common across the many domains in which text-mining is applied [ ], with minimal variation.
|Tokenize||Parse every tweet into separate, single-element tokens (ie, words or word-parts)|
|Transform cases||Makes all text lower case to facilitate data processing|
|Filter tokens by length||Removes tokens consisting of less than 2 characters|
|Filter English stop words||Removes common, low-information particles (eg, “the”) and punctuation marks|
|Filter tokens by content||Removed hashtags and other message-irrelevant tokens such as “http”|
|Stemming (WordNet)||Algorithm for identifying and groups tokens as lemmas, to facilitate processing|
|Generate n-grams||Generates list of all two-, three-, or four-word token combinations (ie, phrases)|
|Word vector creation||Generate metric indicative of the measuring the important of each word in a tweet|
|Pruning||Remove tokens that appear in less than 1% or more than 80% of documents|
This processing generated weighted word vectors, representing the weighted distribution of each processed token or n-gram within a given Tweet. Word vector statistics were calculated using the term frequency-inverse document frequency (TF-IDF) weighting scheme. TF-IDF emphasizes the importance of key but not uncommon terms [, ] and has been demonstrated to improve the performance of text-mining tasks [ ]. TF-IDF is calculated as follows: TF-IDF=tf*log (N/df), where tf is the frequency of a term within a given document, df is the frequency across all documents, and N is the number of documents total [ ].
To evaluate sentiment for each Tweet, the SentiWordNet 3.0 extension was used within Rapidminer. SentiWordNet is a well-established sentiment analysis protocol and has been cited by almost 1000 (988) journal publications as of the date of this writing, according to Google Scholar search. SentiWordNet assigns three sentiment scores (“positive,” “negative,” and “objective”) to each word, based on a generalized classification system developed by the authors using a combination of manual and automated sentiment scoring algorithms . SentiWordNet’s “bag-of-words” methodology has been demonstrated to be reliable for document-level sentiment analysis, with aggregate-level performance roughly on par with more sophisticated methods, including human coding [ ].
For this analysis, nouns were omitted from sentiment calculation. Recent studies have demonstrated that, for automated sentiment analyses, nouns are not likely to provide additional, reliable information . And in topics with terminology that is either uncommon or uncommonly applied, this is even more the case—especially when using a general purpose lexicon such as SentiWordNet [ ]. All terms were, however, retained for topic-level analysis. The sentiment of each Tweet was then calculated by aggregating the scores of all relevant word tokens, as determined using SentiWordNet.
Scores were thus assigned for each Tweet, ranging from −1 to +1, based on the estimated degree of negative or positive sentiment. These scores are reported in unstandardized form. For the purpose of statistical analysis and visualization, scores were then standardized, to produce a distribution with mean of zero (x̄=0) and standard deviation of one (σx̅=1). All Tweets with standardized scores less than −1 were labeled “negative,” whereas those with standardized scores greater than +1 were labeled “positive;” Tweets with standardized scores less than +1 but greater than −1 were labeled “neutral.”
A support vector machine (SVM) analysis was then used to identify the terms and phrases that were most commonly associated with each respective sentiment label. SVM is a computational method that derives a classification scheme based on the degree to which the various input cases (ie, word vectors) predict a given binary class (eg, positive or negative sentiment or “mentions Sasai” or null) . All input terms (and term combinations, ie, “n-grams”) can thus be assessed in terms of “importance” with respect to a given label [ ]. Conceptually, this is similar to a logistic regression; however, the computation is far more computationally intensive [ , ]. In addition, Tweets mentioning Ms Obokata, Dr Sasai, and the Riken institution were labeled accordingly; associated terms or phrases were also extracted via SVM.
Data Analysis and Visualization
Once the Twitter data were processed as described, the data were exported to Microsoft Excel for further processing using the Pivot Table function. Sentiment as well as sampled Tweet volume were aggregated and indices were calculated for all relevant sub- and cross-tables. These tables were then used to generate visualizations either directly in Microsoft Excel or using ggplot2 and ggtern in RStudio. In cases where a given table or visualization suggested a time-trend or association with respect to aggregate sentiment or Tweet volume, statistical significance was assessed using chi-squared and Tukey’s post hoc (1-way analysis of variance, ANOVA) tests. A GLM model (with Bonferroni correction) was used to test month-to-month mean difference versus previous months; 2-way ANOVA was used to compare metrics for individual entities. SPSS Statistics version 23 (IBM Corp) was used for all statistical tests.
Analysis of Sentiment
Over the 15-month period covered, overall sentiment was found to be −0.037 on average, with a notable downward trend (). Over this same period, sampled Tweets averaged 631.1 Tweets per month, with a maximum of 2349 Tweets (April 2014; 372.2% index) and a minimum of 75 Tweets (November 2014; 11.9% index). One-way ANOVA with Tukey’s honest significant difference (HSD) confirmed significant month-to-month variation with respect to sentiment ( ). Overall, discussion tended to be mostly neutral (69.92%), with positive and negative discussion being far less prevalent (12.59% and 17.49%, respectively) overall. Discussion month-to-month tended to be mostly objective; however, when polarized, discussion tended negative ( ). Chi-squared tests confirmed observed differences to be significant in this respect as well ( ).
|Year||Month||N||Subset for alpha=.05|
Both sets of trends were assessed against the timeline of events to determine whether sentiment and volume varied according to actual, real-world events. Findings are reported in terms of average sentiment, volume index (ratio of monthly or average volume), and positivity index (ratio of positive to negative volume).presents a summary timeline. A brief analysis is as follows.
Timeline Analysis and Analysis of Key Events
January 2014: STAP Announced to Much Fanfare; Obokata Hailed
On January 29, 2014, a letter  and research article [ ] describing a “unique and unexpected cellular reprogramming phenomenon, called stimulus-triggered acquisition of pluripotency (STAP)” were published in Nature (ISSN: 0028-0836) by a team from the Riken Center for Developmental Biology in Japan and collaborators. These papers claimed that “stressors reprogram mammalian somatic cells, resulting in the generation of pluripotent cells”—a claim which challenged the very tenets of cell biology. Beginning one day before publication, the lead author, Ms Haruko Obokata, was hailed as a rising star in a series of media events and press releases [ ].
For the 3 days comprising the month of January 2014 (January 29-31), average sentiment was found to be second highest among all months covered (0.083; P<.001, versus grand mean). In terms of volume, January indexed at par (99.8% index; 630/631.1); however, positive index was exceptionally high (3583.3%; 215/6). Discussion hails the “breakthrough” discovery; initial skepticism is present but muted.
February 2014: Doubts Begin to Surface; Riken Launches Investigation
Average sentiment decreased significantly, but remained overall positive (0.044; P=.004). In terms of volume, February indexed below par (67.2% index; 424/631.1); positivity also remained high (888.9%; 80/9). Discussion continues to focus on the merits and implications of STAP; however, strong doubts begin to take hold.
- Initial concerns about possible figure manipulation first voiced on PubPeer (February 4) [ ].
- STAP coauthor, Dr Charles Vacanti, posts images claimed to be human STAP cells (February 5) [ ].
- Riken subsequently launches an investigation into “alleged irregularities” for both papers [ ].
March 2014: Calls for Retraction Mount; Obokata Increasingly Implicated
Average sentiment decreased slightly, but not significantly (0.039; P>.99). However, volume began to increase (109.5% index; 691/631.1); discussion remained positive, albeit to a lesser degree (387.1%; 120/31). Allegations of possible misconduct increasingly take center stage; some antiskepticism still remains.
- “Essential technical tips for STAP...” published by Ms Obokata, Dr Sasai, and Dr Niwa on March 3 [ ].
- STAP coauthor, Dr Wakayama, breaks from others and proposes retraction of both papers [ ].
- In an interim report, the Riken investigation team finds inappropriate handling of data [ ].
April 2014: Obokata Declared Guilty Amid Shake-Up at Riken; Public Interest Spikes
Discussion volume reached its peak (372.2% index; 2349/631.1); however, discussion took on a more negative tone. Average sentiment decreased significantly (−0.022; P<.001), with a positivity now at 88.7% index (276/311). Riken’s finding of misconduct, problems with the investigation team, and Ms Obokata’s claims of innocence dominate; discussion centers on the drama between actors and institution, not the science.
- Riken finds Ms Obokata guilty of “two instances of research misconduct” in the STAP work [ ].
- Ms Obokata holds a press conference in order to rebut Riken’s conclusions [ ].
- Nature publishes a strongly worded editorial on science policy in Japan, citing STAP case [ ].
May 2014: Retraction Appears Inevitable; Obokata, However, Still Defiant
Average sentiment continues the negative trend (−0.052; P=.003). A substantial drop in volume was also observed (88.4% index; 558/631.1), accompanied by a sharp drop in positivity as well (57%; 29/51). Fueled by reports of prior, scathing rejections by Science and Cell, discussion now focuses on the nature of the experiments and results; Riken’s initial rejection of Ms Obokata’s appeal also a hot topic.
- Ms Obokata, under pressure to retract both papers, agrees to retract only the letter (May 28).
- Other senior authors continue to negotiate with Ms Obokata regarding the remaining article [ ].
June 2014: STAP Papers Retracted; End Now in Sight, Calls for Punitive Action Emerge
Driven by a sharp increase in positivity (245%; 137/56) and overall discussion (140.5% index; 887/631.1), average sentiment became slightly positive (0.023; P<.001). Despite calls for punitive action against the senior investigators, STAP retraction is discussed in neutral terms. Decision to suspend disciplinary process against Ms Obokata and allow her to join STAP reproduction efforts is discussed favorably.
- STAP coauthor, Dr Wakayama, presents genetic evidence refuting the existence of STAP cells [ ].
- Ms Obokata and coauthors finally agree to retract both papers published in Nature [ ].
- Riken reform committee recommends restructuring of Center for Developmental Biology [ ].
July 2014: STAP Discussion Takes on a Lighter—and Somewhat Derisive—Tone
Average sentiment was once again negative (−0.051; P<.001), with a positivity index of 67.8% (97/143) against volume only slightly above par (107.7% index; 680/631.1). Discussion focuses on the fallout of the STAP retraction.
- On July 3, the two Nature papers reporting the STAP cells are retracted [ , ].
- Ms Obokata sustains injuries while being pursued by television reporters [ ].
- Concurrent with Riken’s investigation of the STAP case, Waseda University begins investigation of alleged plagiarism in Ms Obokata’s doctoral dissertation [ ]; Ms Obokata retains PhD, for now.
August 2014: Sasai’s Suicide Draws Muted Response
Discussion volume was subpar (62.6% index; 395/631.1); despite a positivity index of 115% (45/39), average sentiment was nevertheless mixed (0.005; P<.001). Discussion focuses on the apparent suicide of Dr Sasai; commentary is reserved, though some take the opportunity to critique the academic culture in Japan.
- On August 5, Dr Sasai, a STAP coauthor, found dead at the Riken center due to apparent suicide.
- Dr Sasai leaves behind a note addressed to Ms Obokata, urging her to verify existence of STAP [ ].
- A STAP coauthor, Dr Niwa, announces his lab’s failure to replicate STAP results (August 27) [ ].
September 2014: Discussion More Sympathetic, Pensive as STAP Retrial Continues
Driven by a large increase in positivity (1575%; 63/4), average sentiment improved considerably (0.098; P<.001). Nevertheless, discussion volume was remarkably low (19% index; 120/631.1). No single topic stands out; discussion instead touches on themes ranging from Ms Obokata’s mentoring to the role of the media.
- Vacanti et al release new STAP protocol; addition of adenosine triphosphate (ATP) now asserted to be key (September 3) [ ].
- Dr Endo publishes a report suggesting that STAP cells may have been embryonic stem cells (September 21) [ ].
October 2014: Waseda University’s Threat to Revoke PhD Draws Mixed Response
In October 2014, average sentiment decreased significantly, but remained overall positive (0.047; P=.23. Despite low overall discussion volume (21.5% index; 136/631.1), positivity was comparably high (1267%; 38/3). Discussion volume, however, remained overall low. Discussion mostly focuses on Waseda University’s demand that Ms Obokata correct her dissertation ; some see this as an “opportunity.”
November 2014: Attention Focused Elsewhere as STAP Retrial Draws to a Close
In November 2014, discussion volume fell to an all-time low (11.9% index; 75/631.1). Despite above average positivity (150%; 3/2), average sentiment continued to trend negative (−0.023; P=.06). Discussion centers on speculation regarding the STAP replication efforts. No other coherent themes emerge.
December 2014: Riken Unexpectedly Halts STAP Retrial; Obokata Resigns
In December 2014, average sentiment decreased slightly, but not to a significant degree (−0.042; P>.99). However, a large increase in discussion volume (173% index; 1092/631.1) precipitated a sharp drop in positivity (54.2%; 71/131). Ms Obokata’s failure to replicate STAP, along with her abrupt resignation attracts the most discussion; “disgraced” is the now most commonly used term to describe Ms Obokata.
- Riken halts STAP verification experiments, announcing them to have failed [ ].
- Ms Obokata resigns from her position at Riken [ ].
January 2015: Obokata Accused of Stealing Materials; Criminal Charges Threatened
In January 2015, the downward trend in average sentiment continued—albeit not to a significant degree (−0.08; P=.10). Discussion volume (33.1% index; 209/631.1) and positivity were both subpar (23%; 6/26). Discussion focuses on allegations of criminal wrongdoing.
February 2015: Riken Openly Discusses Punitive Measures; Guardian Piece Attracts Mixed Response
In February 2015, a large uptick in discussion (163.8% index; 1034/631.1) drove a precipitous decline in average sentiment (−0.26; P<.001) and positivity (1.0%; 8/766). Discussion focuses on the following:
- Riken’s announcement of penalties related to the STAP research and publication.
- Riken’s public announcement of plans to pursue criminal charges against Ms Obokata [ ].
- The Guardian piece, “What pushes scientists to lie,” [ ] is highly cited during this period.
March 2015: Riken Announces Intent Not to Sue Obokata
In March 2015, average sentiment improves slightly but remains extremely negative (−0.18; P<.001). Positivity remains low (5%; 4/78) amid low overall discussion volume (29.6% index; 187/631.1). Despite a few supportive messages, discussion overwhelmingly highlights Ms Obokata’s continuing woes.
- Riken’s decision not to sue Ms Obokata [ ] garners mixed attention.
- However, reported demands that she return publication-related expenses [ ] draws derision.
Sentiment Surrounding Various, Individual Stakeholders
Significant differences were found with respect to the sentiment surrounding various parties. Tweet data were aggregated according to whether Ms “Obokata,” Dr “Sasai,” or (inclusive) the “Riken” institute were mentioned. Overall, sentiment surrounding Ms Obokata and the Riken institute was found to be consistent with broader trends (−0.04 and −0.03, respectively; no significant difference). However, sentiment toward Dr Sasai was found to be significantly more positive overall (0.03; P<.04), with visible trends coinciding with relevant events; but these results were not statistically significant ().
Dr Sasai initially received minimum attention. However, once allegations of misconduct began to emerge, Dr Sasai’s continued, public support of Ms Obokata becomes increasingly associated with discussion that was significantly more favorable (0.14, 0.06, and 0.14 respectively, in March 2014, April 2014, and May 2014; P<.001, P=.05, P=.02 respectively). Indeed, discussion mentioning Dr Sasai remained positive even as sentiment toward Ms Obokata (−0.02 and −0.05 respectively, in April 2014 and May 2014) and Riken (−0.02 and −0.06 respectively, in April 2014 and May 2014) became decidedly negative. Incident to and just before retraction of the STAP papers, discussion increasingly turned to the role of Ms Obokata’s mentors and institutional culpability. Accordingly, sentiment associated with mentions of Dr Sasai fell precipitously during this period (−0.27 in both June 2014 and July 2014; P=.09 and P<.001, respectively). By contrast, sentiment associated with Riken was positive during the same timeframe (0.05 and 0.04 respectively, in June 2014 and July 2014; P=.01 and P=.62, respectively;).
These trends, however, reversed in August and September of that year. Coincident with and following the tragedy surrounding Dr Sasai, the sentiment associated with mentions of Dr Sasai became positive (0.07 and 0.07 respectively, in August 2014 and September 2014; P=.04 for both), whereas sentiment associated with Riken followed the opposite trend (−0.03 and −0.01 respectively, in August 2014 and September 2014; P<.001 and P=.03, respectively).
A simplified “grounded theory” approach  was used to examine the generalizable themes that were most commonly expressed within this dataset. For this purpose, entities specific to this case were omitted. Each Tweet was manually categorized according to major topic or polarity-driving theme. Coding was based on an analysis of the terms and concepts within a given Tweet that correspond with the degree and direction of polarity assigned by the SentiWordNet algorithm. Categories were added, merged, and/or eliminated progressively, as Tweets were reviewed. Higher-level codes were manually assigned to similarity clusters in an iterative fashion, to uncover overarching themes. Tweets were allowed to be assigned to multiple coding classes. The primary themes thus found to be driving polarity were the following: (1) “unfocused negativity—outrage or mockery,” (2) “cynicism toward academic science,” (3) “defense of academic science,” and (4) “miscellaneous conspiracy theories.”
Only a few studies have covered the publicity of science using SNS [, ]; and thus, very little is currently known about how public sentiment may change in response to reported cases of scientific misconduct. A study conducted on behalf of the UK House of Lords found that, although public interest in science is high, “a culture of...secrecy...invites suspicion” [ ]. However, whether such suspicions are based on rational or justifiable criticism is still a matter of controversy [ ]. In addition, little is currently known as to whether and how news related to scientific misconduct is relevant to or impacts public opinion on a broad scale.
This study found that STAP-related discussion volume varied significantly month-to-month, coincident with new events. Furthermore, we found that month-to-month sentiment was generally neutral or of mixed composition, tending to skew negative when polarized. This is consistent with previous findings concerning the characteristics of public sentiment as expressed on Twitter . In this study, it was noted that such increases in polarity generally corresponded with large increases in overall volume, that is, major events attracted more attention, most of which tended negative. It is interesting to note that such increases in volume and corresponding negativity were generally short-lived; positivity, on the other hand, tended to be much less prone to such fluctuation.
In addition, this analysis found that sentiment surrounding various stakeholders differed significantly with respect to specific events. Of particular note is the sentiment surrounding Dr Sasai, the researcher whose tragic fate was found to correspond with an increase in positive sentiment. The relationship between the death of a key stakeholder in a public crisis and subsequent improvement of the public mood—from criticism to sympathy—has been covered in the Japanese literature in the 1980s  and also in a recent Time article reporting Dr Sasai’s death [ ]. And in this study, an analysis of public sentiment, expressed via social media, was able to detect and observe this effect.
The results presented here provide an important case study for understanding the impact of scientific misconduct on public sentiment. The coverage received by the STAP cell case can be attributed to many factors, but the instrumentality of social media cannot be ignored. Although this manuscript was undergoing review, a related study was published that provided rudimentary analysis of the print and social media coverage of the STAP cell case in Japan . This study confirmed that print coverage tended to lag behind social media coverage—a finding which supports other reports suggesting that news initiated and driven by public interest may indeed influence public opinion [ , ], or at least mainstream reporting. Here, we have presented a more robust perspective by including all major timeline events in the STAP cell case and by employing a well-established, objective method for sentiment analysis. This research is the first to establish the patterns according to which public opinion evolves in response to reports of scientific misconduct in the popular press.
The question still remains, however, whether sentiment expressed on Twitter regarding future cases of misconduct will accurately reflect overall public sentiment. Prior research has demonstrated that the Twitter medium most effectively influences or reflects public response with respect to high-volume events or crises . And some research has even suggested superiority to traditional polling [ ] in some respects. For this study, the case covered was considered to be one of the largest and most impactful cases of scientific misconduct in recent memory [ ]. Moreover, this case is the first and only major scientific misconduct case to occur in an era where social media coverage and documentation is so ubiquitous. Indeed, much of the initial concerns and evidence regarding STAP originated in social media [ - ]. And recent research and commentary on evolving mass media trends suggests that social media is increasingly becoming both an initiator and driver of public attention and news cycles [ ]. Consequently, we expect the impact of future cases of major scientific misconduct to be generalizable, using social media metrics in the fashion demonstrated here [ , ].
The text- and sentiment-analysis procedures employed in this study were robust and well-validated. The reported metrics are limited by the analytical processes that were used to derive them from the text. In this case, SentiWordNet was used to obtain sentiment scores. Reported sentiment scores are thus limited by the accuracy and precision of the SentiWordNet database with respective material covered. In addition, volume estimations were based on and limited by the distribution characteristics of the sample obtained from the data provider. Furthermore, the reported metrics are estimations, as is the case with all sampling-based analytical approaches. That having been said, the analytical and data retrieval methods used are well established and have been verified to be sufficiently robust for such analyses [, ]. Future studies would benefit from larger sample sizes and more precise sentiment estimation methods; however, based on previous studies, improvements are expected to be marginal.
This study represents the first objective analysis of public response to a major case of scientific misconduct. This study observes and tracks changes in public sentiment over a 15-month sequence of events associated with the STAP cell case, which was one of the most publicized cases of major scientific misconduct in recent memory. Here, we demonstrated that public response to this particular case tended to be generally neutral or of mixed composition, particularly during times of lower public attention. This was observed in the large majority of months covered in this study. Also observed was that sentiment tended to skew negative as discussion polarity and volume increased. These findings are generally consistent with those observed in the literature with respect to major events across a wide range of topics, including entertainment, sports, business, politics, and even natural disasters. These findings support the notion that changes in public sentiment toward any major event—cases of scientific misconduct included—might be as much a function of the attention received as it is a function of the theme or merits of any specific case. As the saying goes, “no news is good news”—and this study demonstrates this quite clearly. Once the STAP story becomes tainted by allegations of misconduct, increases in public attention—driven mostly by the public relations (PR) efforts of the respective actors—consistently corresponded with increases in overall negativity. The only event that broke this trend was one of the only events not staged for publicity—the apparent suicide of a key stakeholder. Here, we observed a clear and significant positive shift in overall sentiment; however, this was also accompanied by a notable subsequent decrease in volume. Overall, these results strongly suggest that, in cases of research misconduct, public opinion—and by extension, public policy—is likely to be more influenced by negative-leaning news and reporting. Academic researchers, policy makers, and those with associated interests are advised to carefully consider the implications.
Conflicts of Interest
Multimedia Appendix 1
A summary timeline.JPG File, 800KB
- Becker H, Naaman M, Gravano L. Columbia University Libraries. 2011. Beyond Trending Topics: Real-World Event Identification on Twitter URL: https://academiccommons.columbia.edu/catalog/ac:135415 [accessed 2017-03-22] [WebCite Cache]
- Phuvipadawat S, Murata T. Breaking news detection and tracking in Twitter. 2010 Presented at: Proceedings of the IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology; 2010; New York. [CrossRef]
- Kent ML. Using social media dialogically: public relations role in reviving democracy. Public Relat Rev 2013 Nov;39(4):337-345. [CrossRef]
- Auger GA. Fostering democracy through social media: evaluating diametrically opposed nonprofit advocacy organizations’ use of Facebook, Twitter, and YouTube. Public Relat Rev 2013 Nov;39(4):369-376. [CrossRef]
- Berthon PR, Pitt LF, Plangger K, Shapiro D. Marketing meets web 2.0, social media, and creative consumers: Implications for international marketing strategy. Bus Horiz 2012 May;55(3):261-271. [CrossRef]
- Murphy J, Link MW, Childs JH, Tesfaye CL, Dean E, Stern M, et al. Social media in public opinion research: executive summary of the Aapor task force on emerging technologies in public opinion research. Public Opin Q 2014 Nov 25;78(4):788-794. [CrossRef]
- Culotta A, Kumar N, Cutler J. Illinois Institute of Technology. 2015. Predicting the demographics of Twitter users from website traffic data URL: http://www.cs.iit.edu/~culotta/pubs/culotta15predicting.pdf [accessed 2016-05-09] [WebCite Cache]
- Mislove A, Lehmann S, Ahn Y, Onnela J, Rosenquist J. Understanding the demographics of Twitter users. 2011 Presented at: Proceedings of the International AAAI Conference on Web and Social Media; 2011; Menlo Park URL: http://www.aaai.org/ocs/index.php/ICWSM/ICWSM11/paper/view/2816
- O'Connor B, Balasubramanyan R, Routledge B, Smith N. From tweets to polls: linking text sentiment to public opinion time series. 2010 Presented at: the International AAAI Conference on Weblogs and Social Media;11(2); 2010; Washington DC p. 122-129 URL: http://www.aaai.org/ocs/index.php/ICWSM/ICWSM10/paper/view/1536
- Vis F. Twitter as a reporting tool for breaking news. Digit Journal 2013 Feb;1(1):27-47. [CrossRef]
- Kwak H, Lee C, Park H, Moon S. What is Twitter, a social network or a news media? 2013 Presented at: WWW '10 Proceedings of the 19th international conference on World wide web; April 26 - 30, 2010; Raleigh, NC URL: http://dl.acm.org/citation.cfm?id=1772751
- Petrovic S, Osborne M, Mccreadie R, Macdonald C, Ounis I. Can Twitter replace newswire for breaking news? In: International AAAI Conference on Web and Social Media, North America, Jun. 2013 Presented at: Seventh International AAAI Conference on Weblogs and Social Media; July 8– 10, 2013; Cambridge URL: http://www.aaai.org/ocs/index.php/ICWSM/ICWSM13/paper/view/6066
- Killough K. University of Windsor. 2008. Changing the narrative: how media sensationalism affects public policy and how activists can use it to their advantage URL: http://scholar.uwindsor.ca/etd/4628/ [accessed 2017-04-05] [WebCite Cache]
- Ahern KR, Sosyura D. Rumor has it: sensationalism in financial media. Rev Financ Stud 2015 Jan 24;28(7):2050-2093. [CrossRef]
- Johnston CD, Bartels BL. Sensationalism and sobriety differential media exposure and attitudes toward American courts. Public Opin Q 2010 Feb 10;74(2):260-285. [CrossRef]
- Molek-Kozakowska K. Towards a Pragma-linguistic framework for the study of sensationalism in news headlines. Discourse & Communication 2013;7(2):173-197.
- Ransohoff DF, Ransohoff RM. Sensationalism in the media: when scientists and journalists may be complicit collaborators. Eff Clin Pract 2001;4(4):185-188. [Medline]
- Lilford RJ, Braunholtz D. For debate: the statistical basis of public policy: a paradigm shift is overdue. BMJ 1996 Sep 07;313(7057):603-607. [CrossRef]
- Otten AL. The influence of the mass media on health policy. Health Affairs 1992 Nov 01;11(4):111-118. [CrossRef]
- Miller S. Public understanding of science at the crossroads. Public Understand Sci 2001 Jan 26;10(1):115-120. [CrossRef]
- Stern AM, Casadevall A, Steen RG, Fang FC. Financial costs and personal consequences of research misconduct resulting in retracted publications. eLife Internet 2014;3:e02956. [CrossRef]
- Michalek AM, Hutson AD, Wicher CP, Trump DL. The costs and underappreciated consequences of research misconduct: a case study. PLoS Med 2010;7(8):e1000318 [FREE Full text] [CrossRef] [Medline]
- Suda M. Netsuzo no kagakusha : Sutappu saibo jiken (Scientific Misconduct: the STAP Scandal). Tokyo, Japan: Bungeishunju Ltd; 2015.
- Thelwall M, Buckley K, Paltoglou G. Sentiment in Twitter events. J Am Soc Inf Sci 2010 Dec 06;62(2):406-418. [CrossRef]
- Riken. 2014. Riken Press Releases URL: http://www.riken.jp/en/pr/press/2014/ [accessed 2017-03-22] [WebCite Cache]
- Riken. 2015. Riken press releases URL: http://www.riken.jp/en/pr/press/2015/ [accessed 2016-04-28] [WebCite Cache]
- Cyranoski D. Collateral damage: how a case of misconduct brought a leading Japanese biology institute to its knees. Nature 2015 Apr 30;520(7549):600-603. [CrossRef] [Medline]
- Thomson H. New Scientist Internet. 2014 Jul 2. Acid-bath stem cell papers are finally retracted URL: https://www.newscientist.com/article/dn25831-acid-bath-stem-cell-papers-are-finally-retracted/ [accessed 2016-05-09] [WebCite Cache]
- Lancaster C. The acid test for biological science: STAP cells, trust, and replication. Sci Eng Ethics 2016 Feb;22(1):147-167. [CrossRef] [Medline]
- Topsy. Twitter search, monitoring, & analytics URL: https://web.archive.org/web/20150331010859/http://topsy.com/ [accessed 2016-05-09] [WebCite Cache]
- Wilkinson D, Thelwall M. Researching personal information on the public web: methods and ethics. Soc Sci Comput Rev 2010 Aug 17;29(4):387-401. [CrossRef]
- Russell Neuman W, Guggenheim L, Mo Jang S, Bae SY. The dynamics of public attention: agenda-setting theory meets big data. J Commun 2014 Mar 26;64(2):193-214. [CrossRef]
- RStudio. URL: https://www.rstudio.com/ [accessed 2016-05-09] [WebCite Cache]
- Liew WT, Adhitya A, Srinivasan R. Sustainability trends in the process industries: a text mining-based analysis. Comput Ind 2014 Apr;65(3):393-400. [CrossRef]
- Guru D, Suhil M. A novel term_class relevance measure for text categorization. Procedia Computer Science 2015;45:13-22. [CrossRef]
- Abilhoa WD, de Castro LN. A keyword extraction method from Twitter messages represented as graphs. Appl Math Comput 2014 Aug;240:308-325. [CrossRef]
- Gebre B, Zampieri M, Wittenburg P, Heskes T. Proceedings of the Eighth Workshop on Innovative Use of NLP for Building Educational Applications. 2013. Improving native language identification with TF-IDF weighting URL: http://pubman.mpdl.mpg.de/pubman/faces/viewItemOverviewPage.jsp?itemId=escidoc:1740046:12 [accessed 2015-11-10] [WebCite Cache]
- Srivastava AN, Sahami M. Text Mining: Classification, Clustering, and Applications. London: Chapman & Hall/CRC; 2009.
- Baccianella S, Esuli A, Sebastiani F. NMIS. 2010. SentiWordNet 3: an enhanced lexical resource for sentiment analysis and opinion mining URL: http://nmis.isti.cnr.it/sebastiani/Publications/LREC10.pdf [accessed 2016-05-09] [WebCite Cache]
- Annett M, Kondrak G. A comparison of sentiment analysis techniques: polarizing movie blogs. In: Advances in Artificial Intelligence. New York: Springer; 2008:25-35.
- Bhadane C, Dalal H, Doshi H. Sentiment analysis: measuring opinions. Procedia Computer Science 2015;45:808-814. [CrossRef]
- Thelwall M, Buckley K. Topic-based sentiment analysis for the social web: the role of mood and issue-related words. J Am Soc Inf Sci Tec 2013 Jun 19;64(8):1608-1617. [CrossRef]
- Ben-Hur A, Weston J. A user's guide to support vector machines. Methods Mol Biol 2010;609:223-239. [CrossRef] [Medline]
- Guyon I, Weston J, Barnhill S, Vapnik V. Gene selection for cancer classification using support vector machines. Mach Learn 2002;46(1-3):389-422. [CrossRef]
- Salazar D, Vélez J, Salazar J. Comparison between SVM and logistic regression: which one is better to discriminate? Rev Colomb Estad 2012;35(2):223-237 [FREE Full text]
- Martin-Barragan B, Lillo R, Romo J. Interpretable support vector machines for functional data. Eur J Oper Res 2014 Jan;232(1):146-155. [CrossRef]
- Obokata H, Sasai Y, Niwa H, Kadota M, Andrabi M, Takata N, et al. Bidirectional developmental potential in reprogrammed cells with acquired pluripotency. Nature 2014 Jan 30;505(7485):676-680. [CrossRef] [Medline]
- Obokata H, Wakayama T, Sasai Y, Kojima K, Vacanti MP, Niwa H, et al. Stimulus-triggered fate conversion of somatic cells into pluripotency. Nature 2014 Jan 30;505(7485):641-647. [CrossRef] [Medline]
- Riken. 2014 Jan 29. Stress turns ordinary cells pluripotent URL: http://www.riken.jp/~/media/riken/pr/topics/2014/20140702_1/140702_1_1-en.pdf [accessed 2016-05-09] [WebCite Cache]
- PubPeer. 2014 Jan 29. Stimulus-triggered fate conversion of somatic cells into pluripotency URL: https://pubpeer.com/publications/24476887 [accessed 2016-05-09] [WebCite Cache]
- Thomson H. New Scientist. 2014 Feb 5. Extraordinary stem cell method tested in human tissue URL: https://www.newscientist.com/article/dn25004-extraordinary-stem-cell-method-tested-in-human-tissue/ [accessed 2016-05-13] [WebCite Cache]
- Cyranoski D. Nature Internet. 2014 Feb 17. Acid-bath stem-cell study under investigation URL: http://www.nature.com/doifinder/10.1038/nature.2014.14738 [accessed 2017-03-22] [WebCite Cache]
- Niwa H, Obokata H, Sasai Y, Niwa H. Essential technical tips for STAP cell conversion culture from somatic cells. Protocol Exchange 2014 Mar 5. [CrossRef]
- Martin A, Naik G. Wall Str J. 2014 Mar 10. Japanese institute weighs retracting stem-cell studies URL: http://www.wsj.com/news/articles/SB10001424052702304020104579430600241800532 [accessed 2016-05-09] [WebCite Cache]
- Riken. 2014 Mar 14. Interim report on the investigation of the Obokata URL: http://www.riken.jp/en/pr/press/2014/20140314_1/ [accessed 2016-05-05] [WebCite Cache]
- Riken. 2014 Apr 1. Report on STAP cell research paper investigation URL: http://www.riken.jp/en/pr/press/2014/20140401_2/ [accessed 2016-05-05] [WebCite Cache]
- Cyranoski D. Biologist defiant over stem-cell method. Nature 2014 Apr 17;508(7496):299. [CrossRef] [Medline]
- Editorial. Agency for change. Nature 2014 May 1;509(7498):8. [CrossRef] [Medline]
- Japan Times. 2014 May 28. Embattled STAP cell scientist Obokata to retract research paper URL: http://www.japantimes.co.jp/news/2014/05/28/national/science-health/embattled-stap-cell-scientist-obokata-retract-research-paper [accessed 2016-05-05] [WebCite Cache]
- Cyranoski D. Nature. 2014 Jun 17. Gene tests suggest acid-bath stem cells never existed URL: http://www.nature.com/doifinder/10.1038/nature.2014.15425 [accessed 2017-03-22] [WebCite Cache]
- Normile D. Science. 2014 Jun 4. Key researcher agrees to retract both disputed stem cell papers internet URL: http://www.sciencemag.org/news/2014/06/key-researcher-agrees-retract-both-disputed-stem-cell-papers [accessed 2016-05-09] [WebCite Cache]
- Normile D. Science. 2014 Jun 12. Japanese stem cell debacle could bring down center Internet URL: http://www.sciencemag.org/news/2014/06/japanese-stem-cell-debacle-could-bring-down-center [accessed 2016-05-09] [WebCite Cache]
- Obokata H, Wakayama T, Sasai Y, Kojima K, Vacanti MP, Niwa H, et al. Retraction: stimulus-triggered fate conversion of somatic cells into pluripotency. Nature 2014 Jul 3;511(7507):112. [CrossRef] [Medline]
- Obokata H, Sasai Y, Niwa H, Kadota M, Andrabi M, Takata N, et al. Retraction: bidirectional developmental potential in reprogrammed cells with acquired pluripotency. Nature 2014 Jul 3;511(7507):112. [CrossRef] [Medline]
- Japan Times. 2014 Jul 24. Obokata injured while fleeing pack of NHK reporters, lawyer says URL: http://www.japantimes.co.jp/news/2014/07/24/national/obokata-injured-fleeing-pack-nhk-reporters-lawyer-says/ [accessed 2016-05-05] [WebCite Cache]
- Retraction Watch. 2014 Apr 8. Waseda University checking dissertations for plagiarism in wake of STAP stem cell misconduct finding Internet URL: http://retractionwatch.com/2014/04/08/waseda-university-checking-dissertations-for-plagiarism-in-wake-of-stap-stem-cell-misconduct-finding/ [accessed 2016-05-09] [WebCite Cache]
- Cyranoski D. Nature. 2014 Aug 13. Stem-cell pioneer blamed media “bashing” in suicide note URL: http://www.nature.com/news/stem-cell-pioneer-blamed-media-bashing-in-suicide-note-1.15715 [accessed 2017-03-22] [WebCite Cache]
- Science. 2014 Aug 27. In Japan, official effort to replicate STAP stem cells comes up empty URL: http://www.sciencemag.org/news/2014/08/japan-official-effort-replicate-stap-stem-cells-comes-empty [accessed 2016-05-13] [WebCite Cache]
- Vacanti CA, Kojima K. Web.archive. 2014 Sep 14. Revised STAP cell protocol URL: https://web.archive.org/web/20141219103753/https://research.bwhanesthesia.org/site_assets/51520d191eea6679ce000001/cterm/Revised_STAP_protocol-28bcd7e61d02a23624eb590717e241fe.pdf [accessed 2016-05-13] [WebCite Cache]
- Endo TA. Quality control method for RNA-seq using single nucleotide polymorphism allele frequency. Genes Cells 2014 Nov;19(11):821-829 [FREE Full text] [CrossRef] [Medline]
- Martin A. WSJ. 2014 Oct 7. Japanese University may strip stem-cell scientist of doctorate URL: http://www.wsj.com/articles/japanese-university-may-strip-stem-cell-scientist-of-doctorate-1412683955 [accessed 2016-05-09] [WebCite Cache]
- Lies E. Reuters. 2014 Dec 18. Disgraced Japan researcher fails to replicate 'game changing' stem cell results URL: http://www.reuters.com/article/us-japan-science-scandal-idUSKBN0JX0B820141219 [accessed 2016-05-09] [WebCite Cache]
- Gallagher J. BBC News Internet. 2014 Dec 19. Stem cell scandal scientist Haruko Obokata resigns URL: http://www.bbc.com/news/health-30534674 [accessed 2016-05-09] [WebCite Cache]
- Normile D. Science. 2015 Feb 10. RIKEN announces penalties related to stem cell fiasco URL: http://www.sciencemag.org/news/2015/02/riken-announces-penalties-related-stem-cell-fiasco [accessed 2016-05-09] [WebCite Cache]
- Rasko J, Power C. The Guardian. 2015 Feb 18. What pushes scientists to lie? the disturbing but familiar story of Haruko Obokata URL: https://www.theguardian.com/science/2015/feb/18/haruko-obokata-stap-cells-controversy-scientists-lie [accessed 2016-04-25] [WebCite Cache]
- Japan Times. 2015 Mar 17. Riken won't sue Obokata over STAP cell scandal URL: http://www.japantimes.co.jp/news/2015/03/17/national/crime-legal/riken-wont-sue-obokata-over-stap-cell-scandal/ [accessed 2016-05-05] [WebCite Cache]
- Nose T. Web.archive. 2015 Mar 19. Riken to get Obokata to return portion of research funds over stem cell scandal URL: https://web.archive.org/web/20151213214710/http://ajw.asahi.com/article/behind_news/social_affairs/AJ201503190077 [accessed 2016-05-09] [WebCite Cache]
- Strauss A, Corbin JM. Grounded Theory in Practice. London: SAGE; 1997.
- Letierce J, Passant A, Breslin J, Decker S. Understanding how Twitter is used to spread scientific messages. 2010 Presented at: Proceedings of the WebSci10: Extending the Frontiers of Society On-Line; 2010; Raleigh, NC URL: http://journal.webscience.org/314/
- Shuai X, Pepe A, Bollen J. How the scientific community reacts to newly submitted preprints: article downloads, Twitter mentions, and citations. PLoS One 2012;7(11):e47523 [FREE Full text] [CrossRef] [Medline]
- Parliament.uk. 2000 Feb 23. Select committee on science and technology third report URL: http://www.publications.parliament.uk/pa/ld199900/ldselect/ldsctech/38/3802.htm [WebCite Cache]
- Miller S. Public understanding of science at the crossroads. Public Understand Sci 2001 Jan 26;10(1):115-120. [CrossRef]
- Wilkinson D, Thelwall M. Trending Twitter topics in english: an international comparison. J Am Soc Inf Sci Tec 2012 Jul 02;63(8):1631-1646. [CrossRef]
- Tsunoda F. Isshi taizai o shasu : Rikugun Daijin Anami Korechika [a biography of an imperial army general Korechika Anami]. Tokyo, Japan: Shinchosha; 1980.
- Spitzer K. Time. 2014 Aug 8. Science scandal triggers suicide, soul-searching in Japan URL: http://time.com/3091584/japan-yoshiki-sasai-stem-cells-suicide-haruko-obokata/ [accessed 2016-05-05] [WebCite Cache]
- Sugawara Y, Tanimoto T, Miyagawa S, Murakami M, Tsuya A, Tanaka A, et al. Scientific misconduct and social media: role of twitter in the stimulus triggered acquisition of pluripotency cells scandal. J Med Internet Res 2017 Feb 28;19(2):e57 [FREE Full text] [CrossRef] [Medline]
- Chung S, Shih C, Huang C. Can collective sentiment expressed on twitter predict political elections? 2011 Presented at: Twenty-Fifth AAAI Conf Artif Intell Internet; 2011; San Francisco URL: http://www.aaai.org/ocs/index.php/AAAI/AAAI11/paper/view/3549 [CrossRef]
- Bollen J, Pepe A, Mao H. Arxiv. 2009 Nov 8. Modeling public mood and emotion: Twitter sentiment and socio-economic phenomena URL: http://arxiv.org/abs/0911.1583 [accessed 2017-03-22] [WebCite Cache]
- PubPeer. 2014 Feb 5. Stimulus-triggered fate conversion of somatic cells into pluripotency URL: https://pubpeer.com/publications/8B755710BADFE6FB0A848A44B70F7D#fb6119 [accessed 2016-05-09] [WebCite Cache]
- Stapcell. Haruko Obokata, STAP stem cells URL: http://stapcell.blogspot.com/ [accessed 2016-05-09] [WebCite Cache]
- Retraction Watch. 2014 Sep 10. “Truly extraordinary,” “simply not credible,” “suspiciously sharp:” a STAP stem cell peer review report revealed URL: http://retractionwatch.com/2014/09/10/truly-extraordinary-simply-not-credible-suspiciously-sharp-a-stap-stem-cell-peer-review-report-revealed/ [accessed 2016-05-09] [WebCite Cache]
- Knoepfler lab. The Niche. 2014 Jan 29. Review of Obokata stress reprogramming Nature papers Internet URL: http://www.ipscell.com/2014/01/review-of-obokata-stress-reprogramming-nature-papers/ [accessed 2016-05-09] [WebCite Cache]
- Kwak H, Lee C, Park H, Moon S. What is Twitter, a social network or a news media? 2010 Presented at: Proceedings of the 19th international conference on World wide web; 2010; New York URL: http://dl.acm.org/citation.cfm?id=1772751
- Schultz F, Utz S, Göritz A. Is the medium the message? perceptions of and reactions to crisis communication via twitter, blogs and traditional media. Public Relat Rev 2011 Mar;37(1):20-27. [CrossRef]
|ANOVA: analysis of variance|
|ATP: adenosine triphosphate|
|BBC: British Broadcasting Corporation|
|CNN: Cable News Network|
|HSD: honest significant difference|
|PR: public relations|
|SNS: social network services|
|STAP: stimulus-triggered acquisition of pluripotency|
|SVM: support vector machine|
|TF-IDF: term frequency-inverse document frequency|
Edited by G Eysenbach; submitted 17.05.16; peer-reviewed by D Broniatowski, D Fanelli; comments to author 21.08.16; revised version received 11.11.16; accepted 07.03.17; published 20.04.17Copyright
©Alberto Gayle, Motomu Shimaoka. Originally published in JMIR Public Health and Surveillance (http://publichealth.jmir.org), 20.04.2017.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Public Health and Surveillance, is properly cited. The complete bibliographic information, a link to the original publication on http://publichealth.jmir.org, as well as this copyright and license information must be included.