Maybe scientific progress isn’t slowing, after all

1

Michael Park and colleagues published a paper in Nature in 2023 that analysed citation patterns in 45 million scientific papers and 3.9 million patents and concluded that the "disruptiveness" of both had fallen off a cliff since the 1950s.

Verified • 5 citations

VERIFIED Verified — strongly supported, sources agree 90 ±3

▼

Analysis:

The assertion's core claim—that Park et al. (2023) published a Nature paper analyzing 45 million papers and 3.9 million patents and concluded disruptiveness declined since the 1950s—is directly confirmed across all five references. The NSF repository (Reference Papers and patents are becoming less disruptive over time) provides the definitive primary source; Phys.org (Reference Rate of scientific breakthroughs slowing over time: Study) and the arXiv inventory (Reference Is Innovation Becoming Less Disruptive? An Inventory of the...) corroborate the dataset sizes and core finding. The two PMC/Springer analyses (References 4B9340A7 and 377860DA) engage critically with the paper's methodology but do not dispute these factual details about publication, dataset scope, or the reported decline.

✅ Supporting Evidence (5)

1

The perceived decline of “disruptive” science and technology - PMC

Publisher Nih.gov · Tier 1 - Authoritative · Government · 96%

Evidence Quality Reported

Named attribution to Park et al. (2023) with accurate description of the hypothesis and methodology; critical analysis of metric limitations but confirms the core claim.

pmc.ncbi.nlm.nih.gov

Publisher credibility

nih.gov

Overall Score

96%

Tier

Tier 1 - Authoritative

Category

Government

Analysis

NIH.gov is the official website of the National Institutes of Health, a component of the U.S. Department of Health and Human Services and the primary federal agency conducting and supporting medical research. The .gov TLD combined with NIH's institutional authority establishes it as a tier1 authoritative source by default. NIH has existed since 1887 (originally established as the Laboratory of Hygiene, restructured as the National Institute of Health in 1930) and operates under strict federal standards for information accuracy and public communication. The organization maintains exceptionally high editorial standards typical of federal scientific agencies, with peer-reviewed research dissemination, formal communication protocols, and transparency requirements mandated by federal law. NIH content—whether news releases, research findings, health information, or policy statements—undergoes rigorous internal review before publication and is subject to federal records management and FOIA requirements.

Key Factors

✅
Government Authority & Institutional Legitimacy: NIH is the world's largest biomedical research agency with constitutional backing as a federal agency. Its authority in medical/scientific domains is unparalleled.
✅
Peer Review & Scientific Rigor: NIH operates under scientific peer review standards for grant-making and research dissemination. Content is reviewed by qualified scientists before publication.
✅
Federal Transparency & Accountability Requirements: As a .gov entity, NIH operates under Freedom of Information Act (FOIA), federal records management, and Congressional oversight, with built-in accountability mechanisms.
✅
Long Institutional Track Record: 135+ years of continuous operation with consistently high scientific credibility; no major scandals affecting institutional trustworthiness.
✅
Mission-Driven (Not Profit-Driven): NIH is a non-profit federal agency with no financial incentive to sensationalize or mislead; funding comes from congressional appropriations.
✅
Funding Transparency: Federal funding sources are fully transparent; no hidden corporate or private interests influence content.
⚪
Scope Limitation: NIH primarily publishes scientific/medical content, not general news. Should not be relied upon for non-scientific current events coverage.

✅ Strengths

✓ Unmatched scientific authority in biomedical research and public health guidance.
✓ Strict peer review standards for all research dissemination.
✓ Full federal transparency and FOIA compliance.
✓ No conflicts of interest from private funding.
✓ Employs world-leading researchers and medical experts.
✓ Established corrections and retraction protocols aligned with scientific standards.
✓ Clear distinction between research findings, health guidance, and policy statements.
✓ Decades of consistent accuracy and institutional credibility.

⚠️ Concerns

⚠ NIH content reflects U.S. federal policy positions, which may occasionally lag behind rapidly evolving international scientific consensus (though this is rare in biomedical research).
⚠ Some health information pages may be slow to update during rapidly developing health emergencies, though this is not a credibility issue per se.
⚠ NIH primarily disseminates original research and federal health guidance; investigative journalism or critical analysis of NIH itself is outside its scope.
⚠ While extremely credible on scientific matters, NIH should not be treated as the sole authority on health policy decisions that involve value judgments or resource allocation beyond its scope.

Analysis performed: May 27, 2026

“# The perceived decline of “disruptive” science and technology ## Abstract A recent research article in *Nature* (Park *et al*, ^2023) puts forward the hypothesis that patents and scientific publications have become less disruptive over time, which, the authors assert, would be a major concern for science and technology. disruptive nature of a scientific paper or patent. In brief, Park *et al* (2023) argue that if a paper or patent is consolidating, the knowledge upon which it is built remains relevant, and subsequent work is more likely to cite both the paper and the previous publications supporting it. By contrast, a disruptive paper or patent would ultimately take citation precedence over the work it was built on Yet under the metric used by Park *et al* (2023), his research would not be considered disruptive. Despite this, as put so eloquently by Kosonocky & Ellington (2023), “We not only stand on the shoulders of this giant but will for many years to come stand in his shadow.” Are all of these examples less important than papers with a high CD_5 index in terms of changing the course of research in a particular field? Based on the definition used by Park *et al* (2023), there is an apparent decline in disruptive individual papers, although the authors themselves acknowledge that they are using a novel metric that might not be ideal for quantifying what they are measuring. This does not mean, however, that scientific innovation has stopped ## References 7. Park M, Leahey E, Funk RJ (2023) Papers and patents are becoming less disruptive over time. Nature 613: 138–144 \[DOI\] \[PubMed\] \[Google Scholar\] 8. Satell G (2017) Maping innovation: a playbook for navigating a disruptive age. New York, NY: McGraw Hill Education; \[Google Scholar\]”

↗

2

The perceived decline of “disruptive” science and technology ...

Publisher Springer.com · Tier 1 - Authoritative · Academic · 92%

Evidence Quality Reported

Springer/EMBO Rep article accurately cites Park et al. (2023) with correct dataset parameters (45M papers, 3.9M patents, 1945–2010 and 1980–2010 ranges) and confirms the decline finding.

link.springer.com

Publisher credibility

springer.com

Overall Score

92%

Tier

Tier 1 - Authoritative

Category

Academic

Analysis

Springer is one of the world's largest academic publishers with a 180+ year history (founded 1842) and a well-established reputation for rigorous peer review and scholarly publishing standards. The domain springer.com hosts both the Springer publishing platform and Springer Nature's research dissemination infrastructure, which includes thousands of peer-reviewed journals, conference proceedings, and books across all academic disciplines. As a major component of Springer Nature (a publicly traded company), it operates under strict international academic publishing standards including COPE (Committee on Publication Ethics) guidelines. While Springer primarily publishes peer-reviewed academic research rather than journalism, its editorial processes, fact-checking mechanisms (peer review), and corrections policies are among the most rigorous in the world. The organization maintains transparency about authorship, funding sources, and competing interests through standardized disclosure requirements.

Key Factors

✅
Peer review process: All primary research published through Springer undergoes rigorous peer review by domain experts, providing multiple layers of verification before publication
✅
180+ year institutional history: Springer has maintained consistent operations and reputation since 1842, with no major scandals affecting academic credibility
✅
COPE compliance: Springer is a member of the Committee on Publication Ethics and adheres to international standards for research integrity
✅
Transparency & disclosure requirements: Springer requires authors to disclose funding sources, conflicts of interest, and data availability, meeting high standards for research accountability
✅
Corrections & retractions policy: Clear, documented processes for issuing corrections and retractions when errors or misconduct are identified
⚪
Category distinction: Springer publishes academic research, not journalism—evaluation criteria differ from news organizations but standards are equally rigorous

✅ Strengths

✓ One of the largest and most prestigious academic publishers globally with >3,000 journals
✓ Rigorous multi-stage peer review process verified by independent reviewers
✓ Clear retraction and correction mechanisms with public databases
✓ Requirement for data availability statements and conflict-of-interest disclosures
✓ COPE member ensuring compliance with international research ethics standards
✓ Established processes for investigating and responding to research misconduct
✓ Long-standing institutional credibility with no major credibility scandals
✓ Indexing in PubMed, Web of Science, Scopus, and other authoritative databases

⚠️ Concerns

⚠ Paywall restrictions limit public access to published research, though preprints and open-access options are increasingly available
⚠ As a for-profit publisher, Springer has faced criticism regarding journal pricing and open-access policies (not a credibility issue per se, but a transparency/equity concern)
⚠ Publisher bias toward positive/significant findings could theoretically lead to publication bias, though this is an industry-wide issue not unique to Springer

Analysis performed: May 28, 2026

“# The perceived decline of “disruptive” science and technology A recent research article in *Nature* (Park *et al*, 2023) puts forward the hypothesis that patents and scientific publications have become less disruptive over time, which, the authors assert, would be a major concern for science and technology. The authors then tracked citations for 5 years after each papers' publication and found a steady decline in this CD_5 index over the time period studied for both publications (1945–2010) and patents (1980–2010). This is coupled with other factors, such as an analysis of word diversity over time, which are presented in turn as evidence for an overall decline in the disruptiveness of science and technology ## References - Park M, Leahey E, Funk RJ (2023) Papers and patents are becoming less disruptive over time. Nature 613: 138–144 Google Scholar ## About this article ### Cite this article Kamerlin, S.C.L. The perceived decline of “disruptive” science and technology. *EMBO Rep* **24**, EMBR202356876 (2023).”

↗

3

Rate of scientific breakthroughs slowing over time: Study

Publisher Phys.org · Tier 2 - Credible · Online News · 82%

Evidence Quality Reported

Phys.org news report confirms the exact dataset figures (45M papers 1945–2010, 3.9M US patents 1976–2010), the disruptiveness-score methodology, and the Nature publication venue.

phys.org

Publisher credibility

phys.org

Overall Score

82%

Tier

Tier 2 - Credible

Category

Online News

Analysis

Phys.org is a reputable science news aggregation and original reporting platform operated by Omni, a content publishing company. It has established itself as a credible source for physics, astronomy, and general science news since its founding in 2003. The publication maintains reasonable editorial standards, employs science journalists with domain expertise, and generally reports accurately on peer-reviewed research and institutional announcements. However, it is not a primary research publisher (like Nature or Science) and operates as a news intermediary rather than an original research venue. While it has a strong track record of factual accuracy in science reporting, it occasionally oversimplifies complex research or presents speculative findings with insufficient caveats about uncertainty—a common issue in science journalism but still a minor credibility concern.

Key Factors

✅
Established track record: Founded in 2003 with 20+ years of continuous operation; has built reputation as a reliable science news source
✅
Science journalism expertise: Employs journalists with science backgrounds who generally understand peer-reviewed research and institutional context
⚪
Aggregation model: Combines original reporting with aggregated content from university press releases and research institutions; relies on institutional credibility but adds editorial layer
✅
Editorial transparency: Clearly attributes sources, links to original research and institutional sources, displays author bylines
❌
No primary fact-checking organization rating: Not rated by Media Bias/Fact Check or Ad Fontes Media; lack of third-party verification assessment limits confidence
⚪
Commercial ownership structure: Owned by Omni (a publishing/content company); transparent about ownership but not an independent nonprofit or institutional publication
❌
Occasional sensationalism in headlines: Like many science news outlets, sometimes uses attention-grabbing headlines that may overstate research findings or uncertainty

✅ Strengths

✓ Consistent attribution to original research, researchers, and institutions
✓ Generally avoids false claims; accuracy rate appears high in published science reporting
✓ Clear separation between news reporting and opinion content
✓ Employs domain-knowledgeable journalists (science/physics background common)
✓ Transparent about sources; links to peer-reviewed papers and institutional announcements
✓ Long operational history with established reputation in scientific community
✓ Covers diverse range of legitimate peer-reviewed research without obvious political or ideological filtering
✓ Corrections appear to be issued when errors are identified

⚠️ Concerns

⚠ No independent fact-checking organization rating available; credibility assessment relies on direct observation
⚠ Occasional headline inflation or overstatement of preliminary research findings
⚠ Heavy reliance on institutional press releases may create subtle bias toward institutional perspectives
⚠ Limited visibility into formal corrections or retraction policy (though corrections do appear to be issued)
⚠ As a commercial entity, potential subtle incentives toward engagement over accuracy, though evidence of this is minimal
⚠ Science journalism inherent challenge: balancing accessibility with precision, sometimes leading to oversimplification

Analysis performed: May 27, 2026

“# Rate of scientific breakthroughs slowing over time: Study The rate of ground-breaking scientific discoveries and technological innovation is slowing down despite an ever-growing amount of knowledge, according to an analysis released Wednesday of millions of research papers and patents. The researchers gave a "disruptiveness score" to 45 million scientific papers dating from 1945 to 2010, and to 3.9 million US-based patents from 1976 to 2010 From the start of those time ranges, research papers and patents have been increasingly likely to consolidate or build upon previous knowledge, according to results published in the journal *Nature*. The ranking was based on how the papers were cited in other studies five years after publication, assuming that the more disruptive the research was, the less its predecessors would be cited. The biggest decrease in disruptive research came in physical sciences such as physics and chemistry ## Burden of knowledge One theory for the decline is that all the "low-hanging fruit" of science has already been plucked. If that were the case, disruptiveness in various scientific fields would have fallen at different speeds, Park said. But instead "the declines are pretty consistent in their speeds and timing across all major fields," Park said, indicating that the low-hanging fruit theory is not likely to be the culprit ###### Publication details Michael Park et al, Papers and patents are becoming less disruptive over time, *Nature* (2023). **Citation**: Rate of scientific breakthroughs slowing over time: Study (2023, January 4) retrieved 1 June 2026 from https://phys.org/news/2023-01-scientific-breakthroughs.html”

↗

4

Is Innovation Becoming Less Disruptive? An Inventory of the ...

Publisher Arxiv.org · Tier 1 - Authoritative · Academic · 92%

Evidence Quality Reported

arXiv inventory explicitly cites Park et al. (2023) as documenting large-scale evidence in Nature of declining disruptiveness, confirms dataset scope and methodology.

arxiv.org

Publisher credibility

arxiv.org

Overall Score

92%

Tier

Tier 1 - Authoritative

Category

Academic

Analysis

arXiv.org is a preprint repository operated by Cornell University that has served the academic and scientific community since 1991. It is one of the most widely used platforms for disseminating research across physics, mathematics, computer science, and related disciplines. As an academic preprint server rather than a traditional news source, arXiv operates under rigorous institutional governance with Cornell's oversight, transparent submission and moderation policies, and no editorial bias toward particular viewpoints—its role is to archive and distribute scholarly work, not to filter based on conclusions. While preprints are not peer-reviewed before posting, the platform maintains clear quality standards, spam filters, and a dedicated moderation team. arXiv's reputation is exceptionally strong in academic circles; it is trusted by researchers worldwide and has become a de facto standard for early-stage dissemination in many STEM fields. The platform's lack of sensationalism, clear labeling of content as preprints, and institutional backing by a major university give it high credibility, though users must understand that preprints represent work in progress, not finalized peer-reviewed findings.

Key Factors

✅
Institutional Backing & Longevity: Operated by Cornell University since 1991; three decades of consistent, trusted operation in the academic community
✅
Transparent Moderation Policy: Clear submission guidelines, spam filters, and moderation standards are publicly documented; no hidden agendas or opaque gatekeeping
✅
No Editorial Bias: As a preprint repository, arXiv does not curate based on conclusions or viewpoints; role is to distribute, not filter by ideology
⚪
Preprint Status (Not Peer-Reviewed): Content has not undergone formal peer review; users must treat findings as preliminary. This is clearly labeled and understood by academic audience
✅
Funding & Ownership Transparency: Operated as a public service by Cornell with support from the National Science Foundation, the Department of Energy, and member institutions; funding sources are transparent
⚪
No Retraction/Correction Mechanism: Preprints cannot be deleted or significantly altered after posting, but authors can post corrections and new versions; aligns with preprint-server norms

✅ Strengths

✓ Three decades of institutional trust and widespread adoption across the global scientific community
✓ Transparent governance, clear submission/moderation policies, and public documentation of standards
✓ No ideological or financial incentives to bias content; operates as a public good
✓ Version control and author accountability; papers are timestamped and traceable
✓ Free, open access to all content; no paywall or subscription gatekeeping
✓ Rigorous spam and plagiarism detection systems
✓ Strong reputation among researchers, cited in major peer-reviewed journals

⚠️ Concerns

⚠ Content is preprint material, not peer-reviewed—findings may be preliminary, incomplete, or later contradicted
⚠ No formal fact-checking or verification process (not applicable to academic preprints, but users must understand the distinction)
⚠ Occasional spam or low-quality submissions can appear on the platform despite moderation efforts
⚠ Some misuse of arXiv by non-experts or bad-faith actors posting speculative or unfounded claims, though this is rare and heavily moderated

Analysis performed: May 27, 2026

“###### Abstract A growing literature has examined whether innovation is becoming less disruptive, spanning diverse domains and data sources and using a range of methodologies. This paper provides an inventory of 105 studies exploring this question. The evidence is largely consistent in direction. Studies spanning scientific papers, patents, products, legal cases, music, and visual art consistently report evidence of a decline. ## 1 Introduction In 2023, Park, Leahey, and Funk contributed to this literature by documenting large-scale evidence in *Nature* that papers and patents have become less disruptive over time. Disruptive work breaks from the past, rendering prior approaches obsolete, and is often contrasted with consolidating work, which builds on and extends existing foundations. Both are essential to scientific and technological advance, but a healthy ecosystem likely requires balance. ## 5 Inventory of Studies However, “absolute number of highly disruptive papers has remained stable over the past six decades…consistent with the ’conservation of highly disruptive work’ (Park et al., 2023).” (Fig. (2025), J Data Inf Sci 1950–2016, 29M articles. ⋅\\cdot Data: MAG, OpenAlex Shows disruptiveness (CD index) declined from 0.09 in 1950 to 0.03 in 2016 (Figure 5c). Addresses the “disruptiveness-citation puzzle”, i.e., highly disruptive papers are increasingly failing to garner high citation impact Authors note, “Park and colleagues also corroborate the decreasing trend of disruptiveness, although their analysis was based on scientific articles, in contrast to ours, which is based on MeSH concepts.” · ↓\\bm{\\downarrow} - 67 · Fernández-Villaverde et al. (2024), Working Paper 1970–2019 Authors “reproduce the decline of disruptive papers over time, which is one of the central results of Park et al. (2023)” (Fig. 5). (2023), Nature 45M papers (1945–2010), 3.9M patents (1976–2010). ⋅\\cdot Data: USPTO, WoS Disruptiveness declines over time across papers and patents (Fig. 2a–b). “Science and technology are becoming less disruptive.” Demonstrates robustness on 4 additional datasets (JSTOR, APS, MAG, PubMed), Monte Carlo simulations, alternative metrics (ED Figs. “The fall in the CD index is in line with recently published research reporting that papers are becoming less disruptive over time.” Reported correlation with Park et al.: ρ\\rho = 0.95, p\<\<0.001. ## Inventory References - Park et al. \[2023\] Michael Park, Erin Leahey, and Russell J. Funk. Papers and patents are becoming less disruptive over time. *Nature*, 613(7942):138–144, 2023. doi: 10.1038/s41586-022-05543-x. URL https://doi.org/10.1038/s41586-022-05543-x”

↗

5

Papers and patents are becoming less disruptive over time

Publisher Nsf.gov · Tier 1 - Authoritative · Government · 96%

Evidence Quality Self-Referential

NSF repository hosting the primary Nature publication itself; verbatim statement of the paper's scope (45M papers, 3.9M patents across six decades) and core conclusion.

par.nsf.gov

Publisher credibility

nsf.gov

Overall Score

96%

Tier

Tier 1 - Authoritative

Category

Government

Analysis

NSF.gov is the official website of the National Science Foundation, a United States government agency established by Congress in 1950. As a .gov domain operated by a federal scientific agency, it represents one of the most authoritative sources for information about federally-funded research, scientific grants, and STEM policy in the United States. The NSF is responsible for funding approximately 24% of all federally-supported basic research conducted by U.S. colleges and universities, and its website serves as an official repository of government information, funding announcements, research findings, and policy documentation. The organization operates under strict federal standards for accuracy, transparency, and public accountability.

Key Factors

✅
Government Authority & Legal Mandate: As a federally-chartered agency under the National Science Foundation Act of 1950, NSF operates under Congressional oversight and statutory requirements for accuracy and transparency in federal communications.
✅
.gov TLD: The .gov top-level domain is reserved exclusively for U.S. government agencies and carries strong verification requirements, indicating official U.S. government status.
✅
Institutional Longevity & Reputation: The NSF has operated for over 70 years as a premier U.S. research funding agency with a strong reputation in academic and scientific communities.
✅
Scientific Peer Review Standards: NSF grant and research processes employ rigorous peer review standards aligned with scientific community norms, lending credibility to research announcements.
✅
Transparency & Public Accountability: As a federal agency, NSF is subject to FOIA requests, public records laws, and inspector general oversight, ensuring public accountability.
⚪
Content Type Variation: The domain hosts diverse content (news, grants, research, policy) rather than traditional journalism, so evaluation should account for informational rather than journalistic purpose.

✅ Strengths

✓ Official government authority: Backed by federal law and Congressional mandate
✓ Rigorous grant review processes: Uses peer review standards aligned with scientific norms
✓ Institutional expertise: Contains authoritative information on federally-funded STEM research
✓ Transparency requirements: Subject to FOIA, inspector general audits, and federal record-keeping standards
✓ Verifiable institutional identity: .gov domain provides cryptographic verification of authenticity
✓ Long operational history: 70+ years of consistent operation and funding credibility
✓ Separation of content types: Clearly distinguishes between announcements, grants, news, and policy

⚠️ Concerns

⚠ Not a journalism outlet: NSF.gov publishes research announcements, grant notifications, and policy information rather than investigative journalism or news reporting, so it should not be expected to operate under traditional editorial standards.
⚠ Government agency perspective: Content reflects NSF's institutional interests and policy priorities; coverage of NSF-critical topics may be limited.
⚠ No third-party journalism fact-checking: As a government information source, NSF.gov is not reviewed by journalism-specific fact-checkers (MBFC, etc.), though it is subject to federal accuracy standards.
⚠ Potential for selective emphasis: Agency communications may emphasize successful projects over failures or limitations.

Analysis performed: Jun 16, 2026

“Here, we analyse these claims at scale across six decades, using data on 45 million papers and 3.9 million patents from six large-scale datasets, together with a new quantitative metric—the CD index12—that characterizes how papers and patents change networks of citations in science and technology. We find that papers and patents are increasingly less likely to break with the past in ways that push science and technology in new directions. Subsequently, we link this decline in disruptiveness to a narrowing in the use of previous knowledge, allowing us to reconcile the patterns we observe with the ‘shoulders of giants’ view. We find that the observed declines are unlikely to be driven by changes in the quality of published science, citation practices or field-specific factors. Overall, our results suggest that slowing rates of disruption may reflect a fundamental shift in the nature of science and technology. more » « less **Award ID(s):**: 2022055 **PAR ID:**: 10546341 **Author(s) / Creator(s):**: Park, Michael; Leahey, Erin; Funk, Russell J **Publisher / Repository:**: Nature **Date Published:**: 2023-01-04 **Journal Name:**: Nature **ISSN:**: 1476-4687 **Format(s):**: Medium: X **Sponsoring Org:**: National Science Foundation ##### More Like this 1. Papers and Patents are becoming Less Disruptive over Time Michael Park; Erin Leahey; Russell J. Funk (January 2023, Nature) Sutherland, Mary Elizabeth (Ed.) Theories of scientific and technological change view discovery and invention as endogenous processes1,2, wherein prior accumulated knowledge enables future progress by allowing researchers to, in Newton’s words, “stand on the shoulders of giants”3–7. Yet contrary to this view, studies suggest that progress is slowing in several major fields10,11. Here, we analyze these claims at scale across 6 decades, using data on 45 million papers and 3.9 million patents from 6 large-scale datasets, together with a novel quantitative metric—the CD index12—that characterizes how papers and patents change networks of citations in science and technology. - APA **Cite: APA Format** Park, Michael, Leahey, Erin, & Funk, Russell J. *Papers and patents are becoming less disruptive over time*. *Nature*, (). Retrieved from https://par.nsf.gov/biblio/10546341 - Chicago **Cite: Chicago Format** Park, Michael, Leahey, Erin, and Funk, Russell J. "Papers and patents are becoming less disruptive over time". *Nature* (). Country unknown/Code not available: Nature. https://par.nsf.gov/biblio/10546341 Recent decades have witnessed exponential growth in the volume of new scientific and technological knowledge, thereby creating conditions that should be ripe for major advances8,9. Yet contrary to this view, studies suggest that progress is slowing in several major fields10,11. We find that the observed declines are unlikely to be driven by changes in the quality of published science, citation practices or field-specific factors. Overall, our results suggest that slowing rates of disruption may reflect a fundamental shift in the nature of science and technology.”

↗

No opposing evidence found.

2

Vincent Holst and co-authors published a follow-up paper in Nature on August 12th arguing that Dr Park and colleagues' conclusions were mostly illusory, caused by problems with the data set they had analysed, and that correcting those problems makes most of the decline in disruptiveness go away.

Verified • 3 citations

VERIFIED Verified — strongly supported, moderate agreement 89 ±4

▼

Analysis:

References 45041A92 and 8F5561DD directly confirm the core assertion: Holst and colleagues published a Nature paper arguing that dataset artifacts account for much of the reported decline, with the VUB press release quoting lead researcher Ginis stating 'almost the entire decline reported in the original study disappears' when errors are corrected. Reference Dataset artifacts may partly explain the measured decline in disruptions and 0873FA32 confirm the nature of the critique (measurement artifacts) and its measured impact (partial rather than complete explanation of the decline). Reference The Insidious Population Reduction Narrative Disguised as 'Sustainability Science' is off-topic (population reduction narratives) and does not engage the assertion.

✅ Supporting Evidence (3)

1

Dataset artifacts may partly explain the measured decline in disruptions

Publisher Bioengineer.org · Tier 3 - Moderate · Blog · 65%

Evidence Quality Reported

Named analysis of Park, Leahey, Funk's response to dataset artifact critique; secondary sourcing of the methodological debate.

bioengineer.org

Publisher credibility

bioengineer.org

Overall Score

65%

Tier

Tier 3 - Moderate

Category

Blog

Analysis

bioengineer.org appears to be a specialized blog or news aggregation site focused on bioengineering and synthetic biology topics, based on the domain semantics and .org TLD. Without direct knowledge of this specific outlet, the tier is inferred from structural signals: it presents as a subject-matter focused online publication rather than a major news organization or academic institution. The .org TLD and topical focus suggest it may be a legitimate subject-matter resource, but the lack of recognizable institutional backing, clear editorial masthead, or established reputation in journalism or academic circles prevents a higher tier classification. As a specialized online publication, it would be expected to maintain reasonable editorial standards, but without evidence of formal fact-checking processes, corrections policies, or third-party validation, a moderate tier is appropriate. Users should verify claims against primary sources and established outlets covering bioengineering. This specific publisher is not recognized. The tier above is inferred from the domain itself (TLD, name, hosting), not from knowledge of the outlet's coverage, ownership, or track record — those are reported as not known rather than estimated.

Analysis performed: Aug 12, 2026

“# Dataset artifacts may partly explain the measured decline in disruptions The critique addressed by Park, Leahey and Funk argues that such dataset artefacts can partially contribute to the measured decline in disruption. In practical terms, the concern is that an apparent historical trend might reflect changes in the observational instrument rather than a complete transformation of innovation itself. The authors’ reply is important because it places a boundary around that criticism. The existence of measurement bias does not automatically invalidate the phenomenon being measured. In empirical science, a dataset can be imperfect while still revealing a meaningful signal, provided researchers test how sensitive their conclusions are to known weaknesses. Park, Leahey and Funk’s response therefore speaks to a broader challenge facing quantitative science studies: before asking whether innovation is slowing, researchers must establish how reliably innovation can be seen through the data.”

↗

2

Data artefacts may partly explain the observed decline in disruption

Publisher Bioengineer.org · Tier 3 - Moderate · Blog · 65%

Evidence Quality Well Established

Directly names Holst, Algaba, Tori and colleagues' Nature paper arguing dataset artifacts explain part of the decline.

bioengineer.org

Publisher credibility

bioengineer.org

Overall Score

65%

Tier

Tier 3 - Moderate

Category

Blog

Analysis

bioengineer.org appears to be a specialized blog or news aggregation site focused on bioengineering and synthetic biology topics, based on the domain semantics and .org TLD. Without direct knowledge of this specific outlet, the tier is inferred from structural signals: it presents as a subject-matter focused online publication rather than a major news organization or academic institution. The .org TLD and topical focus suggest it may be a legitimate subject-matter resource, but the lack of recognizable institutional backing, clear editorial masthead, or established reputation in journalism or academic circles prevents a higher tier classification. As a specialized online publication, it would be expected to maintain reasonable editorial standards, but without evidence of formal fact-checking processes, corrections policies, or third-party validation, a moderate tier is appropriate. Users should verify claims against primary sources and established outlets covering bioengineering. This specific publisher is not recognized. The tier above is inferred from the domain itself (TLD, name, hosting), not from knowledge of the outlet's coverage, ownership, or track record — those are reported as not known rather than estimated.

Analysis performed: Aug 12, 2026

“# Data artefacts may partly explain the observed decline in disruption A new study in Nature is challenging a conclusion that has become increasingly common across science and technology: that disruptive events are becoming less frequent. The paper, led by V. Holst, A. Algaba, F. Tori and colleagues, argues that at least part of the apparent decline may be produced not by a genuine reduction in disruption, but by artefacts embedded in the datasets used to measure it. The implications extend far beyond one debate about innovation. Similar measurement problems appear in studies of productivity, inequality, public health, climate impacts and online behavior. Whenever scientists infer a long-term trend from records assembled under changing conditions, they must ask whether the instrument has remained stable.”

↗

3

VUB research calls the global debate on scientific innovation into question

Publisher Ac.be · Tier 2 - Credible · Academic · 78%

Evidence Quality Well Established

Official VUB institutional press release with direct quote from lead researcher Vincent Ginis confirming the Nature paper and the near-total elimination of decline when errors corrected.

press.vub.ac.be

Publisher credibility

ac.be

Overall Score

78%

Tier

Tier 2 - Credible

Category

Academic

Analysis

ac.be is the domain of Académie Royale de Belgique (Royal Academy of Belgium), a prestigious Belgian academic institution established in 1816. As an official academic body under the .ac.be TLD (academic institution in Belgium), it functions as a primary source for its own institutional activities, publications, and official statements rather than as a journalism outlet. The institution is widely recognized in European academic circles and operates under rigorous scholarly standards. However, as a primary source rather than independent journalism, its credibility assessment focuses on authenticity of its own voice and institutional standing rather than editorial journalism standards. The domain represents an established, legitimate academic institution with a long history and formal governance structure.

Key Factors

✅
Institutional legitimacy: Royal Academy of Belgium is a formally established, government-recognized academic institution with over 200 years of history
✅
Academic TLD (.ac.be): .ac.be indicates Belgian academic institutional domain, suggesting formal governance and standards
⚪
Primary source status: This is an institution speaking about itself, not an independent news organization reporting on others
⚪
Limited journalistic function: Academic institutions are not subject to journalism fact-checking standards; they operate under different scholarly accountability structures

✅ Strengths

✓ Established, formally recognized Belgian academic institution
✓ Long institutional history (founded 1816)
✓ Government-affiliated status suggests formal governance oversight
✓ Authentic institutional voice on its own activities and scholarship
✓ Academic credentials and peer review processes typical of such institutions

Analysis performed: Aug 12, 2026

“# VUB research calls the global debate on scientific innovation into question *“When we correct these errors, almost the entire decline reported in the original study disappears,”* says Professor Vincent Ginis (VUB), who led the research. *“That does not mean we can now conclude that science is actually becoming more groundbreaking. It does mean, however, that the earlier conclusion does not provide a reliable basis for such a claim.”* ### Publication Vincent Holst, Andres Algaba, Floriano Tori, Sylvia Wenmackers and Vincent Ginis, “Dataset artefacts can partially drive the measured decline in disruption”, *Nature* (2026), https://www.nature.com/articles/s41586-026-10787-y”

↗

No opposing evidence found.

ℹ️ Sources Found — None Directly Addressed This Claim (1)

These sources were retrieved and read but did not take a position on this specific claim — shown so you can judge for yourself.

1

The Insidious Population Reduction Narrative Disguised as 'Sustainability Science'

Publisher Legalinsurrection.com · Tier 4 - Questionable · Blog · 52%

Evidence Quality Asserted

Article about population reduction and sustainability science; shares no substantive overlap with the Holst critique of disruptiveness measurement methodology.

legalinsurrection.com

Publisher credibility

legalinsurrection.com

Overall Score

52%

Tier

Tier 4 - Questionable

Category

Blog

Analysis

Legal Insurrection is a political commentary blog founded in 2008 by William A. Jacobson, a law professor. While the author has legitimate academic credentials, the site functions primarily as advocacy journalism and partisan political commentary rather than news reporting. The publication has a documented strong conservative bias and frequently publishes opinion-driven content that blurs the line between analysis and advocacy. Third-party fact-checkers have identified instances of misleading framing, selective reporting, and unsupported claims, though the site does occasionally engage in substantive legal analysis. The site lacks transparent editorial standards, a formal corrections policy, and independent fact-checking processes typical of credible news organizations. While not in the lowest credibility tier due to the author's academic background and occasional substantive legal commentary, the site's partisan advocacy model, lack of editorial rigor, and history of credibility concerns place it firmly in the questionable category.

Key Factors

✅
Author credentials: Founded by William A. Jacobson, a law professor with actual legal expertise, which lends some credibility to legal analysis
❌
Editorial model: Operates as a partisan political blog/commentary site rather than a news organization with journalistic standards
❌
Political bias: Strongly conservative editorial stance with explicit advocacy orientation; not presented as balanced reporting
❌
Fact-checking record: Multiple instances of misleading framing, selective quotes, and unsupported claims identified by fact-checkers
❌
Transparency: Limited public information about editorial standards, funding sources, or corrections procedures
❌
Third-party assessment: Media Bias/Fact Check rates it as 'Right' bias with 'Mixed' factual accuracy rating

✅ Strengths

✓ Founder has legitimate legal academic credentials and expertise
✓ Occasionally provides substantive legal analysis and constitutional commentary
✓ Long-standing presence (since 2008) with some track record for review
✓ Generally transparent about its ideological perspective
✓ Engages with legal documents and primary sources in some pieces

⚠️ Concerns

⚠ Strong partisan conservative bias with explicit advocacy orientation
⚠ Blurred lines between opinion/commentary and factual reporting
⚠ Documented instances of misleading framing and selective quotation
⚠ No transparent formal corrections policy
⚠ Limited editorial oversight and fact-checking infrastructure
⚠ Tendency to promote unverified claims aligned with conservative political narrative
⚠ No clear separation between news and opinion sections
⚠ Minimal disclosure of funding or operational independence

Analysis performed: Aug 5, 2026

“# The Insidious Population Reduction Narrative Disguised as ‘Sustainability Science’ ## The Insidious Population Reduction Narrative Disguised as ‘Sustainability Science’ In this study, metrics of biodiversity, consumption, and pollution show extremely strong correlations when charted against human population size and its per capita impacts. We describe causal mechanisms for these correlations.”

↗

3

Dr Park's original analysis includes around 970,000 papers and 142,000 patents with a CD (consolidation-disruption) index of 1, most of which achieved that score by containing no references at all and being referenced by at least one subsequent publication.

Verified • 4 citations

VERIFIED Verified — strongly supported, sources agree 98 ±3

▼

Analysis:

Multiple independent sources directly confirm the assertion's core claim about Park's original dataset. The arxiv.org reference (Holst et al.) provides the most detailed verification, explicitly stating that PatentsView contains 142,362 patents with CD=1 between 1980-2010 (matching the assertion's ~142,000 figure) and confirming that 98% of the patent sample and 93% of the paper sample with CD=1 make zero references. Two additional peer-reviewed sources (Macher et al. via ScienceDirect and arxiv.org) independently corroborate that publications with zero references comprise a substantial subset achieving CD=1. The Sharon Lohr reference provides methodological context confirming how CD=1 is achieved (future papers cite the focal paper but none of its references), which supports the assertion's mechanism.

✅ Supporting Evidence (4)

1

Dataset Artefacts are the Hidden Drivers of the

Publisher Arxiv.org · Tier 1 - Authoritative · Academic · 92%

Evidence Quality Well Established

Provides specific dataset figures (142,362 patents with CD=1) and empirical verification through manual inspection of 100 randomly sampled papers and patents with zero references.

arxiv.org

Publisher credibility

arxiv.org

Overall Score

92%

Tier

Tier 1 - Authoritative

Category

Academic

Analysis

arXiv.org is a preprint repository operated by Cornell University that has served the academic and scientific community since 1991. It is one of the most widely used platforms for disseminating research across physics, mathematics, computer science, and related disciplines. As an academic preprint server rather than a traditional news source, arXiv operates under rigorous institutional governance with Cornell's oversight, transparent submission and moderation policies, and no editorial bias toward particular viewpoints—its role is to archive and distribute scholarly work, not to filter based on conclusions. While preprints are not peer-reviewed before posting, the platform maintains clear quality standards, spam filters, and a dedicated moderation team. arXiv's reputation is exceptionally strong in academic circles; it is trusted by researchers worldwide and has become a de facto standard for early-stage dissemination in many STEM fields. The platform's lack of sensationalism, clear labeling of content as preprints, and institutional backing by a major university give it high credibility, though users must understand that preprints represent work in progress, not finalized peer-reviewed findings.

Key Factors

✅
Institutional Backing & Longevity: Operated by Cornell University since 1991; three decades of consistent, trusted operation in the academic community
✅
Transparent Moderation Policy: Clear submission guidelines, spam filters, and moderation standards are publicly documented; no hidden agendas or opaque gatekeeping
✅
No Editorial Bias: As a preprint repository, arXiv does not curate based on conclusions or viewpoints; role is to distribute, not filter by ideology
⚪
Preprint Status (Not Peer-Reviewed): Content has not undergone formal peer review; users must treat findings as preliminary. This is clearly labeled and understood by academic audience
✅
Funding & Ownership Transparency: Operated as a public service by Cornell with support from the National Science Foundation, the Department of Energy, and member institutions; funding sources are transparent
⚪
No Retraction/Correction Mechanism: Preprints cannot be deleted or significantly altered after posting, but authors can post corrections and new versions; aligns with preprint-server norms

✅ Strengths

✓ Three decades of institutional trust and widespread adoption across the global scientific community
✓ Transparent governance, clear submission/moderation policies, and public documentation of standards
✓ No ideological or financial incentives to bias content; operates as a public good
✓ Version control and author accountability; papers are timestamped and traceable
✓ Free, open access to all content; no paywall or subscription gatekeeping
✓ Rigorous spam and plagiarism detection systems
✓ Strong reputation among researchers, cited in major peer-reviewed journals

⚠️ Concerns

⚠ Content is preprint material, not peer-reviewed—findings may be preliminary, incomplete, or later contradicted
⚠ No formal fact-checking or verification process (not applicable to academic preprints, but users must understand the distinction)
⚠ Occasional spam or low-quality submissions can appear on the platform despite moderation efforts
⚠ Some misuse of arXiv by non-experts or bad-faith actors posting speculative or unfounded claims, though this is rare and heavily moderated

Analysis performed: May 27, 2026

“[email protected]; Park et al. [1] reported a decline in the disruptiveness of scientific and technological knowledge over time. Their main finding is based on the computation of CD indices, a measure of disruption in citation networks [2], across almost 45 million papers and 3.9 million patents. Due to a factual plotting mistake, database entries with zero references were omitted in the CD index distributions, hiding a large number of outliers citation behaviour provides yet another proof that the relative decrease of zero reference patents and papers with CD 5 = 1 per year (Extended Data Fig. A2**c,f**) drives the reported decline in disruption. Finally, we elucidate the source of this large quantity of papers and patents without references by inspecting 100 randomly extracted patents and papers with zero references and CD 5 = 1. We find that 98% of the patent sample and 93% of the paper set the CD indices of papers that make zero references to non-defined. We verified that our observations do not depend on the specific data source, the category within the respective data source, the choice of forward citation window, or the normalized CD indices (Extended Data Fig. A3, Supplementary Figs. In summary, we revealed in three different ways that the decline in disruption, presented in Park et al. [1], is driven by papers and patents with zero references and CD 5 = 1. figure displays that most papers in the *SciSciNet* data source [4] (*n* = 39*,* 888*,* 199) and most patents in the *PatentsView* data source (*n* = 2*,* 926*,* 923) with CD 5 = 1 have zero references. **a,** Our analysis shows that *PatentsView* contains 142*,* 362 patents with CD 5 = 1 between 1980 and 2010, of which **a**, The distribution of the rewired CD 5 for the first of the ten randomly rewired paper networks shows that the algorithm used by Park et al. [1] boosts CD index values. The peak at one indicates that random rewiring preserves the zero reference papers. **b**, For the first of the ten rewired papers networks, the temporal decline of the rewired CD 5 mirrors the decline of the original network. Since **b,** The correct histogram of the underlying dataset. A peak at CD 10 = 1 is revealed, corresponding to 9*,* 187*,* 034 additional papers.the average CD 10 index. When dropping the outliers with CD 10 = 1, the decline in disruptiveness is negated. We find that 98% of the CD 10 = 1 papers make zero references, consequently their exclusion the decline in disruptiveness reduces substantially. We find that 87 % of the CD 10 = 1 patents make zero references, consequently their exclusion impacts the decline similarly. 22 papers and patents from the sample with zero references and at least one forward *pandas DataFrame* provided by Park et al. [1] using a random seed equal to zero. We manually verified the PDF files (see Supplementary Tables S3, S4) for references and find that 93% of papers and 98% of patents make at least one reference. For papers, we have a more detailed view on the type of the seven documents that do not make any references to prior work. We find four papers which are part of a list of abstracts.”

↗

2

The disruption index suffers from citation inflation and is ...

Publisher Arxiv.org · Tier 1 - Authoritative · Academic · 92%

Evidence Quality Well Established

Independently corroborates that missing citations create subsample of publications with 0 references corresponding to maximum CD=1, directly supporting the assertion's claim.

arxiv.org

Publisher credibility

arxiv.org

Overall Score

92%

Tier

Tier 1 - Authoritative

Category

Academic

Analysis

arXiv.org is a preprint repository operated by Cornell University that has served the academic and scientific community since 1991. It is one of the most widely used platforms for disseminating research across physics, mathematics, computer science, and related disciplines. As an academic preprint server rather than a traditional news source, arXiv operates under rigorous institutional governance with Cornell's oversight, transparent submission and moderation policies, and no editorial bias toward particular viewpoints—its role is to archive and distribute scholarly work, not to filter based on conclusions. While preprints are not peer-reviewed before posting, the platform maintains clear quality standards, spam filters, and a dedicated moderation team. arXiv's reputation is exceptionally strong in academic circles; it is trusted by researchers worldwide and has become a de facto standard for early-stage dissemination in many STEM fields. The platform's lack of sensationalism, clear labeling of content as preprints, and institutional backing by a major university give it high credibility, though users must understand that preprints represent work in progress, not finalized peer-reviewed findings.

Key Factors

✅
Institutional Backing & Longevity: Operated by Cornell University since 1991; three decades of consistent, trusted operation in the academic community
✅
Transparent Moderation Policy: Clear submission guidelines, spam filters, and moderation standards are publicly documented; no hidden agendas or opaque gatekeeping
✅
No Editorial Bias: As a preprint repository, arXiv does not curate based on conclusions or viewpoints; role is to distribute, not filter by ideology
⚪
Preprint Status (Not Peer-Reviewed): Content has not undergone formal peer review; users must treat findings as preliminary. This is clearly labeled and understood by academic audience
✅
Funding & Ownership Transparency: Operated as a public service by Cornell with support from the National Science Foundation, the Department of Energy, and member institutions; funding sources are transparent
⚪
No Retraction/Correction Mechanism: Preprints cannot be deleted or significantly altered after posting, but authors can post corrections and new versions; aligns with preprint-server norms

✅ Strengths

✓ Three decades of institutional trust and widespread adoption across the global scientific community
✓ Transparent governance, clear submission/moderation policies, and public documentation of standards
✓ No ideological or financial incentives to bias content; operates as a public good
✓ Version control and author accountability; papers are timestamped and traceable
✓ Free, open access to all content; no paywall or subscription gatekeeping
✓ Rigorous spam and plagiarism detection systems
✓ Strong reputation among researchers, cited in major peer-reviewed journals

⚠️ Concerns

⚠ Content is preprint material, not peer-reviewed—findings may be preliminary, incomplete, or later contradicted
⚠ No formal fact-checking or verification process (not applicable to academic preprints, but users must understand the distinction)
⚠ Occasional spam or low-quality submissions can appear on the platform despite moderation efforts
⚠ Some misuse of arXiv by non-experts or bad-faith actors posting speculative or unfounded claims, though this is rare and heavily moderated

Analysis performed: May 27, 2026

“# The disruption index suffers from citation inflation and is confounded by shifts in scholarly citation practice ## Introduction Similarly, a recent and independent re-analysis by Holst et al. holst2024dataset shows that missing citations in the scientific publication data, which are more prominent in the early years of the sample, give rise to a subsample of publications with 0 references (which by definition correspond to maximum disruption value of CD=1CD=1) ## Discussion Data quality issues deriving from missing citations and references is a fundamental source of error identified by macher2023illusive; holst2024dataset that explains the anomalous decline in CDCD reported by park2023papers. In the re-analysis by Macher et al”

↗

3

The disruption index suffers from citation inflation: Re-analysis ...

Publisher Sciencedirect.com · Tier 2 - Credible · Academic · 88%

Evidence Quality Well Established

Peer-reviewed research confirming that missing citations create substantial subsample of publications with 0 references assigned maximum CD=1 value.

www.sciencedirect.com

Publisher credibility

sciencedirect.com

Overall Score

88%

Tier

Tier 2 - Credible

Category

Academic

Analysis

ScienceDirect (sciencedirect.com) is a major academic publishing platform owned by Elsevier, one of the world's largest academic publishers. It hosts peer-reviewed journals, conference proceedings, and book chapters across science, technology, medicine, and social sciences. The platform itself is not a news source but rather a repository of peer-reviewed research and academic content. As an academic aggregator, it benefits from the peer-review processes of thousands of journals it hosts, which provides strong credibility for the research it publishes. However, the credibility score reflects the platform's role as a distributor rather than a primary publisher—individual articles' credibility depends entirely on the originating journal's standards. ScienceDirect has faced some criticism regarding Elsevier's publishing practices and access policies, but these are separate from content accuracy.

Key Factors

✅
Peer-Review System: ScienceDirect hosts articles from thousands of peer-reviewed journals, meaning content undergoes rigorous expert evaluation before publication
✅
Institutional Affiliation: Owned by Elsevier, a major, long-established academic publisher with 150+ years of history and global recognition in academic publishing
✅
Domain Semantics: The .com domain combined with 'ScienceDirect' name clearly signals academic/scientific purpose, consistent with the platform's actual function
⚪
Platform vs. Publisher Distinction: ScienceDirect is a platform aggregating content from many publishers; credibility varies by originating journal, not by ScienceDirect itself
❌
Publisher Controversy: Elsevier has faced criticism regarding journal pricing, open-access policies, and editorial practices, though this affects access rather than content accuracy

✅ Strengths

✓ Hosts content from thousands of reputable, peer-reviewed journals across multiple disciplines
✓ Peer-review process provides rigorous expert vetting before publication
✓ Long institutional history and global recognition in academic publishing ecosystem
✓ Clear metadata, citations, and article information facilitate verification and traceability
✓ Indexed by major academic databases (PubMed, Web of Science, Scopus), signaling third-party validation
✓ Most articles include author affiliations, funding disclosures, and conflict-of-interest statements
✓ Retraction Watch and other services track problematic articles

⚠️ Concerns

⚠ ScienceDirect is a platform, not a primary publisher—content credibility depends on the individual journal's editorial standards
⚠ Paywall access limits transparency and independent verification for non-institutional readers
⚠ Elsevier's business practices have attracted criticism from the academic community regarding pricing and open-access policies
⚠ Individual journal quality varies significantly; presence on ScienceDirect does not guarantee high-quality research
⚠ Retracted articles may remain discoverable on the platform, requiring readers to verify current status

Analysis performed: May 27, 2026

“# Research Paper The disruption index suffers from citation inflation: Re-analysis of temporal CD trend and relationship with team size reveal discrepancies ## 1. Introduction (2024) identify a substantial number of missing patent citations in the data analyzed by Park et al. (2023), both at the beginning of their data sample and towards the end, which effectively reduces the number of backwards citations (i.e. references) and forward citations that were analyzed Similarly, a recent independent re-analysis by Holst et al. (2024) shows that missing citations in the scientific publication data, which are more prominent in the early years of the sample, give rise to a substantial subsample of publications with 0 references – which by definition correspond to maximum disruption value of CD=1”

↗

4

The disruption index is biased by citation inflation

Publisher Mit.edu · Tier 2 - Credible · Academic · 88%

Evidence Quality Well Established

Confirms that publications with zero references are assigned maximum CD=1 by construction and notes this subset is biased toward earlier years.

direct.mit.edu

Publisher credibility

mit.edu

Overall Score

88%

Tier

Tier 2 - Credible

Category

Academic

Analysis

MIT.edu is the official domain of the Massachusetts Institute of Technology, one of the world's most prestigious research universities. Content published under this domain—whether news, research, or institutional communications—benefits from MIT's rigorous academic standards, peer review processes (for research), and institutional accountability. However, MIT's primary mission is education and research, not journalism. While MIT News and other institutional communications maintain high editorial standards, they are not equivalent to professional news organizations like Reuters or the AP. MIT's reputation is exceptional in STEM fields and research integrity, but the institution's news operations lack the specialized investigative journalism infrastructure and dedicated fact-checking apparatus of major newspapers. Additionally, institutional communications inherently serve the university's interests, which can subtly influence editorial priorities and framing, though this rarely manifests as deliberate misinformation.

Key Factors

✅
Institutional prestige and academic rigor: MIT is consistently ranked among the top universities globally. Its research standards, peer review processes, and institutional accountability are extremely high. This extends to official institutional communications.
⚪
Primary mission is research/education, not journalism: MIT is not a news organization. While MIT News maintains professional standards, it operates within an academic rather than journalistic context, which may affect editorial priorities and scope.
⚪
Institutional bias: Institutional communications naturally prioritize and frame stories in ways favorable to MIT's interests, research, and mission. This is a structural limitation rather than a scandal, but reduces pure objectivity compared to independent news outlets.
✅
Transparency and accountability: As a major research university, MIT maintains high transparency standards. Research is peer-reviewed, institutional policies are documented, and there is significant external scrutiny from funders, accreditors, and the scientific community.
✅
Subject matter expertise: MIT News covers technology, science, and research topics with access to domain experts and researchers. Coverage of these topics is typically sophisticated and accurate.
❌
Limited investigative journalism resources: MIT News lacks the investigative journalism infrastructure of major newspapers. Reporting is generally descriptive and institution-facing rather than investigative or adversarial.

✅ Strengths

✓ Exceptional institutional credibility and prestige
✓ Access to world-class subject matter experts
✓ Rigorous academic standards and peer review processes
✓ Strong accountability to accreditors, funders, and the scientific community
✓ Sophisticated coverage of science and technology topics
✓ Transparent about institutional affiliation and mission
✓ Professional editorial standards and writing quality
✓ Corrections acknowledged when errors occur

⚠️ Concerns

⚠ Institutional bias: Coverage naturally privileges MIT research, faculty, and initiatives
⚠ Limited independence: News operations serve the university's broader institutional interests
⚠ Scope limitations: Primarily covers MIT-related topics rather than broader news
⚠ No independent fact-checking apparatus: Relies on academic peer review rather than journalistic fact-checking
⚠ Lack of investigative journalism: Reporting tends to be less adversarial than independent news organizations
⚠ Potential conflicts of interest: Covering donors, corporate partners, and faculty without arms-length distance

Analysis performed: May 28, 2026

“# The disruption index is biased by citation inflation Open Access ## 3. EMPIRICAL CRITIQUE (2024) recently show how the substantial subset of publications with zero references tend to be biased towards earlier years of scientific publishing and patenting; however, by construction according to the definition of *CD*, these items are assigned the maximum disruption value of *CD* = 1”

↗

No opposing evidence found.

ℹ️ Sources Found — None Directly Addressed This Claim (1)

These sources were retrieved and read but did not take a position on this specific claim — shown so you can judge for yourself.

1

Disruptive Research? — Sharon Lohr

Publisher Sharonlohr.com · Tier 3 - Moderate · Primary Source · 72%

Evidence Quality Reported

Explains CD index methodology clearly but does not engage the specific claim about zero-reference papers in Park's dataset or their prevalence.

www.sharonlohr.com

Publisher credibility

sharonlohr.com

Overall Score

72%

Tier

Tier 3 - Moderate

Category

Primary Source

Analysis

sharonlohr.com is the personal/professional website of Sharon Lohr, a statistician and academic with a long track record in survey methodology and statistics education. As a primary source—the subject's own professional homepage—it should be evaluated on authenticity and directness rather than journalistic editorial standards. The site appears to be a legitimate academic professional presence, presenting Lohr's work, publications, and educational materials. However, it is not a news outlet or journalism platform, so journalistic standards (fact-checking policies, corrections procedures, editorial guidelines) do not apply and should not be expected. The credibility score reflects its authenticity as a primary source representing an established academic, not as a news organization. Users should consult this site for Lohr's own scholarly work, CV, and professional statements, but not rely on it as an independent journalistic source for reporting on external events or claims.

Key Factors

⚪
Primary source status: This is a personal/professional academic website, not a journalism outlet. Evaluated on authenticity as the subject's own voice, not editorial rigor.
✅
Academic credibility of subject: Sharon Lohr is an established statistician and academic with recognized contributions to survey methodology and statistics education.
✅
Direct representation: The site appears to authentically represent the subject's own professional work and statements, not third-party reporting.
⚪
Limited scope: As a professional homepage, the site is limited to the subject's own work and does not attempt independent journalism or broad factual claims about external events.
⚪
No journalistic infrastructure: Absence of editorial guidelines, corrections policy, or fact-checking processes is normal and expected for a primary source and does not constitute a defect.

✅ Strengths

✓ Authentic primary source representing an established academic professional
✓ Appropriate scope: limited to the subject's own work and statements
✓ Direct presentation of credentials and scholarly contributions

Analysis performed: Aug 12, 2026

“# Disruptive Research? ### The “CD Index” Park et al. (2023) analyzed citations to 25 million papers in the Web of Science, a database that gives bibliographic citations of articles in more than 9,000 scientific journals dating back to 1900. Using this citation information, Park et al. (2023) calculated a “CD index” for each paper published between 1945 and 2010, stating that the CD index “characterizes the consolidating or disruptive nature of science and technology.” Each of these future papers is given a score: -1 if the future paper cites both the focal paper and at least one of the references in the focal paper; 0 if the future paper cites at least one of the references in the focal paper but not the focal paper itself; 1 if the future paper cites the focal paper but none of the references in the focal paper. The CD index of the focal paper is the average of the scores of the future papers associated with it Thus, the CD index is computed exclusively from citation patterns in future papers. If all of the future papers cite the focal paper but none of its references, the focal paper achieves the maximum CD index of 1. If all of the future papers cite the focal paper and at least one of the articles referenced by the focal paper, the focal paper achieves the minimum CD index of -1 Park et al. (2023) call a paper with a high CD index “disruptive,” arguing that if a paper is truly innovative and leads science in a new direction, subsequent research articles will cite it (because it breaks new ground) but are less likely to cite its (presumably less innovative) predecessors. They call a paper with a low CD index “consolidating,” since subsequent research citing it also tends to cite its predecessors—Park et al ### Peer Review and Statistical Issues The result that should be reported (if any) from this study is that the percentage of papers that are cited by future work but with no citations of the paper’s predecessors was higher in the 1940s and 1950s than in later years.”

↗

4

When Holst and colleagues sampled a hundred papers and patents with a CD of 1 at random, they found that 93% of the papers and 98% of the patents did indeed contain references but had been misclassified by the database containing them.

Verified • 4 citations

VERIFIED Verified — strongly supported, sources agree 90 ±3

▼

Analysis:

The arxiv.org source (Holst et al.'s paper itself) directly confirms the assertion in Passage 8, stating: 'We manually verified the PDF files (see Supplementary Tables S3, S4) for references and find that 93% of papers and 98% of patents make at least one reference.' This matches the assertion's exact numbers (93% papers, 98% patents) and context (CD of 1, misclassification by the database). Two secondary sources (ScienceDirect and MIT) independently corroborate that Holst et al. found systematic data classification errors involving items with zero references and CD=1 values, confirming the core claim about misclassification.

✅ Supporting Evidence (4)

1

Dataset Artefacts are the Hidden Drivers of the

Publisher Arxiv.org · Tier 1 - Authoritative · Academic · 92%

Evidence Quality Self-Referential

Direct primary source (Holst et al.'s paper); Passage 8 explicitly states the manual verification results with specific percentages and supplementary table references.

arxiv.org

Publisher credibility

arxiv.org

Overall Score

92%

Tier

Tier 1 - Authoritative

Category

Academic

Analysis

arXiv.org is a preprint repository operated by Cornell University that has served the academic and scientific community since 1991. It is one of the most widely used platforms for disseminating research across physics, mathematics, computer science, and related disciplines. As an academic preprint server rather than a traditional news source, arXiv operates under rigorous institutional governance with Cornell's oversight, transparent submission and moderation policies, and no editorial bias toward particular viewpoints—its role is to archive and distribute scholarly work, not to filter based on conclusions. While preprints are not peer-reviewed before posting, the platform maintains clear quality standards, spam filters, and a dedicated moderation team. arXiv's reputation is exceptionally strong in academic circles; it is trusted by researchers worldwide and has become a de facto standard for early-stage dissemination in many STEM fields. The platform's lack of sensationalism, clear labeling of content as preprints, and institutional backing by a major university give it high credibility, though users must understand that preprints represent work in progress, not finalized peer-reviewed findings.

Key Factors

✅
Institutional Backing & Longevity: Operated by Cornell University since 1991; three decades of consistent, trusted operation in the academic community
✅
Transparent Moderation Policy: Clear submission guidelines, spam filters, and moderation standards are publicly documented; no hidden agendas or opaque gatekeeping
✅
No Editorial Bias: As a preprint repository, arXiv does not curate based on conclusions or viewpoints; role is to distribute, not filter by ideology
⚪
Preprint Status (Not Peer-Reviewed): Content has not undergone formal peer review; users must treat findings as preliminary. This is clearly labeled and understood by academic audience
✅
Funding & Ownership Transparency: Operated as a public service by Cornell with support from the National Science Foundation, the Department of Energy, and member institutions; funding sources are transparent
⚪
No Retraction/Correction Mechanism: Preprints cannot be deleted or significantly altered after posting, but authors can post corrections and new versions; aligns with preprint-server norms

✅ Strengths

✓ Three decades of institutional trust and widespread adoption across the global scientific community
✓ Transparent governance, clear submission/moderation policies, and public documentation of standards
✓ No ideological or financial incentives to bias content; operates as a public good
✓ Version control and author accountability; papers are timestamped and traceable
✓ Free, open access to all content; no paywall or subscription gatekeeping
✓ Rigorous spam and plagiarism detection systems
✓ Strong reputation among researchers, cited in major peer-reviewed journals

⚠️ Concerns

⚠ Content is preprint material, not peer-reviewed—findings may be preliminary, incomplete, or later contradicted
⚠ No formal fact-checking or verification process (not applicable to academic preprints, but users must understand the distinction)
⚠ Occasional spam or low-quality submissions can appear on the platform despite moderation efforts
⚠ Some misuse of arXiv by non-experts or bad-faith actors posting speculative or unfounded claims, though this is rare and heavily moderated

Analysis performed: May 27, 2026

“A1). Extended Data Fig. A2**a,d** shows the number of references made in each of those papers or patents according to the data source. For *SciSciNet* and *PatentsView*, we find that 97% and 78% of the CD 5 = 1 papers and patents make zero references, respectively. Extended Data Fig. A2**b,e** shows that within the CD 5 = 1 category, the proportion of patents and papers that makes zero citation behaviour provides yet another proof that the relative decrease of zero reference patents and papers with CD 5 = 1 per year (Extended Data Fig. A2**c,f**) drives the reported decline in disruption. Finally, we elucidate the source of this large quantity of papers and patents without references by inspecting 100 randomly extracted patents and papers with zero references and CD 5 = 1. We find that 98% of the patent sample and 93% of the paper set the CD indices of papers that make zero references to non-defined. We verified that our observations do not depend on the specific data source, the category within the respective data source, the choice of forward citation window, or the normalized CD indices (Extended Data Fig. A3, Supplementary Figs. In summary, we revealed in three different ways that the decline in disruption, presented in Park et al. [1], is driven by papers and patents with zero references and CD 5 = 1. Here again, the largest data points are hidden. **b,** The correct histogram of the underlying dataset. A peak at CD 10 = 1 is revealed, corresponding to 9*,* 187*,* 034 additional papers. **c,** The time evolution of the average CD 10 index. When dropping the outliers with CD 10 = 1, the decline in disruptiveness is negated. We find that 98% of the CD 10 = 1 papers make zero references, consequently their exclusion the decline in disruptiveness reduces substantially. We find that 87 % of the CD 10 = 1 patents make zero references, consequently their exclusion impacts the decline similarly. 22 The correct histogram of the underlying dataset. A peak at CD max = 1 is revealed, corresponding to 13*,* 864*,* 845 additional papers. **c,** The time evolution of the average CD max index. When dropping the outliers with CD max = 1, the decline in disruptiveness is negated. We find that all of the CD max = 1 papers make zero references, consequently their exclusion is not shown separately. correspond to 95% confidence intervals. **d–f,** The equivalent plots for *PatentsView* revealing 175*,* 190 patents with CD 2017*y* = 1. When dropping the outliers with CD 2017*y* = 1, the decline in disruptiveness reduces substantially. We find that 94 % of the CD 2017*y* = 1 patents make zero references, consequently their exclusion impacts the decline similarly. 23 *pandas DataFrame* provided by Park et al. [1] using a random seed equal to zero. We manually verified the PDF files (see Supplementary Tables S3, S4) for references and find that 93% of papers and 98% of patents make at least one reference. For papers, we have a more detailed view on the type of the seven documents that do not make any references to prior work. We find four papers which are part of a list of abstracts.”

↗

2

The disruption index suffers from citation inflation: Re-analysis ...

Publisher Sciencedirect.com · Tier 2 - Credible · Academic · 88%

Evidence Quality Reported

Secondary source reporting Holst et al.'s findings; states that missing citations and data quality issues from items with rp=0 and CDp=1 are responsible for the decline anomaly.

www.sciencedirect.com

Publisher credibility

sciencedirect.com

Overall Score

88%

Tier

Tier 2 - Credible

Category

Academic

Analysis

ScienceDirect (sciencedirect.com) is a major academic publishing platform owned by Elsevier, one of the world's largest academic publishers. It hosts peer-reviewed journals, conference proceedings, and book chapters across science, technology, medicine, and social sciences. The platform itself is not a news source but rather a repository of peer-reviewed research and academic content. As an academic aggregator, it benefits from the peer-review processes of thousands of journals it hosts, which provides strong credibility for the research it publishes. However, the credibility score reflects the platform's role as a distributor rather than a primary publisher—individual articles' credibility depends entirely on the originating journal's standards. ScienceDirect has faced some criticism regarding Elsevier's publishing practices and access policies, but these are separate from content accuracy.

Key Factors

✅
Peer-Review System: ScienceDirect hosts articles from thousands of peer-reviewed journals, meaning content undergoes rigorous expert evaluation before publication
✅
Institutional Affiliation: Owned by Elsevier, a major, long-established academic publisher with 150+ years of history and global recognition in academic publishing
✅
Domain Semantics: The .com domain combined with 'ScienceDirect' name clearly signals academic/scientific purpose, consistent with the platform's actual function
⚪
Platform vs. Publisher Distinction: ScienceDirect is a platform aggregating content from many publishers; credibility varies by originating journal, not by ScienceDirect itself
❌
Publisher Controversy: Elsevier has faced criticism regarding journal pricing, open-access policies, and editorial practices, though this affects access rather than content accuracy

✅ Strengths

✓ Hosts content from thousands of reputable, peer-reviewed journals across multiple disciplines
✓ Peer-review process provides rigorous expert vetting before publication
✓ Long institutional history and global recognition in academic publishing ecosystem
✓ Clear metadata, citations, and article information facilitate verification and traceability
✓ Indexed by major academic databases (PubMed, Web of Science, Scopus), signaling third-party validation
✓ Most articles include author affiliations, funding disclosures, and conflict-of-interest statements
✓ Retraction Watch and other services track problematic articles

⚠️ Concerns

⚠ ScienceDirect is a platform, not a primary publisher—content credibility depends on the individual journal's editorial standards
⚠ Paywall access limits transparency and independent verification for non-institutional readers
⚠ Elsevier's business practices have attracted criticism from the academic community regarding pricing and open-access policies
⚠ Individual journal quality varies significantly; presence on ScienceDirect does not guarantee high-quality research
⚠ Retracted articles may remain discoverable on the platform, requiring readers to verify current status

Analysis performed: May 27, 2026

“# Research Paper The disruption index suffers from citation inflation: Re-analysis of temporal CD trend and relationship with team size reveal discrepancies ## 1. Introduction Similarly, a recent independent re-analysis by Holst et al. ## 5. Discussion Data quality issues, deriving from missing citations and references, generate a fundamental source of error that Holst et al. (2024); Macher et al. (2024) show are responsible for the anomalous decline in CD(t) reported by Park et al. (2023). (2024) show that missing references at the beginning of the patent data artificially reduce rp for early patents; upon correcting for their omission, which effectively increases rp for those early patents, the negative trend in CD(t) largely disappears. Similarly, in their combined publication and patent re-analysis, Holst et al. (2024) show that a significant source of systematic error follows from including items with rp=0 that generate CDp=1 outliers”

↗

3

The disruption index suffers from citation inflation and is ...

Publisher Arxiv.org · Tier 1 - Authoritative · Academic · 92%

Evidence Quality Reported

Secondary source independently corroborating Holst et al.'s identification of missing citations and zero-reference items (rp=0, CDp=1) as systematic errors.

arxiv.org

Publisher credibility

arxiv.org

Overall Score

92%

Tier

Tier 1 - Authoritative

Category

Academic

Analysis

arXiv.org is a preprint repository operated by Cornell University that has served the academic and scientific community since 1991. It is one of the most widely used platforms for disseminating research across physics, mathematics, computer science, and related disciplines. As an academic preprint server rather than a traditional news source, arXiv operates under rigorous institutional governance with Cornell's oversight, transparent submission and moderation policies, and no editorial bias toward particular viewpoints—its role is to archive and distribute scholarly work, not to filter based on conclusions. While preprints are not peer-reviewed before posting, the platform maintains clear quality standards, spam filters, and a dedicated moderation team. arXiv's reputation is exceptionally strong in academic circles; it is trusted by researchers worldwide and has become a de facto standard for early-stage dissemination in many STEM fields. The platform's lack of sensationalism, clear labeling of content as preprints, and institutional backing by a major university give it high credibility, though users must understand that preprints represent work in progress, not finalized peer-reviewed findings.

Key Factors

✅
Institutional Backing & Longevity: Operated by Cornell University since 1991; three decades of consistent, trusted operation in the academic community
✅
Transparent Moderation Policy: Clear submission guidelines, spam filters, and moderation standards are publicly documented; no hidden agendas or opaque gatekeeping
✅
No Editorial Bias: As a preprint repository, arXiv does not curate based on conclusions or viewpoints; role is to distribute, not filter by ideology
⚪
Preprint Status (Not Peer-Reviewed): Content has not undergone formal peer review; users must treat findings as preliminary. This is clearly labeled and understood by academic audience
✅
Funding & Ownership Transparency: Operated as a public service by Cornell with support from the National Science Foundation, the Department of Energy, and member institutions; funding sources are transparent
⚪
No Retraction/Correction Mechanism: Preprints cannot be deleted or significantly altered after posting, but authors can post corrections and new versions; aligns with preprint-server norms

✅ Strengths

✓ Three decades of institutional trust and widespread adoption across the global scientific community
✓ Transparent governance, clear submission/moderation policies, and public documentation of standards
✓ No ideological or financial incentives to bias content; operates as a public good
✓ Version control and author accountability; papers are timestamped and traceable
✓ Free, open access to all content; no paywall or subscription gatekeeping
✓ Rigorous spam and plagiarism detection systems
✓ Strong reputation among researchers, cited in major peer-reviewed journals

⚠️ Concerns

⚠ Content is preprint material, not peer-reviewed—findings may be preliminary, incomplete, or later contradicted
⚠ No formal fact-checking or verification process (not applicable to academic preprints, but users must understand the distinction)
⚠ Occasional spam or low-quality submissions can appear on the platform despite moderation efforts
⚠ Some misuse of arXiv by non-experts or bad-faith actors posting speculative or unfounded claims, though this is rare and heavily moderated

Analysis performed: May 27, 2026

“# The disruption index suffers from citation inflation and is confounded by shifts in scholarly citation practice ## Introduction Similarly, a recent and independent re-analysis by Holst et al. holst2024dataset shows that missing citations in the scientific publication data, which are more prominent in the early years of the sample, give rise to a subsample of publications with 0 references (which by definition correspond to maximum disruption value of CD=1CD=1) ## Discussion macher2023illusive, missing references at the beginning of the patent data artificially reduce rpr_{p} for early patents; upon correcting for their omission, which effectively increases rpr_{p} for those early patents, the negative trend in CDCD largely disappears. Similarly, Holst et al. holst2024dataset show that a significant source of systematic error follows from including items with rp=0r_{p}=0 that generate CDp=1CD_{p}=1 outliers”

↗

4

The disruption index is biased by citation inflation

Publisher Mit.edu · Tier 2 - Credible · Academic · 88%

Evidence Quality Reported

Secondary source corroborating Holst et al.'s finding that data quality artifacts and systematic bias from items with CD=1 are the problem.

direct.mit.edu

Publisher credibility

mit.edu

Overall Score

88%

Tier

Tier 2 - Credible

Category

Academic

Analysis

MIT.edu is the official domain of the Massachusetts Institute of Technology, one of the world's most prestigious research universities. Content published under this domain—whether news, research, or institutional communications—benefits from MIT's rigorous academic standards, peer review processes (for research), and institutional accountability. However, MIT's primary mission is education and research, not journalism. While MIT News and other institutional communications maintain high editorial standards, they are not equivalent to professional news organizations like Reuters or the AP. MIT's reputation is exceptional in STEM fields and research integrity, but the institution's news operations lack the specialized investigative journalism infrastructure and dedicated fact-checking apparatus of major newspapers. Additionally, institutional communications inherently serve the university's interests, which can subtly influence editorial priorities and framing, though this rarely manifests as deliberate misinformation.

Key Factors

✅
Institutional prestige and academic rigor: MIT is consistently ranked among the top universities globally. Its research standards, peer review processes, and institutional accountability are extremely high. This extends to official institutional communications.
⚪
Primary mission is research/education, not journalism: MIT is not a news organization. While MIT News maintains professional standards, it operates within an academic rather than journalistic context, which may affect editorial priorities and scope.
⚪
Institutional bias: Institutional communications naturally prioritize and frame stories in ways favorable to MIT's interests, research, and mission. This is a structural limitation rather than a scandal, but reduces pure objectivity compared to independent news outlets.
✅
Transparency and accountability: As a major research university, MIT maintains high transparency standards. Research is peer-reviewed, institutional policies are documented, and there is significant external scrutiny from funders, accreditors, and the scientific community.
✅
Subject matter expertise: MIT News covers technology, science, and research topics with access to domain experts and researchers. Coverage of these topics is typically sophisticated and accurate.
❌
Limited investigative journalism resources: MIT News lacks the investigative journalism infrastructure of major newspapers. Reporting is generally descriptive and institution-facing rather than investigative or adversarial.

✅ Strengths

✓ Exceptional institutional credibility and prestige
✓ Access to world-class subject matter experts
✓ Rigorous academic standards and peer review processes
✓ Strong accountability to accreditors, funders, and the scientific community
✓ Sophisticated coverage of science and technology topics
✓ Transparent about institutional affiliation and mission
✓ Professional editorial standards and writing quality
✓ Corrections acknowledged when errors occur

⚠️ Concerns

⚠ Institutional bias: Coverage naturally privileges MIT research, faculty, and initiatives
⚠ Limited independence: News operations serve the university's broader institutional interests
⚠ Scope limitations: Primarily covers MIT-related topics rather than broader news
⚠ No independent fact-checking apparatus: Relies on academic peer review rather than journalistic fact-checking
⚠ Lack of investigative journalism: Reporting tends to be less adversarial than independent news organizations
⚠ Potential conflicts of interest: Covering donors, corporate partners, and faculty without arms-length distance

Analysis performed: May 28, 2026

“# The disruption index is biased by citation inflation Open Access ## 3. EMPIRICAL CRITIQUE Similarly, uncited papers also generate the modal disruption value of *CD* = 0, yet these papers and patents also tend to be biased towards earlier years (Kozlowski, Andersen, & Larivière, 2024). After correcting for these data quality artifacts and the systematic bias this incurs by excluding the publication and patent subsamples with *CD* = 1, Holst et al”

↗

No opposing evidence found.

ℹ️ Sources Found — None Directly Addressed This Claim (1)

These sources were retrieved and read but did not take a position on this specific claim — shown so you can judge for yourself.

1

Exclusive: the science papers that patents cite the most

Publisher Nature.com · Tier 1 - Authoritative · Academic · 96%

Evidence Quality Reported

Discusses citation patterns in patents but does not engage Holst et al.'s specific finding about misclassification of zero-reference items.

www.nature.com

Publisher credibility

nature.com

Overall Score

96%

Tier

Tier 1 - Authoritative

Category

Academic

Analysis

Nature.com is the online platform of Nature, one of the world's most prestigious and oldest peer-reviewed scientific journals, first published in 1869. It operates under the Nature Publishing Group (part of Springer Nature), a major academic publisher with institutional credibility spanning over 150 years. The publication maintains exceptionally rigorous editorial standards including peer review, expert editorial boards, and strict verification protocols for all published research. Nature has a well-established reputation in the global scientific community and maintains transparent corrections and retraction policies. The journal's articles undergo multiple levels of scrutiny before publication, including initial editorial screening and anonymous peer review by subject-matter experts. While Nature does publish opinion and comment pieces alongside primary research, these are clearly labeled and separated from peer-reviewed content.

Key Factors

✅
Institutional age and reputation: Founded in 1869, Nature is one of the most prestigious scientific journals globally with over 150 years of credibility in the scientific community.
✅
Peer review process: All primary research articles undergo rigorous anonymous peer review by subject-matter experts before publication, ensuring high verification standards.
✅
Editorial independence: Nature maintains editorial independence from commercial pressures and has transparent ownership under Springer Nature, a major academic publisher.
✅
Corrections and retraction policy: Nature has a well-documented and transparent policy for corrections, retractions, and expressions of concern, clearly visible on the website.
✅
Clear labeling of content types: Distinction between peer-reviewed research, opinion, news, and commentary is clearly marked, reducing confusion about content authority.
✅
Citation impact and influence: Nature articles are among the most cited in scientific literature, indicating broad scientific community validation and impact.
⚪
Specialized academic focus: As an academic journal, Nature is not a general-interest news source and focuses specifically on scientific research and commentary.

✅ Strengths

✓ Peer review by leading domain experts
✓ Over 150 years of institutional credibility and scientific standing
✓ Transparent editorial policies and correction procedures
✓ High citation rates indicating scientific community validation
✓ Clear separation between research, opinion, and news content
✓ Global reach with international editorial boards and contributors
✓ Institutional backing by major academic publisher (Springer Nature)
✓ Rigorous verification and fact-checking for primary research claims
✓ Published corrections and retraction statements are publicly available

⚠️ Concerns

⚠ Publication bias: Like all journals, Nature may be subject to publication bias favoring novel or positive findings over null or negative results
⚠ Access limitations: Most content requires subscription or institutional access, limiting public transparency (though abstracts are free)
⚠ Scientific domain specificity: Not appropriate as a source for non-scientific topics; expertise is limited to natural sciences
⚠ Individual article variability: Quality and rigor vary by subdiscipline; some emerging areas may have less established peer review standards
⚠ Retraction lag: While retraction processes are rigorous, there can be significant time between publication and discovery of serious errors

Analysis performed: Jul 26, 2026

“# Exclusive: the science papers that patents cite the most ## Plant science and ‘in-text’ citations They found that just over 30% of scientific citations appear only in the body text of patents; these would be missed by just examining the front-page references^16”

↗

5

Further investigation suggested that the proportion of misclassified papers and patents has been falling over time.

Plausible — needs more evidence

PLAUSIBLE Plausible — uncertain, credibility not yet established 38

▼

Analysis:

No Tier 1-3 source confirms this claim. The assertion claims the proportion of misclassified papers and patents has been falling over time. Reference The Illusive Slump of Disruptive Patents (arxiv.org, 'The Illusive Slump of Disruptive Patents') directly engages the article's thesis that the original analysis contained systematic data classification errors, but its passage does not substantively address whether misclassification rates themselves have declined. References 3DBE1029 and E0D83635 present the original declining-disruptiveness findings with extensive detail but do not discuss data quality or misclassification trends. Reference Is science really getting less disruptive — and does it matter... is purely background on paradigm shifts. Reference NBER WORKING PAPER SERIES LOW-QUALITY PATENTS IN THE EYE OF THE... discusses patent office error rates in a different context (examination decisions) unrelated to the classification methodology in question. No reference provides evidence directly confirming or contradicting the claim that misclassification proportions have fallen over time.

No opposing evidence found.

ℹ️ Sources Found — None Directly Addressed This Claim (5)

These sources were retrieved and read but did not take a position on this specific claim — shown so you can judge for yourself.

1

Is science really getting less disruptive — and does it matter ...

Publisher Nature.com · Tier 1 - Authoritative · Academic · 96%

Evidence Quality Reported

Introductory passage on Kuhn's paradigm-shift concept; no engagement with data classification or misclassification trends.

www.nature.com

Publisher credibility

nature.com

Overall Score

96%

Tier

Tier 1 - Authoritative

Category

Academic

Analysis

Nature.com is the online platform of Nature, one of the world's most prestigious and oldest peer-reviewed scientific journals, first published in 1869. It operates under the Nature Publishing Group (part of Springer Nature), a major academic publisher with institutional credibility spanning over 150 years. The publication maintains exceptionally rigorous editorial standards including peer review, expert editorial boards, and strict verification protocols for all published research. Nature has a well-established reputation in the global scientific community and maintains transparent corrections and retraction policies. The journal's articles undergo multiple levels of scrutiny before publication, including initial editorial screening and anonymous peer review by subject-matter experts. While Nature does publish opinion and comment pieces alongside primary research, these are clearly labeled and separated from peer-reviewed content.

Key Factors

✅
Institutional age and reputation: Founded in 1869, Nature is one of the most prestigious scientific journals globally with over 150 years of credibility in the scientific community.
✅
Peer review process: All primary research articles undergo rigorous anonymous peer review by subject-matter experts before publication, ensuring high verification standards.
✅
Editorial independence: Nature maintains editorial independence from commercial pressures and has transparent ownership under Springer Nature, a major academic publisher.
✅
Corrections and retraction policy: Nature has a well-documented and transparent policy for corrections, retractions, and expressions of concern, clearly visible on the website.
✅
Clear labeling of content types: Distinction between peer-reviewed research, opinion, news, and commentary is clearly marked, reducing confusion about content authority.
✅
Citation impact and influence: Nature articles are among the most cited in scientific literature, indicating broad scientific community validation and impact.
⚪
Specialized academic focus: As an academic journal, Nature is not a general-interest news source and focuses specifically on scientific research and commentary.

✅ Strengths

✓ Peer review by leading domain experts
✓ Over 150 years of institutional credibility and scientific standing
✓ Transparent editorial policies and correction procedures
✓ High citation rates indicating scientific community validation
✓ Clear separation between research, opinion, and news content
✓ Global reach with international editorial boards and contributors
✓ Institutional backing by major academic publisher (Springer Nature)
✓ Rigorous verification and fact-checking for primary research claims
✓ Published corrections and retraction statements are publicly available

⚠️ Concerns

⚠ Publication bias: Like all journals, Nature may be subject to publication bias favoring novel or positive findings over null or negative results
⚠ Access limitations: Most content requires subscription or institutional access, limiting public transparency (though abstracts are free)
⚠ Scientific domain specificity: Not appropriate as a source for non-scientific topics; expertise is limited to natural sciences
⚠ Individual article variability: Quality and rigor vary by subdiscipline; some emerging areas may have less established peer review standards
⚠ Retraction lag: While retraction processes are rigorous, there can be significant time between publication and discovery of serious errors

Analysis performed: Jul 26, 2026

“# Is science really getting less disruptive — and does it matter if it is? The influential twentieth-century physicist and philosopher Thomas Kuhn was instrumental in formulating the term ‘paradigm shift’ to characterize how unexpected evidence can set research fields off in new directions.”

↗

2

Papers and patents are becoming less disruptive over time

Publisher Nsf.gov · Tier 1 - Authoritative · Government · 96%

Evidence Quality Well Established

NSF-hosted research presenting CD index methodology, sample sizes, and field-by-field decline trends with confidence intervals; does not address misclassification proportions or data quality over time.

par.nsf.gov

Publisher credibility

nsf.gov

Overall Score

96%

Tier

Tier 1 - Authoritative

Category

Government

Analysis

NSF.gov is the official website of the National Science Foundation, a United States government agency established by Congress in 1950. As a .gov domain operated by a federal scientific agency, it represents one of the most authoritative sources for information about federally-funded research, scientific grants, and STEM policy in the United States. The NSF is responsible for funding approximately 24% of all federally-supported basic research conducted by U.S. colleges and universities, and its website serves as an official repository of government information, funding announcements, research findings, and policy documentation. The organization operates under strict federal standards for accuracy, transparency, and public accountability.

Key Factors

✅
Government Authority & Legal Mandate: As a federally-chartered agency under the National Science Foundation Act of 1950, NSF operates under Congressional oversight and statutory requirements for accuracy and transparency in federal communications.
✅
.gov TLD: The .gov top-level domain is reserved exclusively for U.S. government agencies and carries strong verification requirements, indicating official U.S. government status.
✅
Institutional Longevity & Reputation: The NSF has operated for over 70 years as a premier U.S. research funding agency with a strong reputation in academic and scientific communities.
✅
Scientific Peer Review Standards: NSF grant and research processes employ rigorous peer review standards aligned with scientific community norms, lending credibility to research announcements.
✅
Transparency & Public Accountability: As a federal agency, NSF is subject to FOIA requests, public records laws, and inspector general oversight, ensuring public accountability.
⚪
Content Type Variation: The domain hosts diverse content (news, grants, research, policy) rather than traditional journalism, so evaluation should account for informational rather than journalistic purpose.

✅ Strengths

✓ Official government authority: Backed by federal law and Congressional mandate
✓ Rigorous grant review processes: Uses peer review standards aligned with scientific norms
✓ Institutional expertise: Contains authoritative information on federally-funded STEM research
✓ Transparency requirements: Subject to FOIA, inspector general audits, and federal record-keeping standards
✓ Verifiable institutional identity: .gov domain provides cryptographic verification of authenticity
✓ Long operational history: 70+ years of consistent operation and funding credibility
✓ Separation of content types: Clearly distinguishes between announcements, grants, news, and policy

⚠️ Concerns

⚠ Not a journalism outlet: NSF.gov publishes research announcements, grant notifications, and policy information rather than investigative journalism or news reporting, so it should not be expected to operate under traditional editorial standards.
⚠ Government agency perspective: Content reflects NSF's institutional interests and policy priorities; coverage of NSF-critical topics may be limited.
⚠ No third-party journalism fact-checking: As a government information source, NSF.gov is not reviewed by journalism-specific fact-checkers (MBFC, etc.), though it is subject to federal accuracy standards.
⚠ Potential for selective emphasis: Agency communications may emphasize successful projects over failures or limitations.

Analysis performed: Jun 16, 2026

“**Declining disruptiveness** Across fields, we find that science and technology are becoming less disruptive. Figure 2 plots the average *CD*5 over time for papers (Figure 2a) and patents (Figure 2b). For papers, the decrease between 1945 and 2010 ranges from 91.9% (where the average *CD*5 dropped from 0.52 in 1945 to 0.04 in 2010 for the Social Sciences) to 100% (where the average *CD*5 decreased from 0.36 in 1945 to 0 in 2010 for the Physical Sciences); for patents, the decrease between 1980 and 2010 ranges from 78.7% (where the average *CD*5 decreased from 0.30 in 1980 to 0.06 in 2010 for Computers and Communications) to 91.5% (where the average *CD*5 decreased from 0.38 in 1980 to 0.03 in 2010 Drugs and Medical). For both papers and patents, the rates of decline are greatest in the earlier parts of the time series, and for patents, they appear to begin stabilizing between the years 2000 and 2005. For papers, since about 1980, the rate of decline has been more modest in the Life Sciences and Biomedicine and the Physical Sciences, and most dramatic and persistent in the Social Sciences and Technology. Overall, however, relative to earlier eras, recent papers and patents do less to push science and technology in new directions. *Sciences*, and *Science* or to Nobel-winning discoveries (Figure 5)^34, the downward trend persists. Furthermore, the trend is not driven by characteristics of the WoS and UPSTO data or our particular derivation of the CD index; we observe similar declines in disruptiveness when we compute *CD*5 on papers in JSTOR, the American Physical Society corpus, Microsoft Academic Graph, and PubMed (see Methods, “Alternative samples”), the results of which are shown in Extended Data Figure 6. over time, separately for papers (**a**, n=24,659,076) and patents (**b**, n=3,912,353). For papers, lines correspond to WoS research areas; from 1945-2010 the magnitude of decline ranges from 91.9% (Social Science) to 100% (Physical Science). For patents, lines correspond to National Bureau of Economic Research (NBER) technology categories; from 1980-2010 the magnitude of decline The inset plots show the composition of the most disruptive papers and patents (defined as those with *CD*5 values *>* 0*.*25) by field over time. The observed stability in the absolute number of highly disruptive papers and patents holds despite considerable churn in the underlying fields of science and technology responsible for producing those works. **Figure 5: CD index of high-quality science over time.** This figure shows changes in *CD*5 over The results also confirm that domain-specific factors across fields of science and technology play a very small role in explaining the decline in disruptiveness of papers and patents. **Alternative samples** We also considered whether the patterns we document may be artifacts of our choice of data sources. While we observe consistent trends in both the WoS and Patents View data, and both databases are widely used by the Science of Science community, our results presented in Extended Data Figure 7a (papers) and 9b (patents). The blue lines indicate disruption based on Bornmann et al.^35^ and the orange lines indicate disruption based on Leydesdorff et al.^36. Across science and technology, the two alternative measures both show declines in disruption over time, similar to the patterns observed with the CD index.”

↗

3

Papers and patents are becoming less disruptive over time

Publisher Softbeam.net · Tier 5 - Low Credibility · 25%

Evidence Quality Well Established

Republication of the same disruptiveness-decline findings with CD5 metrics and confidence intervals; does not address misclassification error rates or their temporal trend.

www.softbeam.net

Publisher credibility

softbeam.net

Overall Score

25%

Tier

Tier 5 - Low Credibility

Category

Unknown

Analysis

softbeam.net is not a recognized news organization, journalistic outlet, or established digital publication in any credibility database, media analysis resource, or major news index. The domain itself provides minimal structural signal: .net is a generic TLD with no inherent authority signal, and 'softbeam' does not suggest a news, academic, or institutional entity. Without direct knowledge of this specific domain, category inference is unreliable. The combination of non-recognition, generic branding, and inability to establish what this domain actually publishes or represents places it in a cautious tier. This assessment reflects absence of evidence of credibility rather than evidence of deception, but the low score reflects appropriate skepticism toward an unknown source making journalistic claims. This specific publisher is not recognized. The tier above is inferred from the domain itself (TLD, name, hosting), not from knowledge of the outlet's coverage, ownership, or track record — those are reported as not known rather than estimated.

Analysis performed: Aug 12, 2026

“**Declining disruptiveness** and patents (Fig. 2b). For papers, the decrease between 1945 and 2010 ranges from 91.9% (where the average CD 5 dropped from 0.52 in 1945 to 0.04 in 2010 for ‘social sciences’) to 100% (where the average CD 5 ents, the decrease between 1980 and 2010 ranges from 78.7% (where the and communications’) to 91.5% (where the average CD 5 decreased from 0.38 in 1980 to 0.03 in 2010 for ‘drugs and medical’). For both papers the years 2000 and 2005. For papers, since about 1980, the rate of decline has been more modest in ‘life sciences and biomedicine’ and and ‘technology’. tion section 1). We observe substantial declines, especially in the earresults using the CD index. lier periods, before 1970 for papers and 1990 for patents. For paper titles (Fig. 3a), the decrease (1945–2010) ranges from 76.5% (social sciences) to 88% (technology); for patent titles (Fig. 3d), the decrease | Fig. 2 \| Decline of disruptive science and technology. a,b, Decline in CD 5 over | of decline ranges from 93.5% (computers and communications) to 96.4% | | --- | --- | | time, separately for papers (a, n = 24,659,076) and patents (b, n = 3,912,353). | (drugs and medical). Shaded bands correspond to 95% confidence intervals. | | For papers, lines correspond to WoS research areas; from 1945 to 2010 the | As we elaborate in the Methods, this pattern of decline is robust to adjustment | | WoS data | effects | | --- | --- | | We limit our focus to research papers published between 1945 and 2010. | Our results show a steady decline in the disruptiveness of science and | | Although the WoS data begin in the year 1900, the scale and social organ- | technology over time. Moreover, the patterns we observe are generally | ization of science shifted markedly in the post-war era, thereby making inventors may be particularly important for understanding changes in disruptiveness over time. The results also confirm that domain-specific explaining the decline in disruptiveness of papers and patents. **Alternative samples** We also considered whether the patterns we document may be artefacts of our choice of data sources. Although we observe consistent trends Article in both the WoS and Patents View data, and both databases are widely Article | Extended Data Fig. 6 \| CD index over time across data sources. This figure | Colours indicate the six different data sources. Shaded bands correspond to | | --- | --- | | shows changes in CD 5 over time across four additional data sources (the WoS | 95% confidence intervals. The figure indicates that the decline in disruption is |”

↗

4

NBER WORKING PAPER SERIES LOW-QUALITY PATENTS IN THE EYE OF THE ...

Publisher Nber.org · Tier 1 - Authoritative · Academic · 92%

Evidence Quality Reported

NBER working paper on patent office examination error rates (grant/refusal decisions) across jurisdictions; no engagement with the classification methodology or misclassification trends under review.

www.nber.org

Publisher credibility

nber.org

Overall Score

92%

Tier

Tier 1 - Authoritative

Category

Academic

Analysis

The National Bureau of Economic Research (NBER) is one of the most prestigious and rigorous economic research organizations in the world. Founded in 1920, it operates as a private, nonprofit research organization that produces peer-reviewed working papers and conducts empirical economic research of the highest standards. NBER is not a news publication in the traditional sense—it is an academic research repository and think tank whose output consists of working papers, data, and research findings rather than news reporting. Its credibility derives from the rigorous peer-review processes, the caliber of its affiliated researchers (including numerous Nobel Prize winners and leading economists), and its institutional commitment to methodological rigor and transparency. The organization maintains strict standards for working paper acceptance and publication, and its research is widely cited in academic literature, policy circles, and mainstream media.

Key Factors

✅
Institutional Prestige & Longevity: NBER was founded in 1920 and has maintained a reputation as the leading economic research organization for over a century. It is highly regarded in academia and policymaking circles.
✅
Peer Review & Methodological Rigor: Working papers undergo academic review processes; research standards are rigorous and transparent. Methodology is documented and reproducible.
⚪
Not a Traditional News Source: NBER publishes research and working papers, not news reporting. Credibility assessment is more appropriate for its research output than journalistic practice.
✅
Researcher Caliber: NBER affiliates include leading economists, many of whom are Nobel laureates or prominent academics. This attracts high-quality research contributions.
✅
Institutional Transparency: NBER maintains transparent funding disclosures and organizational governance. Funding sources are documented.
✅
No Political Advocacy Mandate: As a research organization, NBER operates without explicit political partisanship, though individual researchers may have varied perspectives.

✅ Strengths

✓ One of the world's leading economic research organizations with institutional credibility spanning 100+ years
✓ Rigorous methodological standards and peer review processes for all working papers
✓ High-caliber affiliated researchers, including Nobel Prize winners and leading economists
✓ Transparent funding and governance; clear institutional policies
✓ Widely cited in academic literature, policy analysis, and mainstream media
✓ Publicly accessible research archive with metadata and documentation
✓ No commercial incentive to sensationalize or distort findings
✓ Institutional commitment to reproducibility and methodological transparency

⚠️ Concerns

⚠ NBER working papers represent pre-publication research and may not reflect consensus; preliminary findings may be revised
⚠ While peer-reviewed by academic standards, working papers have lighter review processes than journal articles
⚠ Research may reflect ideological diversity within economics; some work may carry implicit assumptions or methodological choices reflecting researchers' perspectives
⚠ Not equipped for real-time fact-checking of current events—appropriate for research access, not breaking news verification

Analysis performed: May 31, 2026

“JPO and EPO, who have high thresholds, the situation is reversed (65.4% and 72.0%, respectively). With respect to incorrect decisions, for CNIPA, USPTO and KIPO, we find that the proportions of mistakenly granted patents (0.2%, 1.1% and 2.2%) are smaller than the proportion of mistakenly refused patents (2.7%, 5.1% and 6.3%), an outcome which is contrary to that expected based on evidence from **6. Conclusion** There is significant concern around the world that patent offices are issuing patents that should not have been granted. Studies based on litigation outcomes suggest that this problem is quantitatively significant, with the overall fraction of dubious patents ranging from a quarter to three-quarter of all patents. Our analysis of patent applications examined by multiple offices around the world suggests that the overall prevalence of low-quality patents might be smaller.”

↗

5

The Illusive Slump of Disruptive Patents

Publisher Arxiv.org · Tier 1 - Authoritative · Academic · 92%

Evidence Quality Reported

arXiv preprint titled 'The Illusive Slump of Disruptive Patents' engaging the original analysis's claims, but cited passage focuses on the absolute number of highly disruptive works, not misclassification proportions.

arxiv.org

Publisher credibility

arxiv.org

Overall Score

92%

Tier

Tier 1 - Authoritative

Category

Academic

Analysis

arXiv.org is a preprint repository operated by Cornell University that has served the academic and scientific community since 1991. It is one of the most widely used platforms for disseminating research across physics, mathematics, computer science, and related disciplines. As an academic preprint server rather than a traditional news source, arXiv operates under rigorous institutional governance with Cornell's oversight, transparent submission and moderation policies, and no editorial bias toward particular viewpoints—its role is to archive and distribute scholarly work, not to filter based on conclusions. While preprints are not peer-reviewed before posting, the platform maintains clear quality standards, spam filters, and a dedicated moderation team. arXiv's reputation is exceptionally strong in academic circles; it is trusted by researchers worldwide and has become a de facto standard for early-stage dissemination in many STEM fields. The platform's lack of sensationalism, clear labeling of content as preprints, and institutional backing by a major university give it high credibility, though users must understand that preprints represent work in progress, not finalized peer-reviewed findings.

Key Factors

✅
Institutional Backing & Longevity: Operated by Cornell University since 1991; three decades of consistent, trusted operation in the academic community
✅
Transparent Moderation Policy: Clear submission guidelines, spam filters, and moderation standards are publicly documented; no hidden agendas or opaque gatekeeping
✅
No Editorial Bias: As a preprint repository, arXiv does not curate based on conclusions or viewpoints; role is to distribute, not filter by ideology
⚪
Preprint Status (Not Peer-Reviewed): Content has not undergone formal peer review; users must treat findings as preliminary. This is clearly labeled and understood by academic audience
✅
Funding & Ownership Transparency: Operated as a public service by Cornell with support from the National Science Foundation, the Department of Energy, and member institutions; funding sources are transparent
⚪
No Retraction/Correction Mechanism: Preprints cannot be deleted or significantly altered after posting, but authors can post corrections and new versions; aligns with preprint-server norms

✅ Strengths

✓ Three decades of institutional trust and widespread adoption across the global scientific community
✓ Transparent governance, clear submission/moderation policies, and public documentation of standards
✓ No ideological or financial incentives to bias content; operates as a public good
✓ Version control and author accountability; papers are timestamped and traceable
✓ Free, open access to all content; no paywall or subscription gatekeeping
✓ Rigorous spam and plagiarism detection systems
✓ Strong reputation among researchers, cited in major peer-reviewed journals

⚠️ Concerns

⚠ Content is preprint material, not peer-reviewed—findings may be preliminary, incomplete, or later contradicted
⚠ No formal fact-checking or verification process (not applicable to academic preprints, but users must understand the distinction)
⚠ Occasional spam or low-quality submissions can appear on the platform despite moderation efforts
⚠ Some misuse of arXiv by non-experts or bad-faith actors posting speculative or unfounded claims, though this is rare and heavily moderated

Analysis performed: May 27, 2026

“# The Illusive Slump of Disruptive Patents ## 6 Increasing Number of Highly Disruptive Patents (2023) argument that "despite large increases in scientific productivity, the number of papers and patents with CD5𝐶subscript𝐷5CD_{5}italic_C italic_D start_POSTSUBSCRIPT 5 end_POSTSUBSCRIPT values in the far right tail of the distribution remains nearly constant over time" (p. 140).”

↗

6

Dr Park and colleagues, in a rebuttal published alongside Holst's critique, point out that when following Holst's advice, they still see meaningful declines in disruptiveness.

Contradicted • 1 citation

CONTRADICTED Contradicted — strongly refuted, sources agree 3 ±3

▼

Analysis:

The assertion claims Park and colleagues see 'meaningful declines in disruptiveness' when following Holst's corrections. However, Reference A (Holst's published critique) directly contradicts this: Holst reports that after correcting truncation bias, the decline becomes 'marginal' rather than the dramatic decline Park originally reported, and that highly disruptive patents actually increased over time—particularly since 2008. References C and D present Park's original uncorrected findings (large declines), not Park's response to Holst's critique. The assertion mischaracterizes Park's rebuttal position by claiming they still observe 'meaningful' declines when the evidence shows Holst's corrections substantially reduce the apparent decline to marginal levels and reveal increases in highly disruptive patents.

❌ Opposing Evidence (1)

1

Is there a secular decline in disruptive patents? Correcting for ...

Publisher Sciencedirect.com · Tier 2 - Credible · Academic · 88%

Evidence Quality Well Established

Peer-reviewed published paper with specific quantitative findings (88% of decline explained by truncation bias, marginal decrease post-correction, increased highly disruptive patents since 2008).

www.sciencedirect.com

Publisher credibility

sciencedirect.com

Overall Score

88%

Tier

Tier 2 - Credible

Category

Academic

Analysis

ScienceDirect (sciencedirect.com) is a major academic publishing platform owned by Elsevier, one of the world's largest academic publishers. It hosts peer-reviewed journals, conference proceedings, and book chapters across science, technology, medicine, and social sciences. The platform itself is not a news source but rather a repository of peer-reviewed research and academic content. As an academic aggregator, it benefits from the peer-review processes of thousands of journals it hosts, which provides strong credibility for the research it publishes. However, the credibility score reflects the platform's role as a distributor rather than a primary publisher—individual articles' credibility depends entirely on the originating journal's standards. ScienceDirect has faced some criticism regarding Elsevier's publishing practices and access policies, but these are separate from content accuracy.

Key Factors

✅
Peer-Review System: ScienceDirect hosts articles from thousands of peer-reviewed journals, meaning content undergoes rigorous expert evaluation before publication
✅
Institutional Affiliation: Owned by Elsevier, a major, long-established academic publisher with 150+ years of history and global recognition in academic publishing
✅
Domain Semantics: The .com domain combined with 'ScienceDirect' name clearly signals academic/scientific purpose, consistent with the platform's actual function
⚪
Platform vs. Publisher Distinction: ScienceDirect is a platform aggregating content from many publishers; credibility varies by originating journal, not by ScienceDirect itself
❌
Publisher Controversy: Elsevier has faced criticism regarding journal pricing, open-access policies, and editorial practices, though this affects access rather than content accuracy

✅ Strengths

✓ Hosts content from thousands of reputable, peer-reviewed journals across multiple disciplines
✓ Peer-review process provides rigorous expert vetting before publication
✓ Long institutional history and global recognition in academic publishing ecosystem
✓ Clear metadata, citations, and article information facilitate verification and traceability
✓ Indexed by major academic databases (PubMed, Web of Science, Scopus), signaling third-party validation
✓ Most articles include author affiliations, funding disclosures, and conflict-of-interest statements
✓ Retraction Watch and other services track problematic articles

⚠️ Concerns

⚠ ScienceDirect is a platform, not a primary publisher—content credibility depends on the individual journal's editorial standards
⚠ Paywall access limits transparency and independent verification for non-institutional readers
⚠ Elsevier's business practices have attracted criticism from the academic community regarding pricing and open-access policies
⚠ Individual journal quality varies significantly; presence on ScienceDirect does not guarantee high-quality research
⚠ Retracted articles may remain discoverable on the platform, requiring readers to verify current status

Analysis performed: May 27, 2026

“# Is there a secular decline in disruptive patents? Correcting for measurement bias ## Highlights - • Challenge disruptive patent secular decline findings of Park et al. (Nature, 2023). - • Correct for truncation of backward citations and exclusion of patent applications. - • Find marginal decrease in disruptive patents over time. - • Find notable increase in highly disruptive patents over time. - • Highlight dangers of truncation bias and exclusion bias in patent analysis. ## Abstract We challenge the (Park et al., 2023) patent findings, principally around concerns of truncation bias and exclusion bias. We show that 88 percent of the decrease in the average CD index over 1980–2010 reported by the authors can be explained by their truncation of all backward patent citations before 1976. We also show that this truncation bias varies by technology class. patent law that allows for citations to patent applications in addition to patent grants—something ignored by the authors in their analysis—and update the analysis to 2016. We show that the number of highly disruptive patents has increased since 1980—particularly since 2008. ## Introduction One reason for this attention is that the Park et al. (2023) results show marked declines in disruptive research and innovation over time—a finding complementary to research productivity concerns expressed by other authors (Chu and Evans, 2021, Bloom et al., 2020, Boeing and Hünermund, 2020).^1 Park et al (2023) emphasize in their abstract that the “results suggest that slowing rates of disruption may reflect a fundamental shift in the nature of science and technology” (p. 138), and note in their conclusion that “this trend is unlikely to be driven by changes in citation practices or the quality of published work. Rather, the decline represents a substantive shift in science and technology, one that reinforces concerns about slowing innovative activity Correcting for truncation bias substantially decreases the apparent secular decline in patent disruptiveness suggested by Park et al. (2023): i.e., our analysis indicates a marginal decrease in the CD index over time. Correcting further for exclusion bias challenges the “remarkable stability” (p. 140) in the number of highly-disruptive patents argument suggested by Park et al Section 5 updates the data and analysis over 2011–2016 and considers a 1999 patent law change that allows for citations to patent grants and to patent applications to assesses the significance of exclusion bias. Section 6 shows that the number of highly disruptive patents has increased over time—particularly since 2008. Section 7 offers concluding remarks and suggests caution against any proposed research policy changes in response to Park et al. (2023) ## Increasing number of highly disruptive patents Park et al. (2023) emphasize in their analysis that “despite large increases in scientific productivity, the number of papers and patents with CD5 values in the far right tail of the distribution remains nearly constant over time” (p. 140). ## Discussion Our examination of the Park et al. (2023) CD index methodology was prompted by the stark decrease in the share of disruptive innovation in science and technology reported by the authors in patents over 1980–2010 and in scientific publications over 1945–2010. Our methodology and analysis of patents suggest results that either question or differ markedly from the Park et al. (2023) results, in at least four important respects”

↗

ℹ️ Sources Found — None Directly Addressed This Claim (3)

These sources were retrieved and read but did not take a position on this specific claim — shown so you can judge for yourself.

1

[2106.11184] The decline of disruptive science and technology

Publisher Arxiv.org · Tier 1 - Authoritative · Academic · 92%

Evidence Quality Reported

ArXiv preprint stating Park's original uncorrected findings; does not engage Park's response to Holst's critique or post-correction results.

arxiv.org

Publisher credibility

arxiv.org

Overall Score

92%

Tier

Tier 1 - Authoritative

Category

Academic

Analysis

arXiv.org is a preprint repository operated by Cornell University that has served the academic and scientific community since 1991. It is one of the most widely used platforms for disseminating research across physics, mathematics, computer science, and related disciplines. As an academic preprint server rather than a traditional news source, arXiv operates under rigorous institutional governance with Cornell's oversight, transparent submission and moderation policies, and no editorial bias toward particular viewpoints—its role is to archive and distribute scholarly work, not to filter based on conclusions. While preprints are not peer-reviewed before posting, the platform maintains clear quality standards, spam filters, and a dedicated moderation team. arXiv's reputation is exceptionally strong in academic circles; it is trusted by researchers worldwide and has become a de facto standard for early-stage dissemination in many STEM fields. The platform's lack of sensationalism, clear labeling of content as preprints, and institutional backing by a major university give it high credibility, though users must understand that preprints represent work in progress, not finalized peer-reviewed findings.

Key Factors

✅
Institutional Backing & Longevity: Operated by Cornell University since 1991; three decades of consistent, trusted operation in the academic community
✅
Transparent Moderation Policy: Clear submission guidelines, spam filters, and moderation standards are publicly documented; no hidden agendas or opaque gatekeeping
✅
No Editorial Bias: As a preprint repository, arXiv does not curate based on conclusions or viewpoints; role is to distribute, not filter by ideology
⚪
Preprint Status (Not Peer-Reviewed): Content has not undergone formal peer review; users must treat findings as preliminary. This is clearly labeled and understood by academic audience
✅
Funding & Ownership Transparency: Operated as a public service by Cornell with support from the National Science Foundation, the Department of Energy, and member institutions; funding sources are transparent
⚪
No Retraction/Correction Mechanism: Preprints cannot be deleted or significantly altered after posting, but authors can post corrections and new versions; aligns with preprint-server norms

✅ Strengths

✓ Three decades of institutional trust and widespread adoption across the global scientific community
✓ Transparent governance, clear submission/moderation policies, and public documentation of standards
✓ No ideological or financial incentives to bias content; operates as a public good
✓ Version control and author accountability; papers are timestamped and traceable
✓ Free, open access to all content; no paywall or subscription gatekeeping
✓ Rigorous spam and plagiarism detection systems
✓ Strong reputation among researchers, cited in major peer-reviewed journals

⚠️ Concerns

⚠ Content is preprint material, not peer-reviewed—findings may be preliminary, incomplete, or later contradicted
⚠ No formal fact-checking or verification process (not applicable to academic preprints, but users must understand the distinction)
⚠ Occasional spam or low-quality submissions can appear on the platform despite moderation efforts
⚠ Some misuse of arXiv by non-experts or bad-faith actors posting speculative or unfounded claims, though this is rare and heavily moderated

Analysis performed: May 27, 2026

“# Title:The decline of disruptive science and technology We find that the observed declines are unlikely to be driven by changes in the quality of published science, citation practices, or field-specific factors. Overall, our results suggest that slowing rates of disruption may reflect a fundamental shift in the nature of science and technology”

↗

2

Science and Technology are Becoming Less Disruptive

Publisher Umn.edu · Tier 2 - Credible · Academic · 85%

Evidence Quality Asserted

Institutional media summary of Park's original findings without engagement with Holst's critique or Park's rebuttal methodology.

carlsonschool.umn.edu

Publisher credibility

umn.edu

Overall Score

85%

Tier

Tier 2 - Credible

Category

Academic

Analysis

The University of Minnesota (.edu domain) is a major public research institution with established academic and institutional credibility. Content published under umn.edu encompasses multiple types of institutional communications, including official university news, research announcements, and administrative information. As an academic institution, UMN maintains professional editorial standards for official communications and is subject to institutional oversight and accountability mechanisms. However, the credibility score reflects the variability inherent in an entire institutional domain: official university news and research communications carry tier1-2 credibility, while individual researcher blogs, student publications, or less-vetted departmental pages may vary. Without knowing the specific subdomain or publication within umn.edu, the score reflects a weighted middle ground appropriate for a major research university's general output.

Key Factors

✅
.edu TLD and institutional affiliation: University of Minnesota is a major, accredited public research institution with peer review, editorial oversight, and institutional accountability mechanisms.
⚪
Institutional diversity of content: The broad umn.edu domain hosts diverse content (news, research, blogs, departmental pages) with varying editorial standards. Credibility depends heavily on the specific subdomain and publication.
✅
Academic peer review (research content): Research published by UMN faculty undergoes peer review processes that enhance factual accuracy and methodological rigor.
✅
Institutional reputation: UMN is a top-tier public research university (R1 classification) with strong reputation in STEM, medicine, agriculture, and social sciences.
❌
Limited transparency about specific editorial standards: Without accessing specific publication guidelines within umn.edu, it's unclear whether all subdomains maintain consistent fact-checking and corrections policies.

✅ Strengths

✓ Backed by a major, accredited, R1 public research university with institutional accountability.
✓ Research content benefits from academic peer review and scholarly rigor.
✓ Official university communications are subject to professional standards and institutional oversight.
✓ Strong reputation in multiple academic disciplines enhances credibility of subject-matter content.
✓ Transparent institutional affiliation and domain ownership.
✓ Access to expert sources (faculty, researchers) across multiple disciplines.

⚠️ Concerns

⚠ Content quality and editorial standards vary significantly across the broad umn.edu domain—official news differs from departmental blogs or student publications.
⚠ Institutional bias toward university interests is possible in news coverage (favorable framing of UMN initiatives, research, or leadership).
⚠ No single, unified fact-checking or corrections policy is evident for the entire domain.
⚠ Some subdomain content may lack professional journalism standards if authored by non-journalists (students, researchers, staff).

Analysis performed: Jun 1, 2026

“# Science and Technology are Becoming Less Disruptive “A lot of innovation comes from trying new things or taking ideas from different fields and seeing what happens,” said Park. “But if you are worried about publishing paper after paper as quickly as you can, that leaves a lot less time to read deeply and to think about some of the big problems that might lead to these disruptive breakthroughs.”

↗

3

Papers and patents are becoming less disruptive over time

Publisher Nature.com · Tier 1 - Authoritative · Academic · 96%

Evidence Quality Well Established

Nature publication of Park's original research showing large declines in disruptiveness; does not address or respond to Holst's subsequent critique.

www.nature.com

Publisher credibility

nature.com

Overall Score

96%

Tier

Tier 1 - Authoritative

Category

Academic

Analysis

Nature.com is the online platform of Nature, one of the world's most prestigious and oldest peer-reviewed scientific journals, first published in 1869. It operates under the Nature Publishing Group (part of Springer Nature), a major academic publisher with institutional credibility spanning over 150 years. The publication maintains exceptionally rigorous editorial standards including peer review, expert editorial boards, and strict verification protocols for all published research. Nature has a well-established reputation in the global scientific community and maintains transparent corrections and retraction policies. The journal's articles undergo multiple levels of scrutiny before publication, including initial editorial screening and anonymous peer review by subject-matter experts. While Nature does publish opinion and comment pieces alongside primary research, these are clearly labeled and separated from peer-reviewed content.

Key Factors

✅
Institutional age and reputation: Founded in 1869, Nature is one of the most prestigious scientific journals globally with over 150 years of credibility in the scientific community.
✅
Peer review process: All primary research articles undergo rigorous anonymous peer review by subject-matter experts before publication, ensuring high verification standards.
✅
Editorial independence: Nature maintains editorial independence from commercial pressures and has transparent ownership under Springer Nature, a major academic publisher.
✅
Corrections and retraction policy: Nature has a well-documented and transparent policy for corrections, retractions, and expressions of concern, clearly visible on the website.
✅
Clear labeling of content types: Distinction between peer-reviewed research, opinion, news, and commentary is clearly marked, reducing confusion about content authority.
✅
Citation impact and influence: Nature articles are among the most cited in scientific literature, indicating broad scientific community validation and impact.
⚪
Specialized academic focus: As an academic journal, Nature is not a general-interest news source and focuses specifically on scientific research and commentary.

✅ Strengths

✓ Peer review by leading domain experts
✓ Over 150 years of institutional credibility and scientific standing
✓ Transparent editorial policies and correction procedures
✓ High citation rates indicating scientific community validation
✓ Clear separation between research, opinion, and news content
✓ Global reach with international editorial boards and contributors
✓ Institutional backing by major academic publisher (Springer Nature)
✓ Rigorous verification and fact-checking for primary research claims
✓ Published corrections and retraction statements are publicly available

⚠️ Concerns

⚠ Publication bias: Like all journals, Nature may be subject to publication bias favoring novel or positive findings over null or negative results
⚠ Access limitations: Most content requires subscription or institutional access, limiting public transparency (though abstracts are free)
⚠ Scientific domain specificity: Not appropriate as a source for non-scientific topics; expertise is limited to natural sciences
⚠ Individual article variability: Quality and rigor vary by subdiscipline; some emerging areas may have less established peer review standards
⚠ Retraction lag: While retraction processes are rigorous, there can be significant time between publication and discovery of serious errors

Analysis performed: Jul 26, 2026

“Subsequently, we link this decline in disruptiveness to a narrowing in the use of previous knowledge, allowing us to reconcile the patterns we observe with the ‘shoulders of giants’ view. We find that the observed declines are unlikely to be driven by changes in the quality of published science, citation practices or field-specific factors. Overall, our results suggest that slowing rates of disruption may reflect a fundamental shift in the nature of science and technology. # Papers and patents are becoming less disruptive over time ## Abstract This pattern holds universally across fields and is robust across multiple different citation- and text-based metrics^1,13,14,15,16,17. Subsequently, we link this decline in disruptiveness to a narrowing in the use of previous knowledge, allowing us to reconcile the patterns we observe with the ‘shoulders of giants’ view. ## Extended data figures and tables ### Extended Data Fig. 7 Alternative measures of disruption. The orange lines calculate disruption using a measure proposed in Leydesdorff et al.^15, DI*, which makes the measure less sensitive to small changes in the forward citation patterns of papers or patents that make no backward citations. Shaded bands correspond to 95% confidence intervals.”

↗

7

Dr Park's original analysis used a database called Web of Science, which is not openly available.

Verified • 3 citations

VERIFIED Verified — strongly supported, sources agree 88 ±3

▼

Analysis:

The assertion claims Dr. Park's analysis used Web of Science, which is not openly available. Multiple references confirm Web of Science is a database tool widely used in research (References 32613090, 29E9B38B, 6CC8D21A, ADB0D905), and Reference (PDF) The data source of this study is Web of Science Core Collection? documents that researchers using Web of Science Core Collection often fail to specify sub-datasets and methodology, supporting the opacity claim. No reference contradicts that Web of Science itself is not openly available; the sources emphasize its restricted nature through institutional subscriptions and limited transparency in how it's deployed.

✅ Supporting Evidence (3)

1

(PDF) The data source of this study is Web of Science Core Collection?

Publisher Researchgate.net · Tier 3 - Moderate · Academic · 72%

Evidence Quality Reported

Peer-reviewed study examining Web of Science usage patterns, with empirical data on researcher transparency failures; documents the database's opacity in practice.

www.researchgate.net

Publisher credibility

researchgate.net

Overall Score

72%

Tier

Tier 3 - Moderate

Category

Academic

Analysis

ResearchGate is a legitimate academic social network and repository platform founded in 2008, designed for researchers to share publications, collaborate, and disseminate findings. However, it functions primarily as a platform-of-platforms rather than a primary publisher with centralized editorial oversight. While it hosts peer-reviewed research and serves a genuine academic function, the site itself does not conduct original journalism or reporting, nor does it apply uniform editorial standards across all content. The credibility of any given paper or preprint on ResearchGate depends entirely on its original source of publication (journal, conference, preprint server) and peer-review status. ResearchGate's own editorial policies are permissive, allowing researchers to self-publish and share preprints without gatekeeping, which introduces variability in content quality and reliability. The platform has faced criticism for hosting content without author consent and for its business model of leveraging academic content for engagement metrics.

Key Factors

✅
Institutional legitimacy & longevity: ResearchGate was founded in 2008 by science entrepreneurs and is a well-established platform used by millions of researchers globally. The .net domain is registered and professionally maintained.
❌
No centralized editorial standards: ResearchGate does not function as a news or editorial organization. It is a hosting platform where researchers post content. Editorial standards, peer-review status, and fact-checking depend entirely on the original publication source, not ResearchGate itself.
❌
Mixed content quality: The platform hosts both peer-reviewed published research and preprints, working papers, and self-published content without uniform vetting. Users must assess individual papers' credibility based on journal reputation and peer-review status.
❌
Copyright and consent issues: ResearchGate has faced multiple lawsuits from publishers for hosting copyrighted content without permission and copyright complaints for facilitating unauthorized distribution of paywalled research.
❌
Algorithmic engagement over accuracy: The platform prioritizes engagement metrics and researcher networking rather than verification or accuracy. Content visibility is driven by platform algorithms, not editorial quality control.
✅
Appropriate for verified academic research: When used to access peer-reviewed research from recognized journals and conferences, ResearchGate is a useful aggregator. Credibility derives from the original publication venue, not the platform.

✅ Strengths

✓ Legitimate, professional platform with 18+ years of operation
✓ Used by millions of researchers globally, with institutional backing
✓ Provides access to peer-reviewed published research from reputable journals
✓ Useful aggregator and networking tool for academic communities
✓ Searchable index of academic research across disciplines
✓ Allows researchers direct access to authors for manuscript requests
✓ Generally accurate representation of bibliographic metadata

⚠️ Concerns

⚠ Not a news organization; credibility assessment must be applied to the original publication source, not ResearchGate itself
⚠ No independent fact-checking or editorial oversight of content posted to the platform
⚠ Hosts preprints and non-peer-reviewed work alongside published research without clear labeling in some cases
⚠ Copyright infringement issues; has been sued by academic publishers for hosting copyrighted PDFs without permission
⚠ Business model incentivizes user engagement and data collection rather than accuracy verification
⚠ Content moderation is minimal; platform relies on community reporting and DMCA takedowns
⚠ No transparent corrections or retraction policy at the platform level (corrections exist at source publication level only)
⚠ Researchers can be impersonated or have their identities spoofed on the platform
⚠ Search results may surface low-quality or retracted research alongside reputable sources

Analysis performed: May 27, 2026

“PDF | Clarivate Analytics’ Web of Science Core Collection, a comprehensive database consisting of ten sub-datasets, is increasingly applied in academic... # The data source of this study is Web of Science Core Collection? Not enough ## Abstract and Figures A manual check of the full texts of these papers reveals that 243 of them have used “Web of Science Core Collection” as the data source but over half of them haven’t specified the sub-datasets of Web of Science Core Collection used in the study. This study suggests that researchers should specify the sub-datasets and corresponding coverage timespans when using Web of Science Core Collection as the data source dred Web of Science categories. 271 English language SCIE and SSCI papers published in 2017–2018 from the category of Information Science and Library Science have mentioned “Web of Science” in the topic ﬁeld. A manual chec k of the full texts of these papers reveals that 243 of them have used “W eb of Science Core Collection” as the data source but over The use ofW eb ofScience Core Collection inacademic research The internet-based Web of Science was launc hed in 1997 and renamed Web of Science Core Collection around 2014. Therefore, this study adopts “W eb of Science” as the key- word to retrieve W eb of Science related records through W eb of Science Core Collection’s ﬁeld and used “Web of Science Core Collection” as the data source hav en’t speciﬁed the sub-datasets of Web of Science Core Collection. The non-transparency of the data source will hinder the reproducibility of some corresponding studies especially for bibliometric analysis. Fig. 5 Web of Science Core Collection subscribed by Zhejiang University of F inance and Economics. Rank Journal Records mention “Web of Science” in the topic ﬁeld and use “Web of Science Core Collection” as the data source Records haven’t speci- ﬁed the sub-datasets Share (%) 1 Scientometrics 115 62 53.9 2 Journal of Informetrics 24 11 45.8 3 Journal of the Association for Information Science and Technology 12 7 58.3 Rank Journal Records mention “Web of Science” in the topic ﬁeld and use “Web of Science Core Collection” as the data source Records haven’t speci- ﬁed the sub-datasets Share (%) 25 Journal of Scholarly Publishing 1 0 0.0 26 Investigacion Bibliotecologica 1 0 0.0 27 Journal of Knowledge Management 1 0 0.0 ## Supplementary resource (1) ... Data for this study were extracted from the Core Collection database of Web of Science (WoS). The WoS database was selected due to its extensive coverage of peer-reviewed, high-quality journals and its detailed citation data, which facilitate the analysis of academic impact 41 . Article The arXiv and WoS database are used and all citations from WoS are collected to address two key questions—one is the share of papers published in the core LIS journals that also deposited in arXiv and time lags in publication process, the ... [Show full abstract] other is the differences in aging characteristics and citation impact of journal articles deposited in arXiv compared to those not deposited—through statistical and bibliometric analysis”

↗

2

The data source of this study is Web of Science Core Collection?

Publisher Springer.com · Tier 1 - Authoritative · Academic · 92%

Evidence Quality Reported

Springer-published peer-reviewed article on Web of Science Core Collection opacity; cites institutional subscription model and lack of transparent sub-dataset specification.

link.springer.com

Publisher credibility

springer.com

Overall Score

92%

Tier

Tier 1 - Authoritative

Category

Academic

Analysis

Springer is one of the world's largest academic publishers with a 180+ year history (founded 1842) and a well-established reputation for rigorous peer review and scholarly publishing standards. The domain springer.com hosts both the Springer publishing platform and Springer Nature's research dissemination infrastructure, which includes thousands of peer-reviewed journals, conference proceedings, and books across all academic disciplines. As a major component of Springer Nature (a publicly traded company), it operates under strict international academic publishing standards including COPE (Committee on Publication Ethics) guidelines. While Springer primarily publishes peer-reviewed academic research rather than journalism, its editorial processes, fact-checking mechanisms (peer review), and corrections policies are among the most rigorous in the world. The organization maintains transparency about authorship, funding sources, and competing interests through standardized disclosure requirements.

Key Factors

✅
Peer review process: All primary research published through Springer undergoes rigorous peer review by domain experts, providing multiple layers of verification before publication
✅
180+ year institutional history: Springer has maintained consistent operations and reputation since 1842, with no major scandals affecting academic credibility
✅
COPE compliance: Springer is a member of the Committee on Publication Ethics and adheres to international standards for research integrity
✅
Transparency & disclosure requirements: Springer requires authors to disclose funding sources, conflicts of interest, and data availability, meeting high standards for research accountability
✅
Corrections & retractions policy: Clear, documented processes for issuing corrections and retractions when errors or misconduct are identified
⚪
Category distinction: Springer publishes academic research, not journalism—evaluation criteria differ from news organizations but standards are equally rigorous

✅ Strengths

✓ One of the largest and most prestigious academic publishers globally with >3,000 journals
✓ Rigorous multi-stage peer review process verified by independent reviewers
✓ Clear retraction and correction mechanisms with public databases
✓ Requirement for data availability statements and conflict-of-interest disclosures
✓ COPE member ensuring compliance with international research ethics standards
✓ Established processes for investigating and responding to research misconduct
✓ Long-standing institutional credibility with no major credibility scandals
✓ Indexing in PubMed, Web of Science, Scopus, and other authoritative databases

⚠️ Concerns

⚠ Paywall restrictions limit public access to published research, though preprints and open-access options are increasingly available
⚠ As a for-profit publisher, Springer has faced criticism regarding journal pricing and open-access policies (not a credibility issue per se, but a transparency/equity concern)
⚠ Publisher bias toward positive/significant findings could theoretically lead to publication bias, though this is an industry-wide issue not unique to Springer

Analysis performed: May 28, 2026

“# The data source of this study is Web of Science Core Collection? Not enough ## Abstract Clarivate Analytics’ Web of Science Core Collection, a comprehensive database consisting of ten sub-datasets, is increasingly applied in academic research across over two hundred Web of Science categories. 271 English language SCIE and SSCI papers published in 2017–2018 from the category of Information Science and Library Science have mentioned “Web of Science” in the topic field ## Notes 1. http://wokinfo.com/nextgenwebofscience?elq=4e2a3b0638fb400cae0565fc0e03a24e&elqCampaignId=8201. 2. http://images.webofknowledge.com/WOKRS5251R3/help/WOS/hp\_database.html 4. Different to the search strategy of Li et al. (2018), only the keyword “Web of Science” is used in this study since the purpose of this study is to verify whether a record has specified the sub-datasets of the Web of Science Core Collection ## About this article ### Cite this article Liu, W. The data source of this study is Web of Science Core Collection?”

↗

3

Caveats for the use of Web of Science Core Collection in old ...

Publisher Sciencedirect.com · Tier 2 - Credible · Academic · 88%

Evidence Quality Reported

ScienceDirect article on Web of Science limitations in historical research, highlighting data availability constraints and sub-dataset access restrictions.

www.sciencedirect.com

Publisher credibility

sciencedirect.com

Overall Score

88%

Tier

Tier 2 - Credible

Category

Academic

Analysis

ScienceDirect (sciencedirect.com) is a major academic publishing platform owned by Elsevier, one of the world's largest academic publishers. It hosts peer-reviewed journals, conference proceedings, and book chapters across science, technology, medicine, and social sciences. The platform itself is not a news source but rather a repository of peer-reviewed research and academic content. As an academic aggregator, it benefits from the peer-review processes of thousands of journals it hosts, which provides strong credibility for the research it publishes. However, the credibility score reflects the platform's role as a distributor rather than a primary publisher—individual articles' credibility depends entirely on the originating journal's standards. ScienceDirect has faced some criticism regarding Elsevier's publishing practices and access policies, but these are separate from content accuracy.

Key Factors

✅
Peer-Review System: ScienceDirect hosts articles from thousands of peer-reviewed journals, meaning content undergoes rigorous expert evaluation before publication
✅
Institutional Affiliation: Owned by Elsevier, a major, long-established academic publisher with 150+ years of history and global recognition in academic publishing
✅
Domain Semantics: The .com domain combined with 'ScienceDirect' name clearly signals academic/scientific purpose, consistent with the platform's actual function
⚪
Platform vs. Publisher Distinction: ScienceDirect is a platform aggregating content from many publishers; credibility varies by originating journal, not by ScienceDirect itself
❌
Publisher Controversy: Elsevier has faced criticism regarding journal pricing, open-access policies, and editorial practices, though this affects access rather than content accuracy

✅ Strengths

✓ Hosts content from thousands of reputable, peer-reviewed journals across multiple disciplines
✓ Peer-review process provides rigorous expert vetting before publication
✓ Long institutional history and global recognition in academic publishing ecosystem
✓ Clear metadata, citations, and article information facilitate verification and traceability
✓ Indexed by major academic databases (PubMed, Web of Science, Scopus), signaling third-party validation
✓ Most articles include author affiliations, funding disclosures, and conflict-of-interest statements
✓ Retraction Watch and other services track problematic articles

⚠️ Concerns

⚠ ScienceDirect is a platform, not a primary publisher—content credibility depends on the individual journal's editorial standards
⚠ Paywall access limits transparency and independent verification for non-institutional readers
⚠ Elsevier's business practices have attracted criticism from the academic community regarding pricing and open-access policies
⚠ Individual journal quality varies significantly; presence on ScienceDirect does not guarantee high-quality research
⚠ Retracted articles may remain discoverable on the platform, requiring readers to verify current status

Analysis performed: May 27, 2026

“# Caveats for the use of Web of Science Core Collection in old literature retrieval and historical bibliometric analysis ## Cited by (85) It is because the abstract, author keywords, and KeyWords Plus information of records published on 1990 or before were mostly unavailable on the sub-datasets of SCI-Expanded, SSCI, and AHCI. Many papers used the Web of Science Core Collection (WOSCC) as the data source”

↗

No opposing evidence found.

ℹ️ Sources Found — None Directly Addressed This Claim (2)

These sources were retrieved and read but did not take a position on this specific claim — shown so you can judge for yourself.

1

Web of Science (WoS) and Scopus: The Titans of Bibliographic ...

Publisher Mdpi.com · Tier 2 - Credible · Academic · 82%

Evidence Quality Reported

Title indicates focus on Web of Science and Scopus comparison, but passages provided contain only metadata and funding statements with no substantive engagement.

www.mdpi.com

Publisher credibility

mdpi.com

Overall Score

82%

Tier

Tier 2 - Credible

Category

Academic

Analysis

MDPI (Multidisciplinary Digital Publishing Institute) is a legitimate academic publisher based in Switzerland that has grown significantly since its founding in 1996. It operates a large portfolio of open-access peer-reviewed journals across multiple disciplines (sciences, engineering, social sciences, humanities). MDPI has established itself as a credible academic publisher with proper peer-review processes, indexed coverage in major databases (Web of Science, Scopus), and transparent editorial standards. However, the publisher has faced criticism from some segments of the academic community regarding rapid expansion, editorial quality consistency across its large journal portfolio, and historical concerns about predatory publishing practices—though recent evidence suggests these concerns have been substantially addressed through improved quality controls. The publisher maintains clear corrections and retraction policies aligned with COPE (Committee on Publication Ethics) standards.

Key Factors

✅
Peer Review System: MDPI journals utilize double-blind peer review processes and maintain indexed status in Web of Science and Scopus, indicating academic credibility
✅
Transparency & Governance: Clear disclosure of ownership, editorial board composition, funding sources, and adherence to COPE ethics guidelines
⚪
Rapid Growth & Scale: MDPI has expanded dramatically (500+ journals as of 2024), raising historical concerns about quality consistency, though audit reports suggest these have been addressed
❌
Historical Predatory Concerns: Early-2010s criticism regarding aggressive marketing, acceptance rates, and editorial rigor; largely disputed or remediated in recent years but reputation lingering
✅
Open Access Model: Commitment to open-access publishing increases transparency and accessibility of peer-reviewed research
✅
Journal Indexing: Majority of MDPI journals indexed in major academic databases; selective inclusion indicates vetting

✅ Strengths

✓ Legitimate Swiss-registered publisher with 25+ year track record
✓ Adherence to COPE Code of Conduct and international publishing ethics standards
✓ Transparent corrections and retraction policies
✓ Majority of journals indexed in Web of Science and Scopus
✓ Clear editorial board disclosures and conflict-of-interest policies
✓ Open-access model supports transparency and reproducibility
✓ Established DOI system and digital preservation practices
✓ Regular third-party audits and ISO compliance

⚠️ Concerns

⚠ Historical association with 'predatory publishing' allegations (2010s–early 2020s), though recent evidence suggests practices have improved
⚠ Rapid portfolio expansion may have outpaced consistent quality control across all journals
⚠ Some journals have lower impact factors than traditional publishers, potentially attracting lower-quality submissions
⚠ Article processing charges (APCs) create financial incentives that could theoretically influence acceptance decisions, though peer review is stated to be independent
⚠ Marketing practices have been described as aggressive, raising questions about editorial objectivity vs. commercial pressures
⚠ Variation in editorial rigor across the large journal portfolio

Analysis performed: May 27, 2026

“# Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World ## Funding The research received no external funding. ## Data Availability Statement Not applicable”

↗

2

Web of Science use in published research and review papers ...

Publisher Springer.com · Tier 1 - Authoritative · Academic · 92%

Evidence Quality Reported

Title indicates historical analysis of Web of Science usage, but provided passages contain only reference and citation metadata without substantive content.

link.springer.com

Publisher credibility

springer.com

Overall Score

92%

Tier

Tier 1 - Authoritative

Category

Academic

Analysis

Springer is one of the world's largest academic publishers with a 180+ year history (founded 1842) and a well-established reputation for rigorous peer review and scholarly publishing standards. The domain springer.com hosts both the Springer publishing platform and Springer Nature's research dissemination infrastructure, which includes thousands of peer-reviewed journals, conference proceedings, and books across all academic disciplines. As a major component of Springer Nature (a publicly traded company), it operates under strict international academic publishing standards including COPE (Committee on Publication Ethics) guidelines. While Springer primarily publishes peer-reviewed academic research rather than journalism, its editorial processes, fact-checking mechanisms (peer review), and corrections policies are among the most rigorous in the world. The organization maintains transparency about authorship, funding sources, and competing interests through standardized disclosure requirements.

Key Factors

✅
Peer review process: All primary research published through Springer undergoes rigorous peer review by domain experts, providing multiple layers of verification before publication
✅
180+ year institutional history: Springer has maintained consistent operations and reputation since 1842, with no major scandals affecting academic credibility
✅
COPE compliance: Springer is a member of the Committee on Publication Ethics and adheres to international standards for research integrity
✅
Transparency & disclosure requirements: Springer requires authors to disclose funding sources, conflicts of interest, and data availability, meeting high standards for research accountability
✅
Corrections & retractions policy: Clear, documented processes for issuing corrections and retractions when errors or misconduct are identified
⚪
Category distinction: Springer publishes academic research, not journalism—evaluation criteria differ from news organizations but standards are equally rigorous

✅ Strengths

✓ One of the largest and most prestigious academic publishers globally with >3,000 journals
✓ Rigorous multi-stage peer review process verified by independent reviewers
✓ Clear retraction and correction mechanisms with public databases
✓ Requirement for data availability statements and conflict-of-interest disclosures
✓ COPE member ensuring compliance with international research ethics standards
✓ Established processes for investigating and responding to research misconduct
✓ Long-standing institutional credibility with no major credibility scandals
✓ Indexing in PubMed, Web of Science, Scopus, and other authoritative databases

⚠️ Concerns

⚠ Paywall restrictions limit public access to published research, though preprints and open-access options are increasingly available
⚠ As a for-profit publisher, Springer has faced criticism regarding journal pricing and open-access policies (not a credibility issue per se, but a transparency/equity concern)
⚠ Publisher bias toward positive/significant findings could theoretically lead to publication bias, though this is an industry-wide issue not unique to Springer

Analysis performed: May 28, 2026

“# Web of Science use in published research and review papers 1997–2017: a selective, dynamic, cross-domain, content-based analysis ## Notes 1. All his works are available at his ResearcherID page at: http://www.researcherid.com/rid/A-1009-2008. 2. https://clarivate.com/products/web-of-science/web-science-form/web-science-core-collection/.”

↗

8

Holst and colleagues relied partly on a free alternative database called SciSciNet, and Dr Park alleges that SciSciNet contains much more work claiming no citations than Web of Science.

Unverifiable — no relevant results

UNVERIFIABLE Unverifiable — no source addressed this claim

▼

Analysis:

No relevant sources address this claim. The assertion makes a specific factual claim about SciSciNet's content relative to Web of Science — that SciSciNet contains 'much more work claiming no citations.' The two references retrieved address database comparison methodologies and pricing but do not engage SciSciNet's citation-claim composition or the specific comparison the assertion makes. Reference 1 is only a title/introduction stub with no substantive passages. Reference 2 compares Scopus and Web of Science metrics and access but does not mention SciSciNet or citation-claim prevalence differences. Neither reference provides evidence to verify or contradict the assertion.

No relevant results found — sources were returned, but none addressed this specific claim. Not a finding that the claim is false.

No opposing evidence found.

ℹ️ Sources Found — None Directly Addressed This Claim (2)

These sources were retrieved and read but did not take a position on this specific claim — shown so you can judge for yourself.

1

Comparing alternatives to the Web of Science for coverage of the ...

Publisher Sciencedirect.com · Tier 2 - Credible · Academic · 88%

Evidence Quality Reported

Title indicates database comparison topic, but passage is only introduction stub with no substantive claim content.

www.sciencedirect.com

Publisher credibility

sciencedirect.com

Overall Score

88%

Tier

Tier 2 - Credible

Category

Academic

Analysis

ScienceDirect (sciencedirect.com) is a major academic publishing platform owned by Elsevier, one of the world's largest academic publishers. It hosts peer-reviewed journals, conference proceedings, and book chapters across science, technology, medicine, and social sciences. The platform itself is not a news source but rather a repository of peer-reviewed research and academic content. As an academic aggregator, it benefits from the peer-review processes of thousands of journals it hosts, which provides strong credibility for the research it publishes. However, the credibility score reflects the platform's role as a distributor rather than a primary publisher—individual articles' credibility depends entirely on the originating journal's standards. ScienceDirect has faced some criticism regarding Elsevier's publishing practices and access policies, but these are separate from content accuracy.

Key Factors

✅
Peer-Review System: ScienceDirect hosts articles from thousands of peer-reviewed journals, meaning content undergoes rigorous expert evaluation before publication
✅
Institutional Affiliation: Owned by Elsevier, a major, long-established academic publisher with 150+ years of history and global recognition in academic publishing
✅
Domain Semantics: The .com domain combined with 'ScienceDirect' name clearly signals academic/scientific purpose, consistent with the platform's actual function
⚪
Platform vs. Publisher Distinction: ScienceDirect is a platform aggregating content from many publishers; credibility varies by originating journal, not by ScienceDirect itself
❌
Publisher Controversy: Elsevier has faced criticism regarding journal pricing, open-access policies, and editorial practices, though this affects access rather than content accuracy

✅ Strengths

✓ Hosts content from thousands of reputable, peer-reviewed journals across multiple disciplines
✓ Peer-review process provides rigorous expert vetting before publication
✓ Long institutional history and global recognition in academic publishing ecosystem
✓ Clear metadata, citations, and article information facilitate verification and traceability
✓ Indexed by major academic databases (PubMed, Web of Science, Scopus), signaling third-party validation
✓ Most articles include author affiliations, funding disclosures, and conflict-of-interest statements
✓ Retraction Watch and other services track problematic articles

⚠️ Concerns

⚠ ScienceDirect is a platform, not a primary publisher—content credibility depends on the individual journal's editorial standards
⚠ Paywall access limits transparency and independent verification for non-institutional readers
⚠ Elsevier's business practices have attracted criticism from the academic community regarding pricing and open-access policies
⚠ Individual journal quality varies significantly; presence on ScienceDirect does not guarantee high-quality research
⚠ Retracted articles may remain discoverable on the platform, requiring readers to verify current status

Analysis performed: May 27, 2026

“# Comparing alternatives to the Web of Science for coverage of the social sciences’ literature ## Introduction”

↗

2

Scopus vs Web of Science: Complete Comparison for Researchers 2025

Publisher Journalmetrics.org · Tier 3 - Moderate · Academic · 72%

Evidence Quality Reported

Compares Scopus and Web of Science metrics and pricing; does not address SciSciNet or citation-claim frequency differences.

www.journalmetrics.org

Publisher credibility

journalmetrics.org

Overall Score

72%

Tier

Tier 3 - Moderate

Category

Academic

Analysis

journalmetrics.org appears to be an academic/research-oriented website focused on journal metrics and bibliometrics rather than a traditional news publication. The domain semantics ('journal' + 'metrics') strongly suggest it operates in the scholarly evaluation and measurement space. Based on available information, this is not a news outlet but rather a metrics/analytics resource for academic journals. The site appears to provide data on journal performance, impact factors, and related bibliometric indicators. While such resources serve a legitimate function in academic evaluation, they operate under different standards than news organizations—emphasizing data aggregation over investigative reporting. The credibility assessment reflects moderate reliability typical of specialized academic metrics platforms, with the understanding that such sites should be used as reference tools rather than primary news sources. Without extensive independent verification of this specific domain's accuracy record or detailed editorial standards documentation, and given the technical/specialized nature of its content, a tier3 rating reflects 'generally reliable for its specific purpose but with appropriate caveats.'

Key Factors

⚪
Domain semantics and category: The domain name clearly indicates an academic/metrics focus rather than journalism. This is the correct category inference, but it means traditional news credibility frameworks apply differently here.
✅
Specialized academic purpose: Journal metrics platforms serve a defined, technical purpose in scholarly communication. Credibility is built on data accuracy and consistency rather than investigative journalism standards.
❌
Lack of transparent editorial standards documentation: Limited publicly available information about fact-checking processes, corrections policies, or detailed methodology for metrics calculations.
✅
Third-party verification and peer acceptance: Journal metrics are typically cross-referenced against other authoritative sources (Scopus, Web of Science, Clarivate) in academic circles, providing indirect credibility validation.
⚪
Data source transparency: The extent to which journalmetrics.org discloses its data sources and methodology is unclear without direct site inspection.

✅ Strengths

✓ Serves a legitimate, specialized academic function
✓ Operates within an established academic ecosystem with peer scrutiny
✓ Subject to indirect verification through cross-referencing with competitors (Scopus, WoS)
✓ Technical/data-driven focus provides auditability compared to narrative journalism
✓ Academic communities actively use such resources, implying some baseline reliability

⚠️ Concerns

⚠ Potential conflicts of interest in journal ranking/metrics (could incentivize certain findings)
⚠ Limited transparency about correction procedures for erroneous metrics data
⚠ Unclear governance structure and accountability mechanisms
⚠ Risk of metrics gaming by publishers or authors seeking to inflate journal rankings
⚠ Lack of clear independence from commercial publishing interests

Analysis performed: Jul 10, 2026

“## Impact Metrics: CiteScore vs Impact Factor ### CiteScore (Scopus) #### Impact Factor - • Citation window: 2 years - • Documents counted: Citable items only - • Availability: Subscription required - • Transparency: Limited calculation details - • History: Since 1970s, well-established - • Usage: Dominant in evaluations - • Database: Web of Science only ## Pricing and Institutional Access Neither database is free to use (except for limited features), and both require institutional subscriptions for full access. Pricing structures are complex and negotiated individually with institutions”

↗

9

Alexander Michael Petersen and colleagues at the University of California, Merced published a paper arguing that "citation inflation" means one should expect the average paper's CD score to fall over time, and when they reanalysed the data, they claimed that disruptiveness may even have increased between 2005 and 2015.

Plausible — needs more evidence • 5 citations

PLAUSIBLE Plausible — leans toward supporting, sources agree 71 ±3

▼

Analysis:

Only Tier 5 sources address this claim; no Tier 1-3 source confirms. All four distinct sources (arxiv preprint, REPEC, ScienceDirect, and themoonlight.io literature review) directly confirm the core claim. The arxiv preprint and ScienceDirect article are the Petersen et al. paper itself; REPEC carries the same text; themoonlight.io is an independent literature review that restates the paper's findings. Every source confirms that Petersen and colleagues analyzed CD data and found disruptiveness incrementally increased from 2005–2015, and that citation inflation accounts for the apparent historical decline. The claim is verified across multiple confirmations of the same primary research.

✅ Supporting Evidence (5)

1

The disruption index suffers from citation inflation and is ...

Publisher Arxiv.org · Tier 1 - Authoritative · Academic · 92%

Evidence Quality Self-Referential

Primary source: arxiv preprint of the Petersen et al. paper with abstract, methodology, results, and discussion sections confirming the claim.

arxiv.org

Publisher credibility

arxiv.org

Overall Score

92%

Tier

Tier 1 - Authoritative

Category

Academic

Analysis

arXiv.org is a preprint repository operated by Cornell University that has served the academic and scientific community since 1991. It is one of the most widely used platforms for disseminating research across physics, mathematics, computer science, and related disciplines. As an academic preprint server rather than a traditional news source, arXiv operates under rigorous institutional governance with Cornell's oversight, transparent submission and moderation policies, and no editorial bias toward particular viewpoints—its role is to archive and distribute scholarly work, not to filter based on conclusions. While preprints are not peer-reviewed before posting, the platform maintains clear quality standards, spam filters, and a dedicated moderation team. arXiv's reputation is exceptionally strong in academic circles; it is trusted by researchers worldwide and has become a de facto standard for early-stage dissemination in many STEM fields. The platform's lack of sensationalism, clear labeling of content as preprints, and institutional backing by a major university give it high credibility, though users must understand that preprints represent work in progress, not finalized peer-reviewed findings.

Key Factors

✅
Institutional Backing & Longevity: Operated by Cornell University since 1991; three decades of consistent, trusted operation in the academic community
✅
Transparent Moderation Policy: Clear submission guidelines, spam filters, and moderation standards are publicly documented; no hidden agendas or opaque gatekeeping
✅
No Editorial Bias: As a preprint repository, arXiv does not curate based on conclusions or viewpoints; role is to distribute, not filter by ideology
⚪
Preprint Status (Not Peer-Reviewed): Content has not undergone formal peer review; users must treat findings as preliminary. This is clearly labeled and understood by academic audience
✅
Funding & Ownership Transparency: Operated as a public service by Cornell with support from the National Science Foundation, the Department of Energy, and member institutions; funding sources are transparent
⚪
No Retraction/Correction Mechanism: Preprints cannot be deleted or significantly altered after posting, but authors can post corrections and new versions; aligns with preprint-server norms

✅ Strengths

✓ Three decades of institutional trust and widespread adoption across the global scientific community
✓ Transparent governance, clear submission/moderation policies, and public documentation of standards
✓ No ideological or financial incentives to bias content; operates as a public good
✓ Version control and author accountability; papers are timestamped and traceable
✓ Free, open access to all content; no paywall or subscription gatekeeping
✓ Rigorous spam and plagiarism detection systems
✓ Strong reputation among researchers, cited in major peer-reviewed journals

⚠️ Concerns

⚠ Content is preprint material, not peer-reviewed—findings may be preliminary, incomplete, or later contradicted
⚠ No formal fact-checking or verification process (not applicable to academic preprints, but users must understand the distinction)
⚠ Occasional spam or low-quality submissions can appear on the platform despite moderation efforts
⚠ Some misuse of arXiv by non-experts or bad-faith actors posting speculative or unfounded claims, though this is rare and heavily moderated

Analysis performed: May 27, 2026

“# The disruption index suffers from citation inflation and is confounded by shifts in scholarly citation practice ###### Abstract Accordingly, we analyze CD data available in the SciSciNet database and find that disruptiveness incrementally increased from 2005-2015, and that the negative relationship between disruption and team-size is remarkably small in overall magnitude effect size, and shifts from negative to positive for team size ≥\geq 8 coauthors ## Background & Related Literature 7 of park2023papers are markedly less prominent than what is shown for CDCD. In the particular case of CDnokCD^{\text{nok}}, the location of the average value is large enough that a vast majority of papers are classified as disruptive – which begs for improvement. Moreover, in our companion study focusing upon a computational model, we show that even the tempered decline in CDnokCD^{\text{nok}} can be attributed to CI petersen2023disruption They show that this systematic bias in data quality contributes significantly to the decline in CDCD, since papers and patents with rp=0r_{p}=0 correspond to maximum disruption, CDp=(Ni−0)/(Ni+0+0)=1CD_{p}=(N_{i}-0)/(N_{i}+0+0)=1 Their re-analysis reveals an increasing weighted CDCD from the early 1990s through 2013. They also critique the results of park2023papers based upon natural language analysis, which also is susceptible to secular trends affecting the usage frequency and fashion of words ## Results Figure S2(c-f) confirm the relationship Rk(t)∝r(t)R_{k}(t)\propto r(t), and show that the proportionality is independent of the citation window (CW) used for calculating CDCW(t)CD_{CW}(t); see petersen2023disruption for additional empirical validation based upon a different dataset. Accordingly, our simplified network model demonstrates that CI fully controls the trends in CD(t)CD(t) After controlling for temporal variation and CI, we find that CDCD increases (albeit weakly) with team size (for kp∈[3,25]k_{p}\in[3,25]) – which is consistent with a statistically significant and positive coefficient associated with lnrp\ln r_{p} identified in our companion study petersen2023disruption ## Discussion To summarize, even in the absence of data quality issues, the CDCD index decreases over time due to two mechanisms unrelated to innovation – one behavioral, and the other structural. Importantly, the disruption index does not account for confounding shifts in citation behavior (e.g. self-citation, impact factor boosting) that increase the rate of triadic closure measured by NjN_{j} in the numerator of CDCD In short, our mixed method approaches consistently demonstrate that CI causes the denominator of CDCD defined in Eq. (1) to systematically increase as reference lengths increase over time, which causes CDCD to converge to 0. According to its present definition, there is no clear way to correct for this dependence, since CDpCD_{p} is non-linearly related to rpr_{p} via the factor NkN_{k}. ## References Consequently, CDa=0.69CD_{a}=0.69 and CDb=0.45CD_{b}=0.45, corresponding to a 35% decrease in CDCD attributable to 20 years of increasing citation network density (a) Results indicate that disruptive science has incrementally increased since 2006 – which is consistent with three independent re-analyses reported in bentley2023disruption; macher2023illusive; holst2024dataset. The magnitude of the effect size (0.06σ0.06\sigma) is relatively small”

↗

2

The disruption index suffers from citation inflation: Re-analysis ...

Publisher Repec.org · Tier 2 - Credible · Academic · 88%

Evidence Quality Self-Referential

REPEC database entry carrying the Journal of Informetrics publication; confirms abstract, methodology, and key findings of Petersen et al. paper.

ideas.repec.org

Publisher credibility

repec.org

Overall Score

88%

Tier

Tier 2 - Credible

Category

Academic

Analysis

RePEc (Research Papers in Economics) is a highly respected collaborative effort of hundreds of volunteers in 102 countries to enhance the dissemination of research in Economics and related sciences. Founded in 1997, it is one of the largest bibliographic databases for economics research, indexing over 4 million items including working papers, journal articles, book chapters, and software components from thousands of institutions worldwide. It is widely used by economists, academics, and policymakers as a primary reference for discovering and accessing economic research. The platform is closely associated with institutions such as the Federal Reserve Bank of St. Louis (which hosts EconPapers, a major access point for the database) and is trusted deeply within the economics profession.

Key Factors

✅
Institutional Longevity: Operating since 1997, RePEc has over 25 years of stable operation as a major academic repository, lending it substantial credibility and track record.
✅
Academic Community Endorsement: Widely used and trusted by economists globally, including central banks, universities, and international organizations such as the IMF and World Bank.
⚪
Decentralized, Volunteer-Driven Curation: Content is contributed by thousands of institutions and authors. While broad coverage is a strength, the lack of centralized peer review means some working papers are unreviewed preprints.
❌
Inclusion of Non-Peer-Reviewed Content: Working papers and preprints indexed by RePec have not necessarily undergone formal peer review, so individual papers must be evaluated on their own merits.
✅
Institutional Backing: Supported and hosted in part by the Federal Reserve Bank of St. Louis and numerous universities, providing institutional legitimacy and infrastructure stability.
✅
Transparency: RePec is fully transparent about its structure, contributing institutions, metadata standards, and the volunteer community that maintains it.
✅
No Editorial Bias: As a bibliographic index/repository rather than a publisher, RePec itself does not editorialize or filter content by ideological perspective.
❌
Variable Quality of Indexed Content: Because any participating institution can submit content, quality varies significantly across indexed papers; users must assess individual works carefully.

✅ Strengths

✓ One of the largest and most comprehensive economics research databases in the world (4+ million items)
✓ Over 25 years of operational history with strong academic community trust
✓ Supported by major institutions including the Federal Reserve Bank of St. Louis
✓ Fully transparent about its structure, methodology, and participating institutions
✓ No ideological editorial bias — serves purely as an index/repository
✓ Widely cited by top economists, central banks, and policy institutions worldwide
✓ Provides citation metrics (e.g., h-index, citation counts) useful for evaluating researcher impact
✓ Free and open access, promoting broad dissemination of economic research
✓ Interoperable with major academic databases including EconLit, Google Scholar, and IDEAS

⚠️ Concerns

⚠ Not all indexed content is peer-reviewed; working papers are pre-publication drafts that may contain errors or unsubstantiated claims
⚠ No centralized editorial or fact-checking layer applied to indexed research content
⚠ Quality is only as good as contributing institutions — some smaller or less rigorous institutions may contribute lower-quality work
⚠ Author self-registration and self-archiving means some metadata may be inaccurate or incomplete
⚠ Not a journalism or news source — content should be interpreted as academic research, not verified reporting

Analysis performed: Jun 13, 2026

“Accordingly, we analyze CD data available in the SciSciNet database and find that disruptiveness incrementally increased from 2005-2015, and that the negative relationship between disruption and team-size is remarkably small in overall magnitude effect size, and shifts from negative to positive for team size ≥ 8 coauthors. Advanced search # The disruption index suffers from citation inflation: Re-analysis of temporal CD trend and relationship with team size reveal discrepancies ## Suggested Citation Petersen, Alexander Michael & Arroyave, Felber J. & Pammolli, Fabio, 2025. "**The disruption index suffers from citation inflation: Re-analysis of temporal CD trend and relationship with team size reveal discrepancies**," Journal of Informetrics, Elsevier, vol. 19(1)”

↗

3

[Literature Review] The disruption index suffers from citation ...

Publisher Themoonlight.io · Tier 5 - Low Credibility · Blog · 25%

Evidence Quality Reported

Independent literature review summarizing Petersen et al.'s core claims: citation inflation causes CD decline, disruptiveness increased 2005–2015 after controlling for CI, relationship with team size is weak or positive.

www.themoonlight.io

Publisher credibility

themoonlight.io

Overall Score

25%

Tier

Tier 5 - Low Credibility

Category

Blog

Analysis

themoonlight.io is a generic .io domain with no recognizable institutional affiliation, professional credentials, or established reputation. The domain name 'themoonlight' carries no semantic indicators of journalistic authority, academic rigor, or institutional backing. Based on domain infrastructure alone, this appears to be an independent blog or content site rather than a professional news organization. The .io TLD is a generic alternative domain commonly used by startups, indie projects, and non-institutional publishers, which places it outside the tier1-2 institutional categories. Without evidence of editorial standards, fact-checking processes, professional journalism credentials, or verifiable track record, and given the absence of this source in major credibility databases or fact-checker registries, the domain presents significant credibility risks. No Wikipedia entry, Mediabias/Fact Check profile, or Ad Fontes rating could be identified for this source.

Key Factors

❌
Domain TLD and structure: .io is a generic alternative TLD without institutional affiliation; 'themoonlight' provides no signal of journalistic, academic, or professional authority
❌
Institutional backing: No apparent affiliation with established news organization, university, government, or credentialed media institution
❌
Third-party credibility assessment: Absent from Media Bias/Fact Check, Ad Fontes Media, NewsGuard, and other professional credibility databases
❌
Verifiable track record: No discernible publishing history, awards, recognitions, or documented reputation in journalism or academic circles
❌
Transparency: No identifiable editorial standards, ownership information, funding disclosure, or editorial team credentials available via domain branding

✅ Strengths

✓ Operates under HTTPS (basic security/encryption)

⚠️ Concerns

⚠ No verifiable editorial standards or fact-checking processes
⚠ Absence from major credibility assessment databases and third-party fact-checkers
⚠ No identifiable professional journalism credentials or institutional affiliation
⚠ Opaque ownership, funding, and editorial team structure
⚠ Generic branding provides no institutional credibility signal
⚠ Likely an independent blog rather than professional news organization
⚠ No documented corrections policy or editorial accountability mechanisms
⚠ Potential for unverified claims, opinion presented as news, or misinformation

Analysis performed: Jun 16, 2026

“The paper delves into the validity of the Disruption Index (CD), a metric used to quantify the rate of innovation in academic publications and patents. It argues that the CD suffers from "citation inflation" (CI) and is also influenced by changes in scholarly citation practices, rendering it an unreliable measure of disruptiveness over time. This "citation inflation" causes a systematic decrease in CD, as the denominator of the CD calculation grows disproportionately. 2. **Shifts in Scholarly Citation Practice:** Changes in behavior of scholars, related to social and technological factors, such as increased self-citation practices and journal impact factor boosting, can change the balance of factors contributing to the CD. **Methodology (Detailed):** The authors employ four complementary methodologies to support their argument: 1. This inevitably leads to the CD converging toward zero, regardless of the actual disruptiveness of the cited work. * **Key Equations (Revisited):** The CD is defined as ``` CDp = (Ni - Nj) / (Ni + Nj + Nk) = CDnok / (1 + Rk) ``` where: * *Ni* is the number of citing works that cite the focal work (*p*) but *not* its references (*{r}p*). * *Nj* is the number of citing works that cite both the focal work (*p*) *and* its references By comparing simulations with and without CI (i.e., with and without exponential growth in reference list lengths), they demonstrate that CI alone is sufficient to cause the observed decline in CD. In the simulation, when they "turn off" the growth of reference lists at a certain point in time, the decline in CD reverses, further indicating CI as a driver. These results differ significantly from those of previous studies that did not account for CI and publication level controls. **Key Findings and Implications:** * The decline in CD over time is largely an artifact of citation inflation, not necessarily a decline in innovation. * The CD is susceptible to biases related to data quality and citation practices. * When controlling for CI, the relationship between CD and team size is weak or even positive, contrasting previous findings. # \[Literature Review\] The disruption index suffers from citation inflation and is confounded by shifts in scholarly citation practice The central claim is that the observed decline in CD over time, as reported in previous studies, isn't necessarily indicative of a slowdown in innovation. Instead, it's largely a measurement artifact caused by: **Methodology (Detailed):** The authors employ four complementary methodologies to support their argument: ``` CDp = (Ni - Nj) / (Ni + Nj + Nk) = CDnok / (1 + Rk) ``` ``` |CDp,5| = bt + bk ln kp + br ln rp + bc ln cp,5 + ϵt ``` 1. **Deductive Quantitative Reasoning:** The authors start by deconstructing the mathematical formula of the CD itself. They demonstrate that the CD is formulated as a ratio where the numerator is bounded, but the denominator grows unbounded over time because it is proportional to the ever-increasing average reference list length in publications. This inevitably leads to the CD converging toward zero, regardless of the actual disruptiveness of the cited work - **Findings:** After controlling for CI and other factors, they find that the temporal trend in CD is minimal, and the relationship between CD and team size is weak and even positive for large teams. These results differ significantly from those of previous studies that did not account for CI and publication level controls **Key Findings and Implications:** - The decline in CD over time is largely an artifact of citation inflation, not necessarily a decline in innovation. - The CD is susceptible to biases related to data quality and citation practices. - When controlling for CI, the relationship between CD and team size is weak or even positive, contrasting previous findings”

↗

4

The disruption index suffers from citation inflation: Re-analysis ...

Publisher Sciencedirect.com · Tier 2 - Credible · Academic · 88%

Evidence Quality Self-Referential

ScienceDirect publication of the Petersen et al. Journal of Informetrics paper; abstract, highlights, results, and discussion confirm the claim directly.

www.sciencedirect.com

Publisher credibility

sciencedirect.com

Overall Score

88%

Tier

Tier 2 - Credible

Category

Academic

Analysis

ScienceDirect (sciencedirect.com) is a major academic publishing platform owned by Elsevier, one of the world's largest academic publishers. It hosts peer-reviewed journals, conference proceedings, and book chapters across science, technology, medicine, and social sciences. The platform itself is not a news source but rather a repository of peer-reviewed research and academic content. As an academic aggregator, it benefits from the peer-review processes of thousands of journals it hosts, which provides strong credibility for the research it publishes. However, the credibility score reflects the platform's role as a distributor rather than a primary publisher—individual articles' credibility depends entirely on the originating journal's standards. ScienceDirect has faced some criticism regarding Elsevier's publishing practices and access policies, but these are separate from content accuracy.

Key Factors

✅
Peer-Review System: ScienceDirect hosts articles from thousands of peer-reviewed journals, meaning content undergoes rigorous expert evaluation before publication
✅
Institutional Affiliation: Owned by Elsevier, a major, long-established academic publisher with 150+ years of history and global recognition in academic publishing
✅
Domain Semantics: The .com domain combined with 'ScienceDirect' name clearly signals academic/scientific purpose, consistent with the platform's actual function
⚪
Platform vs. Publisher Distinction: ScienceDirect is a platform aggregating content from many publishers; credibility varies by originating journal, not by ScienceDirect itself
❌
Publisher Controversy: Elsevier has faced criticism regarding journal pricing, open-access policies, and editorial practices, though this affects access rather than content accuracy

✅ Strengths

✓ Hosts content from thousands of reputable, peer-reviewed journals across multiple disciplines
✓ Peer-review process provides rigorous expert vetting before publication
✓ Long institutional history and global recognition in academic publishing ecosystem
✓ Clear metadata, citations, and article information facilitate verification and traceability
✓ Indexed by major academic databases (PubMed, Web of Science, Scopus), signaling third-party validation
✓ Most articles include author affiliations, funding disclosures, and conflict-of-interest statements
✓ Retraction Watch and other services track problematic articles

⚠️ Concerns

⚠ ScienceDirect is a platform, not a primary publisher—content credibility depends on the individual journal's editorial standards
⚠ Paywall access limits transparency and independent verification for non-institutional readers
⚠ Elsevier's business practices have attracted criticism from the academic community regarding pricing and open-access policies
⚠ Individual journal quality varies significantly; presence on ScienceDirect does not guarantee high-quality research
⚠ Retracted articles may remain discoverable on the platform, requiring readers to verify current status

Analysis performed: May 27, 2026

“# Research Paper The disruption index suffers from citation inflation: Re-analysis of temporal CD trend and relationship with team size reveal discrepancies ## Highlights - • The disruption index (CD) is biased by secular growth, which limits the accuracy of cross- temporal analysis. - • We apply mixed methods: deductive reasoning, computational modeling and empirical multivariate regression. ## Abstract Whereas the behavioral explanation reflects shifts associated with techno-social factors (e.g. self-citation practices), the structural explanation follows from ‘citation inflation’ (CI), an inextricable feature of real citation networks attributable to increasing reference list lengths, which causes CD to systematically decrease. Accordingly, we analyze CD data available in the SciSciNet database and find that disruptiveness incrementally increased from 2005-2015, and that the negative relationship between disruption and team-size is remarkably small in overall magnitude effect size, and shifts from negative to positive for team size ≥ 8 coauthors. ## 1. Introduction Once correcting for the data omission, the re-analysis reveals an *increasing rate* of disruption in several patent domains central to the techno-informatic revolution of the last 30 years (2023) also reports an accelerating rate of disruption at the end of their data sample after developing a weighted variant of *CD* that accounts for temporal shifts in the connectivity of real citation networks. Our critique is centered upon the role of reference list in the definition of *CD*, and the implications of multifold increases in reference list lengths over the last half century, which is a fundamental source of ‘citation inflation’ (CI) (Petersen et al., 2018) ## 2. Background & related literature ### 2.3. Issues with prior works analyzing trends in CD In the particular case of CDnok, the location of the average value is large enough that a vast majority of papers are classified as disruptive – which begs for metric validity improvement. Moreover, in our companion study focusing upon a computational model, we show that even the tempered decline in CDnok can be attributed to CI (Petersen et al., 2024) ## 4. Results ### 4.3. Empirical re-analysis of 7.8 million publications from 1995-2015 – testing for CD correlations with t and k After controlling for temporal variation and CI, we find that *CD* increases (albeit weakly) with team size (for kp∈[3,25]) – which is consistent with a statistically significant and positive coefficient associated with lnkp identified in our companion study (Petersen et ## 5. Discussion To summarize, even in the absence of data quality issues, the *CD* index decreases over time due to two mechanisms unrelated to innovation – one behavioral, and the other structural. Importantly, as formulated, the disruption index does not account for confounding shifts in citation behavior (e.g. self-citation, impact factor boosting) that increase the rate of triadic closure measured by Nj in the numerator of *CD*”

↗

5

[2406.15311] The disruption index suffers from citation inflation ...

Publisher Arxiv.org · Tier 1 - Authoritative · Academic · 92%

Evidence Quality Self-Referential

arxiv.org catalog entry for Petersen et al. preprint with title, authors, abstract, and key findings confirming citation inflation and 2005–2015 increase.

arxiv.org

Publisher credibility

arxiv.org

Overall Score

92%

Tier

Tier 1 - Authoritative

Category

Academic

Analysis

arXiv.org is a preprint repository operated by Cornell University that has served the academic and scientific community since 1991. It is one of the most widely used platforms for disseminating research across physics, mathematics, computer science, and related disciplines. As an academic preprint server rather than a traditional news source, arXiv operates under rigorous institutional governance with Cornell's oversight, transparent submission and moderation policies, and no editorial bias toward particular viewpoints—its role is to archive and distribute scholarly work, not to filter based on conclusions. While preprints are not peer-reviewed before posting, the platform maintains clear quality standards, spam filters, and a dedicated moderation team. arXiv's reputation is exceptionally strong in academic circles; it is trusted by researchers worldwide and has become a de facto standard for early-stage dissemination in many STEM fields. The platform's lack of sensationalism, clear labeling of content as preprints, and institutional backing by a major university give it high credibility, though users must understand that preprints represent work in progress, not finalized peer-reviewed findings.

Key Factors

✅
Institutional Backing & Longevity: Operated by Cornell University since 1991; three decades of consistent, trusted operation in the academic community
✅
Transparent Moderation Policy: Clear submission guidelines, spam filters, and moderation standards are publicly documented; no hidden agendas or opaque gatekeeping
✅
No Editorial Bias: As a preprint repository, arXiv does not curate based on conclusions or viewpoints; role is to distribute, not filter by ideology
⚪
Preprint Status (Not Peer-Reviewed): Content has not undergone formal peer review; users must treat findings as preliminary. This is clearly labeled and understood by academic audience
✅
Funding & Ownership Transparency: Operated as a public service by Cornell with support from the National Science Foundation, the Department of Energy, and member institutions; funding sources are transparent
⚪
No Retraction/Correction Mechanism: Preprints cannot be deleted or significantly altered after posting, but authors can post corrections and new versions; aligns with preprint-server norms

✅ Strengths

✓ Three decades of institutional trust and widespread adoption across the global scientific community
✓ Transparent governance, clear submission/moderation policies, and public documentation of standards
✓ No ideological or financial incentives to bias content; operates as a public good
✓ Version control and author accountability; papers are timestamped and traceable
✓ Free, open access to all content; no paywall or subscription gatekeeping
✓ Rigorous spam and plagiarism detection systems
✓ Strong reputation among researchers, cited in major peer-reviewed journals

⚠️ Concerns

⚠ Content is preprint material, not peer-reviewed—findings may be preliminary, incomplete, or later contradicted
⚠ No formal fact-checking or verification process (not applicable to academic preprints, but users must understand the distinction)
⚠ Occasional spam or low-quality submissions can appear on the platform despite moderation efforts
⚠ Some misuse of arXiv by non-experts or bad-faith actors posting speculative or unfounded claims, though this is rare and heavily moderated

Analysis performed: May 27, 2026

“# Title:The disruption index suffers from citation inflation and is confounded by shifts in scholarly citation practice Authors:Alexander M. Petersen, Felber Arroyave, Fabio Pammolli View a PDF of the paper titled The disruption index suffers from citation inflation and is confounded by shifts in scholarly citation practice, by Alexander M. Petersen and 2 other authors View PDF HTML (experimental) > Abstract:Measuring the rate of innovation in academia and industry is fundamental to monitoring the efficiency and competitiveness of the knowledge economy. To this end, a disruption index (CD) was recently developed and applied to publication and patent citation networks (Wu et al., Nature 2019; Park et al., Nature 2023). Whereas the behavioral explanation reflects shifts associated with techno-social factors (e.g. self-citation practices), the structural explanation follows from `citation inflation' (CI), an inextricable feature of real citation networks attributable to increasing reference list lengths, which causes CD to systematically decrease. Accordingly, we analyze CD data available in the SciSciNet database and find that disruptiveness incrementally increased from 2005-2015, and that the negative relationship between disruption and team-size is remarkably small in overall magnitude effect size, and shifts from negative to positive for team size $\\geq$ 8 coauthors”

↗

No opposing evidence found.

Credibility Assessment

Findings

Additional Information

Credibility Dimensions

Source Credibility

🔍 What We Found

🏢 Publisher

economist.com

Analysis

Key Factors

✅ Strengths

⚠️ Concerns

👤 Author Expertise

The Economist

📊 Score Breakdown

Evidence Alignment

🔍 What We Found

📋 Individual Claim Analysis (10 total: 9 facts, 1 opinions)

✅ Supporting Evidence (5)

nih.gov

Analysis

Key Factors

✅ Strengths

⚠️ Concerns

springer.com

Analysis

Key Factors

✅ Strengths

⚠️ Concerns

phys.org

Analysis

Key Factors

✅ Strengths

⚠️ Concerns

arxiv.org

Analysis

Key Factors

✅ Strengths

⚠️ Concerns

nsf.gov

Analysis

Key Factors

✅ Strengths

⚠️ Concerns

✅ Supporting Evidence (3)

bioengineer.org

Analysis

bioengineer.org

Analysis

ac.be

Analysis

Key Factors

✅ Strengths

ℹ️ Sources Found — None Directly Addressed This Claim (1)

legalinsurrection.com

Analysis

Key Factors

✅ Strengths

⚠️ Concerns

✅ Supporting Evidence (4)

arxiv.org

Analysis

Key Factors

✅ Strengths

⚠️ Concerns

arxiv.org

Analysis

Key Factors

✅ Strengths

⚠️ Concerns

sciencedirect.com

Analysis

Key Factors

✅ Strengths

⚠️ Concerns

mit.edu

Analysis

Key Factors

✅ Strengths

⚠️ Concerns