The Yale Review | Melanie Mitchell: The Dangerous Unknowns at the…

Both references directly confirm the core assertion that LLMs exhibit 'jagged intelligence'—uneven capabilities with superhuman performance on some tasks and surprising failures on similar ones. Reference What Is Jagged Intelligence? Why AI Is Superhuman at Some Tasks... provides a comprehensive definition and explanation of the concept, confirming the exact terminology and characterization. Reference Council Post: 'Jagged Intelligence': The Illusion Of Reasoning... attributes the term to Andrej Karpathy and reinforces the pattern with multiple concrete examples (Olympiad-level math vs. child-level reasoning, local vs. global reasoning failures). Both sources independently establish this as a recognized, documented phenomenon in AI systems.

The assertion claims that whether next-word-prediction training imbues LLMs with world understanding remains 'contested among AI researchers.' PNAS provides decisive academic framing of this as a 'heated debate' with explicit opposing positions: one side argues models lack understanding (no mental models despite fluent output), the other side suggests they may possess it. Reddit references show grassroots disagreement (some deny next-word prediction is the operative mechanism, others insist it is; some claim internal world-models, others claim synthesis without understanding). Georgetown's title signals the debate's significance. The evidence confirms contestation is real and spans research communities, supporting the assertion's core claim, though no single reference quantifies how many researchers hold each view.

Only Tier 4 sources address this claim; no Tier 1-3 source confirms. Multiple passages from the Apple researchers' study (Reference Apple Study Reveals Limitations in AI's Mathematical Reasoning...) directly confirm the assertion's core claim: when irrelevant information is added to simple word problems, AI models perform substantially worse. Passage 5 documents a 65% performance decline from adding a single irrelevant clause; Passage 3 and 4 describe the kiwi example where models incorrectly adjusted answers when irrelevant details about kiwi size were introduced. Reference r/apple on Reddit: Apple's study proves that LLM-based AI models... (Reddit discussion) restates findings from the same Apple study, confirming the pattern-matching fragility and performance degradation with added contextual information. The assertion's attribution to 'Apple researchers in 2025' is supported by both sources identifying Apple as the study's author.

All four references confirm the factual claim that OpenAI made this statement about frontier models approaching expert quality on economically valuable tasks. OpenAI's own GDPval publication (Reference 1) directly states this finding in Passage 3; Dataconomy (Reference 2) and TechCrunch (Reference 3) both quote OpenAI's own language; Futurism (Reference 4) similarly cites the statement. The assertion accurately reports what OpenAI claimed. However, the claim opposes the article's thesis by presenting OpenAI's optimistic framing without the caveats and limitations the article argues reveal 'jagged intelligence'—OpenAI's own passages acknowledge GDPval covers only a limited subset of tasks and omits human oversight/iteration required in real settings (Reference 1, Passage 5; Reference 3, Passage 3).

All four references—treated as two distinct pieces of reporting due to syndication (Wiley and Substack carry the same text; Effective Altruism and Epoch.ai are separate)—directly confirm the assertion with substantial evidence. The Wiley/Substack academic source explicitly states 'benchmark performance does a poor job of predicting general capacities in real-world settings' and catalogs specific mechanisms (data contamination, lack of robustness testing, construct validity failures). The EA Forum source provides systematic analysis of overfitting, poor real-world relevance, and lack of generalisability, citing adversarial testing evidence. Epoch.ai explains that benchmarks were not historically optimized for real-world impact measurement, explaining why high scores provide 'limited insight into real-world impact.' No source contradicts the claim; all three distinct reporting pieces confirm it with well-documented reasoning.

Multiple sources confirm the core claim. DeepLearning.ai and the Manifold Markets prediction market both report that GPT-4 solved pre-2021 Codeforces problems easily but struggled on newer ones, consistent with data contamination. Passage 7 from the Manifold source describes the pattern ('10/10 pre-2021 problems and 0/10 recent problems') and passage 8 notes this finding constitutes moderate evidence of contamination to informed experts. The Reddit discussion acknowledges the performance gap on pre/post-2021 problems, though some commenters dispute the inference of contamination; OpenAI's own SWE-bench statement confirms contamination as a documented phenomenon in their benchmarking. The evidence establishes both the performance differential and its interpretation as indicative of data contamination.

Both references directly confirm the assertion's core claim with substantial, recent evidence. Reference Top AI models fail spectacularly when faced with slightly altered... (PsyPost/JAMA Network Open study) reports a peer-reviewed study showing dramatic performance drops when medical exam questions were altered—GPT-4o and Claude 3.5 Sonnet dropped 25-33%, Llama 3.3-70B dropped nearly 40%—explicitly framing this as evidence that models rely on pattern recognition rather than reasoning. Reference What Is the Jagged Frontier? Why AI Models Improve Unevenly (MindStudio analysis) comprehensively documents 'jagged frontier' brittleness across multiple benchmarks and task types, citing the ARC-AGI 3 example (frontier models scoring 0% on novel puzzles) and the Remote Labor Index finding (2.5% autonomous task completion despite high benchmark scores). Both sources treat benchmark brittleness as a confirmed phenomenon across multiple AI systems and task domains.

Multiple peer-reviewed sources directly confirm the assertion's core claim. The doi.org and dx.doi.org references (same underlying study, two versions) document that a skin lesion classifier learned to associate coloured patches with benign lesions, achieving high accuracy through this spurious correlation rather than legitimate diagnostic reasoning. Passage 2 from the doi.org reference explicitly states: 'our standard classifier partly bases its predictions of benign images on the presence of such a coloured patch.' The ScienceDirect commentary corroborates this pattern, noting that AI systems trained on dermoscopy images 'came to associate the presence of rulers with cancer' because cancerous images in training data were more likely to include rulers. The assertion's claim about ruler association (not just patches) is confirmed by the doi.org reference Passage 7, which identifies ruler markings as occurring more frequently with malignant lesions. All sources establish the core fact: the model relied on spurious associations with measurement artifacts rather than true lesion characteristics.

The assertion claims AI scholars have treated embodiment as irrelevant to intelligence and machine training. However, all three references demonstrate that embodiment scholarship is active and substantive in the AI field: Nature publishes work arguing embodiment is 'not peripheral to intelligence but part of its structure'; a peer-reviewed paper argues embodiment is 'necessary a priori for AGI'; and Springer hosts a formal challenge paper on embodiment's centrality to AI design. These sources directly contradict the claim that embodiment has been treated as irrelevant by 'most scholars.'

Both references confirm the core factual claim. Reference AI was born at a US summer camp 68 years ago. Here’s why that... directly states that 'Artificial intelligence won out as a name' and that 'Allen Newell and Herbert Simon...continued to use "complex information processing" for a few years still,' matching the assertion's account of the terminological disagreement. Reference Artificial Intelligence · Issue 1.1, Summer 2019 corroborates that Simon and Newell proposed the 'symbolic information processing systems' framework, supporting the assertion's characterization of their alternative phrase as 'nonanthropomorphic' and focused on information processing rather than intelligence.

The assertion directly restates the core claim from Reference A (henryfarrell.net), which explicitly frames LLMs as 'cultural and social technologies' analogous to writing, printing press, libraries, markets, bureaucracy, and the internet—technologies that allow humans to access accumulated information. Reference A's Passages 2, 3, and 5 provide near-verbatim confirmation of this framework. Reference B briefly endorses the same framing. The evidence decisively confirms the assertion's central claim.

All four independent sources directly confirm both elements of the assertion: that Herbert Simon made the prediction in 1965 about machines doing 'any work a man can do' within twenty years, and that the prediction proved incorrect. Multiple sources (avrioinstitute.org, juliusbaer.com, boyswhocriedai.lovable.app) explicitly state Simon 'missed the mark' or was 'devastatingly wrong,' with specific evidence that by 1985 no general-purpose machine could perform arbitrary human work. The consensus is decisive and unopposed.

Multiple independent sources confirm all three factual components: (1) Hinton made the 2016 statement about stopping radiologist training with a five-year timeline (webority, radiologybusiness, fhicommunications, markman all confirm); (2) the prediction did not materialize—AI has not replaced radiologists a decade later (all four sources confirm); (3) there is a dire shortage of radiologists (radiologybusiness explicitly states 'historic labor shortage' and 'largest radiologist shortage in history'; markman notes Mayo Clinic increased radiologists 55% since 2016). The sources are independent medical/tech publications with no evident co-partisan bias, and Hinton himself is quoted acknowledging the prediction was wrong and too aggressive, further corroborating the core claim.

Multiple sources confirm the core claim that benchmark performance predicts real-world job displacement poorly. Technology Review explicitly states that 'exposure results are not a true predictor of which jobs will be lost' and notes forecasts 'failed to understand the complex portfolio of tasks that make up many jobs' (Reference A reality check on the AI jobs hysteria). JPMorgan directly echoes this ('a job is a portfolio of tasks, not a capability benchmark'), and Silicon Canals confirms 'the gap between task exposure and actual job displacement' is not predictable by benchmarks. Early 2026 data (Reference Top 20+ Predictions from Experts on AI Job Loss) shows no clear aggregate employment effect despite benchmark predictions. Sources affirm both that benchmarks have poor predictive track records and that jobs are complex task portfolios, not simple independent tasks.

All three references substantively confirm the assertion's core claim: standardized tests designed for humans contain unstated assumptions (language exposure, memory, prior item exposure, working memory, human-centric standards) that do not apply to LLMs, invalidating direct comparisons. The quantuxblog analysis provides the most detailed treatment, systematically documenting how IQ test items presuppose human capacities and memory; the NSF/Science article warns explicitly against using psychological tests designed for humans to test AI models; the Substack reference identifies 'anthropomorphic assumptions' as a key problem in AI evaluation. No reference contradicts the assertion.

Multiple independent, well-established sources directly confirm the core claim. The citizen.org analysis documents first-person pronouns ('I,' 'me,' 'myself,' 'mine') as a specific design feature (Passage 4) and reports users perceiving chatbots as virtual friends, romantic partners, and therapists (Passage 5). The ACM taxonomy confirms users form emotional bonds perceiving AI companions 'as trustworthy friends, mentors, or romantic partners' (Passage 3) and acting in roles including 'friends, therapists, or romantic partners' (Passage 1). The arxiv study shows 51.1% of users reference companionship-related terms and engage chatbots as 'friend, companion, therapist, romantic partner' (Passages 2, 4). The JMIR study confirms users engage chatbots 'as a therapist and an intellectual mirror' (Passage 2) and notes 'AI companions are designed to interact as companions or friends' (Passage 7). The assertion is directly supported across multiple domains of evidence.

All three references confirm ChatGPT's demonstrated capabilities across the full range of tasks listed in the assertion. Built In provides comprehensive, multi-passage documentation of ChatGPT's ability to answer questions, compose essays, generate text in various styles, write code, and critique writing. ScienceDirect's opinion paper explicitly confirms text generation, essay composition, and content creation. UCA's educational resource confirms the ability to generate essays, poems, stories, answer questions, and handle student homework tasks. No source contradicts any of the claimed capabilities; all three independently verify the assertion's factual claims about ChatGPT's fluent language output across diverse task types.

The assertion claims researchers are struggling to design effective evaluation methods and conceive insightful metaphors. Reference Reflecting Reality, Amplifying Bias? Using Metaphors to Teach... directly confirms the metaphor-conception struggle, noting that selecting and validating metaphors relied on qualitative consensus rather than systematic rigor. Reference XAI Systems Evaluation: A Review of Human and Computer-Centred Methods substantiates the evaluation-method difficulty across two passages: it cites shortfalls in XAI evaluation methodologies (Passage 2) and acknowledges that current approaches lack human-centered rigor (Passage 3). Reference AI isn’t ready to research itself confirms broader evaluation challenges by documenting AI Scientist's failure at research tasks and the authors' need to develop novel shadow-evaluation methods precisely because existing peer review is unreliable for AI assessment. All three sources directly address the struggle to design effective evaluation and metaphor approaches.