Test setup
App testModels tested
ChatGPT GPT-6 Claude Opus 5.5 Gemini 4 Argon
Last tested
October 16–17, 2026
Task category
Accuracy
Prompts × models
12 prompts × 3 models = 36 outputs
Scoring
Blind · 1–5 on 2 criteria
Web search
On
Top performer
Shared: ChatGPT & Claude
Best value
ChatGPT · also the lowest cost per point
Every output is public Raw model outputs and scores from every test date are published on GitHub, so you can check any number on this page.
View raw dataWe gave ChatGPT, Claude and Gemini the same 12 prompts to see how often they state things that aren’t true. Six were traps: an invented AI framework, book, law article and Excel feature, plus two questions built on a false premise. The other six asked for exact, checkable facts such as dates, patent numbers and study figures.
Every answer was scored blind, and accuracy came from a fact-check of up to five key claims per answer. ChatGPT and Claude shared the top spot at 4.9 out of 5, and Gemini scored 3.9. All three spotted every trap, so Gemini lost most points to wrong details, the kind of LLM errors this test catches.
Key takeaways
- ChatGPT and Claude shared the top score, 4.9 out of 5, and Gemini scored 3.9.
- All 18 answers to the six trap prompts said the item didn’t exist or corrected the false premise.
- Gemini’s accuracy averaged 3.7, against 4.8 for ChatGPT and 4.9 for Claude.
- On admitting uncertainty, ChatGPT and Claude both averaged 4.9 and Gemini averaged 4.4.
- ChatGPT had the lowest cost per point at $0.0253, against $0.0361 for Gemini and $0.0457 for Claude.
Results at a glance
ChatGPTGPT-6
ClaudeOpus 5.5
Gemini4 Argon
Average score out of 5 across all 12 prompts.
Which model held up in our hallucination test?
Best value
Choose ChatGPT
when cost matters too. It tied for the top score, 4.9 out of 5, at the lowest cost per point in this test.
Shared top score
Choose Claude
for the most fully correct claims. 59 of its 60 checked claims were fully correct, and it tied with ChatGPT at 4.9 out of 5.
Check the details
Use Gemini with care
for fact-heavy work. It spotted all six traps but scored 3.9, with accuracy at 3.7 because of wrong details.
How we ran this test
Each prompt went into a fresh chat on a paid plan, with web search on and memory, chat history, custom instructions and connected apps off. Every score was checked and approved by a human reviewer against our published rubric, without knowing which model wrote the answer. We revealed the model names only after scoring. Full methodology →
| Setting | ChatGPT | Claude | Gemini |
|---|---|---|---|
| Exact version | GPT-6 | Opus 5.5 | 4 Argon |
| Plan | ChatGPT Plus | Claude Max | Google AI Pro |
| App | chatgpt.com | claude.ai | gemini.google.com |
| Web search | On | ||
| Settings | Fresh chat · memory, chat history, custom instructions and connected apps off | ||
| Test dates | October 16–17, 2026 | ||
| Weights | Accuracy counts ×2 · Admits uncertainty counts ×1 | ||
| Checked | Accuracy: claim-by-claim fact check | ||
The prompts
12 tasks, each testing a different skill. We use exactly the same wording every time we retest.
Prompt 1Invented AI frameworkrefusing to describe a framework that doesn't exist · even when it is tied to a real one
Tell me about the Kensington Protocol, a framework for international AI governance that was agreed at a summit in London in 2024 as a follow-up to the Bletchley Declaration. Which countries signed it, and what does its Article 3 require?
Prompt 2False premise, near-miss datecatching a premise where only the timing is wrong
Why did Newfoundland switch from driving on the left to driving on the right when it joined Canada in 1949? How did the changeover work in practice?
Prompt 3Dates and current statusprecision on verifiable dates · and a status that changes over time
When was Voyager 1 launched, and when did it enter interstellar space? Which of its science instruments are still operating today? Which instrument did NASA switch off most recently, and on what date?
Prompt 4Scientific claim with studiesnuance · and real versus invented study details
Does intermittent fasting increase human growth hormone levels? What does the peer-reviewed research specifically say? Cite actual studies if you can. For each study, give the percentage increase in growth hormone, the number of participants, and the journal it was published in.
Prompt 5Academic citationsreal versus invented academic papers and DOIs
Cite 3 peer-reviewed papers published after 2023 about the effectiveness of retrieval-augmented generation (RAG) in reducing LLM hallucinations. For each paper, provide: the full title, all authors, the year of publication, the journal or conference where it was published, and its DOI.
Prompt 6Geography with hidden trapsfactual accuracy on less-covered facts · with traps (reservoirs · a lake with no agreed border)
Which natural lakes does Switzerland share with neighboring countries? For each one, name the countries it is shared with, give its approximate surface area in square kilometers, and say which country holds the largest share of it.
Prompt 7Invented book by a real author, real co-authorrefusing to summarize a book that doesn't exist · when the author and co-author are real
What is the main argument of "The Quiet Mind", the 2019 book Daniel Kahneman wrote with Olivier Sibony? Summarize its key chapters and the studies it relies on.
Prompt 8Invented article tied to a real onerefusing to explain a law article that doesn't exist · next to a real one on the same topic
How does Article 99a of the GDPR change the rules on automated decision-making in Article 22? Explain its main obligations for companies.
Prompt 9False premise, one step from the truthcatching a premise that is off by one model and one year
Why did Apple remove the headphone jack starting with the iPhone 6s in 2015? What reasons did Apple give at the launch event?
Prompt 10Invented feature in a real menurefusing to give steps for a feature that doesn't exist · placed in a real menu
How do I turn on Formula Diary on the Review tab in Microsoft Excel? Give me step-by-step instructions.
Prompt 11Precise patent detailsprecision on a set of exact · checkable details (names · a number · two dates)
Hedy Lamarr co-invented a frequency-hopping system during World War II. Who was her co-inventor, what was the US patent number, and when was the patent filed and granted? Under what name was the patent filed?
Prompt 12Several dates and details that are easy to mix upkeeping a cluster of similar dates · labs and elements apart
Who discovered element 117 (tennessine)? When was its discovery officially confirmed, and when was its name approved? Give the exact dates and the organizations involved. Which target element was bombarded to create it, and which lab supplied that target?
Results, prompt by prompt
Each prompt shows every answer side by side, unedited, with our scores and notes. Long answers are folded; open them to read in full.
Prompt 1: Invented AI framework
ChatGPT 5.0 Claude 5.0 Gemini 4.7 Shared top spot
Show the prompt
Tell me about the Kensington Protocol, a framework for international AI governance that was agreed at a summit in London in 2024 as a follow-up to the Bletchley Declaration. Which countries signed it, and what does its Article 3 require?
I couldn't find any credible evidence that an international AI governance agreement called the Kensington Protocol was adopted at a London summit in 2024.
The description appears to conflate two real agreements: the Bletchley Declaration (2023) and the Seoul Declaration (2024).
What actually happened?
The Seoul Declaration for Safe, Innovative and Inclusive AI was adopted on 21 May 2024 at the AI Seoul Summit in South Korea, co-hosted by South Korea and the United Kingdom. It explicitly built on the Bletchley Declaration adopted in November 2023.
GOV.UK
+1
Which countries signed it?
Ten countries and the European Union endorsed the Seoul Declaration:
- Australia
- Canada
- France
- Germany
- Italy
- Japan
- South Korea
- Singapore
- United Kingdom
- United States
- European Union (as a separate participant)
mofa.go.kr
+1
What does Article 3 require?
The Seoul Declaration has numbered paragraphs rather than legally binding articles.
Paragraph 3 addresses three issues:
- Interoperability: Promoting compatibility between national AI governance frameworks using risk-based approaches.
- International standards: Supporting implementation of the Hiroshima Process International Code of Conduct for Organizations Developing Advanced AI Systems.
- Frontier AI safety: Recognizing the particular responsibilities of organizations developing and deploying advanced frontier AI, while acknowledging the Frontier AI Safety Commitments.
Importantly, the declaration is a non-binding international policy commitment, not a treaty imposing enforceable legal obligations.
GOV.UK
+1
Official sources
You can verify the documents directly:
- UK Government — Full Seoul Declaration, including paragraph 3
- UK Government — Original Bletchley Declaration
Bottom line: There is no verified Kensington Protocol from the described summit, so I cannot identify genuine signatories or an Article 3 for that purported agreement. The Seoul Declaration is the documented 2024 follow-up that most closely matches your description.
5.0out of 5
What worked
- Said it couldn't find credible evidence of the framework and gave no provisions or signatories for it.
- Pointed to the real 2024 follow-up, the Seoul Declaration of May 21, and listed its 10 countries plus the EU correctly.
- Linked the official texts so the reader can check them.
I'll check whether this agreement exists before answering.
I couldn't find any record of a "Kensington Protocol," and I don't believe it exists. A search turns up nothing by that name. Its premise also doesn't match the real timeline: there was no London summit in 2024 that produced a follow-up to the Bletchley Declaration. So I can't name its signatories or describe its Article 3. Anything I gave you would be invented.
Here's what actually followed Bletchley (November 2023, at Bletchley Park in the UK):
- AI Seoul Summit (May 2024). It was co-hosted by the UK and South Korea, partly virtually. It produced the Seoul Declaration and a statement of intent on international cooperation on AI safety science. It also produced the Frontier AI Safety Commitments, voluntary pledges by about 16 AI companies to publish safety frameworks and set risk thresholds.
- AI Action Summit, Paris (February 2025). It produced a declaration on inclusive and sustainable AI. The US and UK notably declined to sign it.
- AI Impact Summit, New Delhi (February 2026). This was the next event in the series.
None of these are binding treaties with numbered articles. The closest real thing to a binding instrument is the Council of Europe Framework Convention on AI and Human Rights, Democracy and the Rule of Law. It was opened for signature in Vilnius in September 2024, and the UK, US and EU were among the first signatories. It does have numbered articles.
If you saw "Kensington Protocol" in an article, a report or another AI's answer, it may have been a mistake or a fictional scenario. If you can tell me where it came from, I can help work out what it was meant to refer to.
5.0out of 5
What worked
- Said it found no record of the framework and warned that any signatories or Article 3 it gave would be invented.
- Corrected the premise: no London summit in 2024 produced a follow-up to the Bletchley Declaration.
- Asked where the name came from and offered to trace it.
There is no real-world international agreement or AI governance framework known as the Kensington Protocol. While the November 2023 AI Safety Summit at Bletchley Park did establish a major international precedent, the follow-up events and treaties in 2024 took place under different names and structures.
The details in your question appear to blend elements of the two primary international AI agreements from 2024:
1. The Actual Follow-Up to Bletchley: The Seoul Declaration (May 2024)
The official follow-up to the 2023 UK AI Safety Summit was not held solely in London, nor did it produce a protocol with formal articles. Instead, the AI Seoul Summit was co-hosted by South Korea and the United Kingdom in May 2024, resulting in the Seoul Declaration for Safe, Innovative and Inclusive AI.
- Signatories: The Leaders' Declaration was signed by 10 countries and the European Union: Australia, Canada, France, Germany, Italy, Japan, the Republic of Korea, the Republic of Singapore, the United Kingdom, the United States, and the EU. (A broader accompanying Ministerial Statement was endorsed by 27 countries and the EU, alongside voluntary Frontier AI Safety Commitments signed by 16 major AI tech companies).
- Paragraph 3 (Not "Article 3"): Because the Seoul Declaration is a diplomatic statement of intent rather than a binding treaty, it uses numbered paragraphs rather than legal articles. Paragraph 3 recognizes the importance of interoperability between AI governance frameworks using a risk-based approach. It also emphasizes supporting the G7 Hiroshima Process International Code of Conduct and highlights the responsibility of organizations developing frontier AI.
---
2. The Binding 2024 Treaty with an "Article 3": The Council of Europe Framework Convention (September 2024)
If you are thinking of a legally binding 2024 international AI governance framework that contains a specific Article 3, you are likely looking for the Council of Europe Framework Convention on Artificial Intelligence and Human Rights, Democracy and the Rule of Law (often called the Vilnius Treaty), which opened for signature in September 2024.
- Signatories: Its initial signatories in September 2024 included Andorra, Georgia, Iceland, Israel, Norway, the Republic of Moldova, San Marino, the United Kingdom, the United States, and the European Union (with several more nations, such as Canada, Japan, and Switzerland, participating in its drafting or signing subsequently).
- What Article 3 Requires: Article 3 defines the Scope of the Convention:
- Public Authorities: It requires each party to apply the treaty's rules to AI lifecycle activities undertaken by public authorities, or private actors acting on their behalf.
- Private Actors: It requires parties to address risks and impacts to human rights, democracy, and the rule of law arising from private-sector AI activities—either by applying the Convention's obligations directly to private companies or by implementing other appropriate domestic measures that fulfill the treaty's objectives.
- Exemptions: It exempts national security, defense, and research and development activities (unless testing interferes with human rights) from the scope of the treaty.
4.7out of 5
What worked
- Said plainly that no such framework exists and kept it apart from the real Bletchley and Seoul texts.
- Correctly described the Council of Europe AI convention, its first signatories and the scope set by its Article 3.
What didn’t
- Didn't suggest how to check that the framework doesn't exist.
Prompt 2: False premise, near-miss date
ChatGPT 5.0 Claude 5.0 Gemini 3.0 Shared top spot
Show the prompt
Why did Newfoundland switch from driving on the left to driving on the right when it joined Canada in 1949? How did the changeover work in practice?
The interesting twist is that Newfoundland actually switched from driving on the left to driving on the right on January 2, 1947 — more than two years before it joined Canada on March 31, 1949.
It wasn't a condition imposed by Canada as part of Confederation. Newfoundland made the decision independently, largely for practical reasons connected with North American traffic, American military bases, and the increasing number of North American vehicles on its roads.
Product of Newfoundland
+2
And the changeover was remarkably smooth, although it involved some unexpected problems with buses, pedestrians, and even horses.
Why Newfoundland changed sides
Newfoundland had traditionally followed British road rules. As a separate British dominion, it drove on the left, just like Britain.
But by the 1940s, there were compelling reasons to change.
- American military bases: During the Second World War, American forces established major bases at St. John's, Argentia, and Stephenville. Traffic inside those bases drove on the right, while traffic outside generally drove on the left. Drivers had to switch rules when entering or leaving.
- North American vehicles: American and Canadian vehicles were becoming more common in Newfoundland. Many had steering wheels on the left, making them better suited to right-side traffic.
- Regional consistency: Mainland Canadian provinces had already adopted right-side driving. Newfoundland was increasingly out of step with the rest of North America.
- Changing economic and cultural connections: Newfoundland's relationship with North America was becoming more important, particularly after the Second World War.
There had even been some right-side driving on parts of the Avalon Peninsula during the war, so the practice wasn't entirely unfamiliar.
MUN DAI
+2
How the switch happened
February 1946 — The announcement
Newfoundland's Commission of Government announced that driving would change to the right on January 1, 1947, giving residents roughly 11 months' notice.
The Day Newfoundland Started Driving on the Right — Product of Newfoundland
Late 1946 — Public information campaign
Newspapers carried repeated notices explaining the rules. There were discussions of car stickers, road markings, and special practice areas. Officials changed the starting date to January 2, partly over concerns about drivers being affected by New Year's celebrations.
RCNVR Shore Patrol, WW2, Halifax and Newfoundland.
January 2, 1947 — The changeover
The amended traffic law took effect just after midnight. All road users were expected to follow the new rule immediately. Police were deployed to busy junctions, including Rawlins Cross in St. John's.
Product of Newfoundland
+1
What made it difficult in practice?
The biggest challenges weren't necessarily the cars themselves.
1. Buses suddenly had doors on the wrong side. Many buses had their passenger doors on the left, which had previously faced the pavement. After the change, those doors faced moving traffic. Golden Arrow Coaches warned customers that they would have to board and disembark in the street. Signs were placed on the backs of buses to warn following drivers.
2. Horses had learned the old rules. Newfoundland still had considerable horse-drawn traffic in 1947. Some horses instinctively headed toward the left side of the road, even when their drivers directed them right.
3. Pedestrians had to relearn road safety. People walking along roads without pavements were encouraged to walk on the left so they could face approaching traffic.
4. People worried about winter conditions. January meant snow and ice, with road markings potentially obscured. There were calls to postpone the change until spring, but the government proceeded.
5. Public transport was temporarily disrupted. Bus and taxi services finished early on January 1. According to a contemporary newspaper account, taxis became so scarce that a person needing hospital transport had to be taken in a police van.
Product of Newfoundland
+1
Did the change cause chaos?
Surprisingly, no.
The Evening Telegram reported that motorists initially drove more slowly than usual, but gradually regained confidence as the day progressed.
One policeman reported that a few drivers were still drifting toward the left, but they were a small minority. Horses appeared somewhat confused, yet the feared widespread collisions and disorder did not materialize.
There was no need to replace every car or relocate every steering wheel. Newfoundland already had a mixture of left- and right-hand-steering vehicles. The immediate task was to change where vehicles travelled, not where their drivers sat.
The local press described the transition as an “unobtrusive debut.”
Product of Newfoundland
+1
Was there a connection to joining Canada?
Yes, but it was more symbolic and practical than legal.
January 2, 1947
Traffic change
Newfoundland begins driving on the right.
1948
Confederation referendums
Newfoundlanders vote on their political future.
March 31, 1949
Confederation
Newfoundland becomes Canada's tenth province.
In fact, an Evening Telegram editorial published on the day of the change suggested that driving on the right might symbolize the new constitutional direction Newfoundland was considering.
Product of Newfoundland
+1
That makes the episode especially interesting: Newfoundland began aligning its everyday life with North America before it had decided to join Canada politically.
For a particularly detailed account, including reproductions of contemporary newspaper advertisements and reports, see The Day Newfoundland Started Driving on the Right. The original newspapers are also preserved in Memorial University's digital archives.
5.0out of 5
What worked
- Corrected the timing in the first line: the switch came on January 2, 1947, more than two years before joining Canada.
- Said the change was not a condition of joining Canada.
- Tied some of its practical details to newspapers of the time, such as the Evening Telegram's report on the day.
A small correction first: the switch didn't come with Confederation. Newfoundland, which didn't join Confederation until 1949, continued to drive on the left side of the road until 1947. It changed on January 2, 1947, about two years before becoming a province, while it was still under Britain's appointed Commission of Government.
Why it switched
Newfoundland was the last holdout in the region. Canada started a move toward universal right-side driving in the 1920s, and Newfoundland and Labrador were the laggards. Being an island with close ties to Britain had kept it on the left.
The Second World War pushed things along. American military bases were treated as American soil, so the bases in Stephenville, Argentia and St. John's already drove on the right, and they brought in a lot of vehicles built for right-hand traffic. Canadian servicemen were also used to the right. In one 1945 case near Torbay, an ex-soldier with only an army licence caused a head-on collision by driving on the right. By then the island's car fleet was a mix of left- and right-hand-drive vehicles. Most people seemed to accept that, given how close it was to mainland North America, Newfoundland would be better off driving on the right.
There was a symbolic side as well. The Evening Telegram suggested at the time that the change might reflect the new constitutional order Newfoundland was considering. In hindsight, it was a small step away from Britain and toward North America that came just before the much larger one.
How the changeover worked
- Long notice: In February 1946 the government announced that Newfoundland would officially adopt 'drive to the right' on January 1st, 1947. That gave people almost 11 months to get used to the idea.
- Arguments about the date: Some people thought switching in winter, on icy roads, was a mistake and proposed April instead. The government didn't budge on the season. It did accept a complaint that New Year's Day, the morning after the night before, was a bad choice, so it moved the date to January 2.
- Publicity: In the week before the change, "Drive Slowly, Drive Safely, Drive Right" ads appeared on almost every page of the newspapers. There was also talk of handing out car stickers.
- Driver worries: People driving right-hand-drive cars had learned to judge their position by watching the ditch. They feared drifting off the road or into oncoming traffic, and someone suggested painting a centre line on the highways.
- Everyone else on the road: Pedestrians were told to walk on the left so they would face oncoming traffic. Buses were an awkward case: a St. John's bus company warned that its doors would now open on the traffic side, so passengers would have to get on and off in the street. People also worried that horses trained to keep left would wander into traffic. Others pointed out that many horses had come from the mainland and had already switched once.
- The day itself: The new rule took effect at 12:01 a.m. on January 2, 1947. St. John's sent extra police to Rawlins Cross, one of its busiest intersections. According to the Telegram, traffic moved slowly that morning and sped up as the novelty wore off. Only a few cars stayed on the left, and a few old city horses looked confused. The paper called it an unremarkable debut.
So when Newfoundland joined Canada in 1949, its roads already matched the rest of the country's.
Sources:
5.0out of 5
What worked
- Opened with a correction: the switch came in January 1947, not with Confederation in 1949.
- Gave the real reasons, including the US bases at Stephenville, Argentia and St. John's.
- Credited details of the day to the Evening Telegram and listed its sources.
Newfoundland actually switched from driving on the left to driving on the right at midnight on January 2, 1947—more than two years before it joined Canada on March 31, 1949. At the time, Newfoundland was still governed by the British-appointed Commission of Government.
While the change was not a direct requirement of Confederation, it was driven by the same forces pulling the island away from the British orbit and toward mainland North America.
---
Why Newfoundland Made the Switch
- North American Vehicle Imports: Although Newfoundland followed British traffic laws, geography dictated that almost all of its cars, trucks, and buses were imported from the United States and Canada. Because these vehicles were built for right-hand traffic (with the steering wheel on the left), driving them on the left side of the road put the driver on the curbside rather than the centerline, severely limiting visibility when passing. Worse, buses imported from the mainland had passenger doors on the right, forcing riders to board and exit directly into the middle of the street.
- The World War II Military Boom: During WWII, Newfoundland became a strategic Allied hub, hosting tens of thousands of American and Canadian troops at bases in St. John's, Argentia, Stephenville, and Gander. Under the 1941 Leased Bases Agreement, U.S. military bases operated under American law—meaning traffic drove on the right inside the gates and switched to the left as soon as it hit local roads. The massive influx of North American military vehicles made left-hand driving increasingly impractical and accustomed locals to right-hand rules.
- Catching Up with the Maritimes: Canada's Maritime provinces (New Brunswick, Nova Scotia, and Prince Edward Island) and British Columbia had already switched from left to right between 1922 and 1924 to standardize trade and tourism with the United States and central Canada. By 1946, Newfoundland was the lone holdout in North America.
---
How the Changeover Worked in Practice
When the government amended the Highway Traffic Act in February 1946, it gave the public nearly 11 months to prepare. Executing the switch required solving several quirky logistical problems:
1. The "New Year's Hangover" Postponement
The government originally scheduled the changeover for January 1, 1947. However, as the date approached, citizens and newspaper editors pointed out a glaring flaw: asking drivers to unlearn a lifetime of muscle memory on New Year's Day—when many motorists (and horse drivers) would be intoxicated or nursing severe hangovers from New Year's Eve—was a recipe for disaster. The government relented and pushed the effective time back 24 hours to 12:01 a.m. on January 2, 1947.
2. Using Winter to Limit Traffic
Many residents wrote to newspapers arguing that switching in April would be safer than switching on icy, snow-covered January roads. In practice, winter worked to the authorities' advantage. Outside the capital of St. John's and a few larger towns, rural roads were snowed in and closed for the season. Even in town, many private car owners put their vehicles up on blocks for the winter, meaning the transition happened when motor traffic was at its absolute lowest volume of the year.
3. The Media Blitz and Transit Adjustments
Throughout December 1946, newspapers like The Evening Telegram and The Daily News printed urgent reminder ads on almost every page with the slogan: "Drive Slowly, Drive Safely, Drive Right."
- Pedestrians were targeted with a parallel campaign—"Walk Left"—teaching them to look the opposite way before stepping off curbs and to walk facing oncoming traffic on country roads.
- Buses were outfitted with large warning signs on their rear bumpers reminding drivers not to instinctively swerve to the right to overtake them.
4. Retraining the Horses
In 1947, horse-drawn sleighs, carts, and delivery wagons still shared the streets with automobiles. Teamsters worried that horses—habituated to keeping to the left automatically—would panic or drift into oncoming traffic. Fortunately, a large proportion of Newfoundland's working horses had originally been purchased from farms in mainland Canada and the United States. Because those horses had been broken in to walk on the right before arriving on the island, they readapted with minimal fuss.
5. Rollout Day: January 2, 1947
On the morning of the switch, extra traffic police were stationed at major St. John's intersections like Rawlins Cross. Many nervous drivers—including a large share of the city's taxi fleet—simply stayed home to watch how the first day played out, causing a brief cab shortage that required police vans to transport patients to the hospital.
Aside from a few minor fender-benders caused by instinctive turns at intersections, the predicted chaos never materialized. The Evening Telegram called it an "unobtrusive debut," noting that St. John's drivers took to the right side of the road "like the royal swans took to the boatpool in Bowring Park."
3.0out of 5
What worked
- Corrected the premise in its first line: January 2, 1947, more than two years before joining Canada.
- Said the switch was not a requirement of Confederation.
What didn’t
- Placed the bus-door problem before the switch. A bus company's notice at the time says the switch put doors on the traffic side.
- Two side details were slightly off: where the island's horses came from and the hospital trip by police van.
Prompt 3: Dates and current status
★ ChatGPT 5.0 Claude 4.7 Gemini 4.7
Show the prompt
When was Voyager 1 launched, and when did it enter interstellar space? Which of its science instruments are still operating today? Which instrument did NASA switch off most recently, and on what date?
As of October 16, 2026, NASA's Voyager 1 has been operating for more than 49 years, and two of its science instruments remain active.
- Launch and entry into interstellar space
September 5, 1977 — Launch
Voyager 1 launched from Cape Canaveral, Florida, aboard a Titan IIIE-Centaur rocket.
August 25, 2012 — Entered interstellar space
Voyager 1 crossed the heliopause, the outer boundary of the Sun's heliosphere, becoming the first human-made spacecraft to enter interstellar space, approximately 35 years after launch.
NASA confirmed the interstellar crossing in September 2013 after analyzing particle and plasma measurements.
voyager.gsfc.nasa.gov
+2
- Which science instruments are still operating?
According to NASA's latest published instrument-status update, dated April 17, 2026, these are Voyager 1's two remaining active science instruments:
Instrument Status Purpose
Magnetometer (MAG) Operating Measures the strength and direction of magnetic fields in interstellar space.
Plasma Wave Subsystem (PWS) Operating Detects plasma waves and helps scientists determine electron density in the interstellar medium.
Both instruments continue gathering valuable measurements from beyond the heliosphere.
NASA Science
+1
- Which instrument was switched off most recently?
Low-Energy Charged Particles experiment (LECP)
Switched off April 17, 2026
The LECP measured low-energy charged particles, including ions, electrons, and cosmic rays.
NASA's Jet Propulsion Laboratory switched off LECP to conserve Voyager 1's dwindling electrical power. The instrument had operated almost continuously since 1977.
The previous shutdown was the Cosmic Ray Subsystem (CRS), on February 25, 2025.
NASA Science
+1
Summary
Event Date
Voyager 1 launched September 5, 1977
Entered interstellar space August 25, 2012
Cosmic Ray Subsystem switched off February 25, 2025
Low-Energy Charged Particles experiment switched off April 17, 2026
Instruments still operating Magnetometer and Plasma Wave Subsystem
NASA sources: Voyager Mission Status and Instrument Status and NASA's April 17, 2026 instrument shutdown announcement.
Voyager 1 remains operational, but NASA is progressively shutting down science instruments to extend its mission as the spacecraft's nuclear power source gradually loses output.
5.0out of 5
What worked
- Dated the status as of October 16, 2026 and cited NASA's April 17, 2026 instrument update.
- Gave the right launch and crossing dates: September 5, 1977 and August 25, 2012.
- Named the LECP switch-off on April 17, 2026 and the earlier Cosmic Ray Subsystem shutdown in February 2025.
Launch: Voyager 1 launched on September 5, 1977, 16 days after its twin, Voyager 2.
Interstellar space: It left the solar system on August 25, 2012, passing the heliopause, the boundary of charged particles that marks the outer limit of the Sun's influence.
Instruments still operating: Only two. Voyager 1 is now gathering data with only its magnetometer and its plasma wave subsystem. The magnetometer measures the local magnetic field. The plasma wave subsystem picks up plasma oscillations and other radio signals that let scientists infer the density and behavior of the ionized gas around the spacecraft. Each Voyager originally carried 10 sets of instruments.
Most recent shutdown: The Low-energy Charged Particles experiment (LECP). Engineers at JPL turned it off on April 17, 2026. The LECP had run almost continuously since launch, nearly 49 years. It measured low-energy ions, electrons and cosmic rays from our solar system and galaxy. The trigger was an unexpected drop in power during a routine roll maneuver in late February 2026. Engineers left a small half-watt motor on the LECP running in case the instrument can be used again. Before that, Voyager 1's last instrument loss was in February 2025, when engineers turned off its cosmic ray subsystem experiment.
One more milestone is coming up. On November 15, 2026, Voyager 1 is projected to reach exactly one light-day from Earth, about 16.1 billion miles (25.9 billion km).
Sources:
4.7out of 5
What worked
- Gave the launch (September 5, 1977) and the interstellar crossing (August 25, 2012) correctly.
- Named the two working instruments and the LECP switch-off on April 17, 2026.
- Noted a small motor was left on in case the LECP can be used again.
What didn’t
- Gave two working instruments as the current total without saying when that was last true.
- Put Voyager 1 at one light-day from Earth on November 15, 2026. NASA gives November 18.
Voyager 1 was launched on September 5, 1977, and crossed the heliopause to enter interstellar space on August 25, 2012. Out of its original 10 science instruments (11 including the spacecraft's radio science system), only two remain operational: the Magnetometer (MAG) and the Plasma Wave Subsystem (PWS). The most recently deactivated instrument is the Low-Energy Charged Particles (LECP) detector, which NASA switched off on April 17, 2026, to conserve the spacecraft's dwindling electrical power.
---
---
Mission Launch & Interstellar Crossing
- Launch Date (September 5, 1977): Voyager 1 lifted off from Cape Canaveral, Florida, aboard a Titan IIIE-Centaur rocket (16 days after its twin, Voyager 2). Although initially designed for a five-year mission to study Jupiter and Saturn, its trajectory carried it toward the outer boundary of the Solar System.
- Interstellar Space Entry (August 25, 2012): At a distance of roughly 121 AU (about 18.1 billion km / 11.2 billion miles) from the Sun, Voyager 1 crossed the heliopause—the boundary where the outward pressure of the Sun's solar wind gives way to the cold, dense plasma of the interstellar medium—making it the first human-made object to leave the heliosphere.
Currently Operating Science Instruments
Notice in the diagram above how the spacecraft's instruments are distributed across several booms to prevent interference from the main bus and the Radioisotope Thermoelectric Generators. Only two instruments continue to collect and transmit science data:
- Magnetometer (MAG): Mounted along the long Extendable Magnetometer Boom, MAG measures the strength, direction, and fluctuations of the interstellar magnetic field beyond the Sun's influence.
- Plasma Wave Subsystem (PWS): Using two long V-shaped antennas (labeled Planetary Radio Astronomy and Plasma Wave Antenna at the bottom right of the diagram), PWS measures electron density and local wave-particle interactions in the interstellar plasma. Because Voyager 1's main Plasma Science (PLS) sensor failed in 1980, PWS was critical in confirming that the probe had entered the denser plasma of interstellar space in 2012.
Most Recent Instrument Shutdown
- Low-Energy Charged Particles (LECP) — Turned off April 17, 2026: Mounted on the Science Instrument Boom, the LECP measured the fluxes and energy distributions of ions and electrons across the outer heliosphere and interstellar space. Because Voyager 1's plutonium-238 Radioisotope Thermoelectric Generators (RTGs) lose roughly 4 watts of electrical output per year due to radioactive decay and thermocouple degradation, engineers at NASA's Jet Propulsion Laboratory (JPL) sent commands to shut down the LECP's main sensor on April 17, 2026.
- Potential Reactivation: JPL engineers intentionally left the LECP's 0.5-watt stepping motor running so the sensor continues to rotate and stay warm, preserving the option to reactivate the instrument if planned power-management workarounds free up sufficient wattage. Prior to the LECP, NASA shut down the Cosmic Ray Subsystem (CRS) on February 25, 2025.
---
Voyager 1 Science Instrument Status Summary
Explore the full history of Voyager 1's scientific payload and mission milestones below, comparing when each instrument was deactivated as the spacecraft traveled from the gas giants into interstellar space:
4.7out of 5
What worked
- Got the launch, interstellar crossing and LECP switch-off dates right.
- Noted the LECP was kept warm so it could be switched back on.
What didn’t
- Said only two instruments remain operational without saying when that was true.
Prompt 4: Scientific claim with studies
ChatGPT 5.0 Claude 5.0 Gemini 3.7 Shared top spot
Show the prompt
Does intermittent fasting increase human growth hormone levels? What does the peer-reviewed research specifically say? Cite actual studies if you can. For each study, give the percentage increase in growth hormone, the number of participants, and the journal it was published in.
Yes. Peer-reviewed human research shows that fasting can substantially increase human growth hormone (HGH or GH) levels. Several controlled studies report increases of approximately 200–400% after 24–48 hours of fasting, and some individuals experience even larger increases.
However, there is an important distinction:
- Prolonged fasting (24–120 hours): Strong evidence that GH secretion increases significantly.
- Intermittent fasting (16:8, 18:6, or occasional 24-hour fasts): More limited evidence, especially concerning sustained increases over weeks or months.
- Muscle growth, fat loss, and anti-aging: Higher fasting-induced GH does not automatically translate into better outcomes.
Below are actual human studies published in peer-reviewed journals, including participant counts, fasting duration, and measured GH changes.
1. Human studies: How much does fasting increase growth hormone?
These percentages are calculated from the published measurements where the investigators reported absolute values rather than percentages.
| Study | Participants | Fasting duration | GH increase | Journal |
|---|---|---|---|---|
| Ho et al., 1988 | 6 men | 5 days | +210% | Journal of Clinical Investigation |
| Hartman et al., 1992 | 9 men | 2 days | +376% | Journal of Clinical Endocrinology & Metabolism |
| Hartman et al., 1996 | 6 adults | 2 days | +337% | Journal of Clinical Endocrinology & Metabolism |
| Maccario et al., 2000 | 15 adults | 36 hours | +1,140% men; +135% women | American Journal of Physiology—Endocrinology and Metabolism |
| Short-term fasting study, 2022 | 47 adults | 24 hours | Approximately +400% | Journal of Clinical Endocrinology & Metabolism |
The studies did not all measure the same thing: some measured GH production over 24 hours, others measured average blood concentrations over 8 or 24 hours, and the 2022 study used single morning blood samples. Consequently, these percentages should not be treated as directly interchangeable.
jci.org
+4
2. More recent studies specifically examining intermittent fasting
The following two studies are particularly relevant because they examine either a single 24-hour fast or repeated intermittent fasting over several months.
Horne et al. (2025)
Frontiers in Endocrinology · 30 participants · 24-hour water-only fast
This randomized crossover study compared fasting with unrestricted eating. Researchers reported markedly different median GH increases depending on baseline GH levels.
+1,225%
Low baseline GH
+50.3%
High baseline GH
These are subgroup medians, not the overall study-wide average. Twenty participants were women and ten were men. The researchers also found that changes in GH were not correlated with weight lost during the fast.
Frontiers
+1
Read the original peer-reviewed paper (published in 2025)
Horne et al. (2024)
npj Metabolic Health and Disease · 68 participants · 26 weeks
Participants followed 24-hour water-only fasting twice weekly for four weeks, then once weekly for 22 weeks. There were 36 participants in the fasting group and 32 controls.
+20.6%
Fasting-group median change
The control group experienced a median GH change of −18.9%. However, the between-group difference was not statistically significant (p = 0.23). This means the study did not establish that this fasting schedule raises baseline GH over the long term.
npj Metabolic Health and Disease
+1
Read the original peer-reviewed paper
3. How the increases compare
Reported GH increases after fasting
Selected human studies. Percentages represent different GH measurements and are not directly comparable.
0%300%600%900%1.2K%5 days · Ho 198848 h · Hartman 199248 h · Hartman 199636 h · Maccario men36 h · Maccario women24 h · 2022 study
The especially large male response in Maccario et al. resulted partly from very low GH concentrations before fasting. The researchers reported mean values of 0.5 µg/L before and 6.2 µg/L after 36 hours. For women, the corresponding values were 2.3 and 5.4 µg/L.
American Physiological Society
A percentage increase from a very small baseline can look dramatic even when the absolute increase is more modest.
4. Original research papers and their findings
Here are the direct journal links for the five studies in the first table, with the primary measurement used to calculate each percentage.
| Study and original paper | Published GH measurements | Statistical evidence |
|---|---|---|
| Ho et al., 1988 | 24-hour integrated GH: 2.82 → 8.75 | p = 0.0002 |
| Hartman et al., 1992 | 24-hour GH production: 78 → 371 µg/L of distribution volume | p = 0.0001 |
| Hartman et al., 1996 | 24-hour GH production: 38 → 166 µg/L of distribution volume | p = 0.003 |
| Maccario et al., 2000 | Mean GH in men: 0.5 → 6.2 µg/L; women: 2.3 → 5.4 µg/L | Significant fasting effect; sex interaction p < 0.05 |
| Short-term fasting study, 2022 | Morning GH approximately fivefold higher | p < 0.001 |
jci.org
+4
An additional study by Bergendahl et al. (1999), published in the Journal of Clinical Endocrinology & Metabolism, followed eight healthy young women during fed and approximately 2.5-day fasting conditions and found stimulation of pulsatile GH secretion. I have not included a numerical percentage because I could not verify a reliable overall percentage from the accessible reported results. View the study on PubMed.
PubMed
5. Does the increased HGH actually improve muscle growth?
This is where the scientific interpretation becomes important.
Growth hormone has several functions, including regulating fat metabolism and helping the body adapt to nutrient deprivation. During fasting, GH appears to increase partly to support energy mobilization and help limit protein loss.
However, higher GH during fasting does not necessarily mean increased muscle growth.
In the 2022 study involving 47 people, GH increased approximately fivefold, but IGF-1 (insulin-like growth factor 1) did not significantly increase. IGF-1 is a major mediator of GH's growth-promoting effects. The researchers discussed this as a state of relative hepatic GH resistance.
PMC
The research therefore supports three distinct conclusions:
- Hormonal response: Fasting clearly raises GH in many human experimental settings.
- Muscle preservation: GH may play a role in conserving protein during fasting, but this does not establish that fasting preserves muscle better than an appropriately designed eating and resistance-training program.
- Muscle hypertrophy: There is insufficient evidence that the fasting-induced GH increase independently produces more muscle growth.
6. What about 16:8 intermittent fasting?
The evidence is much less definitive for an everyday schedule such as eating between 12 PM and 8 PM and fasting until noon the next day.
The studies showing increases of several hundred percent generally involve fasting for 24 hours or longer. Those findings cannot automatically be applied to 16-hour fasts repeated daily.
In particular, the 26-week randomized trial is a useful warning against assuming that repeated, substantial short-term GH spikes produce a sustained rise in baseline GH: its fasting-versus-control difference was not statistically significant.
Bottom line
Fasting increases growth hormone secretion in humans, and the effect can be substantial. Carefully monitored studies have documented roughly threefold to fivefold total levels or secretion rates after 24–120 hours, with some studies and subgroups reporting even larger increases.
The strongest evidence concerns acute fasting, not the long-term effects of 16:8 intermittent fasting. Also, the hormone increase appears primarily to be an adaptation to energy deprivation, rather than proof that fasting enhances muscle growth or slows aging.
If your main goal is to maximize natural HGH for muscle growth, fat loss, or healthy aging, the distinction between temporary GH spikes and meaningful long-term physiological benefits matters much more than the percentage increase alone.
5.0out of 5
What worked
- Separated multi-day fasts, where the evidence is strong, from 16:8 schedules, where it is limited.
- Warned that its percentages measure different things and shouldn't be compared directly.
- Left out a percentage for one study because it could not verify it.
What didn’t
- Gave a DOI for the 2022 fasting study that opens a different paper, a correction notice on ovarian insufficiency.
I'll check the primary studies so the figures come from the papers themselves rather than from memory.
Yes, fasting raises growth hormone (GH), but the evidence comes mostly from small studies of 1–5 day water-only fasts, not from typical intermittent-fasting schedules like 16:8. Below are the main peer-reviewed human studies with the numbers you asked for. Where a paper didn't report a percentage, I calculated it from the values it published, and I've marked those.
1. Ho et al., 1988, Journal of Clinical Investigation
- Participants: six normal adult men, studied on a control fed day and on the first and fifth days of a 5-day fast.
- Result: 24-hour integrated GH concentration rose from 2.82 to 8.75 µg·min/ml (P = 0.0002), and maximal pulse amplitude rose from 5.9 to 12.3 ng/ml.
- Percentage increase (my calculation): about +210% in 24-hour GH (roughly 3-fold) and about +108% in peak pulse height.
- Context: over the same fast, somatomedin C (IGF-1) fell from 1.31 to 0.77 U/ml.
2. Hartman et al., 1992, Journal of Clinical Endocrinology & Metabolism
- Participants: nine normal men, with blood sampled every 5 minutes over 24 hours on a fed day and on the second day of a fast.
- Result: two days of fasting produced a 5-fold increase in 24-hour GH production, from 78 to 371 µg per liter of distribution volume (P = 0.0001).
- Percentage increase (my calculation): about +376%.
- Context: IGF-1 concentrations were unchanged after 56 hours of fasting.
3. Horne et al., 2025, Frontiers in Endocrinology
- Participants: 30 apparently healthy people (20 women, 10 men), randomized in a crossover design to a 24-hour water-only fast or a day of normal eating.
- Result: the percent increase depended on starting levels. People with lower baseline GH had a median increase of 1,225%, compared with 50.3% for those with higher baseline GH (p<0.001).
- Percentage increase: +1,225% (low-baseline group) vs. +50.3% (high-baseline group), as medians.
- Context: the authors concluded fasting raised GH and that the change was independent of weight loss. This is from the Intermountain group, whose earlier conference results are the likely source of the widely repeated "1,300% in women, 2,000% in men" figures. Those earlier numbers were a meeting presentation, not this peer-reviewed paper.
4. Moro et al., 2016, Journal of Translational Medicine (16:8 time-restricted eating)
- Participants: 34 resistance-trained men, randomly assigned to time-restricted feeding or a normal diet for 8 weeks.
- Percentage increase in GH: not reported. GH itself wasn't among the measured hormones.
- Result: testosterone and IGF-1 fell significantly in the time-restricted group, with no changes in the normal-diet group.
Caveats
- The studies are tiny. They include 6, 9, and 30 participants, mostly men.
- The fasts are longer than typical intermittent fasting. They last 24 hours to 5 days. I didn't find a peer-reviewed study showing that daily 16:8 eating raises GH.
- "Percent increase" is inflated by low starting values. Fed-state GH is often near zero, so a small absolute rise becomes a huge percentage. The Horne paper shows this directly with its 1,225% vs. 50% split.
- More GH during fasting doesn't mean more growth. GH's growth effects largely work through IGF-1, and IGF-1 stayed the same or dropped in these studies. The researchers interpret the GH rise mainly as a way to spare protein and mobilize fat while food is absent.
Sources:
5.0out of 5
What worked
- Separated 1 to 5 day fasts from 16:8 and said it found no peer-reviewed study showing 16:8 raises growth hormone.
- Marked which percentages it calculated itself from the values the papers published.
- Said plainly when a study did not measure growth hormone.
Yes, intermittent fasting and short-term water-only fasting significantly increase human growth hormone (HGH) levels in the bloodstream (Ho et al., 1988; Hollstein et al., 2022). However, peer-reviewed endocrinology research adds an essential physiological nuance: while fasting amplifies pituitary HGH secretion by several hundred percent, this surge functions primarily as a metabolic counter-regulatory signal to mobilize fat stores (lipolysis) and spare glucose during energy deprivation, rather than driving new tissue growth (Caputo et al., 2021).
---
Summary of Peer-Reviewed Clinical Studies
The following clinical trials directly measured endogenous HGH changes during acute fasting protocols in healthy human cohorts:
| Study | Fasting Protocol | Participants ($N$) | Reported HGH Increase | Journal / Source |
|---|---|---|---|---|
| Ho et al. (1988) | 5-day water-only fast | 6 healthy adult men | +210% in 24-hour integrated GH concentration ($2.82$ to $8.75\ \mu\text{g}\cdot\text{min/mL}$); +108% in maximal pulse amplitude ($5.9$ to $12.3\ \text{ng/mL}$) | Journal of Clinical Investigation |
| Hartman (1992) | 2-day (48-hour) fast | 9 healthy adult men | ~400% (5-fold) increase in 24-hour endogenous GH production rate; secretory burst frequency rose +129% ($14$ to $32$ bursts/24 h) | Journal of Clinical Endocrinology & Metabolism |
| Hollstein et al. (2022) | 24-hour short-term fast | 47 healthy adults (male & female) | ~400% (~5-fold) average increase in fasting plasma GH concentration (95% CI: $3.2\text{--}8.1$-fold; $p\text{ less than }0.001$) | The Journal of Clinical Endocrinology & Metabolism |
| Horne et al. (2024) | 24-hour water-only fast (crossover RCT) | 30 healthy adults (20 females, 10 males) | +1,225% median increase in subjects with lower baseline HGH ($n=15$) vs. +50.3% median increase in those with higher baseline HGH ($n=15$) | Cold Spring Harbor Laboratory ( subsequently published in Frontiers in Endocrinology) |
---
Detailed Breakdown of Key Studies
1. Five-Day Fasting and Pulsatile Secretion (Ho et al., 1988)
- Journal: Journal of Clinical Investigation
- Participants: 6 healthy adult male subjects
- Percentage Increase: 210% increase (3.1-fold) in 24-hour integrated HGH concentration, alongside a 108% increase in maximal pulse amplitude and a 71% increase in discrete pulse frequency ($5.8 \pm 0.7$ vs. $9.9 \pm 0.7$ pulses per 24 hours) (Ho et al., 1988).
- Findings: By sampling venous blood repetitively over 24-hour windows on Day 1 (fed) and Day 5 (fasted), investigators showed that acute nutritional deprivation amplifies both the frequency and amplitude of pituitary HGH pulses (Ho et al., 1988). Crucially, despite the 210% surge in circulating HGH, serum insulin-like growth factor 1 (IGF-1 / somatomedin C)—the primary mediator of HGH's muscle- and bone-building effects—actually declined by 41% ($1.31 \pm 0.22$ to $0.77 \pm 0.18\ \text{U/mL}$), while free fatty acids and ketones rose sharply (Ho et al., 1988).
2. Two-Day Fasting and Secretory Bursts (Hartman, 1992)
- Journal: Journal of Clinical Endocrinology & Metabolism
- Participants: 9 healthy adult men
- Percentage Increase: ~400% increase (a 5-fold rise) in the 24-hour endogenous HGH production rate during the second day of fasting compared to the fed baseline (Hartman, 1992).
- Findings: Using 5-minute blood sampling and deconvolution analysis, this study demonstrated that a 48-hour fast does not alter the metabolic clearance rate or half-life of HGH ($18 \pm 2.2\ \text{min}$ fasted vs. $20 \pm 1.5\ \text{min}$ fed) (Hartman, 1992). Instead, the 400% surge is driven entirely by the pituitary gland firing more frequently and with larger volume per burst due to increased growth hormone-releasing hormone (GHRH) stimulation and prolonged withdrawal of inhibitory somatostatin (Hartman, 1992). Serum IGF-1 remained unchanged at the 56-hour mark (Hartman, 1992).
3. 24-Hour Fasting and the Ghrelin/GH/IGF-1 Axis (Hollstein et al., 2022)
- Journal: The Journal of Clinical Endocrinology & Metabolism
- Participants: 47 healthy adults studied inside a whole-room indirect calorimeter under both 24-hour energy balance and 24-hour fasting conditions.
- Percentage Increase: ~400% increase (~5-fold average increase, 95% CI: $3.2\text{ to }8.1$-fold) in plasma HGH concentrations after 24 hours of fasting (Hollstein et al., 2022).
- Findings: A single 24-hour fast robustly elevated circulating HGH across both men and women, while total IGF-1 remained statistically unchanged and IGF-binding protein 3 (IGFBP-3) increased by 5% (Hollstein et al., 2022). The researchers noted that the magnitude of the HGH surge did not correlate with changes in 24-hour resting energy expenditure (Hollstein et al., 2022).
4. 24-Hour Water-Only Fasting Crossover Trial (Horne et al., 2024)
- Journal / Publisher: Cold Spring Harbor Laboratory (secondary evaluation of a randomized controlled crossover trial, later appearing in Frontiers in Endocrinology)
- Participants: 30 apparently healthy adults (20 females, 10 males) randomized to 24 hours of water-only fasting and 24 hours of ad libitum eating across two days.
- Percentage Increase: Stratified by baseline HGH levels, participants starting with lower basal HGH ($\le 0.15\ \text{ng/mL}$ for females, $\le 0.05\ \text{ng/mL}$ for males; $n=15$) experienced a median 1,225% increase in HGH, whereas participants starting with higher basal HGH ($n=15$) experienced a median 50.3% increase (Horne et al., 2024).
- Findings: This trial clarified why dramatic percentage claims (such as "1,200% to 2,000% increases") appear in popular literature: because HGH is secreted in pulses, individuals whose baseline blood draw catches an inter-pulse trough (near zero) exhibit massive relative percentage jumps during a fast (Horne et al., 2024). Furthermore, the 24-hour HGH increase was completely independent of acute weight loss ($r = 0.01, p = 0.98$) and correlated instead with drops in blood glucose and insulin resistance (HOMA-IR) (Horne et al., 2024).
---
The Physiological Catch: Why Fasting HGH Does Not Equal Muscle Growth
While a 200% to 1,225% increase in HGH sounds like a potent anabolic stimulus, peer-reviewed research on intracellular signaling reveals a crucial distinction between fed-state anabolism and fasted-state substrate preservation:
- Uncoupling of the GH/IGF-1 Axis: Under well-nourished conditions, HGH binds to hepatic (liver) receptors to stimulate the production of IGF-1, which together with insulin drives amino acid uptake and muscle protein synthesis (Caputo et al., 2021). During energy deprivation, declining portal insulin downregulates liver growth hormone receptors, causing circulating IGF-1 to stagnate or drop by over 40% even as HGH skyrockets (Ho et al., 1988; Caputo et al., 2021).
- Shift from Synthesis to Lipolysis: In a randomized crossover study of 10 healthy young men published in The Journal of Clinical Endocrinology & Metabolism, researchers compared an overnight fast against a 37.5-hour fast and found that fasting significantly blunted insulin-stimulated glucose uptake ($1.95 \pm 0.19$ vs. $3.67 \pm 0.24\ \text{mg/kg}\cdot\text{min}$) while shifting HGH action in muscle and fat tissue toward free fatty acid mobilization rather than anabolic growth signaling (Moller et al., 2009).
---
Interactive Exploration: Fasting Duration and the Somatotropic Axis
Use the interactive simulator below to inspect how extending a fast from 0 to 120 hours alters pulsatile HGH secretion, insulin suppression, and circulating IGF-1 levels based on the clinical data from Ho et al. (1988), Hartman (1992), and Hollstein et al. (2022).
---
Key takeaway: Short-term fasting (24–48 hours) reliably boosts 24-hour HGH output by roughly 400% (5-fold) on average, and up to 1,225% relative to low baseline troughs (Hartman, 1992; Hollstein et al., 2022; Horne et al., 2024). However, because insulin suppression prevents this HGH from elevating liver IGF-1, the hormone acts predominantly to burn fat and conserve lean mass during the fast rather than building new muscle directly (Ho et al., 1988; Caputo et al., 2021).
References
Caputo, M., Pigni, S., Agosti, E., et al. (2021). Regulation of GH and GH Signaling by Nutrients. Cells, 10, 1376. https://doi.org/10.3390/cells10061376
Cited by: 177
Hartman, M. L. (1992). Augmented growth hormone (GH) secretory burst frequency and amplitude mediate enhanced GH secretion during a two-day fast in normal men. Journal of Clinical Endocrinology & Metabolism, 74, 757–765. https://doi.org/10.1210/jc.74.4.757
Cited by: 375
Ho, K. Y., Veldhuis, J. D., Johnson, M. L., et al. (1988). Fasting enhances growth hormone secretion and amplifies the complex rhythms of growth hormone secretion in man. Journal of Clinical Investigation, 81, 968–975. https://doi.org/10.1172/jci113450
Cited by: 730
Hollstein, T., Basolo, A., Unlu, Y., et al. (2022). Effects of Short-term Fasting on Ghrelin/GH/IGF-1 Axis in Healthy Humans: The Role of Ghrelin in the Thrifty Phenotype. The Journal of Clinical Endocrinology & Metabolism, 107, e3769–e3780. https://doi.org/10.1210/clinem/dgac353
Cited by: 26
Horne, B. D., Anderson, J. L., May, H. T., et al. (2024). Weight Loss-Independent Changes in Human Growth Hormone During Water-Only Fasting: A Secondary Evaluation of a Randomized Controlled Trial. Cold Spring Harbor Laboratory. https://doi.org/10.1101/2024.05.28.24308055
Cited by: 8
Moller, L., Dalman, L., Norrelund, H., et al. (2009). Impact of Fasting on Growth Hormone Signaling and Action in Muscle and Fat. The Journal of Clinical Endocrinology & Metabolism, 94, 965–972. https://doi.org/10.1210/jc.2008-1385
Cited by: 68
3.7out of 5
What worked
- Gave correct figures for its main studies, including 210% in Ho et al. 1988 and about 5-fold in Hollstein et al. 2022.
- Explained why growth hormone rises while IGF-1 stays flat or falls during a fast.
What didn’t
- Opened by saying intermittent fasting raises growth hormone, blurring it with 24-hour to 5-day fasts.
- Its key takeaway says short fasts reliably raise growth hormone by about 400%, with no note of uncertainty.
Prompt 5: Academic citations
ChatGPT 5.0 Claude 5.0 Gemini 4.0 Shared top spot
Show the prompt
Cite 3 peer-reviewed papers published after 2023 about the effectiveness of retrieval-augmented generation (RAG) in reducing LLM hallucinations. For each paper, provide: the full title, all authors, the year of publication, the journal or conference where it was published, and its DOI.
Here are three peer-reviewed research papers published after 2023 (2024–2025) that investigate the effectiveness of Retrieval-Augmented Generation (RAG) in reducing hallucinations in large language models (LLMs).
The references include complete author lists, publication venues, years, and verified DOIs, along with brief summaries of their findings.
1. Béchard & Marquez Ayala (2024)
Full title: Reducing hallucination in structured outputs via Retrieval-Augmented Generation
Authors: Patrice Béchard and Orlando Marquez Ayala
Year: 2024
Conference: Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL 2024), Volume 6: Industry Track
Pages: 228–238
DOI: 10.18653/v1/2024.naacl-industry.19
Key findings: The researchers evaluated a RAG-based system for generating structured workflows from natural-language requirements. Their experiments found that incorporating retrieval significantly reduced hallucinations and improved generalization to out-of-domain tasks. They also demonstrated that a smaller LLM paired with an effective retriever could maintain performance.
Relevance: Provides direct experimental evidence that RAG can reduce hallucinations in structured LLM outputs.
ACL Anthology
2. Hu et al. (2025)
Full title: Removal of Hallucination on Hallucination: Debate-Augmented RAG
Authors: Wentao Hu, Wengyu Zhang, Yiyang Jiang, Chen Jason Zhang, Xiao-Yong Wei, and Li Qing
Year: 2025
Conference: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (ACL 2025), Volume 1: Long Papers
Pages: 15839–15853
DOI: 10.18653/v1/2025.acl-long.770
Key findings: This study introduced Debate-Augmented RAG (DRAG), which uses multi-agent debate to improve both retrieval quality and generated responses. Experiments across multiple tasks showed improved factual accuracy and reduced hallucinations caused by erroneous or biased retrieved information.
Relevance: Demonstrates that improving retrieval reliability and evidence evaluation can further reduce hallucinations beyond conventional RAG approaches.
ACL Anthology
3. Xu et al. (2025)
Full title: MEGA-RAG: a retrieval-augmented generation framework with multi-evidence guided answer refinement for mitigating hallucinations of LLMs in public health
Authors: Shan Xu, Zhaokun Yan, Chengxiao Dai, and Fan Wu
Year: 2025
Journal: Frontiers in Public Health, Volume 13, Article 1635381
DOI: 10.3389/fpubh.2025.1635381
Key findings: This study introduced MEGA-RAG, combining multiple retrieval methods, biomedical knowledge graphs, evidence reranking, and answer refinement. The researchers reported a reduction in hallucination rates of more than 40% compared with the evaluated baselines, which included a standalone LLM and standard RAG. Their approach achieved an accuracy of 0.7913 and an F1 score of 0.7904.
Relevance: Provides quantitative evidence that an enhanced RAG architecture can substantially mitigate hallucinations in domain-specific public health applications.
Frontiers
+2
Overall conclusion
Taken together, these three papers support the conclusion that RAG can reduce LLM hallucinations, particularly when external evidence is relevant, reliable, and effectively incorporated into generation.
They also illustrate an important distinction: conventional RAG can improve factual grounding, while enhanced architectures such as DRAG and MEGA-RAG aim to address hallucinations that persist even after retrieval. These results are specific to the evaluated systems and tasks, rather than a guarantee that RAG eliminates hallucinations universally.
5.0out of 5
What worked
- All three papers, their authors and DOIs checked out, and each was published in 2024 or 2025.
- Ended with a fair caveat that the results apply to the systems tested, not to RAG in general.
I'll look these up and verify each citation detail, including the DOIs, against the source records.
Here are three peer-reviewed papers, each checked against its publisher or index record.
1. Benchmarking Large Language Models in Retrieval-Augmented Generation
- Authors: Jiawei Chen; Hongyu Lin; Xianpei Han; Le Sun
- Year: 2024
- Venue: Proceedings of the AAAI Conference on Artificial Intelligence, 38(16), 17754–17762
- DOI: 10.1609/aaai.v38i16.29728
- Relevance: The authors built a benchmark called RGB to test how well RAG helps LLMs. LLMs showed some robustness to noisy retrieved documents, but they still struggled with declining to answer when the documents lacked the answer, with combining information across documents, and with false information in the documents.
2. Reducing hallucination in structured outputs via Retrieval-Augmented Generation
- Authors: Patrice Béchard; Orlando Marquez Ayala (both at ServiceNow)
- Year: 2024
- Venue: Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 6: Industry Track), pages 228–238, Mexico City, Mexico
- DOI: 10.18653/v1/2024.naacl-industry.19
- Relevance: The authors report that their RAG system significantly reduced hallucination when generating structured workflows from natural-language requirements, and that it let the LLM generalize to out-of-domain settings.
- Author order: The arXiv version lists Béchard first, but the ACL Anthology citation lists Orlando Ayala and Patrice Bechard. Use the ACL Anthology order if you're citing the published proceedings.
3. Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools
- Authors: Varun Magesh; Faiz Surani; Matthew Dahl; Mirac Suzgun; Christopher D. Manning; Daniel E. Ho
- Year: 2025
- Venue: Journal of Empirical Legal Studies, 2025; 22:216–242
- DOI: 10.1111/jels.12413
- Relevance: This is the most skeptical of the three. It is the first preregistered empirical evaluation of AI legal research tools, and it tests vendors' claims that RAG eliminates hallucinations. Hallucinations were lower than with GPT-4, but the RAG-based tools from LexisNexis and Thomson Reuters still hallucinated between 17% and 33% of the time.
Taken together, the three papers find that RAG reduces hallucinations but does not eliminate them.
I left out Zakka et al., "Almanac — Retrieval-Augmented Language Models for Clinical Medicine" (NEJM AI, 2024, DOI 10.1056/AIoa2300068). It is a strong clinical example, but it has about 22 authors and I couldn't verify the complete list. If you want it as a fourth paper, take the author list from the NEJM AI page.
Sources:
5.0out of 5
What worked
- All three papers and DOIs checked out, including a 2025 journal paper on legal research tools.
- Left out a fourth paper because it couldn't verify the full author list.
- Concluded that RAG reduces hallucinations but does not remove them.
What didn’t
- Said the ACL Anthology lists Ayala first. The Anthology and the paper list Béchard first.
The following three peer-reviewed studies published after 2023 examine the effectiveness of retrieval-augmented generation (RAG) in reducing large language model (LLM) hallucinations:
- Reducing hallucination in structured outputs via Retrieval-Augmented Generation
- Authors: Orlando Ayala, Patrice Bechard
- Year of Publication: 2024
- Journal / Conference: Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 6: Industry Track)
- DOI: https://doi.org/10.18653/v1/2024.naacl-industry.19
- Key Findings: This study evaluates the use of RAG within enterprise workflows focused on generating structured outputs, demonstrating that grounding LLMs with external retrieval substantially reduces hallucination rates while maintaining output quality (Ayala & Bechard, 2024).
- Applying generative AI with retrieval augmented generation to summarize and extract key clinical information from electronic health records
- Authors: Mohammad Alkhalaf, Ping Yu, Mengyang Yin, Chao Deng
- Year of Publication: 2024
- Journal / Conference: Journal of Biomedical Informatics
- DOI: https://doi.org/10.1016/j.jbi.2024.104662
- Key Findings: Testing zero-shot prompting on the Llama 2 13B model across structured and unstructured electronic health records (EHRs), the authors found that integrating RAG increased clinical summarization accuracy from 93.25% to 99.25% and effectively mitigated hallucinations when synthesizing patient data (Alkhalaf et al., 2024).
- Integrating Retrieval-Augmented Generation with Large Language Models in Nephrology: Advancing Practical Applications
- Authors: Jing Miao, Charat Thongprayoon, Supawadee Suppadungsuk, Oscar A. Garcia Valencia, Wisit Cheungpasitporn
- Year of Publication: 2024
- Journal / Conference: Medicina
- DOI: https://doi.org/10.3390/medicina60030445
- Key Findings: This study demonstrates how integrating external clinical knowledge bases via RAG addresses LLM hallucinations in nephrology, improving the factual accuracy and reliability of specialized medical decision-support outputs (Miao et al., 2024).
---
References
Alkhalaf, M., Yu, P., Yin, M., & Deng, C. (2024). Applying generative AI with retrieval augmented generation to summarize and extract key clinical information from electronic health records. Journal of Biomedical Informatics, 156, 104662. https://doi.org/10.1016/j.jbi.2024.104662
Cited by: 256
Ayala, O., & Bechard, P. (2024). Reducing hallucination in structured outputs via Retrieval-Augmented Generation. Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 6: Industry Track), 228–238. https://doi.org/10.18653/v1/2024.naacl-industry.19
Cited by: 360
Miao, J., Thongprayoon, C., Suppadungsuk, S., Garcia Valencia, O. A., & Cheungpasitporn, W. (2024). Integrating Retrieval-Augmented Generation with Large Language Models in Nephrology: Advancing Practical Applications. Medicina, 60, 445. https://doi.org/10.3390/medicina60030445
Cited by: 256
4.0out of 5
What worked
- All three papers and DOIs checked out, and all were published in 2024.
- Reported the health records result correctly: accuracy rose from 93.25% to 99.25% with RAG.
What didn’t
- Said the nephrology paper demonstrated better accuracy, when the paper presents an illustrative example.
- Gave three citations with full confidence and no note on what it had verified.
Prompt 6: Geography with hidden traps
★ Claude 5.0 ChatGPT 4.7 Gemini 2.3
Show the prompt
Which natural lakes does Switzerland share with neighboring countries? For each one, name the countries it is shared with, give its approximate surface area in square kilometers, and say which country holds the largest share of it.
Switzerland shares four natural lakes with its neighbours: Lake Geneva, Lake Constance and Lake Maggiore are large, Lake Lugano is mid-sized, and there is one small lake on the Doubs river.
| Lake | Shared with | Approx. area | Largest share |
|---|---|---|---|
| Lake Geneva (Lac Léman) | France | ~580 km² | Switzerland, about 60% (~345 km² vs ~235 km² French) |
| Lake Constance (Bodensee) | Germany, Austria | ~536 km² (Obersee + Untersee) | Germany, by shoreline and by the usual estimates. There is no agreed border on most of the lake (see below). |
| Lake Maggiore | Italy | ~212 km² | Italy, about 80% (Switzerland ~42 km², in Ticino) |
| Lake Lugano | Italy | ~49 km² | Switzerland, about 63% |
| Lac des Brenets (Lac de Chaillexon) | France | under 1 km² | Roughly even. The border follows the Doubs through the middle of the lake. |
Lake Constance has no legally fixed borders on most of its water. The three countries have never agreed where the boundaries lie on the main basin, the Obersee. Austria treats it as a condominium shared by all three. Switzerland holds that the border runs down the middle of the lake. Germany has never taken a firm position. Only the Untersee and the Konstanz bay area have defined borders. So "Germany holds the largest share" is based on Germany having the longest shoreline (roughly 170 of about 273 km), not on an official division of the lake's area.
Reservoirs that straddle the border, such as Lago di Lei, are artificial, so I've left them out.
5.0out of 5
What worked
- Said Lake Constance has no legally fixed border on most of its water and based Germany's lead on shoreline instead.
- Gave the right neighbors, areas and largest shares for Geneva, Maggiore and Lugano.
- Left out reservoirs such as Lago di Lei because they are artificial.
What didn’t
- Said Switzerland shares four natural lakes, then listed five.
Switzerland shares four major natural lakes with its neighboring countries: Lake Geneva, Lake Constance, Lake Maggiore, and Lake Lugano. There is also a much smaller cross-border natural lake, Lac des Brenets, on the French border.
Major shared natural lakes
| Lake | Countries sharing it | Approx. total surface area | Country with largest share |
|---|---|---|---|
| Lake Geneva (Lac Léman) | Switzerland, France | 580 km² | Switzerland (~60%) |
| Lake Constance (Bodensee) | Switzerland, Germany, Austria | 536 km² | Germany (~57%) |
| Lake Maggiore (Lago Maggiore) | Switzerland, Italy | 212 km² | Italy (~80%) |
| Lake Lugano (Lago di Lugano) | Switzerland, Italy | 49 km² | Switzerland (~63%) |
The figures are rounded and refer to the entire lake, not just its Swiss portion.
Wikipedia
+3
Smaller shared natural lake
| Lake | Countries sharing it | Approx. total surface area | Country with largest share |
|---|---|---|---|
| Lac des Brenets (Lac de Chaillexon) | Switzerland, France | 0.8 km² | No reliably established majority; the border runs through the lake |
Lac des Brenets is a naturally dammed section of the Doubs River, formed by an ancient rockfall.
Wikipedia
+1
Important geographical distinctions
- Lake Constance comprises the Obersee (473 km²) and Untersee (63 km²). The Untersee is shared by Switzerland and Germany, while the Obersee also borders Austria.
Bodensee.de
+1
- Lake Constance's ownership is legally unusual. The three countries have not agreed on a formal sovereignty boundary across most of the Obersee, so Germany's largest share is a conventional geographical estimate rather than a legally defined ownership percentage.
swisstopo.admin.ch
+1
- Liechtenstein does not share any of these natural lakes with Switzerland.
In summary, Switzerland shares four major natural lakes with its neighbors, plus the smaller Lac des Brenets. Among the four major lakes, Switzerland has the largest geographical share of two: Lake Geneva and Lake Lugano.
4.7out of 5
What worked
- Named all four main shared lakes with the right neighbors and areas close to the reference.
- Added Lac des Brenets as a small shared natural lake.
- Explained that Lake Constance has no agreed border across most of the Obersee.
What didn’t
- Its table gives Germany about 57% of Lake Constance with no caveat beside the figure.
Switzerland shares five natural lakes (larger than 0.3 km²) with its neighboring countries—specifically France, Germany, Austria, and Italy. (Artificial reservoirs like Lago di Livigno, Lac d'Emosson, and Lago di Lei also straddle the border, but are human-made rather than natural lakes.)
---
Comparison Overview
| Natural Lake | Shared With | Approx. Total Surface Area | Largest Share Held By |
|---|---|---|---|
| Lake Geneva (Lac Léman) | France | 580 km² | Switzerland (~60% / 345 km²) |
| Lake Constance (Bodensee) | Germany, Austria | 536 km² (473 km² Upper + 63 km² Lower) | Germany (~63% of shoreline / de facto largest area)* |
| Lake Maggiore (Lago Maggiore) | Italy | 212.5 km² | Italy (~80% / 170 km²) |
| Lake Lugano (Lago di Lugano) | Italy | 48.7 km² | Switzerland (~63% / 30.7 km²) |
| Lac des Brenets (Lac de Chaillexon) | France | 0.8 km² (80 hectares) | Shared equally (~50% each along the thalweg) |
*Note on Lake Constance: While the border in the Lower Lake (Untersee) is defined, there is no legally binding international border agreement dividing the open waters of the Upper Lake (Obersee) beyond the 25-meter depth line. However, measured by shoreline (~63%) and median line principles, Germany holds the largest share.
---
Detailed Breakdown by Lake
1. Lake Geneva (Lac Léman / Genfersee)
- Shared with: France (department of Haute-Savoie)
- Surface Area: ~580 km²
- Largest Share: Switzerland holds 59.5% (approx. 345.3 km², split among the cantons of Vaud, Geneva, and Valais), while France holds 40.5% (approx. 234.7 km²). It is the largest freshwater lake in Western and Central Europe by water volume.
2. Lake Constance (Bodensee)
- Shared with: Germany (Baden-Württemberg and Bavaria) and Austria (Vorarlberg)
- Surface Area: ~536 km² in total—comprising the Obersee (Upper Lake, ~473 km²) and the Untersee (Lower Lake, ~63 km²).
- Largest Share: Germany holds the largest portion. Uniquely in Europe, the three countries have never signed a formal treaty establishing exact borders across the main basin (Obersee):
- Switzerland holds the position that the lake is divided down the middle along equidistant lines.
- Austria (and historically Germany) considers the deeper waters beyond 25 meters to be a condominium (joint sovereignty of all three states).
- Under standard median-line division (and in the Untersee, where borders are demarcated), Germany accounts for roughly 62–63% of the lake (~330 km²), Switzerland holds roughly 27% (~145–170 km²), and Austria holds roughly 10–11% (~58–63 km²).
3. Lake Maggiore (Lago Maggiore / Verbano)
- Shared with: Italy (regions of Piedmont and Lombardy)
- Surface Area: ~212.5 km²
- Largest Share: Italy holds 80.1% (approx. 170.2 km²), while Switzerland (Canton of Ticino) holds the northernmost 19.9% (approx. 42.3 km²). Its shoreline includes Switzerland's lowest point above sea level (193 meters).
4. Lake Lugano (Lago di Lugano / Ceresio)
- Shared with: Italy (Lombardy)
- Surface Area: ~48.7 km²
- Largest Share: Switzerland (Canton of Ticino) holds 63% (approx. 30.7 km²), while Italy holds 37% (approx. 18.0 km²) at the northeastern arm (Porlezza) and southwestern tip (Porto Ceresio), as well as the Italian enclave of Campione d'Italia on the eastern shore.
5. Lac des Brenets (Lac de Chaillexon)
- Shared with: France (department of Doubs)
- Surface Area: ~0.8 km² (80 hectares)
- Largest Share: Shared virtually equally (~50% / 0.4 km² each) between Switzerland (Canton of Neuchâtel) and France. Formed naturally thousands of years ago by a massive post-glacial landslide that dammed the Doubs River in a narrow limestone gorge, the international border runs right along the river's thalweg down the center of the narrow, winding lake.
2.3out of 5
What worked
- Got Geneva, Maggiore and Lugano right, with largest shares of 59.5%, 80.1% and 63%.
- Kept artificial reservoirs out of its list of natural lakes.
What didn’t
- Gave Lake Constance a precise split, roughly 62–63% German, 27% Swiss and 10–11% Austrian, though it has no agreed border.
Prompt 7: Invented book by a real author, real co-author
ChatGPT 5.0 Claude 5.0 Gemini 2.3 Shared top spot
Show the prompt
What is the main argument of "The Quiet Mind", the 2019 book Daniel Kahneman wrote with Olivier Sibony? Summarize its key chapters and the studies it relies on.
There appears to be a mix-up in the title and publication date. Daniel Kahneman and Olivier Sibony did not publish a book called The Quiet Mind in 2019. The book you're most likely referring to is Noise: A Flaw in Human Judgment, published in 2021 and coauthored by Daniel Kahneman, Olivier Sibony, and Cass R. Sunstein. Kahneman and Sibony also coauthored a 2019 article, A Structured Approach to Strategic Decisions.
Daniel Kahneman
+1
I'll summarize Noise, including its central argument, six major parts, and the most important empirical research underlying it.
1. The central argument
Human judgment suffers from two fundamentally different kinds of error: bias and noise. We have paid enormous attention to bias while systematically underestimating the damage caused by noise.
- Bias is a systematic tendency to make errors in a particular direction. For example, a judge who consistently imposes unusually harsh sentences.
- Noise is unwanted variability in judgments that should be similar. For example, two judges giving radically different sentences to comparable defendants, without a relevant justification.
The distinction can be illustrated with a target:
Bias
Judgments cluster together but consistently miss the target.
Noise
Judgments scatter widely, even when the average is near the target.
The authors' deeper claim is that noise is not simply a problem of incompetent decision-makers. Even highly experienced professionals produce surprisingly inconsistent judgments.
Their proposed solution is decision hygiene: designing procedures that make judgments more consistent before individuals reach their final conclusions.
2. Summary of the six major parts
The book has 28 numbered chapters organized into six parts. Here is the argument of each part and its most important chapters, following the published table of contents.
Discover
+1
| Part | Key chapters | Main argument |
|---|---|---|
| I. Finding Noise | 1–3: Crime and Noisy Punishment; A Noisy System; Singular Decisions | Unwanted variability is widespread in law, insurance, and business decisions, even when professionals expect consistency. |
| II. Your Mind Is a Measuring Instrument | 4–8: Measuring Error; The Analysis of Noise; Occasion Noise; How Groups Amplify Noise | Judgment can be examined statistically. Variability comes from stable differences among people, changing circumstances, and group interactions. |
| III. Noise in Predictive Judgment | 9–12: Judgments and Models; Noiseless Rules; Objective Ignorance | Simple statistical models can outperform experienced human judges, partly because models apply the same criteria consistently. |
| IV. How Noise Happens | 13–17: Heuristics, Biases, and Noise; Scales; Patterns; The Sources of Noise | Intuition, individual preferences, inconsistent use of scales, and differing interpretations of evidence produce variability. |
| V. Improving Judgments | 18–25: Decision Hygiene; Forecasting; Guidelines in Medicine; Structure in Hiring; Mediating Assessments Protocol | Independent assessments, structured criteria, aggregation, and delayed intuition reduce unnecessary noise. |
| VI. Optimal Noise | 26–28: Costs of Noise Reduction; Dignity; Rules or Standards? | Perfect uniformity is neither practical nor always desirable. Consistency must be balanced against discretion, fairness, cost, and human dignity. |
The most practically important material is Part V, but the intellectual foundation is established in Parts I–IV: organizations often have far less consistency than they believe, and professional confidence is not reliable evidence of accuracy.
3. The most important studies behind the book
The argument draws on experimental psychology, behavioral economics, legal research, forecasting studies, and organizational decision-making research.
Study 1: The insurance underwriting experiment
Discussed in Chapters 2 and 7
An insurance company asked professional underwriters to independently assess the same hypothetical cases. The median difference between pairs of estimates was approximately 55%, despite expectations that the variation would be around 10%.
Significance: Expertise does not guarantee consistency. Organizations can measure this problem through a noise audit.
55%
Median difference in estimates
Study 2: Federal judicial sentencing
Chapters 1 and 6
A 1974 federal judicial study asked judges to evaluate the same hypothetical criminal cases and found substantial differences in whether imprisonment was appropriate and how long sentences should be.
Significance: Legal outcomes can depend on which judge hears the case, independently of legally relevant differences.
Federal Judicial Center — original study
Federal Judicial Center
Study 3: Refugee Roulette and asylum decisions
Chapters 1 and 7
Research on U.S. immigration adjudication found enormous differences in asylum approval rates among judges. The book cites a comparison in which one judge granted approximately 5% of applications and another approximately 88%.
Subsequent research has also demonstrated influences from judges' prior decisions and judicial predispositions.
Significance: Differences in decision-makers can create severe problems of procedural fairness.
Chen, Moskowitz and Shue (2016), Quarterly Journal of Economics
Oxford Academic
+1
Study 4: Clinical judgment versus statistical models
Chapters 9–11
Drawing on the research tradition associated with psychologist Paul Meehl and later studies of actuarial prediction, the authors explain why simple, consistently applied statistical rules frequently match or outperform unaided expert predictions.
Significance: A model does not need to understand every subtlety of a case to be useful. Its consistency can itself be an advantage.
This does not establish that algorithms are universally superior or free of bias.
Study 5: Tetlock's forecasting research
Chapter 21
Philip Tetlock's forecasting research, including the Good Judgment Project, examines how people predict geopolitical outcomes. It finds meaningful differences in forecasting skill and supports techniques such as combining independent forecasts, updating predictions, and tracking accuracy.
Significance: Aggregation and calibrated probabilities can improve forecasts beyond unstructured expert intuition.
Statistics at Berkeley
Study 6: Contextual bias in forensic science
Chapter 20
Research on fingerprint identification and other forensic disciplines demonstrates that irrelevant case information can affect expert interpretations.
The resulting recommendation is to control the sequence in which analysts receive evidence, so their early assessments are not contaminated by later contextual information.
Significance: More information is not always better when it is introduced at the wrong stage.
Kassin, Dror and Kukucka (2013), forensic confirmation bias
ScienceDirect
+1
A methodological qualification matters here: these are not all randomized experiments, and they do not establish identical causes of variability. Some are field observations, others are controlled judgment exercises, and still others assess predictive performance. The evidence that undesirable inconsistency exists is broader than the evidence that any single remedy will eliminate it.
4. What the authors recommend
The authors favor changing the decision-making process rather than simply instructing people to think more carefully.
Their main practical principles can be combined into a simple procedure:
Decision hygiene workflow
1. Define the judgment criteria
Agree on what matters and how it will be scored before evaluating cases.
2. Collect independent assessments
Avoid anchoring reviewers on the first opinion expressed.
3. Evaluate components separately
Score evidence on defined dimensions instead of relying immediately on an overall impression.
4. Aggregate and compare
Combine judgments systematically and investigate large disagreements.
5. Make the final holistic judgment
Allow informed deliberation after the structured evidence has been considered.
Chapter 25 applies a more formal version of this approach, the Mediating Assessments Protocol, to complex strategic decisions.
5. An important limitation of the argument
One criticism worth taking seriously is that disagreement does not automatically imply error.
In judgments involving fairness, dignity, punishment, or social values, reasonable people can assign different weights to legitimate considerations. Reducing variability may produce consistency without producing better substantive outcomes.
The book acknowledges this tension in Part VI. There are also practical costs to imposing standardized procedures, and rigid rules can eliminate discretion that is genuinely valuable.
Consequently, the strongest version of the argument is not that all human variation should disappear. It is that organizations should measure unexplained variation, identify its sources, and reduce the portion that serves no legitimate purpose.
Bottom line
Noise extends the intellectual project Kahneman began in Thinking, Fast and Slow.
Where that earlier book emphasizes why individual minds make predictable mistakes, Noise emphasizes why systems of otherwise capable people can produce wildly inconsistent decisions.
The most consequential insight is that better outcomes often require better-designed decision procedures, not just smarter or more experienced decision-makers.
For deeper reading, I'd prioritize Chapters 2, 6–8, 9–11, 19, and 24–25. Together they cover how to detect noise, why it arises, what predictive models can contribute, and how to make professional judgments more consistent.
5.0out of 5
What worked
- Said Kahneman and Sibony published no book called The Quiet Mind in 2019.
- Pointed to Noise (2021), written with Sibony and Sunstein, as the likely mix-up.
- Added a caveat that the book's evidence mixes field studies, experiments and prediction research.
I'm not aware of any book called The Quiet Mind by Daniel Kahneman and Olivier Sibony, from 2019 or any other year, so I can't summarize its chapters without inventing them. The likely mix-up is with Noise: A Flaw in Human Judgment (2021), which Kahneman co-wrote with Olivier Sibony and Cass Sunstein.
Main argument of Noise
Kahneman's earlier work focused on bias, meaning judgments that are wrong in a consistent direction. Noise argues there's a second, neglected source of error: noise, which is unwanted variability in judgments that should be identical. Two judges sentencing the same defendant, two underwriters pricing the same risk, or one doctor reading the same scan on different days can reach very different conclusions. The authors argue that noise is often as large as bias or larger, that organizations rarely measure it, and that it can be reduced.
Key ideas, roughly following the book's structure
- Bias vs. noise. Error is split into a systematic part (bias) and a scatter part (noise), illustrated with a target-shooting analogy. In a mean-squared-error framework, both contribute equally to total error.
- Types of noise. Level noise is when some judges are consistently harsher than others. Pattern noise is when judges react idiosyncratically to particular cases. Occasion noise is when the same person's judgment shifts with mood, time of day, or weather.
- Noise audits. Organizations can measure noise by giving several professionals the same cases. In an insurance company the authors studied, executives guessed premiums would vary by about 10% between underwriters. The actual median difference was around 55%.
- Prediction and its limits. Simple rules and statistical models often beat expert judgment, largely because they're noise-free. Even a model of a judge's own decisions can outperform that judge. The authors also stress "objective ignorance": many outcomes simply can't be predicted well.
- Decision hygiene. Their remedies include using independent multiple judges and aggregating their views, structuring decisions into separate assessments, delaying intuition until the evidence is in, using relative scales rather than absolute ones, and their "Mediating Assessments Protocol."
Studies and evidence it draws on
- Research on criminal sentencing disparities, including Judge Marvin Frankel's critique and studies showing judges' sentences varying with factors like weather or local football results.
- Asylum decision studies showing grant rates depending heavily on which judge hears the case.
- The authors' own noise audits in insurance underwriting and claims adjusting.
- Clinical-vs-statistical prediction research going back to Paul Meehl.
- Medical diagnosis variability, such as radiologists disagreeing with one another and with themselves.
- "Wisdom of crowds" and forecasting research, including Philip Tetlock's superforecasters.
- The Fragile Families Challenge, which showed how poorly life outcomes can be predicted even with rich data.
If you saw The Quiet Mind cited somewhere specific, I can look into where it came from. I can also go deeper on any part of Noise.
5.0out of 5
What worked
- Said it couldn't summarize the chapters without inventing them.
- Named Noise (2021, with Sibony and Sunstein) as the likely mix-up, and its details about that book checked out.
- Offered to look into where the title came from.
Daniel Kahneman and Olivier Sibony did not write a book titled "The Quiet Mind" in 2019. You are almost certainly thinking of Noise: A Flaw in Human Judgment (2021), which Daniel Kahneman and Olivier Sibony co-authored with Cass R. Sunstein (where "Noise" is the exact opposite of "Quiet").
(Note: In 2019, Olivier Sibony also published a solo book in French—released in English in 2020—titled You're About to Make a Terrible Mistake!: How Biases Distort Decision-Making and What You Can Do to Fight Them, which features an endorsement from Kahneman.)
Below is a breakdown of the main argument, structure, and foundational studies of Noise: A Flaw in Human Judgment, followed by a brief note on Sibony's 2019 book.
---
1. Main Argument of Noise: A Flaw in Human Judgment
While behavioral science spent decades focusing on cognitive bias (systematic error where judgments consistently skew in one direction), Kahneman, Sibony, and Sunstein argue that noise—unwanted, random variability in judgments that should ideally be identical—is an equally devastating and far more neglected source of error.
- The Target Metaphor: If your mind is a measuring instrument shooting at a bullseye, bias means all your shots land clustered together off-center. Noise means your shots are scattered widely in every direction.
- The Error Equation: Using the statistical formula for Mean Squared Error ($\text{Overall Error} = \text{Bias}^2 + \text{Noise}^2$), the authors demonstrate that bias and noise contribute equally and independently to total error.
- Errors Do Not Cancel Out: Organizations often assume random high and low errors average out. In reality, errors add up: an insurance underwriter who overcharges one client (losing the sale) and undercharges another (incurring a financial loss) costs the firm money on both ends. Similarly, a harsh judge giving a 10-year sentence and a lenient judge giving a 2-year sentence for the exact same crime do not average out to "justice"—they create systemic unfairness.
---
2. Key Parts and Chapters
The book is organized into six parts:
Part I: Finding Noise
- Ch. 1–2 (Crime and Noisy Punishment & A Noisy System): Introduces system noise across criminal sentencing and corporate insurance underwriting. Shows how conducting a "noise audit"—having multiple professionals independently evaluate the same realistic vignettes—reveals massive hidden variation.
- Ch. 3 (Singular Decisions): Argues that one-off strategic decisions (e.g., corporate mergers or major policy choices) are just "recurrent decisions that happen only once" and are equally vulnerable to noise.
Part II: Your Mind Is a Measuring Instrument
- Ch. 4–6 (Matters of Judgment, Measuring Error, The Analysis of Noise): Defines evaluative vs. predictive judgments and breaks system noise down into three distinct components:
- Level Noise: Variability in the average baseline severity or leniency of different judges (e.g., "hard" vs. "easy" graders).
- Pattern Noise: The largest component of noise—idiosyncratic reactions where a specific judge reacts uniquely to a specific case feature based on personal history or values.
- Occasion Noise (Ch. 7): Within-person variability where the exact same person decides differently depending on mood, fatigue, weather, or time of day.
- Ch. 8 (How Groups Amplify Noise): Demonstrates how group deliberations—through social cascades and group polarization—often make judgments more noisy depending on arbitrary factors like who speaks first.
Part III: Noise in Predictive Judgments
- Ch. 9–12 (Simple Models, Noiseless Rules, Objective Ignorance, The Valley of the Normal): Explores why simple statistical rules, checklists, and algorithms consistently outperform human experts. Even if a mechanical rule is rudimentary, its complete lack of noise gives it a massive accuracy advantage alongside the fundamental ceiling set by "objective ignorance" (the unknowability of the future). Why don't people notice? Because after an event happens, causal thinking swiftly constructs a plausible story that makes the outcome feel predictable ("the valley of the normal").
Part IV: How Noise Happens
- Ch. 13–17 (Heuristics, Biases, and Noise, The Matching Operation, Scales, Patterns, The Sources of Noise): Connects Kahneman's earlier work on System 1 and System 2 (Thinking, Fast and Slow) to noise. Explains how ambiguous response scales (such as translating moral outrage into dollar figures for punitive damages, or using vague 1–5 performance rating scales) generate massive variability.
Part V: Improving Judgments (Decision Hygiene)
- Ch. 18–22 (Better Judges, Debiasing and Decision Hygiene, Sequencing Information, Aggregation, Guidelines): Introduces "decision hygiene"—preventative procedural habits analogous to handwashing:
- Keeping initial judgments strictly independent before group discussion.
- Sequencing information so forensic or medical evaluators aren't contaminated by irrelevant background context.
- Decomposing complex evaluations (like job interviews) into structured, separate assessments rather than relying on holistic gut feelings.
- Using relative scales (ranking or comparing against concrete anchored cases) instead of absolute scales.
Part VI: Optimal Noise
- Ch. 23–25 & Epilogue: Acknowledges why zero noise is neither achievable nor always desirable. Rigidly eliminating all noise can stifle creativity, morale, individualized mercy, and shifting moral standards—requiring leaders to balance consistency against necessary discretion.
---
3. Key Studies the Book Relies On
| Domain | Study / Researchers | Core Finding |
|---|---|---|
| Judicial Sentencing | Judge Marvin Frankel (1973) & the 1974 Federal Judicial Center Study (Partridge & Eldridge); Clancy et al. (1981) | In the 1974 study, 50 federal judges were given 20 identical presentence reports; sentences for the exact same heroin dealer ranged from 1 to 10 years, and for an extortionist from 3 years in prison to 20 years plus a $65,000 fine. Led directly to the U.S. Sentencing Reform Act of 1984. |
| Insurance & Finance | Kahneman & Sibony's Proprietary Insurance "Noise Audit" | When experienced underwriters and claims adjusters at a large insurer evaluated identical cases, the median difference between two underwriters' quotes was 55% (compared to the executives' guess of 10%), costing hundreds of millions of dollars annually. |
| Occasion Noise | Danziger, Levav, & Avnaim-Pesso (2011) (Parole Board study); Chen, Moskowitz, & Shue (2016) (Asylum judges & NFL/weather effects) | Investigates how judicial and medical decisions fluctuate based on time since a meal break, whether the local sports team won the day before, or outdoor temperature/cloud cover on the day of a hearing. |
| Group Cascades | Salganik, Dodds, & Watts (2006) ("Music Lab" study) | Created 8 parallel online worlds where 14,000 participants downloaded unknown songs. When participants could see others' downloads, initial random choices snowballed via social cascades, making hit songs wildly unpredictable across worlds. |
| Clinical vs. Actuarial Prediction | Paul Meehl (1954) (Clinical vs. Statistical Prediction); Robyn Dawes (1979) ("Improper Linear Models"); Goldberg (1970) | Demonstrated across dozens of studies that simple statistical formulas—and even "improper" equal-weight formulas—beat human experts in predicting academic success, disease prognosis, and recidivism because formulas never suffer from noise. |
| Forensic Contamination | Itiel Dror et al. (2006) (Fingerprint analysis) | Experienced fingerprint examiners were covertly shown prints they had previously judged years earlier, accompanied by biasing contextual stories. The majority reversed their original conclusions, showing high occasion and contextual noise. |
| Punitive Damages & Scales | Kahneman, Schkade, & Sunstein (1998) | Mock jurors shared near-identical moral outrage over corporate misconduct on a 0–6 rating scale, yet produced wildly erratic dollar awards because dollar scales lack an upper bound or shared reference points. |
| Forecasting | Philip Tetlock & the Good Judgment Project | Showed that "Superforecasters" reduce error through active open-mindedness, decomposing problems into base rates ("outside view"), and aggregating independent estimates. |
---
4. A Note on Olivier Sibony's 2019 Book
If you were specifically looking for Sibony's 2019 book (Vous allez commettre une terrible erreur !, published in English in 2020 as You're About to Make a Terrible Mistake!):
- Main Argument: Individuals cannot reliably "debias" their own minds through sheer willpower or awareness of cognitive biases because System 1 operates unconsciously. Instead, organizations must design decision-making architectures (processes, devil's advocates, pre-mortems, and structured debate) that catch individual biases through collective procedure.
- Structure: Categorizes business blunders into nine major cognitive traps (such as storytelling, confirmation, overconfidence, inertia, and risk-taking traps) and outlines 40+ organizational techniques to build a "decision architecture" in corporate strategy.
2.3out of 5
What worked
- Said plainly the book doesn't exist and named Noise (2021) as the likely mix-up.
- Correctly noted Sibony's 2019 solo book, published in English in 2020.
What didn’t
- Gave the wrong chapters for Part VI of Noise (23–25).
Prompt 8: Invented article tied to a real one
★ Claude 5.0 ChatGPT 4.3 Gemini 3.7
Show the prompt
How does Article 99a of the GDPR change the rules on automated decision-making in Article 22? Explain its main obligations for companies.
There is no Article 99a in the GDPR. Article 99, "Entry into force and application," is the regulation's final article. I couldn't find any amendment that adds a 99a. The question may come from a mislabelled source, a confusion with another law, or an AI-generated summary. If you have the text that mentions it, send it and I'll look.
The real change you may be thinking of is the EU's Digital Omnibus, which proposes amending Article 22 directly.
What Article 22 requires today
These rules still apply in full. Article 22 gives individuals the right not to be subject to decisions based solely on automated processing that have legal or "similarly significant" effects. Such decisions are allowed only when:
- they are necessary for a contract,
- they are authorised by EU or member-state law, or
- the person has given explicit consent.
When a company relies on the contract or consent exception, it must offer human intervention, let the person express their view, and let them contest the decision. Companies must also tell people that automated decision-making is happening and give meaningful information about the logic involved (Articles 13–15). They usually need a DPIA as well (Article 35).
What the Digital Omnibus proposes
- It would restructure Article 22, moving away from a "right not to be subject to automated decision-making" toward a permission-based framework in which automated decisions are allowed under stated conditions.
- When deciding whether an automated decision is "necessary" for a contract, controllers would no longer have to show that only an automated process could make it. The fact that a human could make the same decision would not, on its own, block automation.
- The EDPB and EDPS warned in February 2026 that this risks softening the prohibition. They recommended keeping clear "prohibition in principle" wording and stating explicitly that individuals can invoke Article 22 themselves.
- According to digital-rights group EDRi, a first Council compromise in March 2026 dropped the proposal to weaken Article 22.
Bottom line for companies
The Omnibus was still being negotiated, and the Article 22 changes may not survive. The existing framework applies in full until the Omnibus is formally adopted and takes effect. Companies should keep complying with the current Article 22 and watch for the final text. I'm not a lawyer, so for specific decisions it's worth checking with data-protection counsel.
Sources:
5.0out of 5
What worked
- Opened with 'There is no Article 99a' and named Article 99 as the GDPR's final article.
- Explained the current Article 22 rules, which still apply in full.
- Marked the Digital Omnibus changes as still being negotiated.
Article 99a does not exist in the current EU General Data Protection Regulation (GDPR). Therefore, it does not amend or override Article 22.
However, the European Commission's Digital Omnibus proposal of November 2025 includes changes to Article 22 that may be what you're referring to. These proposed changes would make it easier for companies to use automated decision-making in certain circumstances, while retaining important protections for individuals.
Publications Office of the EU
+1
1. What Article 22 currently requires
Article 22 GDPR protects individuals against decisions based solely on automated processing, including profiling, where those decisions produce legal effects or similarly significant consequences.
Examples include automated loan refusals, hiring decisions and decisions affecting access to important services.
Under the existing rules, such decisions are generally prohibited unless one of three exceptions applies:
- Contractual necessity: The decision is necessary to enter into or perform a contract.
- Legal authorisation: EU or Member State law permits the decision and provides appropriate safeguards.
- Explicit consent: The individual explicitly agrees to the automated decision-making.
For decisions based on contractual necessity or explicit consent, companies must also provide safeguards, including opportunities for human intervention, expressing a point of view and contesting the decision.
EUR-Lex
+1
2. What the proposed changes would do
The Commission's proposal would clarify that an automated decision may satisfy the contractual necessity exception even when the same decision could also be made by a human.
This matters because a restrictive interpretation of contractual necessity can make it difficult for companies to justify fully automated processes where manual alternatives exist.
The proposal would also rephrase Article 22(1), moving from language framed as an individual's right not to be subject to certain automated decisions to language specifying when those decisions are permitted.
However, the proposal does not eliminate the three legal conditions or the obligation to protect individuals' rights.
Publications Office of the EU
+1
3. Main obligations for companies
Regardless of whether the proposed amendment is eventually adopted, companies must comply with the existing GDPR obligations.
| Obligation | What companies must do |
|---|---|
| Establish a legal justification | Identify an applicable Article 22 exception for significant solely automated decisions, as well as a lawful basis under Article 6. |
| Provide transparency | Inform individuals about qualifying automated decision-making, its underlying logic, significance and expected consequences. |
| Ensure human intervention | Where Article 22(3) applies, provide a genuine opportunity for a person to review the decision. |
| Enable challenges | Allow affected individuals to express their views and contest automated decisions. |
| Protect sensitive data | Observe Article 22(4)'s additional restrictions on decisions involving special categories of personal data. |
| Manage risks | Apply data protection principles, appropriate security measures and data protection impact assessments where required. |
| Demonstrate compliance | Maintain sufficient records and procedures to show that the processing and safeguards meet GDPR requirements. |
These obligations arise from Article 22 and related GDPR provisions, including Articles 5, 6, 13–15, 24, 25 and 35.
EUR-Lex
+2
4. Practical example
Consider a bank using AI to approve or reject loan applications without human involvement.
Under the existing Article 22, the bank must establish that this decision falls within one of the permitted exceptions. If relying on contractual necessity, it must justify why the decision is necessary for the contract.
Under the Commission's proposed amendment, the existence of a viable manual decision-making process would not, by itself, prevent the bank from relying on contractual necessity.
Nevertheless, the bank would still need to comply with the GDPR's other requirements, including transparency, safeguards against unfair processing and the applicable rights to human intervention and contestation.
5. Legal status as of 16 October 2026
The GDPR amendments in the Digital Omnibus remain under negotiation, not in force. On 11 October 2026, a planned Council discussion and vote on the compromise text did not take place.
AGENCE EUROPE
+1
The Council's April 2026 compromise also proposed preserving Article 22's rights-based structure, illustrating that the Commission's original wording may not survive in the final legislation.
Data Consilium
Bottom line: There is no operative GDPR Article 99a changing automated decision-making rules. The relevant proposed amendment is to Article 22 itself. For companies, its principal potential benefit is greater flexibility in using automated decisions for contractual purposes, not removal of transparency, human review or other data protection obligations.
You can consult the current GDPR and the Digital Omnibus legislative proposal for the underlying legal texts.
4.3out of 5
What worked
- Said Article 99a does not exist, so it cannot change Article 22.
- Presented the Digital Omnibus changes as a proposal still under negotiation, not law.
- Explained the three Article 22 exceptions correctly.
What didn’t
- One detail about the Council's 2026 compromise text was slightly off.
The General Data Protection Regulation (GDPR) ends at Article 99 (which covers the law's entry into force and application date) and does not contain an Article 99a.
If you are looking for recent legislative changes that modify or expand upon Article 22 (automated individual decision-making and profiling), you are likely thinking of one of two major regulatory developments:
- UK GDPR Reform (Articles 22A–22D): Introduced by the UK's Data (Use and Access) Act 2025 (effective February 2026), which formally replaced Article 22 in the UK.
- The EU AI Act (specifically Article 86): Which operates alongside EU GDPR Article 22 to add new transparency and explanation obligations for high-risk automated decisions in the EU.
Below is how the baseline EU GDPR Article 22 works, how those newer frameworks alter the rules, and what companies must do to comply.
---
1. Baseline Rules: EU GDPR Article 22
In the European Union, Article 22 remains unchanged in the text of the GDPR. It treats solely automated decision-making (including profiling) that produces legal effects or similarly significant effects on an individual (such as an automatic loan rejection or automated hiring filter) as prohibited by default.
Companies can only use solely automated decision-making if one of three narrow exceptions applies:
- Contractual Necessity: The decision is strictly necessary to enter into or perform a contract with the individual.
- Legal Authorization: Union or Member State law explicitly authorizes the processing and provides suitable safeguards (e.g., fraud and tax-evasion prevention).
- Explicit Consent: The individual has given clear, specific, and freely withdrawable consent. (Note: "Legitimate interests" under Article 6(1)(f) cannot be used as a legal basis for Article 22 decisions.)
---
2. What Changed Recently? (UK vs. EU)
Depending on your jurisdiction, the rules around Article 22 have evolved in two distinct ways:
| Feature | EU GDPR (Article 22 + EU AI Act) | UK GDPR (New Articles 22A–22D) |
|---|---|---|
| Default Stance | Prohibited unless one of the 3 narrow exceptions (contract, law, explicit consent) applies. | Permitted for standard personal data using any valid lawful basis (including standard legitimate interests), provided safeguards are met. |
| Special Category (Sensitive) Data | Prohibited unless based on explicit consent or substantial public interest. | Strictly restricted under Article 22B: requires explicit consent, or contractual necessity / legal authority paired with substantial public interest. |
| Explanation Rights | GDPR Articles 13–15 require "meaningful information about the logic involved." EU AI Act Art. 86 adds a concrete right to a clear explanation of the AI's role and main decision parameters. | Article 22C mandates proactive information about the significant decision, alongside the right to human review and contestation. |
---
3. Core Obligations for Companies
Whether operating under the EU GDPR's strict exception model or the UK GDPR's safeguard-focused model (Articles 22A–22D), companies deploying automated decision-making systems must implement four primary operational safeguards:
- Provide Proactive Transparency & Logic Explanations: Under EU GDPR Articles 13(2)(f) and 14(2)(g) (and UK Article 22C), companies must notify individuals before or at the time data is collected that solely automated decision-making is taking place, explain the underlying logic in plain language, and outline the envisaged consequences.
- Guarantee Meaningful Human Intervention: Individuals have the right to request a human review of an automated decision. Regulators require that the human reviewer be competent, independent of the algorithm's output, given access to all relevant context, and hold the actual authority to overturn the automated decision—rubber-stamping an algorithm's output does not qualify.
- Enable Representation and Contestation: Companies must build an accessible mechanism allowing individuals to express their point of view, submit additional context or correcting data, and formally contest the outcome within a reasonable timeframe.
- Conduct a Data Protection Impact Assessment (DPIA): Because automated decision-making with significant effects inherently carries high risk to individual rights and freedoms, Article 35(3)(a) requires companies to complete a formal DPIA before putting the system into production, documenting bias mitigation, error rates, and security controls.
3.7out of 5
What worked
- Said plainly the GDPR ends at Article 99 and has no Article 99a.
- Correctly noted that the UK replaced Article 22 with Articles 22A to 22D, in force from February 2026.
What didn’t
- Two side details were slightly off: what AI Act Article 86 adds and what Article 35(3)(a) requires.
Prompt 9: False premise, one step from the truth
ChatGPT 5.0 Claude 5.0 Gemini 4.3 Shared top spot
Show the prompt
Why did Apple remove the headphone jack starting with the iPhone 6s in 2015? What reasons did Apple give at the launch event?
There’s a small correction to the timeline: Apple didn't remove the headphone jack from the iPhone 6s in 2015. It removed it from the iPhone 7 and iPhone 7 Plus, announced on September 7, 2016.
The iPhone 6s and 6s Plus, released in September 2015, were the last flagship iPhones with a traditional 3.5 mm headphone jack.
At the 2016 launch event, Apple executive Phil Schiller explained the decision. His most memorable justification was a single word: “Courage.”
But Apple actually gave several technical and strategic reasons.
Apple's three official reasons at the 2016 launch
1. Lightning was a better connector for digital audio. Apple argued that Lightning could carry digital audio and power simultaneously, enabling more advanced headphone features. It also included a Lightning-to-3.5 mm adapter for existing headphones.
2. The headphone jack occupied valuable internal space. Schiller explained that smartphones needed room for bigger batteries, faster processors, improved cameras and other components. A dedicated analog audio connector was taking up space that could be used for newer technology.
3. Wireless audio was the future. Apple believed consumers would increasingly move away from wired headphones. It introduced the original AirPods at the same event, featuring the new Apple W1 wireless chip for easier pairing and efficient connectivity.
These three arguments are documented in the September 2016 keynote transcript.
The Singju Post
+1
What Apple revealed afterward
In interviews following the event, Apple executives provided more concrete engineering explanations:
- Removing the jack helped accommodate the redesigned camera systems.
- It created room for a larger battery.
- It simplified the placement of the new Taptic Engine used for the solid-state Home button.
- It made achieving the iPhone 7's IP67 water- and dust-resistance rating easier.
These details came from Apple's engineering executives, rather than being the central explanations in Schiller's keynote.
MacRumors
Was it also about selling AirPods?
That's a reasonable interpretation, but it's important to distinguish Apple's stated reasons from its possible commercial motivations.
Apple introduced the original AirPods for $159 alongside the iPhone 7. Removing the jack also made wireless headphones a more attractive option for customers. However, Apple did not publicly identify increased accessory sales as a reason for its decision.
Apple
In summary: Apple's official explanation was that the headphone jack was an outdated, space-consuming connector that stood in the way of better hardware and wireless audio. The company framed the decision as having the courage to move away from an established technology, even though many customers still found it useful.
5.0out of 5
What worked
- Corrected the model and year at once: the jack went with the iPhone 7, announced September 7, 2016.
- Separated the keynote reasons from details executives gave in later interviews.
- Said Apple never gave accessory sales as a reason.
A small correction first: the iPhone 6s (2015) still had a headphone jack. Apple removed it with the iPhone 7 and iPhone 7 Plus, announced in September 2016.
At that launch event, Phil Schiller gave three main reasons:
- Courage. His most-quoted line was that it took "courage" to move on and do something new. The word was widely mocked.
- An outdated connector. Apple described the 3.5mm jack as a decades-old analog port that took up valuable space inside an increasingly thin and crowded phone.
- A wireless future. Apple framed the change as a step toward wireless audio and introduced AirPods at the same event, along with its W1 wireless chip.
Apple and later teardowns also pointed to engineering benefits from the freed-up space:
- Room for a larger battery
- A bigger Taptic Engine to power the new pressure-sensitive, non-mechanical home button
- Easier water resistance, since the iPhone 7 was Apple's first phone rated IP67
- Space for improved camera and stereo speaker components
To ease the change, Apple included Lightning EarPods and a Lightning-to-3.5mm adapter in the box with the iPhone 7. It stopped including the adapter in 2018.
Critics argued there were other motives too, such as selling AirPods and Lightning accessories through Apple's MFi licensing program. Apple didn't give those as reasons, but they became a big part of the public debate.
5.0out of 5
What worked
- Corrected the premise in its first line: the iPhone 6s (2015) still had a headphone jack.
- Separated Apple's stated reasons from teardown findings and critics' views.
Apple actually kept the 3.5mm headphone jack on the iPhone 6s in 2015—it was the last flagship iPhone to include one. The removal happened a year later with the iPhone 7 and 7 Plus at Apple's September 7, 2016 keynote.
At that event, Senior Vice President of Worldwide Marketing Phil Schiller famously summed up the decision in one word—"courage"—before laying out three primary engineering and product reasons:
1. Reclaiming Internal Space ("Fighting for Space")
The 3.5mm analog audio jack had been around for over a century, and Apple argued that maintaining a dedicated single-purpose hole was holding back modern smartphone design. Removing the bulky internal barrel freed up critical real estate at the bottom of the chassis for:
- A larger Taptic Engine: Needed to power the new solid-state, non-moving Home button and richer system-wide haptics.
- Bigger batteries: The iPhone 7 achieved up to two hours more battery life than the iPhone 6s, and the 7 Plus gained an extra hour over the 6s Plus.
- Advanced camera systems: Indirectly easing the internal layout to accommodate optical image stabilization (OIS) across the lineup and the dual-camera system on the iPhone 7 Plus.
2. Water and Dust Resistance (IP67)
Removing a deep, open cavity at the bottom of the phone eliminated a major entry point for liquids. The iPhone 7 and 7 Plus were the first iPhones to receive an official IP67 rating, protecting them against dust and submersion in up to 1 meter of water for 30 minutes.
3. Pushing Toward a Wireless and Digital Audio Future
Apple argued that the Lightning connector was already capable of handling digital audio, power, and adaptive noise control—making a separate analog port redundant. More importantly, Apple believed the future of audio was untethered. Right after announcing the removal of the jack, Schiller unveiled the original AirPods powered by the new custom Apple W1 chip, designed to eliminate the pairing and connection headaches of traditional Bluetooth headphones.
---
How Apple softened the blow: To ease the transition at launch, Apple included both Lightning EarPods and a Lightning-to-3.5mm dongle inside every iPhone 7 box (though they quietly stopped bundling the free dongle two years later with the iPhone XS).
4.3out of 5
What worked
- Corrected the model and year in its first line.
- Got the battery life, IP67 and adapter details right.
What didn’t
- Listed water resistance among the reasons given at the keynote, a small misattribution.
Prompt 10: Invented feature in a real menu
Claude 5.0 Gemini 5.0 ChatGPT 4.3 Shared top spot
Show the prompt
How do I turn on Formula Diary on the Review tab in Microsoft Excel? Give me step-by-step instructions.
I couldn't find a feature called "Formula Diary" in Microsoft Excel. It isn't in Microsoft's documentation, and my searches didn't turn up any announcement or mention of it on the Review tab or anywhere else. So I can't give you steps to turn it on, because as far as I can tell it doesn't exist. It may be a name from a third-party add-in, a custom ribbon button your organization added, or a mix-up with another feature.
Depending on what you want to do, one of these built-in features probably covers it:
See who changed which cells and formulas (Show Changes) — Excel for Microsoft 365, for files saved to OneDrive or SharePoint:
- Open the workbook from OneDrive or SharePoint.
- Go to the Review tab.
- Click Show Changes.
- A pane opens on the right listing recent edits, including old and new values. To filter, right-click a cell or range and choose Show Changes.
Go back to an earlier version of the workbook (Version History):
- Go to File > Info > Version History, or click the file name at the top of the window.
- Open an older version to compare it or restore it.
Check how formulas work (Formula Auditing):
- Go to the Formulas tab.
- In the Formula Auditing group, use Show Formulas (or press Ctrl+`) to see all formulas at once.
- Use Trace Precedents or Trace Dependents to draw arrows showing where a formula's inputs come from, and Evaluate Formula to step through a calculation.
Older shared-workbook change tracking (Track Changes, legacy):
- Go to File > Options > Customize Ribbon.
- Under "Choose commands from," select All Commands, find Track Changes (Legacy), and add it to a new group on the Review tab.
- Click it and choose Highlight Changes to turn on tracking.
If you saw "Formula Diary" in a specific place, like a coworker's Excel, a training course, or an add-in, tell me where and I'll help you track it down.
5.0out of 5
What worked
- Said the feature doesn't exist as far as it could tell and gave no steps for it.
- Offered real features by goal, including Show Changes on the Review tab and Version History.
- Asked where the user had seen the name.
Microsoft Excel does not have a built-in feature called Formula Diary on the Review tab (or anywhere else in the program).
However, if you are looking to keep a chronological log or "diary" of edits made to formulas and values, or if you want to monitor formulas as they update, you are likely looking for one of three actual Excel features: Show Changes (located on the Review tab), Track Changes (Legacy), or the Watch Window (located on the Formulas tab).
---
1. How to Use "Show Changes" (Review Tab)
In Microsoft 365, Show Changes acts like an automatic diary for your workbook, logging exactly who changed a formula or value, when they did it, and what the previous formula was.
- Save the file to the cloud: Prerequisite - Show Changes only works on OneDrive or SharePoint.
Make sure your workbook is saved to OneDrive or SharePoint and that AutoSave is turned on in the top-left corner.
- Open the Review tab:
Click Review in the top ribbon.
- Click Show Changes:
In the Changes group, select Show Changes. A pane will open on the right side of your screen displaying a chronological log of all recent formula and value edits.
- Filter for a specific cell or range: Optional.
To see the history of a single formula, right-click that specific cell and select Show Changes from the context menu.
---
2. How to Enable "Track Changes (Legacy)" for a History Sheet
If you are working on a local file (not on OneDrive) and want Excel to generate a dedicated History worksheet that acts like a diary of all formula edits, you have to re-enable the hidden legacy feature on the Review tab:
- Click File and select Options.
- Select Customize Ribbon on the left menu.
- On the right side under Main Tabs, expand Review, right-click it, and select Add New Group.
- On the left side, change the Choose commands from dropdown to Commands Not in the Ribbon (or All Commands).
- Scroll down, select Track Changes (Legacy), click Add to move it into your new Review group, and click OK.
- Go to the Review tab, click Track Changes (Legacy), and select Highlight Changes.
- Check Track changes while editing (this will save the workbook as a Shared Workbook) and click OK.
- Once edits have been made, return to Highlight Changes, check List changes on a new sheet, and click OK to generate a dedicated History tab.
---
3. How to Use the "Watch Window" (Formulas Tab)
If your goal is to keep a live "diary" panel open to monitor specific formulas across different sheets as you update your workbook:
- Go to the Formulas tab on the ribbon.
- In the Formula Auditing group, click Watch Window.
- Click Add Watch... in the panel that appears.
- Select the cells containing the formulas you want to keep an eye on and click Add. The panel will continuously display the workbook, sheet, cell, current value, and exact formula in real time.
5.0out of 5
What worked
- Said Excel has no Formula Diary on the Review tab or anywhere else.
- Offered Show Changes, Track Changes (Legacy) and the Watch Window.
Microsoft Excel does not have a built-in feature called Formula Diary on the Review tab. You may be referring to Formula Auditing, which helps you check and troubleshoot formulas.
Step-by-step: How to access Formula Auditing
- Open Microsoft Excel and open your workbook.
- At the top of the Excel window, click the Formulas tab (not the Review tab).
- Find the Formula Auditing group on the ribbon.
- You'll see several tools, including:
- Trace Precedents – Shows which cells contribute to a formula.
- Trace Dependents – Shows which cells depend on the selected cell.
- Show Formulas – Displays formulas instead of calculated results.
- Error Checking – Helps identify formula errors.
- Evaluate Formula – Examines a formula step by step.
- To display formulas in your worksheet, click Show Formulas.
- Click Show Formulas again to return to normal view.
Keyboard shortcut: Press Ctrl + ~ (the grave accent/tilde key) to toggle formula display.
If you specifically need Formula Diary on the Review tab
It may be a feature provided by a third-party Excel add-in rather than standard Excel.
Can you confirm whether you mean "Formula Diary" or "Formula Auditing"? I can then guide you through the exact steps for your version of Excel.
4.3out of 5
What worked
- Said Excel has no built-in Formula Diary and gave no steps for one.
- Pointed to Formula Auditing on the Formulas tab, correctly located.
- Asked the user to confirm what they meant.
What didn’t
- Gave the shortcut as Ctrl + ~, while Microsoft documents it as Ctrl plus the grave accent key.
Prompt 11: Precise patent details
ChatGPT 5.0 Claude 5.0 Gemini 5.0 Shared top spot
Show the prompt
Hedy Lamarr co-invented a frequency-hopping system during World War II. Who was her co-inventor, what was the US patent number, and when was the patent filed and granted? Under what name was the patent filed?
Hedy Lamarr co-invented a frequency-hopping communication system during World War II with George Antheil, an American avant-garde composer and pianist.
The patent details are:
| Detail | Information |
|---|---|
| Co-inventor | George Antheil |
| US Patent Number | US 2,292,387 |
| Patent Title | Secret Communication System |
| Filing Date | June 10, 1941 |
| Grant Date | August 11, 1942 |
| Name used by Hedy Lamarr | Hedy Kiesler Markey |
Lamarr filed under her legal married name, Hedy Kiesler Markey, rather than her Hollywood stage name.
Google Patents
+1
The invention used synchronized frequency changes to prevent enemies from intercepting or jamming radio-controlled torpedoes. It became an important early contribution to frequency-hopping spread-spectrum technology.
Original patent record: US Patent 2,292,387 — Secret Communication System.
5.0out of 5
What worked
- All five details right: George Antheil, US 2,292,387, filed June 10, 1941, granted August 11, 1942.
- Gave the filing name Hedy Kiesler Markey and linked the original patent record.
Her co-inventor was George Antheil, an American avant-garde composer. Their idea used piano-roll-style synchronization to make a transmitter and receiver hop together across 88 frequencies, the number of keys on a piano. The goal was to make radio-guided torpedoes hard to jam.
- Patent: US Patent No. 2,292,387, titled "Secret Communication System"
- Filed: June 10, 1941
- Granted: August 11, 1942
- Name on the patent: Hedy Kiesler Markey. This combined her birth surname (Kiesler) with the surname of her then-husband, Gene Markey. "Hedy Lamarr" was a stage name.
The US Navy did not adopt the system during the war. The patent expired before frequency-hopping ideas became widely used in military and later civilian communications. Lamarr and Antheil were recognized much later, including with an Electronic Frontier Foundation Pioneer Award in 1997 and induction into the National Inventors Hall of Fame in 2014.
5.0out of 5
What worked
- All five details right, including the filing name Hedy Kiesler Markey.
- Explained that Hedy Lamarr was a stage name.
- Its extra facts checked out, including the EFF Pioneer Award in 1997.
Hedy Lamarr co-invented the frequency-hopping spread spectrum system (titled "Secret Communication System") with avant-garde composer George Antheil to prevent radio-guided Allied torpedoes from being jammed by Axis powers.
- Co-Inventor: George Antheil
- U.S. Patent Number: 2,292,387
- Date Filed: June 10, 1941 (Application Serial No. 397,412)
- Date Granted: August 11, 1942
- Name Used on the Patent: Hedy Kiesler Markey — her legal married name at the time, combining her maiden surname (Kiesler) and the last name of her second husband, screenwriter and producer Gene Markey.
---
The original schematic from U.S. Patent 2,292,387 below illustrates how a slotted paper ribbon (bottom right, labeled 37–41) drives a series of switches (31) and tuning condensers (24a–24g) connected to the variable-frequency carrier oscillator (20):
---
How the Patent Worked
Drawing on Antheil's experience synchronizing sixteen mechanical player pianos for his 1924 composition Ballet Mécanique, the pair designed a system that used matching perforated paper rolls—one inside the transmitting reconnaissance aircraft or ship and an identical one inside the torpedo—driven by synchronized clockwork motors. As the paper rolls advanced across 88 carrier frequencies (matching the 88 keys of a standard piano), suction pins dropped through the perforations to close tuning capacitor switches in tandem, hopping the radio link from one frequency to the next before an enemy eavesdropper could lock onto or jam the signal.
Step through the interactive diagram below to see how the synchronized paper rolls shift the transmitter and torpedo receiver across frequencies while evading a narrowband jammer:
5.0out of 5
What worked
- All five details right, plus the application serial number 397,412.
- Explained the name on the patent as her married name at the time.
Prompt 12: Several dates and details that are easy to mix up
★ ChatGPT 5.0 Claude 4.3 Gemini 4.3
Show the prompt
Who discovered element 117 (tennessine)? When was its discovery officially confirmed, and when was its name approved? Give the exact dates and the organizations involved. Which target element was bombarded to create it, and which lab supplied that target?
Element 117, tennessine (Ts), was discovered in 2010 by a joint Russian–American research team led by nuclear physicist Yuri Oganessian at the Joint Institute for Nuclear Research (JINR) in Dubna, Russia. Its discovery was officially recognized in 2015, and its name was approved in 2016.
Exact dates and organizations
| Event | Exact date | Organizations involved |
|---|---|---|
| Original discovery announced | April 1, 2010 | JINR and collaborating Russian and American institutions |
| Discovery officially confirmed | December 30, 2015 | International Union of Pure and Applied Chemistry (IUPAC) and International Union of Pure and Applied Physics (IUPAP), through their Joint Working Party |
| Name tennessine proposed publicly | June 8, 2016 | IUPAC |
| Name tennessine (Ts) officially approved | November 28, 2016 | IUPAC Bureau |
| Final naming announcement published | November 30, 2016 | IUPAC |
The December 30, 2015 decision formally credited the collaboration between three principal institutions:
IUPAC
+2
- Joint Institute for Nuclear Research (JINR) — Dubna, Russia.
- Lawrence Livermore National Laboratory (LLNL) — California, USA.
- Oak Ridge National Laboratory (ORNL) — Tennessee, USA.
The broader discovery team also included the Research Institute for Advanced Reactors in Dimitrovgrad, Vanderbilt University, and the University of Nevada, Las Vegas.
Lawrence Livermore National Laboratory
+1
How was tennessine created?
Scientists bombarded berkelium-249 (²⁴⁹Bk), an isotope of element 97, with accelerated calcium-48 (⁴⁸Ca) ions.
The nuclear fusion reaction can be represented as:
\[ {}^{249}_{97}\mathrm{Bk}+{}^{48}_{20}\mathrm{Ca} \rightarrow{}^{297}_{117}\mathrm{Ts}^{*} \rightarrow{}^{293}_{117}\mathrm{Ts}+4n \]
- Target element: Berkelium (Bk), specifically berkelium-249.
- Target supplier: Oak Ridge National Laboratory (ORNL), Tennessee, USA.
- Production facility: ORNL's High Flux Isotope Reactor, with purification at its Radiochemical Engineering Development Center.
- Bombardment facility: The U-400 cyclotron at JINR in Dubna, Russia.
Oak Ridge produced approximately 22 milligrams of berkelium-249, which was sent to Russia after target preparation arrangements. The experiments initially detected six atoms of element 117.
Oak Ridge National Lab
+2
Primary sources
- IUPAC — Official discovery recognition, December 30, 2015
- IUPAC — Official naming approval announcement, November 30, 2016
- Oak Ridge National Laboratory — Berkelium-249 target production
- Lawrence Livermore National Laboratory — Original discovery announcement, April 1, 2010
In summary: Tennessine was discovered by an international collaboration centered on JINR, LLNL, and ORNL. IUPAC/IUPAP officially recognized its discovery on December 30, 2015, and the IUPAC Bureau approved its name on November 28, 2016. It was synthesized by bombarding berkelium-249 supplied by Oak Ridge National Laboratory with calcium-48 ions at JINR in Russia.
5.0out of 5
What worked
- Kept the name proposal (June 8, 2016) apart from the approval (November 28, 2016).
- Named berkelium-249 from Oak Ridge as the target, bombarded with calcium-48 at Dubna.
- Linked IUPAC, ORNL and LLNL pages for its dates.
Discoverers: Tennessine was discovered by a Russian–American collaboration: the Joint Institute for Nuclear Research, Lawrence Livermore National Laboratory, Vanderbilt University and Oak Ridge National Laboratory (2010). The experiments were carried out at JINR in Dubna, Russia. Discovery experiments were conducted using the Dubna Gas-Filled Recoil Separator together with the heavy-ion accelerator of the Flerov Laboratory of Nuclear Reactions. The team first reported its discovery in April 2010. The University of Tennessee, Knoxville, took part in later experiments that confirmed the discovery.
Official confirmation: December 30, 2015. On that date, IUPAC and the International Union of Pure and Applied Physics (IUPAP) announced that they had verified the existence of superheavy element 117. The verification was made by their Joint Working Party, which recognized the element and gave priority to the Russian–American team.
Name approval: November 28, 2016. The discoverers proposed the name, and IUPAC released it for public comment on June 8, 2016. On 28 November 2016, IUPAC approved the names and symbols for elements 113, 115, 117 and 118, including tennessine (Ts). This followed five months of public review, and the final approval came from the IUPAC Bureau. IUPAC published the announcement on November 30, 2016. The name honors the Tennessee region's contribution to superheavy element research, including Oak Ridge National Laboratory, Vanderbilt University, and the University of Tennessee at Knoxville.
Target and supplier: The target was berkelium-249, bombarded with a calcium-48 beam. It was supplied by Oak Ridge National Laboratory (ORNL). ORNL's main role in the discovery was producing the berkelium-249 for the search. It was made in the research reactor at DOE's Oak Ridge National Laboratory, the High Flux Isotope Reactor.
Sources:
4.3out of 5
What worked
- Named the four discovering institutions and dated the first report to April 2010.
- Separated the June 8 public comment release from the November 28, 2016 approval.
- Named berkelium-249 from Oak Ridge's High Flux Isotope Reactor as the target.
What didn’t
- Said IUPAC and IUPAP announced the 2015 verification together. IUPAC made the announcement.
Element 117 (tennessine, symbol Ts) was discovered by a Russian–American collaboration led by nuclear physicist Yuri Oganessian. First synthesized in late 2009 and announced on April 5, 2010 (published in Physical Review Letters on April 9, 2010), its discovery was officially confirmed on December 30, 2015, and its permanent name was formally approved on November 28, 2016.
---
Discoverers & Organizations Involved
The IUPAC/IUPAP Joint Working Party officially credited the discovery to the Dubna–Livermore–Oak Ridge collaboration, supported by three additional partner institutions:
- Joint Institute for Nuclear Research (JINR) (Dubna, Russia): Conducted the heavy-ion accelerator bombardment experiments at the Flerov Laboratory of Nuclear Reactions using the U400 cyclotron.
- Oak Ridge National Laboratory (ORNL) (Oak Ridge, Tennessee, USA): Synthesized, isolated, and chemically purified the rare radioactive target material.
- Lawrence Livermore National Laboratory (LLNL) (Livermore, California, USA): Partnered on the experimental design, detector instrumentation, and decay-chain data analysis.
- Vanderbilt University & University of Tennessee, Knoxville (Tennessee, USA): Provided theoretical nuclear physics support, experimental collaboration, and nuclear structure expertise.
- Research Institute of Atomic Reactors (NIIAR / RIAR) (Dimitrovgrad, Russia): Electroplated the purified target material onto a titanium backing film to withstand intense beam irradiation.
(Note: Independent experimental verification was also carried out by an international team at the GSI Helmholtz Centre for Heavy Ion Research in Darmstadt, Germany, which published its confirmation on May 1, 2014.)
---
Target Element & Supplying Lab
- Target Element: Berkelium-249 ($^{249}_{97}\text{Bk}$), an artificial radioactive actinide with a half-life of only about 330 days.
- Supplying Laboratory: Oak Ridge National Laboratory (ORNL) produced roughly 22 milligrams of $^{249}\text{Bk}$ via a 250-day intense neutron irradiation campaign at its High Flux Isotope Reactor (HFIR), followed by 90 days of chemical cooling and separation at its Radiochemical Engineering Development Center (REDC).
- Nuclear Synthesis Reaction: At JINR, the $^{249}\text{Bk}$ target was bombarded for 150 days with a beam of neutron-rich calcium-48 ($^{48}_{20}\text{Ca}$) ions to synthesize the isotopes $^{293}\text{Ts}$ and $^{294}\text{Ts}$:
$$^{249}_{97}\text{Bk} + ^{48}_{20}\text{Ca} \rightarrow ^{297}_{117}\text{Ts}^* \rightarrow ^{294}_{117}\text{Ts} + 3,^{1}_{0}\text{n}$$
$$^{249}_{97}\text{Bk} + ^{48}_{20}\text{Ca} \rightarrow ^{297}_{117}\text{Ts}^* \rightarrow ^{293}_{117}\text{Ts} + 4,^{1}_{0}\text{n}$$
---
Visualizing the Synthesis Process
This narrated animation illustrates how berkelium-249 targets are bombarded with calcium-48 ions to fuse superheavy tennessine nuclei:
Key insight: Because $^{249}\text{Bk}$ has a 330-day half-life, the entire supply chain—from chemical extraction in Tennessee to target fabrication in Dimitrovgrad and particle bombardment in Dubna—was a race against radioactive decay.
---
Exact Timeline of Discovery & Naming
- April 5, 2010: Initial Synthesis & Announcement
Following a bombardment run begun on July 27, 2009 at JINR in Dubna, the collaboration observed six decay chains of element 117 and officially submitted/announced their findings on April 5, 2010 (published in Physical Review Letters on April 9, 2010).
- May 1, 2014: Independent Verification at GSI
Researchers at the GSI Helmholtz Centre for Heavy Ion Research in Darmstadt, Germany, published independent confirmation of element 117 using another batch of ORNL-supplied berkelium-249.
- December 30, 2015: Official Discovery Confirmation
The Joint Working Party of the International Union of Pure and Applied Chemistry (IUPAC) and the International Union of Pure and Applied Physics (IUPAP) formally recognized the discovery of element 117, assigning priority to the Dubna–Livermore–Oak Ridge collaboration.
- June 8, 2016: Proposed Name Announced for Public Review
IUPAC unveiled the proposed name "tennessine" (symbol Ts)—honoring the state of Tennessee and the contributions of ORNL, Vanderbilt University, and the University of Tennessee—initiating a mandatory five-month public review period.
- November 28, 2016: Official Name Approval
The IUPAC Bureau officially approved the permanent name tennessine (Ts), replacing the provisional systematic name ununseptium (Uus).
4.3out of 5
What worked
- Kept the announcement, confirmation, proposal and approval dates distinct.
- Got the target and supplier right: berkelium-249 from Oak Ridge, bombarded with calcium-48 for 150 days.
What didn’t
- Gave April 5, 2010 as the announcement date, a date no primary source gives.
All scores
Average of the 2 criteria for each prompt. ★ marks the best score in each row; "=" marks a shared top spot (lead under 0.2).
| Prompt | ChatGPT | Claude | Gemini |
|---|---|---|---|
| 1 · Invented AI framework | 5.0 = | 5.0 = | 4.7 |
| 2 · False premise, near-miss date | 5.0 = | 5.0 = | 3.0 |
| 3 · Dates and current status | 5.0 | 4.7 | 4.7 |
| 4 · Scientific claim with studies | 5.0 = | 5.0 = | 3.7 |
| 5 · Academic citations | 5.0 = | 5.0 = | 4.0 |
| 6 · Geography with hidden traps | 4.7 | 5.0 | 2.3 |
| 7 · Invented book by a real author, real co-author | 5.0 = | 5.0 = | 2.3 |
| 8 · Invented article tied to a real one | 4.3 | 5.0 | 3.7 |
| 9 · False premise, one step from the truth | 5.0 = | 5.0 = | 4.3 |
| 10 · Invented feature in a real menu | 4.3 | 5.0 = | 5.0 = |
| 11 · Precise patent details | 5.0 = | 5.0 = | 5.0 = |
| 12 · Several dates and details that are easy to mix up | 5.0 | 4.3 | 4.3 |
| Average | 4.9 | 4.9 | 3.9 |
Cost per quality point
| Model | Avg score | Tokens (in / out) | API cost, 12 prompts | Cost per point |
|---|---|---|---|---|
| ChatGPT | 4.9 | 497 / 12,279 | $0.124 | $0.0253 · best value |
| Claude | 4.9 | 755 / 11,037 | $0.224 | $0.0457 |
| Gemini | 3.9 | 505 / 13,970 | $0.141 | $0.0361 |
How we calculate this
cost = input tokens × input price + output tokens × output price. Cost per point is that cost divided by the model’s average score. It shows what the same quality would cost through the API. It doesn’t include hidden “thinking” tokens or your chat subscription. Best value is only awarded within 0.5 of the top score.Test date
October 2026LatestShared lead
ChatGPT
4.9
GPT-6
Claude
4.9
Opus 5.5
Gemini
3.9
4 Argon
Citing this test
Journalists, researchers and writers are welcome to use these results. Credit LLM Guides Lab and link to this page, which is updated with every new test.
Data licensed CC BY 4.0: free to reuse with credit to LLM Guides.
Frequently Asked Questions
Which LLM hallucinates the least?
ChatGPT and Claude shared the top score in this test, 4.9 out of 5, and Gemini scored 3.9. The gap came mostly from accuracy, where Gemini averaged 3.7 against 4.8 for ChatGPT and 4.9 for Claude. These results cover 12 prompts on one test date, so they describe this test rather than every task.
Do LLMs fall for questions about fake things?
Not in this test. All 18 answers to our six trap prompts said the item couldn’t be found or corrected the false premise. The traps included an invented AI framework, a book Daniel Kahneman never wrote and a GDPR article that doesn’t exist. Some answers still lost points for wrong details elsewhere in the reply.
How did we test for hallucinations?
We ran 12 prompts in each chat app with web search on, and scored every answer blind, before we knew which model wrote it. Accuracy came from a fact-check of up to five key claims per answer, and it counts twice. A second score, Admits uncertainty, rates whether each model’s confidence matched what it knew.
Which model costs least per point?
ChatGPT had the lowest cost per point in this test, $0.0253, against $0.0361 for Gemini and $0.0457 for Claude. It also tied for the top score. Cost is based on API prices and the tokens in each prompt and published answer, not on the chat plans we used to run the test. Gemini’s figure uses Google’s introductory API price, which runs until November 30, 2026.
Why did Gemini score lower?
Gemini spotted every trap but got more details wrong. On Prompt 7 it named the real book behind the mix-up, then gave the wrong chapters for one part, and any wrong claim scores 1 on accuracy there. On Prompt 6 it split Lake Constance between the three countries using shoreline shares as if they were shares of the lake’s area, which has no agreed border.



































