White House releases health report written by LLM, with hallucinated citations

  • I have this pet theory that this wave of AI won't end with amazing productivity gains.

    I think it'll end in mass confusion. Dumbing down of the leadership and elites that now can cosplay as smart and eloquent.

    countries that don't embrace AI will have a massive edge over other countries because their population will be smarter and more capable.

  • I assure you Mrs. Buttle, the Ministry is very scrupulous about following up and eradicating any error.

    If you have any complaints which you'd like to make, I'd be more than happy to send you the appropriate forms.

    Braaaaazil......

    [where my mind goes on every news from this admin]

  • Someone should put in an FOIA request for the prompt. Or get a congressional committee to ask for it.

  • Technically, this is title editorializing, since WH denied using AI… but they are probably lying.

  • First the bogus tariff equation, now this. Certainly not the last.

    Jokes aside, it's really sad to see seemingly no competent people not wanting to work with this administration.

  • https://archive.ph/FBVff

  • These people even struggle to do a bad job well enough.

  • Next time, they'll just add "don't include citations" in the prompt. Problem solved.

  • Can we all agree to not cite any study that a) doesn't exist, b) cannot be reproduced, or c) includes fake data?

    For bonus points, the participants of the b) and c) options should be forced to pay back whoever funded their research.

  • This is a great example of why AI is the perfect tool for politicians who want to do something, then try to find some rational for it. AI will always give you the answer you want, even if it has to make it up.

  • At this point we can fully replace talking heads with AI. Let them generate reports, write fake citations, review each other’s work, sign it, worship it – all in imitation of what we once called a state. A huge win for humanity.

  • Reminds me of this “AI study” on climate change

    https://factcheck.afp.com/doc.afp.com.39798G2

    It is not the “minor citation errors” what are the most worrying, but rather the fact that LLMs aim to please you, even if you really believe your prompt was neutral (which I doubt when it comes to Kennedy and vaccines for example).

  • The goal here is to normalize the US government doing random shit, in order to reduce transparency. Average US citizen won't be able to tell if another political scandal is just Trump being Trump, or actual power grab.

  • this is obviously horrific, but they are succeeding at their broader goal - making the entire US Federal apparatus untrustworthy and operated completely by selfish idiots who do whatever they want at any given time, with the only binding force the idiotic whims of the president. (almost all of - AOC and Bernie and a few others are notable exceptions) congress has already completely conceded this fact and continues to do so by not impeaching the president.

    to me, it is extremely hard to imagine how this deliberate destruction can be undone in less than decades.

  • Not really sure what’s better - hallucinating LLM or hallucinating politicians…

  • [dead]

  • Think the title here is a little misleading. The citations do indeed appear to be hallucinations but it is not known if the report was written partially or entirely with an LLM. I would have no trouble believing that it was but at this point there isn't even a leak at MAHA claiming that it is.