Thursday, 17 Oct 2024

Anthropic’s CEO thinks AI will lead to a utopia — he just needs a few billion dollars first

If you want to raise ungodly amounts of money, you better have some godly reasons.That’s what Anthropic CEO Dario Amodei laid out for us on Friday in more than 14,000 words: otherworldly ways in which artificial general intelligence (AGI, though he prefers to call it “powerful AI”) will change our lives. In the blog, titled “Machines of Loving Grace,” he envisions a future where AI could compress 100 years of medical progress into a decade, cure mental illnesses like PTSD and depression, upload your mind to the cloud, and alleviate poverty. At the same time, it’s reported that Anthropic is hoping to raise fresh funds at a $40 billion valuation.Today’s AI can do exactly none of what Amodei imagines. It will take, by his own admission, h


Anthropic’s CEO thinks AI will lead to a utopia — he just needs a few billion dollars first

If you want to raise ungodly amounts of money, you better have some godly reasons.

That's what Anthropic CEO Dario Amodei laid out for us on Friday in more than 14,000 words: otherworldly ways in which artificial general intelligence (AGI, though he prefers to call it "powerful AI") will change our lives. In the blog, titled "Machines of Loving Grace," he envisions a future where AI could compress 100 years of medical progress into a decade, cure mental illnesses like PTSD and depression, upload your mind to the cloud, and alleviate poverty. At the same time, it's reported that Anthropic is hoping to raise fresh funds at a $40 billion valuation.

Today's AI can do exactly none of what Amodei imagines. It will take, by his own admission, hundreds of billions of dollars worth of compute to train AGI models, built with trillions of dollars worth of data centers, drawing enough energy from local power grids to keep the lights on for millions of homes. Not to mention that no one is 100 percent sure it's possible. Amodei says himself: "Of course no one can know the future with any certainty or precision, and the effects of powerful AI are likely to be even more unpredictable than past technological changes, so all of this is unavoidably going to consist of guesses."

AI execs have mastered the art of grand promises before massive fundraising. Take OpenAI's Sam Altman, whose "The Intelligence Age" blog preceded a staggering $6.6 billion round. In Altman's blog, he stated that the world will have superintelligence in "a few thousand days" and that this will lead to "massive prosperity." It's a persuasive performance: paint a utopian future, hint at solutions to humanity's deepest fears - death, hunger, poverty - then argue that only by removing some redundant guardrails and pouring in unprecedented capital can we achieve this techno-paradise. It's brilliant marketing, leveraging our greatest hopes and anxieties while conveniently sidestepping the need for concrete proof.

The timing of this blog also highlights just how fierce the competition is. As Amodei points out, a 14,000-word utopian manifesto is pretty out of step for Anthropic. The company was founded after Amodei and others left OpenAI over safety concerns, and it has cultivated a reputation for sober risk assessment rather than starry-eyed futurism. It's why the company continues to poach safety researchers from OpenAI. Even in last week's post, he insists Anthropic will prioritize candid discussions of AI risks over seductive visions of a techno-utopia.

But safety isn't a thrilling pitch deck subject, and new challengers are emerging daily. OpenAI cofounder Ilya Sutskever has launched his own AI lab, and departing OpenAI CTO Mira Murati is rumored to be starting her own venture. Amodei's blog isn't just about selling his vision - it's about staying competitive.

Despite his stated aversion to grandiose claims, he spends thousands of words painting a future where AI could reshape humanity's destiny (seeming to match Altman's silver-tongued pitches, which are legendary in tech circles). The post only makes one mention of alignment, aka ensuring AI systems operate in accordance with human values, and no mention of safety. This contradiction exposes a harsh truth: in the high-stakes world of AI development, even those wary of hype find themselves forced to play the game of grand promises to secure crucial funding.

you may also like

Popular spring German festival, Oktoberfest returns, just a short drive from San Diego
  • by travelandtourworld
  • descember 09, 2016
Popular spring German festival, Oktoberfest returns, just a short drive from San Diego

A lively German celebration Oktoberfest is making its way back to Southern California this spring, and the best part?

read more