By MIKE MAGEE
Final month, Dario Amodei, CEO of Anthropic, did it once more – scaring the bejesus out of societal leaders worldwide with warnings that their grip on safety and governance of human populations is dangerously near AI extinction.
Amodei’s opening paragraph in his article titled “The Adolescence of Know-how” wastes no time getting the reader’s consideration. He writes, “There’s a scene within the film model of Carl Sagan’s guide Contact the place the primary character, an astronomer who has detected the primary radio sign from an alien civilization, is being thought-about for the function of humanity’s consultant to fulfill the aliens. The worldwide panel interviewing her asks, ‘Should you may ask [the aliens] only one query, what would it not be?’ Her reply is: ‘I’d ask them, How did you do it? How did you evolve, how did you survive this technological adolescence with out destroying your self?’”
Now, I ought to be clear. I used to be already nervous. As a Medical Historian, making ready for a significant lecture on the start of Immunology this Spring, I’ve been researching the sphere. What am I on the lookout for? The identical factor I all the time discover lacking when exploring the frontiers of scientific progress – historic context. Typically, details and figures abound, however their impression on the complicated net of human relations through the years is usually lacking.
Amodei is trying to offer that context in actual time. Actual instances embrace headlines like this one from the New York Occasions: “ICE Already Know Who Protesters Are “ from AI powered facial recognition know-how . However Amodei’s issues are extra elementary. The problem for him is the velocity of change with generative AI which he clearly states is alarming. As he says, “As a result of AI is now writing a lot of the code at Anthropic, it’s already considerably accelerating the speed of our progress in constructing the subsequent era of AI programs. This suggestions loop is gathering steam month by month, and could also be just one–2 years away from some extent the place the present era of AI autonomously builds the subsequent.”
Clearly with Musk’s current DOGE foray in thoughts, Amodei lays out a fairly believable modern-day vulnerability. He says, “It’s considerably awkward to say this because the CEO of an AI firm, however I feel the subsequent tier of danger is definitely AI firms themselves. AI firms management giant datacenters, prepare frontier fashions, have the best experience on methods to use these fashions, and in some circumstances have day by day contact with and the potential of affect over tens or lots of of thousands and thousands of customers.”

Getting a bit extra particular with out outright naming Musk-controlled Grok and X, Amodei leaves little doubt who he’s referring to when he says, “Some AI firms have proven a disturbing negligence in the direction of the sexualization of kids in at present’s fashions, which makes me doubt that they’ll present both the inclination or the power to deal with autonomy dangers in future fashions.”
At one level in the course of the ICE offenses final month, a authorized observer in Portland, Maine, filming an ICE agent, was approached by the agent who had simply filmed her automobile and was now filming her face. Asking why he was doing that, the ICE agent replied, “Cuz we’ve a pleasant little database and now you’re thought-about a home terrorist. So have enjoyable with that.”
The actions of the previous month, and the unprovoked murders of two harmless US residents make Amodei’s closing warning prescient. He says, “Present autocracies are restricted in how repressive they are often by the necessity to have people perform their orders, and people typically have limits in how inhumane they’re prepared to be. However AI-enabled autocracies wouldn’t have such limits.”
Mike Magee MD is a Medical Historian and common contributor to THCB. He’s the writer of CODE BLUE: Inside America’s Medical Industrial Complicated. (Grove/2020)
