There's so much bonkers stuff in this Kevin Roose interview, starting with his acknowledgement that betting on AI only makes sense if you assume it will take over the whole economy, and oh yeah, his new media company is just six people and a dozen Claude agents in a Slack channel. https://www.newyorker.com/culture/the-new-yorker-interview/the-case-for-ai-optimism
"A good, moral, ethical person could still build an A.I. model that goes rogue and kills millions of people."
Okay. Hypothetically? Sure.
"On the other side of the coin, someone who is totally craven and corrupt could manage to produce an incredibly ethical A.I. model with all of the proper guardrails."
No, buddy, that's not how any of this works. "So bad at evil you end up being ethical" is a cartoon plot, not real life.
"This is a recurring motif in the modern A.I. industry: people who are scared of A.I., and who don't believe their bosses or rivals are taking enough steps to contain it, break off and start their own companies."
Cool story, but his example is Musk(!) and Altman starting OpenAI because they don't believe Google is a good steward, and then people leaving OpenAI because they don't believe Altman is a good steward. So either it's bad stewards all the way down, or stewardship isn't actually why they're spinning off billion-dollar startups.
It's wild to me how unphased Roose seems by the obvious contradictions in the stories he tells about the AI industry. Anthropic is this idealistic bunch of "AI safety nerds" with no plan to make money, but somehow also on a "rocket-ship trajectory" that makes them into a trillion dollar company with AI that hacks other companies. Does that make sense to you, bro? Have you tried connecting those dots? Or have you maybe been a little too satisfied with the way the company presented itself to you?