michael-dean-k/

On Monday 6/15, I'm hosting a workshop to kick off a reading group for classic essays: RSVP here.

← all posts

For All of Humanity

· 386 words

When AI leaders (Altman, Amodei) talk about the potentials and dangers, they always bring up curing cancer. Last night I heard Amodei say that curing cancer, Alzheimer’s, schizophrenia, and mental illness would make everything worth it, even 100% job loss. This feels like blatant pathos, an appeal to emotion. I feel like they haven’t been pushed hard on the obvious—what do curing these diseases have to do with public chatbots and agents? Surely, someone isn’t going to use a public chatbot to cure cancer; there would be a specialized internal model with 100x the compute and medical experts. It’s a dishonest use case.

Curing diseases might be a side effect, but they’re obviously more focused on (1) the technical excitement of the problem, and (2) infinite leverage (a datacenter of 24/7 geniuses). There’s no compelling public answer for “why are you doing this?” The average fearful person can’t grasp the answer.

When Amodei was asked, “won’t we all be useless?” his answer was weak (along the lines of, “we’ll have to think about work differently”). How? Here’s my attempt at an explanation: there will be no jobs anymore because any single person will be able to launch and scale a business. Do you have an idea you want to bring into reality? Maybe you’ve had 100s of ideas you’d like to see in the world, but they stay trapped in your head because of the incredible challenge of starting even the most basic idea. What if they could all come to life?

I think the rise of AI will bring Silicon Valley culture as the default mode of work. No more jobs, but everyone becomes a startup. Maybe this sounds exciting to some, but only 1% of startups make it, at least in the current paradigm. I imagine there is a small % of people who want to be in “founder mode,” but maybe AGI will be solid enough that you won’t have to grind and sacrifice your life to spawn a company. You can effectively launch a bad idea from your couch, hope it goes well, forget about it, and earn passive income if it does.

We’re so used to the maxim of “idea are useless, it’s all execution,” but if execution becomes automated, then we’re in for the revenge of the idea guy.