Discussion about this post

User's avatar
Trading With Time's avatar

For me, the most important point here is that AI is not only a tech question anymore. It is becoming a human question: what kind of society are we building, and who gets to decide the values inside these systems? I don’t think we can leave that only to companies racing each other for dominance. We probably need more moral voices outside the incentives. Do you think AI can be guided from inside the race, or does real pressure have to come from outside?

TannyHead's avatar

In my lifetime, nuclear weapons, genetic engineering, and now AI. Three existential scale technologies. None of which we know how to make safe.

Take a break from focusing on the particular technologies, and ask yourself, where did these threats come from? What is their source? The knowledge explosion. Knowledge development feeds back upon itself, resulting in an accelerating pace of further knowledge development.

Now, as a thought experiment, imagine that AI could be made perfectly safe. What would happen next? In that case, AI would be enthusiastically applied to scientific research, thus accelerating the knowledge explosion further. And the faster the knowledge explosion goes, the more and bigger threats we'll see.

So even if we completely solve the AI problem, it won't be long before we're again freaking out about some other new technology with the potential to bring on game over events.

Focusing on particular threatening technologies one by one by one is a LOSER'S GAME, because an accelerating knowledge explosion is generating such threats faster than we can figure out how to control them.

There is basically no hope for the modern world unless we turn our attention to the source of all these threats. Modern science is built upon a "more is better" relationship with knowledge. That was a good model in the long era when new knowledge was very hard to come by.

We no longer live in that era!

Today we live in a time when knowledge is exploding in every direction at an accelerating pace, and the old "more is better" knowledge philosophy model is now dangerously outdated.

That's what the problem is.

AI is symptom of that problem.

Fixing AI will not solve the real problem.

1 more comment...

No posts

Ready for more?