AI has started building better AI. It can be one alien mind aligned by a few people, or humanity itself grown smarter, in the open, where mistakes can be seen and fixed; the second is the safest route to aligned superintelligence.

The claim

AI has started building better AI, and superintelligence may be years away, not decades. It can be one alien mind, aligned by a few people to their values or to none, or it can be humanity itself grown smarter: people and AI thinking together, in the open, where mistakes can be seen and fixed. The second is the safest route to a superintelligence aligned with us, and we are building it.