As AI systems become more capable, they will soon exceed expert skill levels in most domains and carry out as much productive activity as one of todays largest corporations. This calls for special treatment and coordination to ensure that the development of superintelligence occurs in a manner that allows us to both maintain safety and help smooth its integration with society. Three main ideas matter to successfully navigate this development: (1) coordination among leading development efforts, (2) an international authority that can inspect systems, require audits, test for compliance with safety standards, and place restrictions on degrees of deployment and levels of security, and (3) technical capability to make superintelligence safe. Mitigating risks of todays AI technology is crucial, but managing superintelligence risks to ensure a prosperous future is an urgent need that requires collective action and responsible behavior from everyone involved.
