intelligence (AI) design, AI capability control proposals, also referred to as AI confinement, aim to increase our ability to monitor and control the behavior...

monitoring, and capability control. Research challenges in alignment include instilling complex values in AI, developing honest AI, scalable oversight...

robots effectively take control of the planet away from the human species, which relies on human intelligence. Stories of AI takeovers remain popular...

monitoring, and capability control. Research challenges in alignment include instilling complex values in AI, developing honest AI, scalable oversight...

progress in AI capability is inevitable because of economic pressures. Such pressures can already be seen in the development of existing AI technologies...

greater chance that our inability to control AI will cause an existential catastrophe. In 2023, hundreds of AI experts and other notable figures signed...

exercise caution in dealing with AI, stating "that's too dangerous. You can't break things when you are talking about AI". In a similar vein, Ellen Huet...

an existential catastrophe, it is necessary to successfully solve the "AI control problem" for the first superintelligence. The solution might involve instilling...

regulated. For general-purpose AI, transparency requirements are imposed, with additional evaluations for high-capability models. There are different risk...

against the hypothetical risk of an AI takeover, and have advocated for the use of AI capability control in addition to AI alignment methods. Other fields...