intelligence (AI) design, AI capability control proposals, also referred to as AI confinement, aim to increase our ability to monitor and control the behavior...

progress in AI capability is inevitable because of economic pressures. Such pressures can already be seen in the development of existing AI technologies...

robots effectively take control of the planet away from the human species, which relies on human intelligence. Stories of AI takeovers remain popular...

monitoring, and capability control. Research challenges in alignment include instilling complex values in AI, developing honest AI, scalable oversight...

monitoring, and capability control. Research challenges in alignment include instilling complex values in AI, developing honest AI, scalable oversight...

lack. If AI were to surpass humanity in general intelligence and become superintelligent, then it could become difficult or impossible to control. Just as...

exercise caution in dealing with AI, stating "that's too dangerous. You can't break things when you are talking about AI". In a similar vein, Ellen Huet...

an existential catastrophe, it is necessary to successfully solve the "AI control problem" for the first superintelligence. The solution might involve instilling...

former OpenAI researcher Paul Christiano, ARC focuses on recognizing and comprehending the potentially harmful capabilities of present-day AI models. ARC's...

from artificial general intelligence. MIRI's work has focused on a friendly AI approach to system design and on predicting the rate of technology development...