OpenAI首席科学家:AI对齐问题尚未解决
“Currently I believe that no lab has solved alignment and monitoring to a sufficient degree to conti...
OpenAI首席科学家公开承认AI对齐问题未解决,呼吁行业放缓发展速度,与Gary Marcus观点一致。
OpenAI首席科学家Jakub Pachocki表示,目前没有实验室已充分解决AI对齐和监控问题。他呼吁AI研究机构自愿放缓发展速度,直到建立共同的安全标准。Pachocki强调国际协调应对AI发展应成为各国政府首要任务。
“Currently I believe that no lab has solved alignment and monitoring to a sufficient degree to conti...
“Currently I believe that no lab has solved alignment and monitoring to a sufficient degree to continue responsibly scaling at maximum speed for much longer. I expect and hope for voluntary slowdowns to become commonplace until shared safety bars are established. And I believe that international coordination on future AI development needs to become a top priority for governments around the world” is pretty much everything I have been saying for the last few years. maybe now that @merettm from OpenAI is saying the same people will believe it? Andrew Curran @AndrewCurran_ Jakub Pachocki, Chief Scientist OpenAI: 'Currently I believe that no lab has solved alignment and monitoring to a sufficient degree to continue responsibly scaling at maximum speed for much longer. I expect and hope for voluntary slowdowns to become commonplace until shared safety bars are established. And I believe that international coordination on future AI development needs to become a top priority for governments around the world.' 'Machine intelligence playing a larger and larger role in its own development process is a natural conclusion of sustained technological progress. If AI progress continues, machine recursive self-improvement (RSI) will be at the very core of future scientific discovery. Automated AI research is a more dramatic form of scaling intelligence with compute; and of course as a part of it, AI will improve the computational substrate itself. And similarly to scaling, we focus OpenAI research towards RSI as we believe it is the only way to remain at the frontier of AI research moving forward. I want to stress that the above words don’t imply I think greatly accelerating deep learning research, especially in the short term, is the right collective action we should take as the research community. However, I do think this is where the current path leads, and we all need to make a conscious choice on how to proceed.' 🔗 View Quoted Tweet 💬 7 🔄 2 ❤️ 16 👀 5130 📊 7 ⚡