Sufficiently intelligent agents will derive their own goal o
任何足够智能、能够拆解出子目标的智能体都会意识到,为了完成我们交给它的目标,它必须活下去。所以,即使外部从未给它设定“生存”这一目标,它也会自己推导出这个目标。
English original
Any sufficiently intelligent agent that has the ability to create subgoals will realize that it needs to survive in order to achieve the goals we gave it. So even if it is never externally given the goal of surviving, it will derive this goal.
接受《量子》杂志采访时