I'm going to talk about a failure of intuition that many of us suffer from.
我想谈论一种我们很多人都经历过的来自于直觉上的失误。
It's really a failure to detect a certain kind of danger.
它让人们无法察觉到一种特定危险的存在。
I'm going to describe a scenario that I think is both terrifying and likely to occur, and that's not a good combination, as it turns out.
我要向大家描述一个情景,一个我觉得既令人害怕,却又很可能发生的情景,这样一个组合的出现,显然不是一个好的征兆。
And yet rather than be scared, most of you will feel that what I'm talking about is kind of cool.
不过,在座的大部分人都会觉得,我要谈论的这件事其实挺酷的。
I'm going to describe how the gains we make in artificial intelligence could ultimately destroy us.
我将描述我们从人工智能中获得的好处,将怎样彻底地毁灭我们。
And in fact, I think it's very difficult to see how they won't destroy us or inspire us to destroy ourselves.
事实上,想看到人工智能最终不摧毁我们是很难的,或者说它必将驱使我们自我毁灭。
And yet if you're anything like me, you'll find that it's fun to think about these things.
如果你和我有共同点,你会发现思考这些问题是相当有趣的。
And that response is part of the problem. OK? That response should worry you.
而这种反应就是问题的一部分。因为这种想法应该使你感到担忧。
And if I were to convince you in this talk that we were likely to suffer a global famine,
假如我想在这个演讲中让你们相信,
either because of climate change or some other catastrophe, and that your grandchildren, or their grandchildren,
我们因为气候变化或者其他灾难,很可能会遭受全球性的饥荒,同时你们的子孙后辈
are very likely to live like this, you wouldn't think, "Interesting. I like this TED Talk."
都可能在这样的饥荒中挣扎求生,你们就不会觉得“真有趣,我喜欢这个TED演讲。”
Famine isn't fun. Death by science fiction, on the other hand, is fun,
因为饥荒一点都不有趣。不过,科幻小说中的死亡往往却引人入胜,
and one of the things that worries me most about the development of AI at this point
所以我现在最担心的一个问题是,人们对人工智能的发展
is that we seem unable to marshal an appropriate emotional response to the dangers that lie ahead.
将带来的危险,似乎还没有形成一个正确的认识。
I am unable to marshal this response, and I'm giving this talk.
我也同样如此,所以我想在这个演讲中和大家一起探讨。