The Future of Humanity Institute recently reported the results of a survey conducted at their 2011 Winter Intelligence conference. The survey asked participants, who came from fields like philosophy, computer science and engineering, and AI and robotics, several questions about the future of machine intelligence, and one of the results is somewhat worrying. Participants were asked the following question:
How positive or negative are the ultimate consequences of the creation of a human‐level (and beyond human-level) machine intelligence likely be?
And result?
"Extremely bad" answer is first!