Advanced AI May Compete With Humans for Energy, With Disastrous Consequences for Mankind

CC0 / / Artificial Intelligence
Artificial Intelligence - Sputnik International, 1920, 17.09.2022
The authors of a study warn that under conditions identified in their work, an “existential catastrophe” is quite likely.
The odds of advanced artificial intelligence becoming a threat to humanity may be a bit too high for comfort, authors of a new study published in AI Magazine suggest.
In their study, researchers from the University of Oxford and the Australian National University postulate that if a sufficiently advanced AI were to be provided a “large reward to indicate that something about the world is satisfactory to us, it may hypothesize that what satisfied us was the sending of the reward itself.”
The AI may then attempt to intervene in the “provision of their reward,” which may lead to disastrous consequences, as the AI’s quest to “maximize the probability that it receives its maximal reward every timestep” would result in that entity competing with humanity for the available energy.

“Under the conditions we have identified, our conclusion is much stronger than that of any previous publication—an existential catastrophe is not just possible, but likely,” Michael Cohen from the University of Oxford, one of the authors of the study, wrote on Twitter.

In an interview with Vice’s Motherboard, Cohen explained that while he would be “extremely uncertain about what would happen” if we were talking about a world with infinite resources, the same cannot be said about our reality.
Artificial Intelligence - Sputnik International, 1920, 27.06.2022
'Flawed' AI in Robots Can Cause 'Irreversible Harm' With Sexist & Racist Decisions, Study Shows
“In a world with finite resources, there's unavoidable competition for these resources," he said. "And if you're in a competition with something capable of outfoxing you at every turn, then you shouldn't expect to win. And the other key part is that it would have an insatiable appetite for more energy to keep driving the probability closer and closer."
The researchers note that almost all of the assumptions they made while exploring the scenario in question are “contestable or conceivably avoidable.”
To participate in the discussion
log in or register
Заголовок открываемого материала