After beating the pro team OG, which won more than $11 million at Dota 2’s high-profile tournament called The International 2018, OpenAI’s team of Dota 2 bots faces a much more challenging opponent – internet players. OpenAI, a technology non-profit founded by Elon Musk and others, began allowing any Dota 2 player to challenge OpenAI Five – and the first loss came just hours after the test began.
The first team to do so was a professional roster, Alpha Red, from Thailand, who beat the AI team in around 45 minutes, with 34 kills to 24.
“Beating OpenAI Five is a testament to human tenacity and skill. The human teams have been working together to get those wins. The way people win is to take advantage of every single weakness in Five—some coming from the few parts of Five that are scripted rather than learned—gradually build up resources, and most importantly, never engage Five in a fair fight.” OpenAI co-founder Greg Brockman told Motherboard.
The program has practiced an equivalent of 45,000 years of Dota 2 over a period of 10 months. Players working together on Discord servers and Reddit are analyzing weaknesses to figure out how to best exploit the program. One particularly encouraging comment was posted by Swedish Dota 2 player Niklas 'Wagamama' Högström: “The bots are locked."
"They [the bots] are not learning, but we humans are. We will win,” another player said, as transcribed on Reddit.
The OpenAI team says it will continue to work on Dota 2. The company also plans to release “a more technical analysis” of the program once it has reviewed the OpenAI Five Arena matches. “Can top teams learn to beat it consistently? So far, no one’s beaten it twice in a row. Can people find exploits that allow even low-ranked teams to beat it? We don’t know what to expect—no one’s ever run an experiment like this,” Brockman said.