{"id":210618,"date":"2017-05-14T15:00:13","date_gmt":"2017-05-14T13:00:13","guid":{"rendered":"http:\/\/mybroadband.co.za\/news\/?p=210618"},"modified":"2017-05-14T12:27:21","modified_gmt":"2017-05-14T10:27:21","slug":"when-humans-play-games-against-computers","status":"publish","type":"post","link":"https:\/\/mybroadband.co.za\/news\/software\/210618-when-humans-play-games-against-computers.html","title":{"rendered":"When humans play games against computers"},"content":{"rendered":"<p>Way back in the 1980s, a school teacher challenged me to write a computer program that played tic-tac-toe. I failed miserably.<\/p>\n<p>But just a couple of weeks ago, I explained to one of my computer science graduate students how to solve tic-tac-toe using the so-called \u201c<a href=\"https:\/\/en.wikipedia.org\/wiki\/Minimax\">Minimax algorithm<\/a>,\u201d and it took us about an hour to write a program to do it.<\/p>\n<p>Certainly my coding skills have improved over the years, but computer science has come a long way too.<\/p>\n<p>What seemed impossible just a couple of decades ago is startlingly easy today. In 1997, people were stunned when a chess-playing IBM computer named <a href=\"http:\/\/www.nytimes.com\/1997\/05\/12\/nyregion\/swift-and-slashing-computer-topples-kasparov.html\">Deep Blue beat international grandmaster Garry Kasparov<\/a> in a six-game match.<\/p>\n<p>In 2015, Google revealed that its DeepMind system had mastered several <a href=\"http:\/\/www.techrepublic.com\/article\/google-ai-beats-humans-at-more-classic-arcade-games-than-ever-before\/\">1980s-era video games<\/a>, including teaching itself a crucial winning strategy in \u201c<a href=\"https:\/\/www.youtube.com\/watch?v=V1eYniJ0Rnk\">Breakout<\/a>.\u201d In 2016, Google\u2019s AlphaGo system beat a top-ranked Go player in a <a href=\"https:\/\/www.theatlantic.com\/technology\/archive\/2016\/03\/the-invisible-opponent\/475611\/\">five-game tournament<\/a>.<\/p>\n<p><iframe loading=\"lazy\" src=\"https:\/\/www.youtube.com\/embed\/V1eYniJ0Rnk\" width=\"640\" height=\"360\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p>The quest for technological systems that can beat humans at games continues. In late May, AlphaGo will take on <a href=\"https:\/\/arstechnica.com\/information-technology\/2017\/04\/deepmind-alphago-go-ke-jie-china\/\">Ke Jie<\/a>, the best player in the world, among other opponents at the Future of Go Summit in Wuzhen, China.<\/p>\n<p>With increasing computing power, and improved engineering, computers can beat humans even at games we thought relied on human intuition, wit, deception or bluffing \u2013 like <a href=\"http:\/\/www.csd.cs.cmu.edu\/news\/carnegie-mellon-ai-takes-chinese-poker-players\">poker<\/a>.<\/p>\n<p>I recently saw a video in which volleyball players practice their serves and spikes against <a href=\"https:\/\/www.youtube.com\/watch?v=EHKv6lRRV10\">robot-controlled<\/a> rubber arms trying to block the shots. One lesson is clear: When machines play to win, human effort is futile.<\/p>\n<p><iframe loading=\"lazy\" src=\"https:\/\/www.youtube.com\/embed\/EHKv6lRRV10\" width=\"640\" height=\"360\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p>This can be great: We want a perfect AI to drive our cars, and a tireless system looking for signs of cancer in X-rays. But when it comes to play, we don\u2019t want to lose. Fortunately, AI can make games more fun, and perhaps even endlessly enjoyable.<\/p>\n<h3 class=\"my-4\">Designing games that never get old<\/h3>\n<p>Today\u2019s game designers \u2013 who write releases that <a href=\"http:\/\/www.businessinsider.com\/here-are-the-top-10-highest-grossing-video-games-of-all-time-2012-6\">earn more than a blockbuster movie<\/a> \u2013 see a problem: Creating an unbeatable artificial intelligence system is pointless. Nobody wants to play a game they have no chance of winning.<\/p>\n<p>But people do want to play <a href=\"https:\/\/theconversation.com\/the-future-is-in-interactive-storytelling-76772\">games that are immersive, complex and surprising<\/a>. Even today\u2019s best games become stale after a person plays for a while. The ideal game will engage players by adapting and reacting in ways that keep the game interesting, maybe forever.<\/p>\n<p>So when we\u2019re designing artificial intelligence systems, we should look not to the triumphant Deep Blues and AlphaGos of the world, but rather to the overwhelming success of massively multiplayer online games like \u201c<a href=\"https:\/\/worldofwarcraft.com\/en-us\/\">World of Warcraft<\/a>.\u201d<\/p>\n<p>These sorts of games are graphically well-designed, but their key attraction is interaction.<\/p>\n<p>It seems as if most people are not drawn to extremely difficult logical puzzles like chess and Go, but rather to meaningful connections and communities.<\/p>\n<p>The real challenge with these massively multi-player online games is not whether they can be beaten by intelligence (human or artificial), but rather how to keep the experience of playing them fresh and new every time.<\/p>\n<h3 class=\"my-4\">Change by design<\/h3>\n<p>At present, game environments allow people lots of possible interactions with other players. The roles in a dungeon <a href=\"https:\/\/en.wikipedia.org\/wiki\/Raid_(gaming)\">raiding party<\/a> are well-defined: Fighters take the damage, healers help them recover from their injuries and the fragile wizards cast spells from afar.<\/p>\n<p>Or think of \u201c<a href=\"https:\/\/en.wikipedia.org\/wiki\/Portal_2\">Portal 2<\/a>,\u201d a game focused entirely on collaborating robots puzzling their way through a maze of cognitive tests.<\/p>\n<p>Exploring these worlds together allows you to form common memories with your friends. But any changes to these environments or the underlying plots have to be made by human designers and developers.<\/p>\n<p>In the real world, changes happen naturally, without supervision, design or manual intervention.<\/p>\n<p>Players learn, and living things adapt. Some organisms even <a href=\"http:\/\/dx.doi.org\/10.1086\/691101\">co-evolve<\/a>, reacting to each other\u2019s developments. (A similar phenomenon happens in a <a href=\"http:\/\/www.amnh.org\/exhibitions\/einstein\/peace-and-war\/nuclear-arms-race\/\">weapons technology arms race<\/a>.)<\/p>\n<p>Computer games today lack that level of sophistication. And for that reason, I don\u2019t believe developing an artificial intelligence that can play modern games will meaningfully advance AI research.<\/p>\n<h3 class=\"my-4\">We crave evolution<\/h3>\n<p>A game worth playing is a game that is unpredictable because it adapts, a game that is ever novel because novelty is created by playing the game. Future games need to evolve. Their characters shouldn\u2019t just react; they need to explore and learn to exploit weaknesses or cooperate and collaborate.<\/p>\n<p><a href=\"http:\/\/www.livescience.com\/474-controversy-evolution-works.html\">Darwinian evolution and learning<\/a>, we understand, are the drivers of all novelty on Earth. It could be what <a href=\"https:\/\/theconversation.com\/evolving-our-way-to-artificial-intelligence-54100\">drives change in virtual environments<\/a> as well.<\/p>\n<p>Evolution figured out how to create <a href=\"https:\/\/theconversation.com\/understanding-the-four-types-of-ai-from-reactive-robots-to-self-aware-beings-67616\">natural intelligence<\/a>. Shouldn\u2019t we, instead of trying to code our way to AI, just evolve AI instead?<\/p>\n<p>Several labs \u2013 <a href=\"http:\/\/hintzelab.msu.edu\/\">including my own<\/a> and that of <a href=\"http:\/\/adamilab.msu.edu\/\">my colleague Christoph Adami<\/a> \u2013 are working on what is called \u201c<a href=\"https:\/\/en.wikipedia.org\/wiki\/Neuroevolution\">neuro-evolution<\/a>.\u201d<\/p>\n<p>In a computer, we simulate complex environments, like a road network or a biological ecosystem. We create virtual creatures and challenge them to evolve over hundreds of thousands of simulated generations.<\/p>\n<p>Evolution itself then develops the best drivers, or the best organisms at adapting to the conditions \u2013 those are the ones that survive.<\/p>\n<p><iframe loading=\"lazy\" src=\"https:\/\/www.youtube.com\/embed\/5lJuEW-5vr8\" width=\"640\" height=\"360\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p>Today\u2019s AlphaGo is beginning this process, learning by continuously <a href=\"https:\/\/www.theguardian.com\/technology\/2016\/jun\/27\/alphago-deepmind-ai-code-google\">playing games against itself<\/a>, and by analyzing records of games played by top Go champions. But it does not learn while playing in the same way we do, experiencing unsupervised experimentation.<\/p>\n<p>And it doesn\u2019t adapt to a particular opponent: For these computer players, the best move is the best move, regardless of an opponent\u2019s style.<\/p>\n<p>Programs that learn from experience are the next step in AI. They would make computer games much more interesting, and enable robots to not only function better in the real world, but to adapt to it on the fly.<\/p>\n<p><a href=\"https:\/\/theconversation.com\/profiles\/arend-hintze-225106\">Arend Hintze<\/a>, Assistant Professor of Integrative Biology &amp; Computer Science and Engineering, <em><a href=\"http:\/\/theconversation.com\/institutions\/michigan-state-university-1349\">Michigan State University<\/a><\/em><\/p>\n<p>This article was originally published on <a href=\"http:\/\/theconversation.com\">The Conversation<\/a>. Read the <a href=\"https:\/\/theconversation.com\/computers-to-humans-shall-we-play-a-game-77383\">original article<\/a>.<\/p>\n<h3 class=\"my-4\">Now read:\u00a0<a href=\"https:\/\/mybroadband.co.za\/news\/software\/210438-apple-itunes-coming-to-the-windows-store.html\" rel=\"bookmark\">Apple iTunes coming to the Windows Store<\/a><\/h3>\n","protected":false},"excerpt":{"rendered":"<p>The quest for technological systems that can beat humans at games continues.<\/p>\n","protected":false},"author":340972,"featured_media":192560,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[16],"tags":[27887,35],"class_list":["post-210618","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-software","tag-ai","tag-headline"],"_links":{"self":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/210618"}],"collection":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/users\/340972"}],"replies":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/comments?post=210618"}],"version-history":[{"count":1,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/210618\/revisions"}],"predecessor-version":[{"id":210620,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/210618\/revisions\/210620"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/media\/192560"}],"wp:attachment":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/media?parent=210618"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/categories?post=210618"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/tags?post=210618"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}