{"id":566017,"date":"2024-10-19T13:00:00","date_gmt":"2024-10-19T11:00:00","guid":{"rendered":"https:\/\/mybroadband.co.za\/news\/?p=566017"},"modified":"2024-10-19T13:01:23","modified_gmt":"2024-10-19T11:01:23","slug":"housebot-reality-check","status":"publish","type":"post","link":"https:\/\/mybroadband.co.za\/news\/ai\/566017-housebot-reality-check.html","title":{"rendered":"Housebot reality check"},"content":{"rendered":"\n<p>The walking, talking, dancing Optimus robots at the recent Tesla demonstration generated <a href=\"https:\/\/x.com\/HowThingsWork_\/status\/1844735472418931145\">huge excitement<\/a>.<\/p>\n\n\n\n<p>But this turned to <a href=\"https:\/\/gizmodo.com\/elon-musks-beer-pouring-optimus-robots-are-not-autonomous-2000510899\">disappointment<\/a> as it <a href=\"https:\/\/www.bloomberg.com\/news\/articles\/2024-10-14\/tesla-s-optimus-robots-were-remotely-operated-at-cybercab-event\">became apparent<\/a> that <a href=\"https:\/\/fortune.com\/2024\/10\/13\/elon-musk-tesla-optimus-robot-tele-operated-robotaxi\/\">much of<\/a> what was happening was actually being controlled remotely by humans.<\/p>\n\n\n\n<p>As much as this might still be a fascinating glimpse of the future, it\u2019s not the first time that robots have turned out to be a little too good to be true.<\/p>\n\n\n\n<p>Take Sophia, for instance, the robot created by Texas-based Hanson Robotics back in 2016. She was presented by the company as essentially an intelligent being, prompting <a href=\"https:\/\/www.theverge.com\/2018\/1\/18\/16904742\/sophia-the-robot-ai-real-fake-yann-lecun-criticism\">numerous tech specialists<\/a> to <a href=\"https:\/\/www.youtube.com\/watch?v=CE4pGzmucig\">call this out<\/a> as well beyond our capabilities at the time.<\/p>\n\n\n\n<p>Similarly we\u2019ve seen carefully choreographed videos of pre-scripted action sequences like Boston Dynamics\u2019 <a href=\"https:\/\/www.cnet.com\/tech\/farewell-to-boston-dynamics-atlas-robot-hilarious-bloopers-and-triumphs-reel\/\">Atlas gymnastics<\/a>, the English-made <a href=\"https:\/\/www.youtube.com\/watch?v=o6nej26lAhM\">Ameca robot \u201cwaking up\u201d<\/a>, and most recently Tesla\u2019s Optimus <a href=\"https:\/\/x.com\/Tesla_Optimus\/status\/1846797392521167223\">in the factory<\/a>.<\/p>\n\n\n\n<p>Obviously these are still impressive in different ways, but they\u2019re nowhere near the complete sentient package. Let Optimus or Atlas loose in a random home and you\u2019d see something very different.<\/p>\n\n\n\n<p>A humanoid robot capable of working in our homes needs to be capable of doing many different tasks, using our tools, navigating our environments and communicating with us like a human. If you thought this was just a year or two away, you\u2019re going to be disappointed.<\/p>\n\n\n\n<p>Building robots able to interact and carry out complex tasks in our homes and streets is still a huge challenge. Designing them even to do one specific task well, such as opening a door, is phenomenally difficult.<\/p>\n\n\n\n<p>There are so many door handles with different shapes, weights and materials, not to mention the complexity of dealing with unforeseen circumstances such as a locked door or objects blocking the way. <\/p>\n\n\n\n<p>Developers have actually <a href=\"https:\/\/www.newscientist.com\/article\/2415590-this-robot-can-figure-out-how-to-open-almost-any-door-on-its-own\/\">now created<\/a> a door-opening robot, but robots that can deal with hundreds of everyday tasks are still some way off.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Behind the curtain<\/h2>\n\n\n\n<p>The Tesla demonstration\u2019s \u201cWizard of Oz\u201d remote operation technique is a commonly used control method in this field, giving researchers a benchmark against which to test their real advances.<\/p>\n\n\n\n<p>Known as telemetric control, this has been around for some time, and is becoming more advanced.<\/p>\n\n\n\n<p>One of the authors of this article, Carl Strathearn, was at a conference in Japan earlier this year, where a keynote speaker from one of the top robotics labs demonstrated an advanced telemetrics system.<\/p>\n\n\n\n<p>It allowed a single human to simultaneously operate many humanoid robots semi-autonomously, using pre-scripted movements, conversation prompts and computerised speech.<\/p>\n\n\n\n<p>Clearly, this is very useful technology. Telemetric systems are used to control robots working in <a href=\"https:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC10741399\/\">dangerous environments<\/a>, <a href=\"https:\/\/www.bbc.co.uk\/news\/technology-46466531\">disability healthcare<\/a> and even in <a href=\"https:\/\/www.reuters.com\/science\/humanoid-robots-space-next-frontier-2023-12-27\/\">outer space<\/a>.<\/p>\n\n\n\n<p>But the reason why a human is still at the helm is because even the most advanced humanoid robots, such as Atlas, are not yet reliable enough to operate completely independently in the real world.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Atlas | Partners in Parkour\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/tF4DML7FIWk?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>Another major problem is what we can call social AI.<\/p>\n\n\n\n<p>Leading generative AI programs such as <a href=\"https:\/\/www.technologyreview.com\/2023\/12\/06\/1084471\/google-deepminds-new-gemini-model-looks-amazing-but-could-signal-peak-ai-hype\/\">DeepMind\u2019s Gemini<\/a> and OpenAI\u2019s <a href=\"https:\/\/help.openai.com\/en\/articles\/8555496-gpt-4-vision-api\">GPT-4 Vision<\/a> may be a foundation for creative autonomous AI systems for humanoid robots in the future.<\/p>\n\n\n\n<p>But we should not be misled into believing that such models mean that a robot is now capable of functioning well in the real world.<\/p>\n\n\n\n<p>Interpreting information and problem solving like a human requires much more than just recognising words, classifying objects and generating speech.<\/p>\n\n\n\n<p>It requires a deeper contextual understanding of people, objects and environments \u2014 in other words, common sense.<\/p>\n\n\n\n<p>To explore what is currently possible, we recently completed a <a href=\"https:\/\/cui.acm.org\/workshops\/HRI2023\/pdfs\/HRCI23_paper_5.pdf\">research project<\/a> called Common Sense Enhanced Language and Vision (CiViL).<\/p>\n\n\n\n<p>We equipped a robot called Euclid with commonsense knowledge as part of a generative AI vision and language system to assist people in preparing recipes.<\/p>\n\n\n\n<p>To do this, we had to create commonsense knowledge databases using real-world problem-solving examples enacted by students.<\/p>\n\n\n\n<p>Euclid could explain complicated steps in recipes, give suggestions when things went wrong, and even point people to locations in the kitchen where utensils and tools might typically be found.<\/p>\n\n\n\n<p>Yet there were still issues, such as what to do if someone has a bad allergic reaction while cooking. The problem is that it\u2019s almost impossible to handle every possible scenario, yet that\u2019s what true common sense entails.<\/p>\n\n\n\n<p>This fundamental aspect of AI has got somewhat lost in humanoid robots over the years. Generated speech, realistic facial expressions, telemetric controls, even the ability to play games such as \u201crock paper scissors\u201d are all impressive.<\/p>\n\n\n\n<p>But the novelty soon wears off if the robots are not actually capable of doing anything useful on their own.<\/p>\n\n\n\n<p>This isn\u2019t to say that significant progress <a href=\"https:\/\/humanoid-ai.github.io\/HumanPlus.pdf\">isn\u2019t being made<\/a> toward autonomous humanoid robots.<\/p>\n\n\n\n<p>There\u2019s impressive work going on into <a href=\"https:\/\/www.newscientist.com\/article\/2274084-artificial-nervous-system-senses-light-and-learns-to-catch-like-humans\/\">robotic nervous systems<\/a> to give robots more senses for learning, for instance. It\u2019s just not usually given the same amount of press attention as the big unveiling.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Janken (rock-paper-scissors) Robot with 100% winning rate\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/3nxjjztQKtY?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">The data deficit<\/h2>\n\n\n\n<p>Another key challenge is the lack of real-world data to train AI systems, since online data doesn\u2019t always accurately represent the real-world conditions necessary for training our robots well enough.<\/p>\n\n\n\n<p>We have yet to find an effective way of collecting this real-world data in large enough quantities to get good results. However, this may change soon if we can access it from technologies such as Alexa and <a href=\"https:\/\/www.ray-ban.com\/uk\/ray-ban-meta-smart-glasses\">Meta Ray-Bans<\/a>.<\/p>\n\n\n\n<p>Nonetheless, the reality is that we\u2019re still perhaps decades away from developing multimodal humanoid robots with advanced social AI that are capable of helping around the house.<\/p>\n\n\n\n<p>Maybe in the meantime we\u2019ll be offered robots controlled remotely from a command centre. Will we want them, though?<\/p>\n\n\n\n<p>In the meantime, it\u2019s also more important that we focus our efforts on creating robots for roles that can support people who urgently need help now.<\/p>\n\n\n\n<p>Examples would <a href=\"https:\/\/fsi.stanford.edu\/news\/robots-may-be-right-prescription-struggling-nursing-homes\">include healthcare<\/a>, where there are long waiting lists and understaffed hospitals; <a href=\"https:\/\/schoolsweek.co.uk\/how-robots-are-helping-anxious-pupils-go-back-to-school\/\">and education<\/a>, to offer a way for overanxious or severely ill children to participate in classrooms remotely.<\/p>\n\n\n\n<p>We also need better transparency, legislation and publicly available testing, so that everyone can tell fact from fiction and help build public trust for when the robots eventually do arrive.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p><em><a href=\"https:\/\/theconversation.com\/profiles\/carl-strathearn-1196677\">Carl Strathearn<\/a>, Research Fellow, Computing, <a href=\"https:\/\/theconversation.com\/institutions\/edinburgh-napier-university-696\">Edinburgh Napier University<\/a> and <a href=\"https:\/\/theconversation.com\/profiles\/dimitra-gkatzia-340620\">Dimitra Gkatzia<\/a>, Associate Professor in Computing, <a href=\"https:\/\/theconversation.com\/institutions\/edinburgh-napier-university-696\">Edinburgh Napier University<\/a><\/em><\/p>\n\n\n\n<p><em>This article is republished from <a href=\"https:\/\/theconversation.com\">The Conversation<\/a> under a Creative Commons license. Read the <a href=\"https:\/\/theconversation.com\/robot-developers-keep-making-it-seem-like-housebots-are-imminent-when-theyre-decades-away-241638\">original article<\/a>.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Robot developers keep making it seem like housebots are imminent when they\u2019re decades\u00a0away.<\/p>\n","protected":false},"author":340972,"featured_media":566018,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_sma_x_autopost_status":"idle","_sma_x_autopost_error":"","_sma_x_post_id":"","_sma_facebook_post_id":"","_sma_instagram_post_id":"","_sma_threads_post_id":"","_sma_x_attempts":0,"footnotes":""},"categories":[92837],"tags":[97407,24682,9531,97406,20719,91557],"class_list":["post-566017","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","tag-ameca","tag-atlas-robot","tag-boston-dynamics","tag-hanson-robotics","tag-tesla","tag-tesla-optimus-robot"],"_links":{"self":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/566017"}],"collection":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/users\/340972"}],"replies":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/comments?post=566017"}],"version-history":[{"count":1,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/566017\/revisions"}],"predecessor-version":[{"id":566020,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/566017\/revisions\/566020"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/media\/566018"}],"wp:attachment":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/media?parent=566017"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/categories?post=566017"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/tags?post=566017"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}