{"id":494595,"date":"2023-06-05T16:20:32","date_gmt":"2023-06-05T14:20:32","guid":{"rendered":"https:\/\/mybroadband.co.za\/news\/?p=494595"},"modified":"2023-06-05T16:22:19","modified_gmt":"2023-06-05T14:22:19","slug":"blind-raspberry-pi-camera-takes-pictures-using-sounds","status":"publish","type":"post","link":"https:\/\/mybroadband.co.za\/news\/gadgets\/494595-blind-raspberry-pi-camera-takes-pictures-using-sounds.html","title":{"rendered":"&#8220;Blind&#8221; Raspberry Pi camera takes pictures using sounds"},"content":{"rendered":"<p>A Mexican artist and computer researcher has created a Raspberry Pi-powered &#8220;blind&#8221; camera that uses artificial intelligence (AI) to convert sounds into images.<\/p>\n<p>Created by Diego Trujillo Pisanty, the device features a horn that is aimed at a sound source in much the same way you would point a camera in the direction of the scene or object you wish to capture.<\/p>\n<p>The heavy lifting is done by a custom-made AI neural network (ANN) that Pisanty trained using his own video recordings around Mexico City.<\/p>\n<p>The ANN can make links between a sound and an image, like how the word &#8220;dog&#8221; can refer to an image of a furry animal and a barking noise, Pisanty explained.<\/p>\n<p>&#8220;Each video frame was associated with its previous second of sound,&#8221; said Pisanty.<\/p>\n<p>&#8220;The network was then trained to encode the sound into a vector, decode it back to the matching image, and try and convince another network that the resulting image is a photograph,&#8221; said Pisanty.<\/p>\n<p>&#8220;[The] Blind Camera thus combines elements of Autoencoders and Generative Adversarial Networks,&#8221; Pisanty stated.<\/p>\n<div id=\"attachment_494615\" style=\"width: 2444px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-05-094520.png\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-494615\" class=\"size-full wp-image-494615\" src=\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-05-094520.png\" alt=\"\" width=\"2434\" height=\"1402\" srcset=\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-05-094520.png 2434w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-05-094520-600x346.png 600w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-05-094520-800x461.png 800w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-05-094520-768x442.png 768w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-05-094520-1536x885.png 1536w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-05-094520-2048x1180.png 2048w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-05-094520-1200x691.png 1200w\" sizes=\"(max-width: 2434px) 100vw, 2434px\" \/><\/a><p id=\"caption-attachment-494615\" class=\"wp-caption-text\">Pisanty records the sound of a subway train in Mexico City<\/p><\/div>\n<div id=\"attachment_494617\" style=\"width: 1671px\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-05-094528.png\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-494617\" class=\"size-full wp-image-494617\" src=\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-05-094528.png\" alt=\"\" width=\"1661\" height=\"942\" srcset=\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-05-094528.png 1661w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-05-094528-600x340.png 600w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-05-094528-800x454.png 800w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-05-094528-768x436.png 768w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-05-094528-1536x871.png 1536w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-05-094528-1200x681.png 1200w\" sizes=\"(max-width: 1661px) 100vw, 1661px\" \/><\/a><p id=\"caption-attachment-494617\" class=\"wp-caption-text\">One of the frames from the video generated by the Blind Camera&#8217;s ANN<\/p><\/div>\n<p>Pisanty said that developing the AI with bespoke training data rather than using an existing model provided flexibility and control to trigger certain image aesthetics based on his artistic intent.<\/p>\n<p>The resulting &#8216;photo&#8217; was indexical of the surrounding soundscape, not the scene in front of the camera.<\/p>\n<p>&#8220;The code is as much an artwork as the object and its resulting images,&#8221; he stated.<\/p>\n<p>&#8220;The process of producing Blind Camera&#8217;s code prompted reflection about how AI written by artists would work and how it could differ from currently available models.&#8221;<\/p>\n<p>Pisanty said because of the ANN&#8217;s limited source data, the results were intentionally biased to interpret the world from a local [Mexico City] perspective.<\/p>\n<p>&#8220;The Blind Camera will therefore produce images matching its Mexican identity,&#8221; Pisanty stated.<\/p>\n<p>He explained because the ANN was only trained in the city, using it in areas like a park filled with trees and grass would still produce a city-like image.<\/p>\n<hr \/>\n<h3 class=\"my-4\">Now read: <a href=\"https:\/\/mybroadband.co.za\/news\/gadgets\/494197-garmin-unveils-new-premium-smartwatches-with-up-to-139-days-battery-life.html\" rel=\"bookmark\">Garmin unveils new premium smartwatches \u2014 with up to 139 days battery life<\/a><\/h3>\n","protected":false},"excerpt":{"rendered":"<p>A Mexican artist and computer researcher has created a Raspberry Pi-powered &#8220;blind&#8221; camera that uses artificial intelligence (AI) to convert sounds into images.<\/p>\n","protected":false},"author":341042,"featured_media":494619,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_sma_x_autopost_status":"idle","_sma_x_autopost_error":"","_sma_x_post_id":"","_sma_facebook_post_id":"","_sma_instagram_post_id":"","_sma_threads_post_id":"","_sma_x_attempts":0,"footnotes":""},"categories":[29],"tags":[35793,86881,8043],"class_list":["post-494595","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-gadgets","tag-artificial-intelligence-ai","tag-diego-trujillo-pisanty","tag-raspberry-pi"],"_links":{"self":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/494595"}],"collection":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/users\/341042"}],"replies":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/comments?post=494595"}],"version-history":[{"count":1,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/494595\/revisions"}],"predecessor-version":[{"id":494747,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/494595\/revisions\/494747"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/media\/494619"}],"wp:attachment":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/media?parent=494595"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/categories?post=494595"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/tags?post=494595"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}