{"id":478191,"date":"2023-01-30T10:24:01","date_gmt":"2023-01-30T08:24:01","guid":{"rendered":"https:\/\/mybroadband.co.za\/news\/?p=478191"},"modified":"2023-01-30T10:27:01","modified_gmt":"2023-01-30T08:27:01","slug":"google-creates-ai-generator-for-music","status":"publish","type":"post","link":"https:\/\/mybroadband.co.za\/news\/software\/478191-google-creates-ai-generator-for-music.html","title":{"rendered":"Google creates AI music generator"},"content":{"rendered":"<p>Google researchers have developed an artificial intelligence (AI) music generator that uses text prompts to create minutes-long musical pieces, the company revealed in a <strong><a href=\"https:\/\/arxiv.org\/abs\/2301.11325\" target=\"_blank\" rel=\"noopener\">research paper<\/a><\/strong>.<\/p>\n<p>Known as MusicLM, Google says the new feature uses a hierarchical sequence-to-sequence model for conditional music generation.<\/p>\n<p>The music is produced at 24kHz, which remains consistent for several minutes. MusicLM can also transform a whistled or hummed melody into other instruments.<\/p>\n<p>Google <strong><a href=\"https:\/\/google-research.github.io\/seanet\/musiclm\/examples\/\" target=\"_blank\" rel=\"noopener\">shared multiple snippets<\/a><\/strong> that were produced using MusicLM. The examples it created include shorter tracks from &#8220;rich captions&#8221; and several &#8220;story mode&#8221; clips.<\/p>\n<p>An example of the &#8220;rich caption&#8221; text prompt Google used to generate the soundtrack for an arcade game is quoted below.<\/p>\n<p>&#8220;The main soundtrack of an arcade game. It is fast-paced and upbeat, with a catchy electric guitar riff,&#8221; the prompt reads.<\/p>\n<p>&#8220;The music is repetitive and easy to remember, but with unexpected sounds, like cymbal crashes or drum rolls.&#8221;<\/p>\n<p>The &#8220;story mode&#8221; clip examples were created using various shorter text prompts, including:<\/p>\n<ul>\n<li>Time to meditate (0:00-0:15), time to wake up (0:15-0:30), time to run (0:30-0:45), time to give 100% (0:45-0:60)<\/li>\n<li>Electronic song played in a videogame (0:00-0:15), meditation song played next to a river (0:15-0:30), fire (0:30-0:45), fireworks (0:45-0:60)<\/li>\n<\/ul>\n<p>Google&#8217;s MusicLM can also generate music clips from paintings \u2014 specifically from descriptions of the artworks \u2014 including Salvador Dali&#8217;s famous &#8220;The Persistence of Memory&#8221;.<\/p>\n<p>MusicLM can even simulate human vocals. However, while it seems to get the tone and overall sound of voices right, they don&#8217;t sound entirely genuine.<\/p>\n<h2 class=\"my-4\">Samples<\/h2>\n<ol>\n<li><strong>Arcade game soundtrack:<\/strong><!--[if lt IE 9]><script>document.createElement('audio');<\/script><![endif]-->\n<audio class=\"wp-audio-shortcode\" id=\"audio-478191-1\" preload=\"none\" style=\"width: 100%;\" controls=\"controls\"><source type=\"audio\/wav\" src=\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/Google-MusicLM-sample-arcade-game-main-theme.wav?_=1\" \/><a href=\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/Google-MusicLM-sample-arcade-game-main-theme.wav\">https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/Google-MusicLM-sample-arcade-game-main-theme.wav<\/a><\/audio><\/li>\n<li><strong>Story mode 1:<\/strong><audio class=\"wp-audio-shortcode\" id=\"audio-478191-2\" preload=\"none\" style=\"width: 100%;\" controls=\"controls\"><source type=\"audio\/wav\" src=\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/Google-MusicLM-sample-story-mode-1.wav?_=2\" \/><a href=\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/Google-MusicLM-sample-story-mode-1.wav\">https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/Google-MusicLM-sample-story-mode-1.wav<\/a><\/audio><\/li>\n<li><strong>Story mode 2:<\/strong><audio class=\"wp-audio-shortcode\" id=\"audio-478191-3\" preload=\"none\" style=\"width: 100%;\" controls=\"controls\"><source type=\"audio\/wav\" src=\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/Google-MusicLM-sample-story-mode-2.wav?_=3\" \/><a href=\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/Google-MusicLM-sample-story-mode-2.wav\">https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/Google-MusicLM-sample-story-mode-2.wav<\/a><\/audio><\/li>\n<li><strong>Dali &#8211; Persistence of Memory:<\/strong><audio class=\"wp-audio-shortcode\" id=\"audio-478191-4\" preload=\"none\" style=\"width: 100%;\" controls=\"controls\"><source type=\"audio\/wav\" src=\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/Google-MusicLM-sample-dali.wav?_=4\" \/><a href=\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/Google-MusicLM-sample-dali.wav\">https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/Google-MusicLM-sample-dali.wav<\/a><\/audio><\/li>\n<\/ol>\n<hr \/>\n<h2 class=\"my-4\">Now read: <a href=\"https:\/\/mybroadband.co.za\/news\/software\/478011-robot-lawyer-pulled-from-first-court-case-over-jail-time-threats.html\" rel=\"bookmark\">&#8220;Robot lawyer&#8221; pulled from first court case over jail time threats<\/a><\/h2>\n","protected":false},"excerpt":{"rendered":"<p>Google&#8217;s MusicLM can generate munites-long musical pieces from text prompts, painting descriptions, and hummed melodies.<\/p>\n","protected":false},"author":341076,"featured_media":478193,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[16],"tags":[11941,167,83963],"class_list":["post-478191","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-software","tag-artificial-intelligence","tag-google","tag-musiclm"],"_links":{"self":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/478191"}],"collection":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/users\/341076"}],"replies":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/comments?post=478191"}],"version-history":[{"count":1,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/478191\/revisions"}],"predecessor-version":[{"id":478229,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/478191\/revisions\/478229"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/media\/478193"}],"wp:attachment":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/media?parent=478191"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/categories?post=478191"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/tags?post=478191"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}