{"id":917,"date":"2022-06-13T18:04:02","date_gmt":"2022-06-13T10:04:02","guid":{"rendered":"https:\/\/ecology.shanghai-visual.org\/web\/?p=917"},"modified":"2023-01-29T00:00:03","modified_gmt":"2023-01-28T16:00:03","slug":"audio-visual-interaction-for-urban-ecology-using-bio-inspired-media","status":"publish","type":"post","link":"https:\/\/ecology.shanghai-visual.org\/web\/audio-visual-interaction-for-urban-ecology-using-bio-inspired-media\/","title":{"rendered":"Nature Deism, QUAN Zerui"},"content":{"rendered":"\n<h4 class=\"wp-block-heading\">Hearing Nature, Audio-visual Interaction for Urban Ecology Using Bio-inspired Media<\/h4>\n\n\n\n\n\n\n\n<p><\/p>\n\n\n\n<p>Nature is like improvised music, it is a combination of mechanism and organicism, an opposition between order and chaos, and the title &#8216;Deism&#8217; symbolises the rational spirit of human understanding of nature. By linking the two through mathematics, using algorithms and machine learning techniques, and using a mobile phone app as a vehicle, nature becomes listenable and more people are engaged, a new connection between humans and nature is created.<\/p>\n\n\n\n<p>After research, I have designed an algorithm that can transform nature into music. Through it, we can hear flowers, grass, trees and many other plants around us. Here is the exact logical framework. I first collected a part of the data of the plant, including images and Fibonacci data, the former can be provided to the ai for recognition learning, the latter will enter two sets of algorithms I wrote to make the series into melody and harmony respectively, I call it mechanical music 1.0, which will enter the recurrent neural network magenta to generate music 2.0. The algorithm gives the music the mechanical, while machine learning brings chaos and organicity to the music.<\/p>\n\n\n\n<p>I set up different plants as four vocal parts of the orchestra &#8211; plant soprano, plant baritone, plant bass player and plant chorus &#8211; and created characterisations for them, which can be chosen freely by the user.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img fetchpriority=\"high\" decoding=\"async\" width=\"1024\" height=\"683\" src=\"https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/Featuredimage1-1024x683.jpg\" alt=\"\" class=\"wp-image-2134\" srcset=\"https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/Featuredimage1-1024x683.jpg 1024w, https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/Featuredimage1-300x200.jpg 300w, https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/Featuredimage1-768x512.jpg 768w, https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/Featuredimage1-930x620.jpg 930w, https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/Featuredimage1.jpg 1500w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-gallery has-nested-images columns-1 is-cropped wp-block-gallery-1 is-layout-flex wp-block-gallery-is-layout-flex\">\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" width=\"1024\" height=\"512\" data-id=\"2136\" src=\"https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT1-1-1024x512.jpg\" alt=\"\" class=\"wp-image-2136\" srcset=\"https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT1-1-1024x512.jpg 1024w, https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT1-1-300x150.jpg 300w, https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT1-1-768x384.jpg 768w, https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT1-1-1536x768.jpg 1536w, https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT1-1-2048x1024.jpg 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" width=\"1024\" height=\"512\" data-id=\"2135\" src=\"https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT2-1-1024x512.jpg\" alt=\"\" class=\"wp-image-2135\" srcset=\"https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT2-1-1024x512.jpg 1024w, https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT2-1-300x150.jpg 300w, https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT2-1-768x384.jpg 768w, https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT2-1-1536x768.jpg 1536w, https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT2-1-2048x1024.jpg 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"512\" data-id=\"2137\" src=\"https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT3-1-1024x512.jpg\" alt=\"\" class=\"wp-image-2137\" srcset=\"https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT3-1-1024x512.jpg 1024w, https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT3-1-300x150.jpg 300w, https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT3-1-768x384.jpg 768w, https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT3-1-1536x768.jpg 1536w, https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT3-1-2048x1024.jpg 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"512\" data-id=\"2138\" src=\"https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT4-1-1024x512.jpg\" alt=\"\" class=\"wp-image-2138\" srcset=\"https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT4-1-1024x512.jpg 1024w, https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT4-1-300x150.jpg 300w, https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT4-1-768x384.jpg 768w, https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT4-1-1536x768.jpg 1536w, https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/DefensePPT4-1-2048x1024.jpg 2048w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/figure>\n\n\n\n<p><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Paper<\/h2>\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n\n\n\n<div class=\"wp-block-media-text is-stacked-on-mobile is-vertically-aligned-top\" style=\"grid-template-columns:28% auto\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"1000\" height=\"1000\" src=\"https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/QUANzeruiPicture.jpg\" alt=\"\" class=\"wp-image-2139 size-full\" srcset=\"https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/QUANzeruiPicture.jpg 1000w, https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/QUANzeruiPicture-300x300.jpg 300w, https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/QUANzeruiPicture-150x150.jpg 150w, https:\/\/ecology.shanghai-visual.org\/web\/wp-content\/uploads\/2023\/01\/QUANzeruiPicture-768x768.jpg 768w\" sizes=\"(max-width: 1000px) 100vw, 1000px\" \/><\/figure><div class=\"wp-block-media-text__content\">\n<p>a graduation project by<\/p>\n\n\n\n<p class=\"has-x-large-font-size\"><strong>\u5168\u6cfd\u745e Cling QUAN<\/strong><\/p>\n\n\n\n<p>An independent musician and designer.<br><br><a href=\"https:\/\/www.instagram.com\/clingstudio.zip\/\">https:\/\/www.instagram.com\/clingstudio.zip\/<\/a><br><br>clingquan@qq.com<\/p>\n<\/div><\/div>\n","protected":false},"excerpt":{"rendered":"<p>Hearing Nature, Audio-visual Interaction for Urban Ecology Using Bio-inspired Media Nature is like improvised music, it is a combination of mechanism and organicism, an opposition between order and chaos, and the title &#8216;Deism&#8217; symbolises the rational spirit of human understanding of nature. By linking the two through mathematics, using algorithms and machine learning techniques, and&hellip;&nbsp;<a href=\"https:\/\/ecology.shanghai-visual.org\/web\/audio-visual-interaction-for-urban-ecology-using-bio-inspired-media\/\" class=\"\" rel=\"bookmark\">Read More &raquo;<span class=\"screen-reader-text\">Nature Deism, QUAN Zerui<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":2142,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"neve_meta_sidebar":"","neve_meta_container":"","neve_meta_enable_content_width":"","neve_meta_content_width":0,"neve_meta_title_alignment":"","neve_meta_author_avatar":"","neve_post_elements_order":"","neve_meta_disable_header":"","neve_meta_disable_footer":"","neve_meta_disable_title":"","footnotes":""},"categories":[89,92],"tags":[50,52,54,53],"class_list":["post-917","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ba-graduation-projects","category-thesis","tag-algorithms","tag-audio-visual-interaction-design","tag-generative-music","tag-mathematics"],"_links":{"self":[{"href":"https:\/\/ecology.shanghai-visual.org\/web\/wp-json\/wp\/v2\/posts\/917","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ecology.shanghai-visual.org\/web\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ecology.shanghai-visual.org\/web\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ecology.shanghai-visual.org\/web\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ecology.shanghai-visual.org\/web\/wp-json\/wp\/v2\/comments?post=917"}],"version-history":[{"count":4,"href":"https:\/\/ecology.shanghai-visual.org\/web\/wp-json\/wp\/v2\/posts\/917\/revisions"}],"predecessor-version":[{"id":2330,"href":"https:\/\/ecology.shanghai-visual.org\/web\/wp-json\/wp\/v2\/posts\/917\/revisions\/2330"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ecology.shanghai-visual.org\/web\/wp-json\/wp\/v2\/media\/2142"}],"wp:attachment":[{"href":"https:\/\/ecology.shanghai-visual.org\/web\/wp-json\/wp\/v2\/media?parent=917"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ecology.shanghai-visual.org\/web\/wp-json\/wp\/v2\/categories?post=917"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ecology.shanghai-visual.org\/web\/wp-json\/wp\/v2\/tags?post=917"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}