{"id":19187,"date":"2025-10-23T09:17:27","date_gmt":"2025-10-23T01:17:27","guid":{"rendered":"https:\/\/cde.nus.edu.sg\/edic\/?page_id=19187"},"modified":"2025-11-27T09:47:31","modified_gmt":"2025-11-27T01:47:31","slug":"iconic-audio-experiences-2026","status":"publish","type":"page","link":"https:\/\/cde.nus.edu.sg\/edic\/projects\/iconic-audio-experiences-2026\/","title":{"rendered":"Creating Iconic Audio Experiences (2026)"},"content":{"rendered":"\n<h2>\n\t\tCreating Iconic Audio Experiences\n\t<\/h2>\n\t<p>With the advent of spatial audio and 3D audio effects, smart speakers now have the ability to use advanced algorithms and audio processing techniques to place sounds in different parts of a room, creating immersive audio landscapes.<\/p>\n<p>However, currently these abilities still have to be controlled manually using a remote control. Common indoor positioning technologies like WiFi and Bluetooth do not have the ability to localize the listener to below a few meters in precision. Thus, we will explore the use of newer positioning technologies like Ultra-WideBand (UWB), which is capable of 10 cm precision, to localize the listener instead. We will also explore new features and use cases that can be realized with this ability, e.g. music that follows a listener as they move around a room or between rooms, location-based playlists, self-calibrating and adjusting speakers, etc.<\/p>\n<p>In this studio, we will work with Bang &amp; Olufsen (who are renowned for creating iconic audio experiences) to explore these and other technologies (e.g. flexible electronics, electronic fabrics, and innovative designs for headphones, etc.) to design and test new listening experiences.<\/p>\n<p>Examples of problem statements in this studio:<\/p>\n<ul>\n<li><strong>Localising listeners<\/strong>: how can we detect accurately how many people are in the room and where they are positioned?<\/li>\n<li><strong>Directing music dynamically<\/strong>: how can we detect how many speaker products are present and control them to direct music optimally to different listeners?<\/li>\n<li><strong>Innovative materials and mechanical designs for headphones<\/strong>: how can we use flexible electronics, electronic fabrics, and other innovative mechanical designs (e.g. to incorporate better air flow) to design headphones that provide a better experience?<\/li>\n<li><strong>On-device LLM for voice control on remote controls<\/strong>: how might we use <a href=\"https:\/\/gektor650.medium.com\/audio-transcription-with-openai-whisper-on-raspberry-pi-5-3054c5f75b95\">open-source libraries and frameworks<\/a> to implement on-device voice control?<\/li>\n<li><strong>Best use of parametric acoustic arrays<\/strong>: how might we use ultrasound-based <a href=\"https:\/\/youtu.be\/Fbphhg9ArXw\">directional audio<\/a> to create new products and experiences?<\/li>\n<li><strong>Creating visuals from sound<\/strong>: how might we use audio transparent materials to provide <a href=\"https:\/\/youtu.be\/VTEOu1p_0OU\">visual representations of music<\/a> as an extension to the <a href=\"https:\/\/www.bang-olufsen.com\/en\/sg\/speakers\/beosound-shape\">Beosound Shape<\/a>?<\/li>\n<\/ul>\n<h4>Project partner:<\/h4>\n<ul>\n<li>Bang &amp; Olufsen<\/li>\n<\/ul>\n<h4>Project supervisors:<\/h4>\n<ul>\n<li>Dr Yen Shih Cheng (<a href=\"mailto:sc.yen@nus.edu.sg\">sc.yen@nus.edu.sg<\/a>)<\/li>\n<li>Mr Graham Zhu Hongjiao (<a href=\"mailto:graham88@nus.edu.sg\">graham88@nus.edu.sg<\/a>)<\/li>\n<\/ul>\n<h4>Studio timeslot in Semester 2 AY2025\/2026:<\/h4>\n<ul>\n<li>Wednesday 9 am to 12 pm<\/li>\n<\/ul>\n\t\t\t\t<img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/cde.nus.edu.sg\/edic\/wp-content\/uploads\/sites\/37\/2024\/10\/Sonos-spatial-audio.jpg\" alt=\"Illustration of spatial audio from Sonos\" height=\"1003\" width=\"1920\" title=\"Sonos-spatial-audio\" \/>\n\t\tIllustration of spatial audio from Sonos\n\t\t\t\t<img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/cde.nus.edu.sg\/edic\/wp-content\/uploads\/sites\/37\/2025\/11\/Beolab28.png\" alt=\"Beolab 28 speaker set from B&amp;amp;O\" height=\"282\" width=\"297\" title=\"Beolab28\" \/>\n\t\tBeolab 28 speaker set from B&amp;O\n\t\t\t\t<img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/cde.nus.edu.sg\/edic\/wp-content\/uploads\/sites\/37\/2025\/11\/Beosound2.jpg\" alt=\"Beosound 2 Ferrari Edition from B&amp;amp;O\" height=\"282\" width=\"309\" title=\"Beosound2\" \/>\n\t\tBeosound 2 Ferrari Edition from B&amp;O\n\t\t\t\t<img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/cde.nus.edu.sg\/edic\/wp-content\/uploads\/sites\/37\/2025\/11\/Murata-2BP-EVK.jpg\" alt=\"Murata UWB Type2BP EVK\" height=\"136\" width=\"216\" title=\"Murata-2BP-EVK\" \/>\n\t\tMurata UWB Type2BP EVK\n\t\t\t\t<img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/cde.nus.edu.sg\/edic\/wp-content\/uploads\/sites\/37\/2025\/11\/Murata-2DK-EVK.jpg.png\" alt=\"Murata UWB Type2DK EVK\" height=\"190\" width=\"285\" title=\"Murata-2DK-EVK.jpg\" \/>\n\t\tMurata UWB Type2DK EVK\n\t\t\t\t<img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/cde.nus.edu.sg\/edic\/wp-content\/uploads\/sites\/37\/2025\/11\/Beoshape-sound.png\" alt=\"Beosound Shape from B&amp;amp;O\" height=\"1105\" width=\"964\" title=\"Beoshape-sound\" \/>\n\t\tBeosound Shape from B&amp;O\n\t\t\t\t<img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/cde.nus.edu.sg\/edic\/wp-content\/uploads\/sites\/37\/2025\/11\/Visual-representation-music.png\" alt=\"Concept for visual representations of music\" height=\"1105\" width=\"966\" title=\"Visual-representation-music\" \/>\n\t\tConcept for visual representations of music\n<h4>\n\t\tExamples of past projects:\n\t<\/h4>\n\t\t\t\t<a href=\"https:\/\/cde.nus.edu.sg\/edic\/projects\/innovating-for-smarter-living\/beosound-focus\/\" target=\"_blank\" rel=\"noopener\">\n\t\t\t\t<img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/cde.nus.edu.sg\/edic\/wp-content\/uploads\/sites\/37\/2025\/10\/IS-312-beosound-scaled.png\" alt=\"IS-312-beosound\" height=\"1440\" width=\"2560\" title=\"IS-312-beosound\" \/>\n\t\t\t\t<\/a>\n<h4>\n\t\t<a href=\"https:\/\/cde.nus.edu.sg\/edic\/projects\/innovating-for-smarter-living\/beosound-focus\/\" title=\"Beosound focus: directional audio\" target=\"_blank\" rel=\"noopener\">\n\t\tBeosound focus: directional audio\n\t\t<\/a>\n\t<\/h4>\n\t<p>This project aims to provide golfers a hands-free, sweat-free, personalised audio experience with minimal disturbance to others by combining directional audio and ultra-wideband localisation technologies in one commercial product.<\/p>\n\t\t\t\t<a href=\"https:\/\/cde.nus.edu.sg\/edic\/projects\/innovating-for-smarter-living\/dazzler\/\" target=\"_blank\" rel=\"noopener\">\n\t\t\t\t<img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/cde.nus.edu.sg\/edic\/wp-content\/uploads\/sites\/37\/2025\/10\/IS-308-dazzler.png\" alt=\"IS-308-dazzler\" height=\"1080\" width=\"1920\" title=\"IS-308-dazzler\" \/>\n\t\t\t\t<\/a>\n<h4>\n\t\t<a href=\"https:\/\/cde.nus.edu.sg\/edic\/projects\/innovating-for-smarter-living\/dazzler\/\" title=\"Dazzler: revolutionising event lighting\" target=\"_blank\" rel=\"noopener\">\n\t\tDazzler: revolutionising event lighting\n\t\t<\/a>\n\t<\/h4>\n\t<p>Dazzler is a system that analyses live music in real-time using signal analysis to create dynamic, synchronised light shows for performances unlike existing solutions that rely on manual control, pre-programming, or basic sound-active modes.<\/p>\n\t\t\t\t<a href=\"https:\/\/cde.nus.edu.sg\/edic\/projects\/innovating-for-smarter-living\/levitas\/\" target=\"_blank\" rel=\"noopener\">\n\t\t\t\t<img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/cde.nus.edu.sg\/edic\/wp-content\/uploads\/sites\/37\/2025\/11\/IS-311-Levitas-2.png\" alt=\"IS-311-Levitas-2\" height=\"1080\" width=\"1920\" title=\"IS-311-Levitas-2\" \/>\n\t\t\t\t<\/a>\n<h4>\n\t\t<a href=\"https:\/\/cde.nus.edu.sg\/edic\/projects\/innovating-for-smarter-living\/levitas\/\" title=\"Levitas gaming headphones\" target=\"_blank\" rel=\"noopener\">\n\t\tLevitas gaming headphones\n\t\t<\/a>\n\t<\/h4>\n\t<p>Featherweight comfort. Heavyweight gaming performance.<\/p>\n\t\t\t\t<a href=\"https:\/\/cde.nus.edu.sg\/edic\/projects\/innovating-for-smarter-living\/presence-location-intelligence\/\" target=\"_blank\" rel=\"noopener\">\n\t\t\t\t<img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/cde.nus.edu.sg\/edic\/wp-content\/uploads\/sites\/37\/2025\/10\/IS-313-presence-scaled.png\" alt=\"IS-313-presence\" height=\"1440\" width=\"2560\" title=\"IS-313-presence\" \/>\n\t\t\t\t<\/a>\n<h4>\n\t\t<a href=\"https:\/\/cde.nus.edu.sg\/edic\/projects\/innovating-for-smarter-living\/presence-location-intelligence\/\" title=\"Presence: location intelligence\" target=\"_blank\" rel=\"noopener\">\n\t\tPresence: location intelligence\n\t\t<\/a>\n\t<\/h4>\n\t<p>In this project, we designed a distributed system that provides live location data of users indoors, with enhanced reliability and accuracy, enabling smart audio automations and other adaptive experiences.<\/p>\n\n","protected":false},"excerpt":{"rendered":"<p>Creating Iconic Audio Experiences With the advent of spatial audio and 3D audio effects, smart speakers now have the ability to use advanced algorithms and audio processing techniques to place sounds in different parts of a room, creating immersive audio landscapes. However, currently these abilities still have to be controlled manually using a remote control. [&hellip;]<\/p>\n","protected":false},"author":171,"featured_media":0,"parent":4674,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"site-sidebar-layout":"default","site-content-layout":"default","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"disabled","ast-breadcrumbs-content":"","ast-featured-img":"disabled","footer-sml-layout":"","theme-transparent-header-meta":"default","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"set","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""}},"footnotes":""},"class_list":["post-19187","page","type-page","status-publish","hentry"],"acf":[],"_links":{"self":[{"href":"https:\/\/cde.nus.edu.sg\/edic\/wp-json\/wp\/v2\/pages\/19187","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cde.nus.edu.sg\/edic\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/cde.nus.edu.sg\/edic\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/cde.nus.edu.sg\/edic\/wp-json\/wp\/v2\/users\/171"}],"replies":[{"embeddable":true,"href":"https:\/\/cde.nus.edu.sg\/edic\/wp-json\/wp\/v2\/comments?post=19187"}],"version-history":[{"count":4,"href":"https:\/\/cde.nus.edu.sg\/edic\/wp-json\/wp\/v2\/pages\/19187\/revisions"}],"predecessor-version":[{"id":19560,"href":"https:\/\/cde.nus.edu.sg\/edic\/wp-json\/wp\/v2\/pages\/19187\/revisions\/19560"}],"up":[{"embeddable":true,"href":"https:\/\/cde.nus.edu.sg\/edic\/wp-json\/wp\/v2\/pages\/4674"}],"wp:attachment":[{"href":"https:\/\/cde.nus.edu.sg\/edic\/wp-json\/wp\/v2\/media?parent=19187"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}