{"id":17139,"date":"2024-05-18T19:11:35","date_gmt":"2024-05-18T11:11:35","guid":{"rendered":"https:\/\/cde.nus.edu.sg\/edic\/?page_id=17139"},"modified":"2024-05-18T19:11:35","modified_gmt":"2024-05-18T11:11:35","slug":"genai-cabin-training","status":"publish","type":"page","link":"https:\/\/cde.nus.edu.sg\/edic\/projects\/innovating-with-immersive-reality\/genai-cabin-training\/","title":{"rendered":"Generative AI in mixed reality for cabin crew training"},"content":{"rendered":"\n<h2>\n\t\tGenerative AI in mixed reality for cabin crew training\n\t<\/h2>\n\t<p><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/cde.nus.edu.sg\/edic\/wp-content\/uploads\/sites\/37\/2024\/03\/EG4301-Cabin-training-1024x476.png\" alt=\"\" width=\"1024\" height=\"476\" \/><\/p>\n<p>The current training method for cabin crew in commercial airlines faces inefficiency and scalability challenges due to fixed mock-up capacities and diverse plane models requirements, prompting the need for innovative solutions.<\/p>\n<p>Virtual reality (VR) emerges as a reliable alternative, offering mobility, flexibility, and cost-effectiveness. We leverage the power of a Large Language Model (LLM) to analyse and generate responses as the virtual passenger. This allows us to generate a more unpredictable situation yet able to provide objective feedback to the trainees through tracking of various data. Speech-to-Text (STT) and Text-to-Speech (TTS) algorithms are also utilised to analyse and generate speech that is more closely aligned with a Singaporean setting. This project explores the integration of these technologies to create a convincing training environment with accurate and natural interactions, addressing the pressing demand for scalable and effective cabin crew training solutions.<\/p>\n\t\t\t\t\t<img decoding=\"async\" src=\"https:\/\/i.ytimg.com\/vi\/wA9ZzmVwES0\/maxresdefault.jpg\" alt=\"youtube-video-thumbnail\" \/>\n\t<h3>Project Team<\/h3>\n<h4>Students:<\/h4>\n<ul>\n<li>Chen Qing Hua (Mechanical Engineering, Class of 2024)<\/li>\n<li>Chen Yuhan (Electrical Engineering, Class of 2024)<\/li>\n<li>Raymond Bala (Electrical Engineering, Class of 2024)<\/li>\n<\/ul>\n<h4>Supervisor:<\/h4>\n<ul>\n<li>A\/Prof Khoo Eng Tat (<a href=\"mailto:etkhoo@nus.edu.sg\">etkhoo@nus.edu.sg<\/a>)<\/li>\n<\/ul>\n\n","protected":false},"excerpt":{"rendered":"<p>Generative AI in mixed reality for cabin crew training The current training method for cabin crew in commercial airlines faces inefficiency and scalability challenges due to fixed mock-up capacities and diverse plane models requirements, prompting the need for innovative solutions. Virtual reality (VR) emerges as a reliable alternative, offering mobility, flexibility, and cost-effectiveness. We leverage [&hellip;]<\/p>\n","protected":false},"author":171,"featured_media":0,"parent":2565,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"site-sidebar-layout":"default","site-content-layout":"default","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"disabled","ast-breadcrumbs-content":"","ast-featured-img":"disabled","footer-sml-layout":"","theme-transparent-header-meta":"default","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"set","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""}},"footnotes":""},"class_list":["post-17139","page","type-page","status-publish","hentry"],"acf":[],"_links":{"self":[{"href":"https:\/\/cde.nus.edu.sg\/edic\/wp-json\/wp\/v2\/pages\/17139","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cde.nus.edu.sg\/edic\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/cde.nus.edu.sg\/edic\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/cde.nus.edu.sg\/edic\/wp-json\/wp\/v2\/users\/171"}],"replies":[{"embeddable":true,"href":"https:\/\/cde.nus.edu.sg\/edic\/wp-json\/wp\/v2\/comments?post=17139"}],"version-history":[{"count":2,"href":"https:\/\/cde.nus.edu.sg\/edic\/wp-json\/wp\/v2\/pages\/17139\/revisions"}],"predecessor-version":[{"id":17141,"href":"https:\/\/cde.nus.edu.sg\/edic\/wp-json\/wp\/v2\/pages\/17139\/revisions\/17141"}],"up":[{"embeddable":true,"href":"https:\/\/cde.nus.edu.sg\/edic\/wp-json\/wp\/v2\/pages\/2565"}],"wp:attachment":[{"href":"https:\/\/cde.nus.edu.sg\/edic\/wp-json\/wp\/v2\/media?parent=17139"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}