School of computing students Koh Wee Lun, Clarence, Pattany Kruathorn and Yang Yuqing collaborated with iDP students Aiden Koh and Anthea Foong in developing a virtual reality orthopaedic clinic assessment solution for National University Health System. The project won SGTech-SoC Innovation Prize 2020 – Team Prize. The innovation prizes (1 individual and 1 team) are given each year for student projects which demonstrate a significant degree of innovation and high potential socio-economic impact. Congratulations to the students!
Watch the project video here
Problem Statement
Clinical consultation involves the doctors’ judgement and is based on information provided by the patient. Therefore, great amount of training is required before a doctor can be competent to make accurate diagnosis. However, clinical consultation hands-on practices are limited and expensive. Peer-to-peer training for clinical consultation is unrealistic and do not develop students in their skills to deal with on-the-job scenarios.
Our Solution
The project adopts novel Hands Tracking, unique to Oculus Quest, and it features a refreshing new use case of this feature that has never been done before. With his/her bare hands, users can interact with the virtual patient to execute physical examination.A dialog model was built from scratch using Rasa X, RASA Core and Microsoft Azure, and trained to handle the unpredictability of patient-doctor conversations.
