MediVR: VR Medical Training

Project Motivation

iDP Students Aiden Koh, Anthea Foong and Jeremy Ong saw an opportunity to transform medical education by providing medical institutions with cost effective training, a wide variety of training scenarios, and individualised data-driven feedback.

Clinical consultation involves the doctors’ judgement and is based on information provided by the patient. Therefore, a great amount of training is required before a doctor can be competent to make accurate diagnosis. However, clinical consultation hands-on practices are limited and expensive. Peer-to-peer training for clinical consultation is unrealistic and does not develop students in their skills to deal with on-the-job scenarios.

Design Solution

MediVR offers a virtual reality training platform featuring AI patients in scalable clinical scenarios.

A dialog model was built from scratch using Rasa X, RASA Core and Microsoft Azure, and trained to handle the unpredictability of patient-doctor conversations.

The project adopts novel Hands Tracking, unique to Oculus Quest, and it features a refreshing new use case of this feature that has never been done before. With his/her bare hands, users can interact with the virtual patient to execute physical examination.

Lastly, MediVR provide users with objective feedback based on medical gold standards to quickly bridge their learning gaps.

youtube-video-thumbnail

Awards

  • At the 2021 Founder IGNITE pitch organized by Enterprise Singapore, the MediVR was the only student startup to win and were featured on CNA, News 8 and Business Times. They were awarded the $50,000 SGFounder Grant and recognized as one of the next emerging startups by Enterprise Singapore.
  • In 2020, the team won the SGTech-SoC Innovation Prize – Team Prize given each year for student projects which demonstrate a significant degree of innovation and high potential socio-economic impact.

Project Team

Students:

  • Aiden Koh (Mechanical Engineering, Class of 2021)
  • Anthea Foong (Biomedical Engineering, Class of 2021)
  • Jeremy Ong (Biomedical Engineering, Class of 2021)

Medical Advisors:

  • Dr Gabriel Liu
  • Dr Tan Jun Hao

Supervisor: