This week I looked into the tech stack used by Cornell tech study on remote healthcare through AR/VR devices. While their paper doesn’t reveal exact tools used, the blogs of one of the author does have a diagram giving insights into how they were able to achieve the setup.
I tried dissecting the tech stack to understand what parts can and should we replicate for our own prototype. While the use of depth kit studio stays constant, the MRTK-WebRTC library used to integrate peer-to-peer real-time audio and video communication has been deprecated by Microsoft so an alternate needs to be explored. I am yet to have my hands on the library machine but as far as transmitting the video mesh from depth kit studio to the VR device is concerned that tech stack can also be adapted to an extent since Spout can send real-time video stream between windows applications and NDI aids that transfer through encoding and decoding of video within a LAN. The next problem I searched up on was how to make this truly remote and transfer outside the LAN and came across this implementation of Janus which can also be experimented with. https://janus.conf.meetecho.com/docs/index.html
Apart from that this week I had a paper presentation for my social computing class which took some time. Blockchain course was not very demanding this week but is about to get super demanding as the mid-term report is due soon and the rest of the course requires us to submit paper summaries of 4 papers every week.