In light of the recent Coronavirus outbreak, students everywhere are in quarantine, spending numerous hours on Zoom video calls for their lectures and discussions. With the huge volume of people now using Zoom, we wanted to create a new feature that may make these video calls a bit more enjoyable.
What It Does
VROOM allows users to join their Zoom meetings in VR, where they'll be able to see other meeting participants on separate screens in a 3D space.
How We Built It
We used OpenCV to grab each person's video and sent data through Windows Sockets to Unreal Engine 4. Then used this data to display the videos on materials in UE4.
Challenges We Ran Into
We ran into different challenges at each step of the development process, including trying to figure out how to grab the individual video frames from Zoom, how to dynamically alter materials in UE4 to project the grabbed videos in VR, and how to allow individual components of the program to communicate with each other and transfer around data. We also were challenged with the lack of time and having to adjust according to unforeseen situations.
Accomplishments That We’re Proud Of
We’re proud of the amount of work we were able to complete within the short time frame of the hackathon and the difficult environment of working together virtually.
What We Learned
We learned more about how APIs and SDKs work, and got lots of experience programming in C++. We touched on using OpenCV, Unreal Engine 4, and Windows Sockets.
What's next for VROOM
There are many more features we would like to see implemented in VROOM in the future, including the ability for a user to also open their desktop in another screen alongside the video gallery of member participants.
c++, opencv, unreal-engine, zoom