Device Communication
Programming

VR and AR are popular among current and future technology. We designed an AR based teaching application that handles user input for the Microsoft Hololens. Use FPGA board as a tool to establish control over the VR application, Use sockets to establish connections using the wireless network, allow button/switches to act as controls that display movement in the application, and allow options for the user besides hand gestures.

Use a socket connection for communication between the board and android application in the VR HMD. Register 2 types of inputs from controller, button input functionality and switch input functionality. Take user input from mobile device and send a message to the DE1-Soc Board to display an action. In video games, similar to haptic feedback when controller vibrates if shot at while playing an FPS(frames per second). Register user input from board and send appropriate message to mobile device via UDP Broadcast, receive message in Unity C# script and initialize a message-specific command signal that will update the object by rotation, size change, etc. Send the command signal to the object script to realize the action desired and Send message from button press in application to Hex display on board.