This looks like a great project you’re working on. I’ll post some pictures from your blog here to help other people understand your project goals. People may be working on similar projects.
I believe that @Jake_Kenin project uses A-Frame for the navigation and partial display.
You may be able to adapt it to stereoscopic. A-Frame is browser-based and works in mobile phones. I have not verified the streaming. If you get it working, please post back to here.
Current example is with video file.
General A-Frame info.