This is the concept under discussion. Note that there are no success reports yet of eliminating the laptop connected to the headset and getting the 4K 30fps stream.
Alternate approach. I believe that @biviel has his plugin streaming to the VR headset using his cloud-based system at few second (or lower) latency using SRT. However, the stream would go out to his system first. It may be possible to use his plugin with vlc-unity.