The Raspberry Pi cannot display the H.264 4K stream to the monitor connected to the Pi. you must use either a Jetson Nano or restream from the raspberry pi.
On a Linux computer (not raspberry pi right now) use this modified version of libuvc
You can then use this sample application to get it to the screen (not ona Raspberry Pi)
To get the video stream to a video device such as /dev/video0, you need to use this.
For short distances, you can use the motionjpeg from the THETA V.
example of using mjpeg over wifi with OpenCV, which may be what you want.
Flutter example of displaying the stream with navigation using panorama_viewer.
Hello Again Craig,
Thank you for your kind help.
I was trying gst_loopback on raspi4 and it took 2 days. I can run successfully ./gst_viewer but ./gst_loopback didn’t.
To be clear that, is loopback not working on raspi? (I am also not giving up using USB API with raspi4)
I installed latest Raspberry Pi OS(64-bit) btw.
For latest I got Jetson Nano and test Theta V with my company protocol for webview using internet. it was about 0.36ms over internet.
The lowest latency you can get is around 350ms due to stitching time inside the camera. There is no way to bypass the in-camera pipeline.
I do not believe the Raspberry Pi graphics chipset supports 4K H.264 hardware decoding. You can try cut down the video resolution to 2K as a test.
I believe that someone on this forum did stream to a Raspberry Pi at 2K, but it was slow. You can research if 4K H.264 hardware decoding works with the Raspberry Pi.
If your robot already has a Raspberry Pi on it as the controller and you don’t want to incur the electrical power cost of the NVIDIA Jetson, then restream from the Raspberry Pi without decoding it.
Stream From Raspberry Pi 4 to a Windows PC
Thanks to Shun Yamashita of fulldepth for this solution to stream the Z1 video to a Raspberry Pi 4 with USB then restream it to a Windows PC.
This is the process:
Use GStreamer to stream UDP(RTP) to the Windows PC
Do not use H264 decoding on the Raspberry Pi as the Windows machine is handling it and it’s likely that the RPi4 can’t use hardware decoding for 4K H.264.
Tested with Raspberry Pi4 modelB with 4GB of RAM running Raspberry Pi OS
On the Raspberry Pi, the following was changed in the GStreamer pipeline in gst/gst_viewer.c.
Hello Craig,
I am trying Theta V with Rapi 4. The Theta V will be attached on a crawler robot and I am going to control and view over LAN with no internet environment.
Because of I failed to load Theta V on /dev/video0, I am going to approach this diagram. I have setup Janus on raspi but don’t know how to install RTSP Streaming Plugin and how to use Theta V from raspi yet.
I have tried for 2 weeks and still not success yet. I can run gst-launch-1.0 thetauvcsrc mode=0 do-timestamp=true ! h264parse ! openh264dec ! videoconvert ! autovideosink