Our team have a project about route planning based on computer vision and recently switched to RICOH THETA Z1 for extended FOV. Our algorithm was designed for perspective images so we have to convert the equirectangular images to perspective ones in real time. My questions are:
Is it possible to have THETA Z1 live stream dual-fisheye images via USB?
If not, one of my colleague has ever developed an algorithm that converts fisheye images to perspective images, he thinks it is not that difficult to implement an equirectangular-to-perspective conversion as long as he knows the paramters that THETA built-in stitcher uses to perform the fisheye-to-equirectangular stitching. Has anybody in the forum ever done a similar job like this? Or does anybody know those parameters required to perform the conversion?
Sorry for having no time to view all of previous threads, probably I missed something. Thanks in advance!
Unfortunately, there is no way to do this. The THETA S (old model) is the only model that could stream over the USB cable in dual-fisheye
The stitching parameters of the lens are not disclosed. Other people are implementing the equirectangular to perspective without the lens distortion parameters and it appears to be good-enough in some cases.
If it is limited production, you can manually calibrate each camera and save the correction parameters to a settings file of your application.
.
Robotics Intelligence Laboratory using THETA S. However, they are also using the THETA V for some prototypes. You may want to contact the OP and ask what the current status is.
hi! Yes, it does work. It’s using WiFi connection and RTMP protocol for now. My guess would be that they need very low latency and with RTMP that may be an issue. I hope will get an answer here soon.
We need to work outdoors where wifi is not always available. Another reason is that we are working on Linux and our application was designed to read data from v4l2 video devices.
Latency is one of what we are concerned about as we need to process the live streaming images as quickly as possible in real time. We’ve tested the gstreamer pipeline with nvdec, the latency appears to be acceptable when streaming in 2K resolution. Streaming in 4K is intermittently stuck every a few seconds, although our project doesn’t need 4K images indeed.
The THETA S can stream in dual-fisheye. However, that model is no longer in production. You may be able to find it on a site like eBay. The V and Z1 cannot stream in dual-fisheye over a USB cable. However, they can stream in dual-fisheye using a plug-in with a Wi-Fi connection. Search for discussions from @biviel about his plug-in,
Can you advise if your application can work with a live stream from the camera using Wi-Fi as the transmission medium and a protocol such as RTSP with H.264 or similar for the data transmission format.
