SOLVED: Gst_viewer shown Can't open THETA on raspberry pi 4

codin-son · September 26, 2024, 4:24pm

hello, i have been trying to view the video stream using gst_viewer from libuvc_theta_sample on raspberry pi 4. im using ricoh theta z1 and i got result Can’t open THETA.
this is information for lsusb:

this is information for uvc

the camera not found from v4l and video device…

information about v4l2-ctl

craig · September 26, 2024, 4:35pm

There is no known success displaying the output to a Raspberry Pi 4 due to lack of hardware acceleration of the video. You can retransmit from a Raspberry Pi 4 to another computer that is cable to displaying the video.

If you’re doing development, suggest you get your application working on a standard Linux x86 workstation with an NVIDIA discrete GPU first, then try to move the working solution to another board for deploy to something like a robot.

Due to the limitations of the GPU on the Raspberry Pi 4, it will be difficult to use things like OpenCV on the 4K video stream. You may want to consider something like the Nvidia Jetson.

Please advise if you need to display the video feed to the monitor connected to the Raspberry Pi or if you are running it on the Raspberry Pi for development testing only and your single-board computer (SBC) will retransmit to a something like a laptop using WiFi.

craig · September 26, 2024, 4:39pm

If you are using libuvc-theta-sample, did you modify the v4l2sink to /dev/video0

github.com

ricohapi/libuvc-theta-sample/blob/f8c3caa32bf996b29c741827bd552be605e3e2e2/gst/gst_viewer.c#L190


      
          
          	cmd_name = rindex(argv[0], '/');
          	if (cmd_name == NULL)
          		cmd_name = argv[0];
          	else
          		cmd_name++;
          
          	if (strcmp(cmd_name, "gst_loopback") == 0)
          		pipe_proc = "decodebin ! autovideoconvert ! "
          			"video/x-raw,format=I420 ! identity drop-allocation=true !"
          			"v4l2sink device=/dev/video1 sync=false";
          	else
          		pipe_proc = " decodebin ! autovideosink sync=false";
          
          	if (!gst_src_init(&argc, &argv, pipe_proc))
          		return -1;
          
          	res = uvc_init(&ctx, NULL);
          	if (res != UVC_SUCCESS) {
          		uvc_perror(res, "uvc_init");
          		return res;

codin-son · September 27, 2024, 1:25am

hye mr craig! thanks for your reply. actually im trying to stream the theta by plugin the camera to the pi 4 using usb cable and stream it to my windows pc via wifi. i already follow your suggestion by set the pipeline like this

src.pipeline = gst_parse_launch(
        " appsrc name=ap ! queue ! h264parse ! queue"
        " ! rtph264pay ! udpsink host=192.168.0.15 port=9000",
        NULL);

but im still got error cant open theta.

codin-son · September 27, 2024, 1:26am

no im not mr craig. previously, im just trying to run the default code first before i follow your suggestion

craig · September 27, 2024, 2:46am

Please confirm

You are using this:

GitHub - ricohapi/libuvc-theta: a cross-platform library for USB video devices

Please also confirm that you do not have another version of libuvc on your system.

I’m on arch linux now and can’t test it at this at the moment, but maybe the command to check is something like this?

apt list --installed |grep libuvc

codin-son · September 27, 2024, 2:55am

yes mr craig it seem like i have another libuvc installed here

craig · September 27, 2024, 2:57am

uninstall the duplicate libuvc and reboot the computer. make clean your app and rebuild it.

codin-son · September 27, 2024, 3:02am

alright mr craig. ill let you know the update later. thank you so much. your work very inspired me. before this i already succeed streaming the 360 live stream into my vr app. now i need to integrate with our robot to make it can have a view of third person view

codin-son · September 27, 2024, 3:08am

thank you so much mr craig for your time and help. your guidance very helpful. let me know if you come to malaysia some day. im very gladful to show you our robotic platform

craig · September 27, 2024, 4:28pm

Great news. Thank you for reporting your success.

I would like to go to Malaysia to see your robotics platform, but don’t know if I’ll make it down there any time soon.

If you and your company are okay with sharing the gstreamer pipeline you end it using, please post it here.

@Hiep_Tran_Tien1 was trying to use the RTSP plug-in on a Z1 to feed the 360 video stream into NVIDIA DeepStream SDK on another computer. Maybe he can use the inexpensive Raspberry Pi 4 to retransmit the video stream with RTSP. I don’t know if the input can be RTP on his application.

Even if you can’t share the gstreamer pipeline, can you comment on your use case. For example, are you using the RTP stream to view the video only on something like a Windows laptop?

Our forum is sponsored by RICOH and we like to report to RICOH on commercial use cases for the THETA.