8 Amazing Open Source RICOH THETA Plug-ins To Kickstart Development


#1

You can develop custom functionality for RICOH THETA V cameras in minutes by downloading an existing open source plug-in and modifying it for your specific requirements.

Top 8 Open Source Plug-ins

Here are 8 plug-ins that will get your development started like a rocket.

Plug-in Name Description Author
Cloud Upload Upload automatically from THETA to Google Photos for 360 and VR viewing Ricoh
Wireless Live Streaming 4K equirectangular live streaming from THETA direct to YouTube and Facebook using RTMP Ricoh
Automatic Face Blur Automatically detect and blur the faces of people to protect privacy Ricoh
Live Streaming Plug-in Sample for RICOH THETA Sample application using WebRTC SFU to live stream spherical video to the RICOH Cloud with the RICOH Live Streaming API for their cloud. Ricoh
THETA Sample Plug-in: CameraAPI Capture Plugin Excellent starting point for using the internal CameraAPI to take pictures and video. Simple and easy to customize. Ricoh
THETA Sample Plug-in: WebAPI Capture Plugin Great sample application to use the WebAPI from the plug-in Shohara
Dual-fisheye Plug-in Ichi Hirota’s dual-fisheye plug-in to take 3 bracketed images. Includes examples for modifying exposure and the number of images Ichi Hirota
THETA Plug-in SDK Official plug-in SDK Ricoh

3 More Open Source Plug-ins

Here are three additional plug-ins from the community. These are all based on the THETA Sample Plug-in: Camera API project listed above.

Plug-in Name Description
Long 2K Video Bypasses 25 minute video recording limitation to record 1 hour and 24 minutes of 2K video with spatial audio
Long 4K Video Tested to 1 hour 24 minutes of 4K 30fps video with mono audio and 48 minutes with spatial audio and default encoding
Surveillance 2K 10 hour 55 minute saved to internal storage. 2K, 10fps

Additional Live Streaming Plug-in Information

Facebook, YouTube, Periscope and RTMP

Facebook, YouTube, and Periscope use Real-Time Messaging Protocol (RTMP) to live stream events. The Wireless Live Streaming Plug-in provides a great example of RTMP for 4K equirectangular video direct from the camera.

WebRTC, Oculus Go and Video Conferencing

You will need to do more work for WebRTC. The RICOH Live Streaming plug-in Sample for RICOH THETA provides a complete open source example using the RICOH Cloud servers.

If you want to use WebRTC with your own servers, you will need an external signaling server.

Examples of WebRTC external server use:

Ethernet

Although the Wireless Live Streaming plug-in does work with Ethernet, the camera cannot be powered by Ethernet. There is no known success of bypassing the battery to power the THETA V from an external source. If you use Wi-Fi, you can power the THETA V from the USB port

Heat

HoloBuilder has reported success with 24 hour 4K live streaming using Wi-Fi. Some people have reported heat issues.

  • blowing a fan on the body of the camera helps. You can use a household fan and angle it toward the camera.
  • Using Wi-Fi will generate more heat than streaming through the USB cable
  • Although you can stream dual-fisheye and offload the stitching, Ricoh does not release lens parameter information.

USB

No one has figured out how to stream from the plug-in over USB as of Oct 2018. We do not think it is possible to stream from the plug-in using USB. We recommend that you use the normal camera application and not the plug-in.

Power

We’re using a mobile phone charger capable of supplying 1.5 amps for our tests. Do not power the camera from your computer USB while attempting Wi-Fi streaming. Although the camera is receiving power from the USB when it is streaming over Wi-Fi, our initial tests indicate that the battery power may be decreasing slowly.

Test and Debug

Tip to use adb with a USB cable and Wi-Fi for streaming:

adb shell settings put global usb_debug true

Use adb from IP address

If you’re testing Wi-Fi live streaming, you may be trying to connect the THETA V Wi-Fi to the Internet while you are debugging the plug-in with Vysor or adb connected to your camera with a USB cable. This won’t work.

To get Vysor or adb to work with TCP/IP, you need to run the following command first with the camera connected with a USB cable:

adb tcpip 5555

Get IP address from router.

Once connected, establish adb connection with:

adb connect IP.address:PORT

or with my IP address of 192.168.2.102

adb connect 192.168.2.102:5555

You can also use Vysor with an IP address that is established using Wi-Fi or Ethernet.


Join the THETA Partner Program to Start Building Your Own Plug-in