Tutorial: Live Ricoh Theta S Dual Fish Eye for SteamVR in Unity

tutorial
unity

#21

Hello everyone! I have recently switched form theta v to theta s, and now it works! I was wondering, does the wifi feature on the theta s only work with the app? Or am I able to use the wifi camera preview with the Unity app that we have created above.


#22

Example using THETA S and Unity using WiFi API


#23

Hi, I am a postgraduate student at Osaka University. I am using HoloLens for research.
I want to use Theta V to rebuild indoor environment. The Theta V is now on the way, and, I want to know is this live stream package available on HoloLens?
thank you!


#24

We don’t have any community projects with the HoloLens, though it should work.

The THETA V appears as a standard webcam to a Windows 10 machine. Although I’m not familiar with HoloLens, I expect that it has an API to accept an equirectangular video stream. According to this article, Windows Mixed Reality immersive headsets should work with SteamVR. If that is the case, there are a number of projects on this site that use SteamVR and the THETA. Just use the THETA V as a standard webcam texture if you use Unity.

You will likely need this driver:

The last time I checked, audio is single channel only.

Most people are using tethered USB connection between the camera and the computer.

It’ll be great to hear your experiences with the HoloLens and THETA V.


#25

Hello. I want to incorporate live streaming of Dual Fish Eye into Unity via USB connection. I created a THETA V plug-in application using Android Studio. I stream videos by live streaming as follows in the application.

    private void customShutter(){
        Camera.Parameters params = mCamera.getParameters();
        params.setPreviewSize(1920, 960);
        params.set("RIC_SHOOTING_MODE", "RicMoviePreview1920");
        params.set("RIC_PROC_STITCHING", "RicNonStitching");
        mCamera.setParameters(params);
        params = mCamera.getParameters();
        mCamera.setDisplayOrientation(0);
        try {
            mCamera.setPreviewDisplay(holder);
        } catch (IOException e) {
            Log.d("My", "Nothing Texture!!"); //debug
        }
        mCamera.startPreview();
    }

How can I recognize this live streaming by Unity?
‘’‘WebcamTexture.devices’’’ shows only existing drivers such as “THETA V FullHD” and “TEHTA V 4K”. I want to recognize information flowing from my plug-in.


#26

Either @jcasman or I will need to ask someone at Ricoh if it’s possible to use the plug-in to stream over a USB cable. Currently, we only have examples to stream from the plug-in using Ethernet or Wi-Fi.

The Ricoh camera app can stream over USB, but it’s using a different code base.

Update: 2018/09/18: Does not look possible to stream dual-fisheye over USB using the plug-in. See this:


#27

Helo,

I am streaming 360 by by USB.
I brought S first and its resolution is not high enough for my application.
I then brought V.

For V, I adopted “THETA THETA V 4k” driver.

I tried below Unity sphere example for my V. It works.


However, it has some defects at transition edges between two camera.

I tried this example for my S. it works great with no defects.
Below are those Sphere parameters.
Sphere1:
Offset U: 0.013
Offset V: 0.007
Scale U: 0.983
Scale V: 1.149
Scale Center U: 0.0686
Scale Center V: 0.5

Sphere2:
Offset U: -0.01
Offset V: -0.031
Scale U: 0.976
Scale V: 0.958
Scale Center U: 0.26
Scale Center V: 0.55
However, these parameters are not suitable for V.
I tried one whole day to tune those parameters so that my V can work with Dual Fish.
But i failed.
If anyone knows the parameter values?

Thanks~


#28

I think most people are using the equirectangular live stream on the THETA V. How did you get the dual-fisheye stream with the THETA V?