Solved: Unity Can't Display THETA V Live Stream on Windows 10

[Nima]

@codetricity

When you start your application, does SteamVR automatically configure your audio input as the THETA V?

Hello,

I did not need to change anything in the audio configuration of SteamVR, so I believe it is automatic.

N

[codetricity]

@Nima

I did not need to change anything in the audio configuration of SteamVR, so I believe it is automatic.

Thanks. I have it working with single channel audio.

[codetricity]

@Litto

One colleague of mine told me i should try changing the audio DSP Buffer to Best latency. Could not test it so far but I will let you know

I did a video review of a new Acer Predator Helios 300 gaming laptop with quad core i7. The CPU was maxed out at 100%.

THETA V Test with Acer Predator Helios 300 and HTC Vive

I’m getting an audio delay of less than one second. I had the DSP Buffer Size set to default. I will try it with “Best latency”

If other people want to try it, the setting is in Edit → Project Settings → Audio → DSP Buffer Size

Even though the CPU was maxed out, the movement in the headset was smooth.

BTW, I think you’re aware, but the latency is a problem that for telepresence that many people are working on. One solution is to develop a new protocol with better compression, specifically for transmission over networks.

See this company for cool ideas:

http://gitai.tech/

[0-Vanes-0]

Hello? Are you all still here?
I have a couple of questions. I’ve got 360 camera but it’s not THETA, it’s Insta360. So um… I can’t realize how you remove this black gaps on your sphere. What does this shader do?
(Solved: Unity Can’t Display THETA V Live Stream on Windows 10)
And what do you do in regedit? Is this thing for searching webcam or for… turning my webcam with 2 lenses into 2 webcams with single lenses?
I can’t resolve my problem with black gaps for a week.
Please help. Thanks in advance.

[codetricity]

The THETA V outputs 4K equirectangular live streaming video. I’m not familiar with the insta360. You may want to ask someone on the insta360 developer site. If you do decide to purchase a THETA V, it also has the ability to develop plug-ins inside the camera.

Good luck with your project.

[Bhumit_Dave]

@codetricity Does THETA V support Linux ? Is there any possiblity that we can use your unityPack on Ubuntu?

Thanks In Advance

[Bhumit_Dave]

@codetricity THETA V Does have Linux Driver , So we can directly use THETA V on ubuntu with unity package that you have provided?

[codetricity]

I think it’s likely that you won’t be able to use the THETA V working on Linux for the stream

It’s likely that you’ll need to do a dual-boot and install Windows or MacOS on another disk.

[FirepadCN]

thx,i can play it’s video in unnity,but the video aways at low fps. cpu i7,gpu 970.Is there a better solution for this?

[codetricity]

Do you mean that you’re getting considerably below 30fps?

[FirepadCN]

yes, with 4k model,that below 10 fps，i use webcamtexture to get theta v 's live video

[codetricity]

Other people have reported this problem, but I can’t replicate it.

This is old, but I just used it a few weeks ago on my laptop and I was getting close to 30fps. We used the demo at several events with hundreds of people. I suspect something has changed with Unity to reduce the fps, but I can’t replicate the problem.

codetricity/theta-v-htc-vive-steamvr

Can you share the code base you are testing?

[Christopher_Paton]

Hi all, I’ve gotten pretty far with this post, great work all, but streaming has this weird segmentation.

Any advice.

Thanks
Chris

[craig]

There’s a newer discussion at the link below.

Can RICOH THETA Z1 be used in Unity as a webcam?

Hi everyone, We want to build a small VR conferencing app using Unity. I see that there were a lot of posts about connecting Ricoh Theta V with Unity via USB cable (like a webcam) to live stream 4K, but I couldn’t find any post about connecting the newer Z1 camera to Unity. Did someone successfully managed to connect it to Unity via USB? I like the larger sensor on Z1 and the image quality it produces, that is why I would like to go with it. Thank you and have a nice day.

Also, improved technique from @RicoB

Stream Ricoh Theta to Unity Skybox

Note: This was done with the Theta Z1, but should work with the others too. Thought I’d share this here to help improve the quality of projects people are working on. I noticed a lot of people are projecting the cam texture on a “inverted” sphere. The problem is that sphere’s are still polygons and create “edges” in your 360 image. It’s not pretty or professional. Even worse is if you decide to use it in room-scale VR - the sphere won’t move with you and it’ll just be weird (unless you make th…

[Christopher_Paton]

Thanks Craig, the skybox worked for me. Just what I wanted. Thank you

[craig]

@Christopher_Paton, thanks for reporting back on the success. It helps others.

The original Unity examples in this topic are old and I should reorganize the examples to help people find the updated information.

Let us know if you create something cool.

[Christopher_Paton]

Trying to set up telepresence robot operation.

Just trying to learn unity to get oculus quest controllers mapped.

[craig]

You may find these articles interesting.

Telepresence Using THETA V and Segway by TwinCam Go

A community member pointed out this amazing project using two THETA V cameras. It won an award at Innovation 2018 by a governmental agency. The project was also nominated for SIGGRAPH Emerging Technologies next year. I believe the groups behind this project are: Tokyo Metropolitan University Ikei Research Laboratory NTT Communication Basic Science Laboratory [image] [image] [image] [image] [image] [image] [image] [image] [image] [image] [image] [image] [image] …

RICOH THETA Powers Construction Equipment VR Technology at Kumagai

[image] Just saw a RICOH THETA Z1 featured in a Japanese article about unmanned construction technology developed by Kumagai Group and Tokyo National College of Technology. The system provides audio and live streaming video with the RICOH THETA Z1 to remote operators. [image] The group developed a VR Cockpit to control construction equipment remotely using a telepresence experience. [image] Real-time video from the RICOH THETA Z1 is streamed into a VR head-mounted display or cockpit. Au…

---

The examples below are not using Unity. The developers for the two projects below are on this forum. You may be able to exchange ideas on implementation.

Successful Theta V stream from drone to VR headset 0.25 miles away

Just figured I would drop a little project update here letting people know about the senior design project I worked on that used a Ricoh Theta V. I know @codetricity and others on here would definitely be interested in it, since I have seen people talking about sending Ricoh Theta V video from a drone, but as far as I know noone has demonstrated anything yet. We built a system that would allow a ground operator to view a livestream video from a drone in their VR headset. The system will send th…

Industrial Robot Uses RICOH THETA 360° Live Video To Inspect Tight Places

[image] Hugues Perret builds robots that explore the inside of dark pipes under the streets of France. His robots live stream 360° video direct to a laptop, enabling the robot operator to see any cracks or damage. They can look up, down, left, right at any point in the inspection. His company, FOX SEWER ROVER, designs and builds these amazing robotic rovers for a leading French company that repairs a complex network of underground pipes. In addition to live streaming 360° video, the rover can…

[Christopher_Paton]

You sir, are a legend. thank you.

Chris

[anokhee]

Hello everyone.

I am using Theta V for a project, wherein I want to get the live stream from the camera on the screen of a phone, such that it can be viewed in real time using a VR headset (so the picture format has to be such). Could anyone please help me out?

Wired or wireless, either type of communication works. The only requirement is that the lags must be minimized. I am looking for some existing apps or methods which could help me achieve the above stated aims.

Thank you.