VR BLOG

VIRTUAL REALITY 3D

Is VIRTUAL REALITY the future of Stereoscopy?

Article written for STEREOSCOPY Magazine Issue 4 2019

ron vr stereoscopy cover

Cover of STEREOSCOPY ANAGLYPH mockup...  Ron Labbe at VIRTUALITY STATION London 1991

I say YES!

Stereoscopic images have never been easy to share; they’ve almost always needed a viewing device. Print viewers were fairly common at the turn of last century, while film viewers were mass marketed for only about 10 years through the 1950’s. View-Master was the outlier, having produced millions of viewers since 1939. But what viewers are available for digital stereo? HMDs. The beauty of digital imaging is the ability to share easily- the number of flat images taken and shared each and every day is staggering… but it’s not so easy for stereo! Digital stereo had gotten some hardware support for a few years, but little public interest led to almost every piece of taking/viewing equipment disappearing for good. Online viewing is basically limited to those who can free-view or have anaglyph glasses (or one of the rare 3D monitors). Even the one stereo-centric website I know of (phereo. com) has suffered from lack of support with blackouts being common (and it may well disappear entirely by the time this article is published). So what do you do with your stereo photos? Who gets to see them, aside from some folks who go to your home or the occasional 3D meeting? Remarkably, millions of new stereo viewers are in the hands of consumers in the form of HMDs (Head Mounted Displays) that can easily access your stereo imaging as well as 3D from around the world. Most owners don’t know anything about stereo and couldn’t care less (similar to many View-Master fans). In addition, new VR stereo cameras are being sold for this new VR system (though traditional digital pairs stereo can be also viewed in a headset). There is no question that digital imaging technology is constantly improving, so we can certainly expect VR headset and camera quality to keep advancing. In the late 1980’s I was introduced to the very impressive LEEPVR photography system: 120 film in specially built super-wide lensed 3D camera with the matching viewer. The inventor, Eric Howlett, subsequently tried to utilize the extremely immersive lenses to work with video, but the tech was not nearly advanced enough: the 1992 “Cyberface 2” utilized dual Sharp color 385 x 119 pixel LCDs. (I personally never saw one… there’s plenty of info on this system here.)

 

leep viewers camera

Rare LEEP Triple Head Viewer stand with Camera circa 1989

 

cyberface

LEEP Employee Greg Rivera with Cyberface 1 and 2 with Telehead, 1992


My first exposure to a video headset was in 1991 when I experienced the arcade system called VIRTUALITY in London. My memory was that it was (not surprisingly) quite rudimentary in terms of computer graphics and insanely bulky, but it was stereo (dual 372x276 LCDs), and the interaction/immersion was profound. Different versions were shown at a Virtual Reality Expo in Boston several years later. I also viewed an early full color VR system at Disney World in 1999: “Aladdin’s Magic Carpet Ride” at DisneyQuest exhibit (shut down in 2016). A number of VR systems were developed throughout the 1990’s, but it would take 20 years for computer power and image resolution to bring VR to a viable state.

 

virtuality london

Ron Labbe VIRTUALITY at Rock Garden UK Oct 1991

 

virtuality ride

VIRTUALITY Station Ride Virtual Reality Expo Boston 1993


VR viewer Disneyquest

Aladdin VR Ride DisneyQuest 1999


In 2013 John Ribarich shared an Oculus RIFT “Development Kit” in his room at a National Stereoscopic Association convention in Traverse City, MI. Apparently, it was not that impressive as I don’t recall the imaging at all! (NOTE: Oculus RIFT was Kickstarted in 2012. Two years later Facebook purchased Oculus for $2 billion.) However, at the 2016 NSA convention 3 years later in Tulsa, OK, Franklin Londin shared some 360 3D VR in his Gear VR headset that nearly blew my head off (similar to the experience of me seeing my first Realist transparency pair). We saw amazingly immersive short documentary videos by Felix and Paul which put me inside a Maasai hut and on a handmade wooden boat to visit people living in stilt homes above the water off the Borneo coast. I guess running these 360 stereo video was intense for his Samsung S6, as he had to occasionally cool it off in the room’s mini-fridge freezer! Back home I was soon playing with “Google Cardboard” headsets, both paper and plastic, with my LG smartphone. The interface was very limited (a single “button” that sometimes worked), but there were a number of apps (including 3DStereoid PRO) that allowed viewing of stereo images and video.


rob rift demo 2017

Oculus Rift demo Best Buy Feb 2017


In Feb of 2017 I went to the local BEST BUY to check out an Oculus RIFT demo with my 3D friend Rob… it was VERY compelling! What astounded me was the “six degrees of freedom” that allows you to move within a (computer graphic) space… I remember bending down to look under a table and all around the models on it. However, it was expensive, and I didn’t like that it wasn’t portable (needing to be tethered to a powerful computer)… not easy to share. Instead, I purchased a Gear VR and (used) Samsung smartphone system in August of 2017, and found it much easier to navigate via the hand controller. My friend Lattie Smart, from his home in Maryland (I live in Massachusetts), showed me around some of the amazing apps, including VTime: you can (via your “avatar”) chat with up to four people (each having their own avatars) in a virtual “room” to share stereo images (which you’ve uploaded to the VTime website) on the virtual projection screen! The resolution, of course, is not great, but still impressive. The first digital projections at NSA 1998 were from the groundbreaking Vrex projector that showed 720x240 (interlaced NTSC) per eye! Since Gear VR is supported by Oculus, it offers the similar “home page” interface that allowed much easier navigation between apps than the Cardboard (which demanded pulling the phone between operations).

Moving to the Oculus GO (1280x1440 per eye) in May 2018 was an easy choice since the display as well as the stereo speakers were integrated (the sound was surprisingly good considering the speakers are built into the straps!) It featured the same familiar homepage as the Gear VR, along with an easy way to load images or video via USB cable. Of course, I became very interested in shooting my own immersive stills and video, and I’d been looking at lots of the work done by others online. Mainly, there are 180 and 360 formats. Seems all 180 is stereoscopic, while most 360 is 2D. I found 360, even if 3D, often problematic- I really don’t like the feeling that I’m missing something behind me and it’s not fun to constantly crane one’s neck around, especially if not in a swivel chair (or standing). If 360 is 2D, it looks to me as though the scene in projection mapped inside a ball that you’re inside of. In addition, 360 videos (or stills) require “stitching” of at least 2 fisheye images, which may or not be seamless. And when the camera sees in all directions, it’s very hard to extricate the cameraman, crew, lights or anything else you don’t want in the picture. For me, 180VR (3D) makes the most sense… So, in February 2019, the VUZE XR VR camera came out ($439) to very good reviews. It can be used with lenses back to back for 360, but with the press of a button the lenses flip to side by side for 180. The first thing I had to learn was that you cannot hold the handle while shooting or your fingers will get in the image! You really have to think of a geometric plane exactly flush with the lenses that comprise the edges of what is seen: The left lens curve is actually in the right eye view! Video is 5.7mb/30fps, stills render at 3000x3000 pixels per eye. That’s a good amount of resolution, but of course it’s spread out to top, bottom, left and right edges. The lack of resulting sharpness is made up for by the immersion factor… and the resolution will only improve with better lens design, denser displays and faster/smaller computer power. And of course HMDs will get smaller and more comfortable. I’m not a gamer, but when I got a PlayStation 3 many years ago to play 3D Blu- Rays, I also got a few 3D games to see how good they were. None caught my interest for more than a few tries. The best (2D) game I’d ever tried was called “Neverhood,” a “claymation” puzzle game for Windows 95. So I thought I’d try to find some puzzle games (amongst the myriad shooters) and a few were spectacular! When the RIFT S became available in June 2019, I grabbed one since I really wanted to see state-of-the art gaming in the “six degrees of freedom” environment. Of course, all of these games are computer graphics, which I’ve always loved at the cinema (especially in 3D), and now total immersion can be had. In addition, there are some incredible videos (along with many poor ones). Just as there are people who complain of nausea with 3D movies, there are VR experiences that are even more likely to induce headache, certainly shaky or fast moving video as well as game action that tracks poorly or moves too quickly. As developers (and hardware) mature, most of these issues will subside.

For centuries, people have looked at images in some kind of frame (usually a rectangle). In stereo, we call this the stereo window. For the first time, that boundary is erased: There is no window; you are virtually within the space. I think this is a huge leap in imaging technology, and the tech is truly in its infancy. People with whom I’ve shared the GO experience almost always express amazement (more so than other forms of stereo imaging, and I’ve shared a few). It’s hard to know whether HMDs will catch on with the “masses,” but it’s definitely on an upward trend, with no end in sight. In addition to being used for virtual travel, education, sales and training, there’s also augmented reality, mixed reality and other technologies. Right now, it’s virtual reality that is piquing my interest. I urge you to give it a try.



VR BLOG Ron Labbe


April 11 2024

Meta has produced a new VR180 immersive series! "The Faceless Lady" is the first attempt that I know of to create a high quality narrative drama... this one is in the horror genre. The production looks really quite professional! I've only watched the first episode, which looked like a medieval set... It's AMAZING to feel like you're there, though it takes some time to get over feeling like you're on the set, watching the actors. There were a number of special effects, which are going to be a LOT more difficult to pull off in this stereoscopic space, never mind all the usual components like lights and boom microphones.

March 9 2024

Just got a nose blocker facepad/cover for my Quest 3... nose blocker is great (no light from below) but I'll have to see how the silcone cover works vs. the included cloth. Still can't figure out how to set Wallace and Grommit for sitting... but I still purchased the golf game! Spent a few hours in the "free" Asgard's Wrath... set it for super easy (mostly story) but there's still way too much fighting! And way too complicated (I have to go back to the Bazaar, but I can't find it on the map!) with pages and pages of stories, codex, saved items... I'll keep going for a while, have yet to search online for answers... it's likely to take way too much time.

Feb 19 2024

The WOOORLD app amazed me when I checked out my home town! Entirely 3D (bitmaps were lo-res, but still!)... I'd seen some of the major world cities in Google Earth, but to see my own Boston suburb with Google Maps 360 enviroments was really fun. Finished Another Fisherman's Tale which was great (only had to look up one puzzle piece). Loving the Wallace and Grommit Grand Getaway, but I'm stuck in a shooting game (I hate these). Part of the problem is they think I'm standing when I'm sitting, and the "OPTIONS" in settings seems unavailable! Very annoying... Also spent some time in Meta TV where I found the filter for VR180 animations... quite a variety, most of very enjoyable (unique!). Interesting to hear the Apple Vision Pro reviews... not exactly a game changer.

Feb 5 2024

Today I got about 20 minutes with the Apple Vision Pro. Yes, the resolution/image quality was astounding! If it was a Meta Vision Pro, I might be tempted! But this viewer's features offer little of what I'd like to see. It's VERY personalized, so handing it to another for viewing is not recommended. Accessing personal stereo stills or vids seems totally unsupported. No games. The "spatial videos" from the iPhone 15 (birthday party/cake, blowing bubbles) were quite good... the fuzzy edges didn't bother me (but better if it were an option). At the very end of the demo I got to see short segments of 3D movies (Super Mario was the first- didn't get a choice), which looked amazing... but not as impressive as the several VR180 clips (rhinos eating out of my hand!)... of course Kurt didn't know what camera was used. Also got to view some Avatar in Cinema mode, which puts you in a box (not theater) environment where you can choose close, medium or far screen distance (I only saw medium, I'm sure I would have gone for close if my time hadn't run out! For 2D I was able to zoom into text in a Safari website. Font was huge with ZERO pixellation! As it is, there's no way I'll spend $3500 (plus tax!) for this toy... but it's great to see the potential for competition.

Jan 24 2024

With the Apple Vision Pro hitting the shelves soon, it's finally time for a VR Blog. I've had the Meta Quest 3 since it came out (Sept 2023)- luckily I was able to see the Q2 for $200 on eBay (with new headstrap/battery). Got the Elite strap which I'm quite happy with (extra battery power and very easy on/off and comfortable). The quality of the visuals is excellent, especially at the price point. Not only are there great games to enjoy (I've never been a gamer, but being IN a game with a stereoscopic environment is amazing) but I can view my own VR180 stills and video (with VUZE XR) as well as regular digital stereo. ImmerVR is a great app for showing your stereo. Recently I noticed on the Meta Browser that there were VR games available on websites! The first one I tried, The Escape Artist, was surprisingly good! For a relatively lo-res game, the art aspect was extremely well done and the puzzles were engaging (with hints if needed, which I really like). Currently I'm playing Another Fisherman's Tale, which is good, but so far not as good as the original (which really toyed with scale in a way that fittingly utilized the VR space). I am generally NOT a fan of shooters, I'm mainly interested in graphics, humor and wit. Since Moss 2 was released, I went back to see if I could get through the original, but I got STUCK at the same place I got stuck at before, where killer beetles KEEP COMING relentlessly and at least one is also firing it's canon at you. I don't find this fun, I find it frustrating, especially since you cannot proceed until victory, which I'm just not getting (how long does it take to acquire the skills necessary?). At least if you're stuck on a puzzle you can find the answer online... if you're stuck in combat, the game is over. :( One game that has puzzles as well as shooting is HALF-LIFE ALYX... This game is the most incredible experience I've had in a game- despite the guns (I was able to get through and finish!). The insane quality and detail was so close to be in an interactive movie... As it's VERY data/process intense, I can only run it via computer (via Virtual Desktop/Steam). My other favorite game is WOLVES IN THE WALLS which is totally free.