The takeaway Mallinson talked about the most, both onstage and in Venturebeats follow-up. He gave three examples of evolutionary hardware improvements first, and offered his predictions.
“The first is resolution,” Mallinson explained. “This is more pixels per degree. It’s about the sharpness and the clarity of the display. And you have to be able to match what people expect to see today with high definition. I would expect the resolution to roughly double in the next set of VR products.”
“Along with that, we also need a greater field of view,” he continued. “The human visual system is out to about 180 degrees. Most VR headsets today are about 100 degrees. There are diminishing returns to get wider. But I would expect the next set of products to be roughly 120 degrees in terms of field of view.
“And finally, HDR. In the TV industry, HDR is already incredibly important to creating the best experiences. The human eye sees an enormous range of light from bright sunlight to deep shadow. Today’s VR panels only capture a tiny fraction of that. So in order to increase the sense of presence, I do expect to see HDR adopted in the near future.”
Trippin’ over those Cables
He offered two solutions: an all-in-one headset, where the compute is part of the headset, and using wireless transmission technology to replace the cable in PSVR 2.
“In both cases, these require a battery, either on your head or close to your head,” Mallinson noted. “Having a battery on your head is a little bit inconvenient in terms of ergonomics and industrial design. But I think that the all-in-one headsets that you’re beginning to see now are actually getting pretty good. But honestly speaking, they cannot possibly compete with a wired headset today because of the enormous amount of compute and rendering performance you can get on a high-end PC or a games console. You just can’t put that on your head.”
Thankfully, progress is moving quickly here too.
“But fortunately, wireless transmission technology is getting better every day,” Mallinson said. “New technologies such as 60 gigahertz are allowing for these options to become possible for VR products. But it might well remain an option, because it will be more costly than with the cable.”
Tracking your Gaze
“Gaze tracking, this is the technology that excites me the most,” Mallinson declared. “We’re already beginning to see this in some products on display at industry events. I think it has the greatest potential to change the PSVR 2 user experience at a pretty fundamental level. I think it was Shakespeare who coined this phrase that ‘the eyes are a window to our souls’. I’ve been a little more prosaic by saying that ‘the eyes are a window to our thoughts’. I think everyone can intuitively understand just how rich human communication becomes when you have that eye contact.”
“So what do I mean by gaze tracking? I mean the technology to understand where you’re looking in this virtual world. What is your attention point? And then on top of that, we can then layer extra things. We can understand perhaps your attention by measuring pupil dilation. We can do biometrics to understand who you are looking at. … And we can measure your IPD (interpupillary distance) — the distance between your pupils. This is very important to VR because it allows us to accurately set up the optics and the rendering to give you maximum comfort, and to really get the correct sense of distance and scale in VR. So fundamentally, with this technology, we know what you’re looking at in VR. And this allows for countless user interface and user experience possibilities.”
Forve… Fover… Fearov… You know what we mean.
The other reason Mallinson is so bullish about gaze tracking is because it enables foveated rendering in PSVR 2.
“More pixels needs more rendering performance,” Mallinson explained. “If you just brute force it, it requires a lot of extra rendering performance. The human eye has a part in the retina called the fovea, which is responsible for our super-sharp vision. We don’t see very much in the peripheral vision. So if we can match our rendering performance to the fovea, we can deliver higher effective resolutions, and also better quality images. So gaze tracking is a win-win in this respect.”
Gaze tracking thus “pays for itself.” It brings a new user experience, and enables the hardware optimization of foveated rendering. All of the above together consists of the rapid improvements in technology that Mallinson expects will drive wider adoption of VR.
In the coming months we will surely get more details on both devices, so stay tuned for the latest on PS5 and PSVR 2!