The next generation of Spatial Computing is here
Entirely controlled by your voice, eyes and hand gestures, Apple Vision Pro is about to re-write the rulebook
Apple Vision Pro is finally here, and the importance of this milestone cannot be underestimated. I’ve been waiting patiently since mid 2023 for the next generation of computing to arrive from Apple.
I got to try Apple Vision Pro back in June 2023, if you are interested in checking out my initial reaction video, it’s at the top of this article. Now, the device is here and shipping first week in Feb 2024 and I couldn’t be more excited.
It’s hard to quantify to someone who hasn’t used Apple Vision Pro just why it’s so different, it’s one of those “you need to try it for yourself” products. Only then do you feel that ‘ah-ha’ moment and (probably) take out your credit card! 🙂
So what is it? For all intents and purposes, it’s a wearable Mac. But you can’t just port the MacOS to a device that you wear like glasses, so Apple had to redesign the entire OS to work with the new input medium for Apple Vision Pro… your eyes.
“What I had with Apple Vision Pro was the best audio visual experience in the music arena ever…“
Kane Vato – Editor In Chief
at the Vision Pro unveiling, WWDC June 2023
Build it and they will come
Whilst wearable based computing isn’t new, most other brands have approached the entire platform with one focus, be it gaming, or augmented reality. Apple Vision Pro is a brand new Mac-like Operating System that just happens to sit a few inches in front of your face.
Thanks to the eco-system of App developers and the interoperability between iOS, iPadOS, macOS and now visionOS, existing apps can be ported with relative ease over to Apple Vision Pro. Some initial reports showed coders being able to switch their iPad apps to Apple Vision Pro in under 15 minutes.
If Apple Vision Pro is a success, then all the independent developers win, and will immediately have an exciting new platform to earn revenue from. If the Apple Vision Pro App Store is full of new shiny apps, then the consumer wins, and in turn the success of the Vision Pro will become a self fulfilling prophesy, giving Apple, and more importantly the developers a solid win from day one. It’s impossible to predict the success just yet, but early announcements from Apple show that there are over 1,000,000 apps already in the Apple Vision Pro App Store, so we can be sure that the user isn’t going to run out of things to do with their new headset.
Frame rate
90
Battery life
270
External Power
Apple Vision Pro's battery puck has a USBC port for charging and pass through power for "all-day" use.
Your content can now be captured in Spatial Video from your iPhone 15 Pro and displayed on Apple Vision Pro
Apple Vision Pro is a content consumption product at its heart. Whilst productivity apps may rise up over time, initially Apple Vision Pro will disrupt the entertainment, and light gaming markets.
The iPhone recently received an update that allows it to use two cameras on the phone to shoot in Spatial Video which when played back on device gives a “depth” effect to the content. I think this is cute, but probably not very useful for most people, simulated depth in images (a la 2019 Facebook) often leave a little to be desired, but where Apple Vision Pro will really shine is with Apple’s Immersive Video Format. Very little has been revealed about the codec yet, but early reports and leaks show that it’s possibly two fields of view shot on 8k with a 180 degree lens. (Canon R5C)
This format will give the user a new level of interactivity that could change the way we consume events such as concerts and sports. With immersive content, you’ll be able to feel like you are sitting absolutely front row from your couch. Wherever you look (in the 180 degree FOV) will feel like you are there. If you’re watching the tennis, you’ll literally be swinging your head left to right to left to right. I expect PPV content to become a primary revenue stream for Apple with this format, possibly even more than 3D content, which is also viewable on Apple Vision Pro.
As far as gaming goes, Apple Vision Pro offers an ‘infinitely’ giant screen, and the ability to use console controllers. However, even with the M2 chip, games still don’t quite meet the standards that pro-gamers demand, but for the light gamer, Vision Pro will offer a fun experience.
Creating your persona on Vision Pro uses the same technology as we are used to in FaceID
Apple’s promo content really pushes Apple Vision Pro as a genuinely useful FaceTime/Zoom/Webex tool during office hours. I tried the FaceTime functionality briefly and it was very good but I think it’s important to recognise that Apple’s commitment to adding this, alongside all the productivity tools signals that they really believe this will be an all-day use device.
Whilst I personally struggle to use the iPad as my “main” device for an entire day, where I think Apple Vision Pro shines with the ability to access your Mac and simply act as an enormous external monitor. This feature set brings a lot more than just your Mac apps, it means you’ll also be able to use your keyboard and trackpad or mouse. Bringing real life tactile interactions to a fully virtual world is going to make the transition to using the headset much more palatable.
Vision OS
The new OS from Apple is the cumulation of engineering in MacOS, iOS and iPadOS. For the first time ever the entire computer can be controlled with gestures, eye movement and voice. However if you want to use your external keyboard you can, but the ease of simply looking and tapping your fingers is a magical experience that can’t be described. You have to try it to believe it.
Realtime 3D mapping
Apple Vision Pro has an array of cameras hidden beneath the glass front plate allowing for high resolution pass-through video, hand and motion tracking, and 3D mapping of your room for both visual and audio fidelity.
Bring your Mac to the party
One of the most underrated features in my opinion is the ability to bring your Mac near to Apple Vision Pro and your screen will immediately pop ‘out’ of the Mac and hover in space. From there you can make your screen as large as you want. External monitors on the go will be a thing of the past.
Is Apple Vision Pro going to replace my TV and gaming setup?
If you are going to spend a few thousand dollars on a TV, and a sound system for your home, then it's probably more cost effective to get Apple Vision Pro. However, it is important to factor in that each user will require a device, so for a larger family the price starts to run away.
Content Formats Available
- Regular Video (up to 4k)
- Apple Immersive Video (shot in 8k)
- 3D Movies
- 2D & Immersive Games in the App Store (may require controller)
Apple Vision Pro launches Feb 2 in the USA, international rollout to follow.
“I’d go as far as saying that it’s the most fun you can have with your pants on… Enjoy!”
Kane Vato – Editor In Chief
at the Vision Pro unveiling, WWDC June 2023