Apple reveals visionOS 2 upgrade for Vision Pro with new features

Apple has unveiled visionOS 2, the latest upgrade for its Apple Vision Pro device, bringing a host of new features and capabilities to the platform only months after its initial launch in the United States. The update was announced in Cupertino, California, and introduces a novel approach to creating and experiencing spatial photos, new intuitive gestures for easier navigation, and an array of tools for developers to elevate spatial computing.

The visionOS 2 update significantly enhances user experience, offering new ways to manage and interact with memories. Users can now generate spatial photos directly from their library in the redesigned Photos app, which uses advanced machine learning to convert 2D images into dynamic, spatial photos. These photos can be shared with loved ones via the Vision Pro device or through SharePlay with a spatial Persona, allowing for a more immersive experience.

Additionally, visionOS 2 bolsters Apple Vision Pro's productivity tools. The Mac Virtual Display will soon offer higher resolution and larger sizes, comparable to two 4K monitors side by side, enhancing workspace efficiency. The update also introduces mouse support and reveals the physical Magic Keyboard even when users are engaged in immersive environments or applications. New hand gestures have been added to facilitate quicker access to key functions like Home View and Control Center, including checking the time, battery levels, and adjusting the volume.

Apple's vice president of the Vision Products Group, Mike Rockwell, emphasised the company's commitment to advancing spatial computing. "From navigating visionOS more seamlessly to pushing the boundaries of how users connect with memories, and enhancements to key Vision Pro apps, we can't wait for users to experience the range of new capabilities with visionOS 2," Rockwell stated. He highlighted the robust set of tools provided for developers to create richer spatial apps, making Apple Vision Pro even more potent.

Developers will find a suite of new APIs and frameworks at their disposal, aimed at facilitating the creation of volumetric and shareable app experiences. With more than 2,000 spatial apps designed for Apple Vision Pro and over 1.5 million compatible iOS and iPadOS apps, visionOS 2 seeks to unlock new potential in spatial computing. The update also integrates HealthKit, enabling developers to design innovative health and fitness experiences leveraging visionOS's infinite canvas.

Several developers are already exploiting visionOS 2's new capabilities. For instance, 1640 LLC's The Museum That Never Was app will use new volumetric APIs to add immersive 3D objects and interaction methods. GRL Games is developing Haunted Chess, a murder mystery board game utilising TabletopKit for a 3D, holographic experience. Enterprise developers are also adopting the new tools for applications in sectors such as healthcare, manufacturing, aerospace, and automotive industries.

Apple Vision Pro's content capabilities are set to expand with the support for Apple Immersive Video, featuring 3D 8K video and a 180-degree field of view with Spatial Audio. The Apple TV app will host an increasing number of immersive films and series. Later this year, Blackmagic Design is expected to launch a new camera system and update to DaVinci Resolve Studio to support Apple Immersive Video, allowing professional filmmakers to create highly immersive content.

The visionOS 2 update also brings enhancements to Safari, enabling users to watch videos from popular sites in an immersive Environment. Siri has been updated to read and speak webpage content while users multitask. The Apple TV app will soon support multiview for watching up to five simultaneous sports streams, and the Mindfulness app has a new Follow Your Breathing feature for dynamic visual and audio feedback based on users' breathing patterns. Additionally, system-wide Live Captions aim to assist deaf or hard-of-hearing users with live conversations and audio from apps, while AirPlay support has been extended to allow content viewing from iPhone, iPad, or Mac on Vision Pro.