Spatial computing and VisionOS - get into an entirely new universe of apps and games development

Spatial computing combines virtual reality, augmented, mixed, and extended reality interaction techniques to allow humans and machines to interact in immersive ways

Mar 31, 2024 - 09:57
Apr 1, 2024 - 11:54
 0
Techatty All-in-1 Publishing
Techatty All-in-1 Publishing

Spatial computing and VisionOS - get into an entirely
new universe of apps and games development
.

The possibilities for what you as a developer can dream up and build for Apple Vision Pro are endless. With familiar tools and frameworks like Xcode, SwiftUI, RealityKit, and ARKit, as well as support for Unity and the new 3D-content preparation app Reality Composer Pro, you and your fellow developers have everything you need to create amazing spatial experiences.

Talk to Techatty
Talk to Techatty

Discover visionOS

All-new platform. Familiar frameworks and tools. Get ready to design and build an entirely new universe of apps and games for Apple Vision Pro.

A spectrum of immersion

Apple Vision Pro offers an infinite spatial canvas to explore, experiment, and play, giving you the freedom to completely rethink your experience in 3D. People can interact with your app while staying connected to their surroundings, or immerse themselves completely in a world of your creation. And your experiences can be fluid: start in a window, bring in 3D content, transition to a fully immersive scene, and come right back.

Talk to Techatty
Talk to Techatty

The choice is yours, and it all starts with the building blocks of spatial computing in visionOS.

Windows

You can create one or more windows in your visionOS app. They’re built with SwiftUI and contain traditional views and controls, and you can add depth to your experience by adding 3D content.

Volumes

Add depth to your app with a 3D volume. Volumes are SwiftUI scenes that can showcase 3D content using RealityKit or Unity, creating experiences that are viewable from any angle in the Shared Space or an app’s Full Space.

Spaces

By default, apps launch into the Shared Space, where they exist side by side — much like multiple apps on a Mac desktop. Apps can use windows and volumes to show content, and the user can reposition these elements wherever they like. For a more immersive experience, an app can open a dedicated Full Space where only that app’s content will appear. Inside a Full Space, an app can use windows and volumes, create unbounded 3D content, open a portal to a different world, or even fully immerse people in an environment.

-

Apple frameworks — extended for spatial computing

-

SwiftUI

Whether you’re creating windows, volumes, or spatial experiences, SwiftUI is the best way to build a new visionOS app or bring your existing iPadOS or iOS app to the platform. With all-new 3D capabilities and support for depth, gestures, effects, and immersive scene types, SwiftUI can help you build beautiful and compelling apps for Apple Vision Pro. RealityKit is also deeply integrated with SwiftUI to help you build sharp, responsive, and volumetric interfaces. SwiftUI also works seamlessly with UIKit to help you build apps for visionOS.

RealityKit

Present 3D content, animations, and visual effects in your app with RealityKit, Apple’s 3D rendering engine. RealityKit can automatically adjust to physical lighting conditions and cast shadows, open portals to a different world, build stunning visual effects, and so much more. And for authoring your materials, RealityKit has adopted MaterialX, an open standard for specifying surface and geometry shaders used by leading film, visual effects, entertainment, and gaming companies.

ARKit

On Apple Vision Pro, ARKit can fully understand a person’s surroundings, giving your apps new ways to interact with the space around them. By default, ARKit powers core system capabilities that your apps automatically benefit from when they’re in the Shared Space — but when your app moves to a Full Space and asks permission, you can take advantage of powerful ARKit APIs, like Plane Estimation, Scene Reconstruction, Image Anchoring, World Tracking, and Skeletal Hand Tracking. So splash water on a wall. Bounce a ball off the floor. Make experiences that wow people by blending the real world with your content.

Accessibility

visionOS is designed with accessibility in mind for people who want to interact with their device entirely with their eyes, voice, or a combination of both. And for people who prefer a different way to navigate content, Pointer Control lets them select their index finger, wrist, or head as an alternative pointer. You can create accessible apps for visionOS using the same techniques and tools you already use on other Apple platforms and help make Apple Vision Pro a great experience for everyone.

-

All the tools you need

-

Xcode

Development for visionOS starts with Xcode, which supports the visionOS SDK. Add a visionOS target to your existing project or build an entirely new app. Iterate on your app in Xcode Previews. Interact with your app in the all-new visionOS simulator and explore various room layouts and lighting conditions. Create tests and visualizations to explore collisions, occlusions, and scene understanding for your spatial content.

Reality Composer Pro

Discover the all-new Reality Composer Pro, designed to make it easy to preview and prepare 3D content for your visionOS apps. Available with Xcode, Reality Composer Pro can help you import and organize assets, such as 3D models, materials, and sounds. Best of all, it integrates tightly with the Xcode build process to preview and optimize your visionOS assets.

Unity

Now you can use Unity’s robust and familiar authoring tools to create new apps and games or reimagine your existing Unity-created projects for visionOS. Your apps get access to all the benefits of visionOS, like passthrough and Dynamically Foveated Rendering, in addition to familiar Unity features, like AR Foundation. By combining Unity’s authoring and simulation capabilities with RealityKit-managed app rendering, content created with Unity looks and feels at home in visionOS.

Your visionOS journey begins here

Start developing with the visionOS SDK, Xcode, the visionOS simulator, Reality Composer Pro, documentation, sample code, design guidance, and more.

Plan for visionOS

Whether you already have an app on the App Store or it’s your first time developing for Apple platforms, there’s a lot you can do to get ready for creating apps for visionOS. Discover how you can make updates to your app today and explore existing frameworks that make it even easier for you to start developing for visionOS.

Learn about visionOS

With best-in-class frameworks and tools, visionOS is the perfect platform to help you create incredible spatial experiences. Whether you’re dreaming up a game, building a media experience, designing moments of connection and collaboration with SharePlay, creating apps for business, or updating your website to support visionOS, we’ve got sessions and information to help you make your plan. Get ready for the visionOS SDK with 46 WWDC23 sessions to help you learn about developing for the platform, designing for spatial experiences, and testing and tools. Learn more about visionOS

Submit your Apple Vision Pro apps

Whether you’ve created a new visionOS app or are making your existing iPad or iPhone app available on Apple Vision Pro, here’s everything you need to know to prepare and submit your app to the App Store. Here are all you need to know.

Work with Apple

Get direct support from Apple as you develop your apps and games for visionOS. Learn about upcoming events, testing opportunities, and other programs to support you as you create incredible experiences for this platform. Learn more about working with Apple here.

Web and Cloud LLC Your reliable technology partner, and digital inclusion advocate from Miami, Florida. Web and Cloud is a technology partner with extensive expertise in consulting, software engineering, server infrastructure and services, support and management of technology projects for companies of all sizes. Let's talk about leveraging the power of innovative technology, and AI & Human collaboration to help your business or startup works smarter, move faster, and achieve greater success. *Login or create a free account at my.webandcloud.com to get started.
Web and Cloud LLC - talk to us and let's discuss your needs.
Let's help transform your business