IFang Lee2 min

Swiftly Highlights: Vision Pro Impact, New AI Tools & Apple’s CTF Overhaul

EngineeringMay 23, 2024



May 23, 2024

IFang LeeiOS Engineer

Share this article

It’s a new month and we're excited to keep you updated on the latest highlights, innovations and trends in the ever-changing Apple world. There's a lot happening right now, so let’s dive right in.

Apple Distribution

Apple has updated its Core Technology Fee (CTF) rules for developers in response to criticism and regulatory scrutiny in the EU. Key changes include exempting free app developers entirely and giving small developers three years to adapt. These tweaks aim to support non-commercial and smaller developers, especially those who unexpectedly gain popularity, surpassing download thresholds. These changes will soon extend to iPadOS, aligning with Apple's EU compliance efforts.

Starting May 1, 2024, Apple requires developers to clearly outline their use of specific sensitive APIs, known as 'required reason APIs,' in privacy manifest files during App Store submissions. This helps users understand how apps and third-party SDKs use their data. Apps without this info risk rejection, showing Apple's dedication to privacy and transparency. Van der Lee offers a guide on understanding, creating and managing these manifest files for app developers. 


Apple is expected to reveal an on-device large language model (LLM) at WWDC, making it easier for developers to add AI features to their apps using the upcoming iOS SDK. While waiting for Apple's own AI models, developers can utilize SDKs from OpenAI and Google's Gemini (formerly Bard) to embed AI into their mobile apps. 

Simon Ng's tutorial efficiently walks developers through integrating Google's Gemini AI into SwiftUI apps. It showcases using the gemini-pro model for text input and the gemini-pro-vision model for both text and image inputs. With sample code provided, developers can customize and experiment, offering users a rich AI-driven experience powered by Gemini's powerful Generative AI capabilities.

Apple Vision Pro

Apple Vision Pro seeks to transform business productivity with spatial computing. Trusted by Fortune 500 companies, it merges digital content with the physical world,  creating flexible workspaces using apps like SAP Analytics Cloud and Microsoft 365. 

The device’s 23 million-pixel display delivers over 4K resolution per eye for exceptional clarity. Its 3D visualization enhances product design, retail planning and construction modeling. NVIDIA Omniverse Cloud APIs enable developers to stream extensive 3D engineering data to Vision Pro, allowing real-time manipulation of immersive designs.

KLM Royal Dutch Airlines leverages the Engine Shop app to overlay repair instructions, enhancing technician training and aircraft maintenance efficiency. Resolve's 3D models enable engineers and architects to access system data behind walls, streamlining construction workflows.

Apple equips developers with APIs and the Enterprise Spatial Design Lab, while Deloitte's Academy for Apple Vision Pro trains professionals to harness spatial computing. Take a closer look at the details.

Apple News

The countdown has begun: WWDC season is almost here! From June 10 to 14, the Worldwide Developers Conference will be live online, offering the chance to explore the latest cutting-edge tools, frameworks and technologies to build your best apps and games. For the first time, WWDC sessions will be available on YouTube, alongside the Apple Developer app and website. Visit the Apple Developer channel to subscribe and catch up on select sessions.

Do you know a student or aspiring developer excited to start coding? Check out the new Develop in Swift Tutorials for a practical introduction to Swift, SwiftUI and spatial computing by building projects in Xcode.

That wraps up this edition of Swiftly Highlights. I hope you found it both insightful and fun. Until next time!

Share this article

Sign up to our newsletter

Monthly updates, real stuff, our views. No BS.