Apple Intelligence: A New Era of Personal Computing

Apple has unveiled a groundbreaking suite of features and updates across its operating systems, collectively branded as "Apple Intelligence." This new era promises to enhance user experience through deeper integration of AI, improved system responsiveness, and more intuitive interactions with devices.

Mac OS Golden Gate: A Refined Visual Experience

The next iteration of Mac OS, codenamed "Golden Gate," introduces significant visual refinements. Liquid Glass, the system's foundational transparency effect, has been retuned to diffuse complex content more effectively, creating greater depth and separation. A new slider in settings allows users to adjust Liquid Glass from ultra-clear to fully tinted.

Key visual enhancements include:

• Uniform Toolbars: A more consistent toolbar design across all applications.
• Expanded Sidebars: Sidebars now extend to the window edges, reducing distractions and enhancing the feeling of expansiveness. Sidebar icons regain their color for easier identification.
• Consistent Corner Radii: All windows now feature a tighter corner radius for improved visual consistency across applications.
• Enhanced App Icons: App icons integrate additional layers of Liquid Glass, adding character and making them appear sharper and more defined.

Performance and Responsiveness Boost

Apple Intelligence focuses on optimizing system performance, leading to noticeable improvements in responsiveness:

• Faster App Launches: iPhone and iPad apps launch up to 30% faster.
• Quicker Photo Loading: New photos appear in the library up to 70% faster.
• Accelerated AirDrop Transfers: File transfers via AirDrop are up to 80% faster.
• Expedited File Browsing: Transferring files from iPad to external drives is up to five times faster, matching Mac Finder speeds.
• CPUuler Optimization: A key system component, the CPUuler, has been optimized to manage CPU resources more efficiently, bringing improved responsiveness to older iPhones, including the iPhone 11. iOS 27 will be supported on iPhone 11 and all models that supported iOS 26.

Seamless Connectivity and Communication

Network transitions are now more seamless, allowing iPhones to transition smoothly between cellular and Wi-Fi networks. In low-bandwidth situations, sending large photos or videos in Messages will no longer slow down the conversation. A new send indicator provides clarity on message delivery status.

Reimagined Search and Photos

The foundation of search across iOS, iPad OS, and Mac OS has been rebuilt. This new infrastructure powers Spotlight, Photos, and Mail, utilizing a rich search index to understand and locate content more effectively.

• Enhanced Mail Search: A new ranking system surfaces more relevant results in Mail's top hits.
• Collaborative Shared Albums: iCloud Shared Albums now support contributions from friends on Android and Windows devices, allowing full resolution sharing.

Health and Personalization Features

• Cycle Tracking Expansion: The Health app's cycle tracking now includes support for perimenopause and menopause, with notifications for suggestive patterns, symptom logging, and educational information.
• Custom AirPods EQ: Users can now personalize how their AirPods sound with custom EQ settings.
• Spatial Panoramas: Apple Vision Pro users can transform panoramas into spatial scenes with depth and realism, usable as environments.
• Enhanced Flyover in Maps: Maps' Flyover feature receives a significant boost, rendering aerial imagery with stunning detail using vision intelligence models.

Trust and Safety for Families

New features enhance parental controls and child safety:

• Content Focus: Parents can curate content access for children, starting with essential apps and gradually adding more.
• Ask to Browse: Children must ask permission to view new websites, with parents able to review and approve. This functionality extends across iPhone, iPad, and Mac.
• Controlled Communication: Parents can restrict who their children can connect with, starting with immediate family and expanding as needed.
• Enhanced Communication Safety: The system now warns children and blurs content containing nudity in images and videos, extending to live FaceTime calls. It also intervenes before children can see gore or violent content in shared media.
• Time Allowances: Screen Time introduces time allowances for entertainment, games, and social media, with daily recommendations and easy scheduling adjustments.

Apple Intelligence: The Core of the New Experience

Apple Intelligence represents a deep collaboration with Google, leveraging their Gemini family of models to create Apple's next generation of foundation models. These models are optimized for both on-device and private cloud compute.

Key capabilities include:

• On-Device Processing: A powerful on-device model understands and generates speech, text, and images, delivering high accuracy for systemwide dictation and natural language understanding.
• Systemwide Integration: Apple Intelligence is deeply integrated into platforms, coordinated by a new system orchestrator.
• Personal Context Understanding: Utilizes Spotlight's semantic index and broad world knowledge to surface relevant information and provide up-to-date answers.
• App Actions: Leverages app toolboxes to complete requests, such as drafting an email.
• Onscreen Awareness: Tailors assistance based on the app and current activity.
• Privacy: Emphasizes on-device processing and private cloud compute, ensuring data is not stored or accessible by Apple.

Siri AI: A Profoundly More Capable Assistant

Siri has been reimagined as "Siri AI," offering enhanced capabilities, conversational fluency, and engaging answers.

• Conversational Interaction: Users can engage in back-and-forth conversations with Siri, receiving detailed responses.
• World Knowledge Integration: Siri draws on current world knowledge for contextually relevant answers.
• Personal Context Awareness: Siri can access personal information, such as addresses from messages, to fulfill requests.
• Photo Management: Siri can search and organize photos based on specific criteria and add them to shared albums.
• Expressive Voices: A new voice experience offers more expressive and customizable Siri voices, with adjustable expressivity and pace.
• Systemwide Dictation: Dictation accuracy is significantly improved, with better spelling, punctuation, and capitalization, integrated directly into the keyboard.
• CarPlay and AirPods Integration: Siri AI extends to CarPlay and AirPods, enabling complex requests and creative brainstorming.
• Dynamic Island Integration (iOS): Swipe down from the Dynamic Island to search or initiate a conversation with Siri.
• Conversational Experience: A new conversational interface provides more information and can even include images in responses.
• Mac OS Integration: Siri is integrated into Spotlight, allowing context-aware interactions via control-click menus.
• Cross-Device Continuity: Conversations can be started on iPhone, continued on iPad, and finished on Mac via the Siri app.
• Watch OS and Vision OS Support: Siri AI is tailored for watch OS for wrist-based actions and offers a 3D visualization on Vision OS, with hands-free activation by looking at Siri.
• Camera Integration (iPhone): A new Siri mode in the camera app allows for visual analysis of food for nutritional insights or bills for tab splitting.
• Visual Intelligence (Mac OS & Vision OS): Access visual intelligence via a keyboard shortcut on Mac or by looking at objects in Vision OS to get helpful answers and suggested actions.
• Writing Tools: Siri AI assists with drafting documents, reflecting personal communication styles, and providing feedback on writing.
• Automatic Proofreading: Systemwide automatic proofreading is available in most third-party apps.
• Language Support: Siri AI will initially be available in English, with expansion to more languages planned.

Enhanced Safari and Productivity Tools

• Tab Organization: Safari uses Apple Intelligence to organize tabs into topics, making navigation easier.
• Notify Me: Safari can monitor pages on behalf of users, notifying them of changes.
• Describe an Extension: Users can describe desired functionality in natural language to create custom Safari extensions.
• Password Updates: Eligible accounts can be automatically updated to strong passwords with a tap, with Passwords app agentically handling the process.
• Messages and Mail Suggestions: One-tap suggestions in Messages and Mail make it easier to create reminders, notes, and take action with favorite apps.
• Calendar Integration: Events can be added to the Calendar by describing them in natural language.
• Phone App Context: Call context proactively surfaces relevant information from apps, such as confirmation codes for airline bookings.
• Home App Analysis: The Home app analyzes camera clips to generate descriptions and pull up relevant footage from multiple cameras.
• Shortcuts Automation: Users can describe desired shortcuts in natural language, and Shortcuts will create the necessary automations.

Advanced Image Editing Tools

• Image Playground: Create high-quality images in various styles, including photorealistic, and transform existing photos into new styles through natural language descriptions. Users can edit objects within images by circling them and describing changes.
• Cleanup Tool: The cleanup tool offers improved quality and more realistic infill for removing distractions.
• Extend Tool: Expand images to create more space around subjects or achieve different aspect ratios.
• Spatial Reframing: Fix composition issues after a photo has been taken, adjusting framing and perspective as if the camera had been repositioned.

These new features will be available for free with the latest software releases, with some features, like image generation, having daily usage limits that can be increased with iCloud Plus subscriptions. Siri AI will not be initially available in the EU on iOS and iPad OS due to ongoing regulatory discussions. Siri AI and other Apple Intelligence features will also not be available in China while regulatory requirements are addressed.

New OS releases will be available as developer betas today, with a public beta next month, and general availability this fall.