Security

Investigating iOS 18's AI Capabilities

In this article we discuss iOS 18’s AI capabilities, named, Apple AI - its benefits, risks, and the growing importance of data governance.

Anirban Banerjee
Dr. Anirban Banerjee is the CEO and Co-founder of Riscosity
Published on
11/7/2024
5
min.

With the release of iOS 18, Apple has continued to expand its integration of AI technologies, positioning the iPhone as a powerful personal assistant capable of smart recommendations, advanced text and image analysis, and even predictive suggestions. Leveraging on-device machine learning, iOS 18’s AI features tap into user data to provide a personalized experience. However, as AI becomes an integral part of mobile operating systems, data security and governance concerns must be addressed, especially in corporate environments. 

This article discusses the AI capabilities in iOS 18, the types of data it uses, potential data leaks, and why companies must go beyond monitoring by implementing robust governance controls for data passed to AI tools.

iOS 18’s AI-Driven Features and Functionality 

Apple’s iOS 18 offers an array of AI-based features designed to improve productivity and enhance the user experience. Some of these capabilities include:

  1. Enhanced Siri Suggestions: Siri has become much more intelligent in iOS 18, providing predictive insights based on recent searches, location, and user patterns. It can suggest actions, remind users of unfinished tasks, or even anticipate needs based on prior behavior.
  2. Smart Photo Analysis: The Photos app now includes AI-driven tools to identify people, objects, and settings, grouping photos into smart albums and automatically generating captions. Additionally, AI can suggest edits, including lighting adjustments or background effects, based on trends in photography.
  3. Proactive Text and Email Suggestions: iOS 18’s AI analyzes text exchanges to suggest email responses, meeting follow-ups, or calendar reminders based on conversation context. For business users, this feature aims to make communications smoother and faster.
  4. Customizable Privacy Settings and On-Device AI: While Apple emphasizes user privacy, iOS 18 does utilize on-device data to power many of its AI features. The goal is to keep processing local to the device, though some capabilities may require network connectivity for enhanced results or recommendations.

What Types of Data iOS 18 AI Uses

To deliver these personalized features, iOS 18 AI processes a vast amount of user data, including:

  • Location Data: AI utilizes location history to suggest relevant information based on a user’s physical location, such as reminders tied to specific places, or travel times to frequent destinations.
  • Communication Data: Conversations from Messages, Mail, and calendar events are analyzed to provide smart suggestions for responses, reminders, and task management.
  • Usage Patterns: App usage data allows the system to predict which apps may be needed at a given time, making it easier for users to access frequently used tools and features.
  • Photos and Media Data: With access to photo metadata and content, AI can recognize people, places, and objects, enabling organized photo libraries and relevant search suggestions.
  • Browsing and Search History: Web searches and browsing history are analyzed to predict and recommend content, provide faster navigation, and enhance Siri’s understanding of user preferences.

The Futility of Firewall Blocking for AI Tools

Many organizations attempt to block external AI tools like OpenAI’s ChatGPT by restricting access through firewalls. However, this strategy has become increasingly ineffective as employees can simply switch to cellular networks to access these tools outside of corporate Wi-Fi. With the upcoming iOS 18.2 update, which will support integration with external API keys for tools like OpenAI, the workaround of switching to cellular data will become even more appealing for employees who want access to these tools, especially in BYOD (Bring Your Own Device) environments.

Moreover, iOS 18’s API integration will allow employees to customize AI interactions with OpenAI, creating a scenario where firewall blocks are no longer sufficient. This shift underscores the importance of a more sophisticated approach to data governance rather than relying solely on network-based access restrictions.

Types of Data Used by AI Services and Potential Data Leaks

AI tools require substantial data input to generate accurate responses. Common data types include:

  • User Input Data: Text queries and other inputs, which often contain sensitive information, are a primary data source for AI services.
  • Contextual Metadata: Information such as IP addresses, timestamps, and locations can be used by AI services to refine responses.
  • Device and App Data: To improve personalization, some AI services also collect data about the device, apps in use, and their interactions.

Each of these data types presents a potential risk for leakage, especially in corporate settings where sensitive information, including financial details, intellectual property, and customer data, may be involved. For example, if an employee inadvertently inputs proprietary information into an AI-powered tool, that data might be stored or analyzed externally, posing a risk to the organization.

Job Roles Responsible for AI Data Governance

With iOS 18’s expanding AI capabilities, multiple roles within a company should be actively engaged in overseeing the flow of data to AI services:

  • Chief Information Security Officer (CISO): Responsible for safeguarding sensitive data and preventing leaks, the CISO must ensure that AI interactions comply with security policies.
  • Data Protection Officer (DPO): The DPO is key in ensuring compliance with privacy regulations like GDPR, which apply to data exchanged with external AI tools.
  • IT and Security Teams: These teams are responsible for enforcing security protocols and ensuring that AI interactions on corporate devices align with policy guidelines.
  • Compliance Officers: They ensure that AI tool usage conforms to regulatory standards, mitigating the risk of non-compliance fines.

Why Active Data Governance Is Essential

Simply monitoring data exchanges is insufficient in today’s AI-integrated world. Active governance through proxy mechanisms is essential to control data flow to AI tools. Proxy controls can help filter and analyze the types of data employees share, flagging potential breaches before they occur. This active governance approach allows organizations to track, restrict, and even prevent certain data from being shared with AI services, enhancing security and compliance.

With iOS 18.2, Apple’s support for external API keys—allowing users to bring their own keys for AI tools like OpenAI—will accelerate the use of these tools in both personal and professional settings. Organizations must adopt real-time monitoring and control mechanisms to ensure employees use these APIs responsibly and in compliance with security standards.

Conclusion

iOS 18’s AI capabilities mark a significant step forward in Apple’s integration of intelligent, personalized features. However, this evolution brings about new challenges in data governance and security, especially as the upcoming 18.2 update will empower users with even more flexibility to interact with external AI tools.

For companies, simply blocking access to AI services is no longer effective, and data monitoring alone is inadequate. To safeguard sensitive information, organizations must implement comprehensive governance mechanisms, proxy controls, and employee education. Proactively managing the types of data shared with AI tools will help prevent data leaks, protect intellectual property, and ensure compliance with privacy regulations.