Apple On-Device
About
Apple's on-device large language AI model is an integral part of its Apple Intelligence system, featuring approximately 3 billion parameters tailored for efficient use on Apple devices 13. Built on a transformer architecture, it includes optimizations like grouped-query attention and quantization to enhance speed and lower memory usage 1. This model excels in tasks such as text summarization, writing assistance, and responding to user prompts, though its size limits the complexity it can handle compared to larger server models 13. Designed for deployment on A17 Pro chip devices (iPhone 15 Pro and Pro Max) and M-series Macs, it leverages LoRA adapters for task-specific fine-tuning, optimizing flexibility without maintaining multiple full model copies 5. Apple prioritizes responsible AI use, emphasizing human feedback and safety in its development process 1.