LLM Reference

Apple On-Device

About

Apple's on-device large language AI model is an integral part of its Apple Intelligence system, featuring approximately 3 billion parameters tailored for efficient use on Apple devices 13. Built on a transformer architecture, it includes optimizations like grouped-query attention and quantization to enhance speed and lower memory usage 1. This model excels in tasks such as text summarization, writing assistance, and responding to user prompts, though its size limits the complexity it can handle compared to larger server models 13. Designed for deployment on A17 Pro chip devices (iPhone 15 Pro and Pro Max) and M-series Macs, it leverages LoRA adapters for task-specific fine-tuning, optimizing flexibility without maintaining multiple full model copies 5. Apple prioritizes responsible AI use, emphasizing human feedback and safety in its development process 1.

Capabilities

MultimodalFunction CallingTool UseJSON Mode

Specifications

Released2024-06-11
Parameters3B
ArchitectureDecoder Only
Specializationgeneral