LLM Reference

Phi-3 Mini 4k

About

The Phi-3 Mini-4K-Instruct model by Microsoft is an advanced, lightweight language model boasting 3.8 billion parameters, optimized for environments with limited computational resources. It excels in various natural language processing tasks, especially in reasoning, text generation, and maintaining multi-turn conversations. Trained on a mix of synthetic and high-quality data, the model is tailored for effective instruction-following. Despite its capabilities, it has limitations in factual knowledge and multilingual support, often requiring external resources to enhance accuracy. The model is ideal for commercial and research applications that demand efficient processing, such as mobile apps and real-time systems.

Capabilities

VisionMultimodalReasoningFunction CallingTool UseJSON ModeCode Execution

Providers(4)

Compare all →
ProviderInput (per 1M)Output (per 1M)Type
Azure OpenAI$0.28$0.84ServerlessProvisioned
NVIDIA NIMProvisioned
Baseten APIServerless
Replicate API$0.05$0.25Serverless

Benchmark Scores(4)

BenchmarkScoreVersionSource
Google-Proof Q&A40.9diamondOpen LLM Leaderboard
HellaSwag87.110-shotOpen LLM Leaderboard
HumanEval59.8pass@1Open LLM Leaderboard
Massive Multitask Language Understanding68.25-shotOpen LLM Leaderboard

Rankings

Specifications

FamilyPhi-3
Released2024-04-23
Parameters3.8B
Context4K
ArchitectureDecoder Only
Specializationgeneral
Trainingfinetuning

Created by

Advancing the state-of-the-art in AI and computing.

Redmond, Washington, United States
Founded 1991
Website