LLM Reference

OctoML Llama-2-70b-chat

Open Source

About

Llama 2 70B Chat via OctoML

Capabilities

MultimodalFunction CallingTool UseJSON Mode

Providers(1)

ProviderInput (per 1M)Output (per 1M)Type
OctoML$0.4$0.6Serverless

Specifications

FamilyLlama 2
Parameters70000000000
Context4096
ArchitectureDecoder Only
Specializationgeneral