LLM ReferenceLLM Reference

OctoML Llama-2-70b-chat

octoml-llama-2-70b-chat

Open Source

About

Llama 2 70B Chat via OctoML

OctoML Llama-2-70b-chat has a 4K-token context window.

OctoML Llama-2-70b-chat input tokens at $0.4/1M, output at $0.6/1M.

Capabilities

VisionMultimodalReasoningFunction CallingTool UseStructured OutputsCode ExecutionPrompt CachingBatch APIAudioFine-tuning

Providers(1)

ProviderInput (per 1M)Output (per 1M)Type
OctoML (Deprecated)$0.4$0.6Serverless

Rankings

Specifications

FamilyLlama 2
Released2023-07-18
Parameters70B
Context4K
ArchitectureDecoder Only
Specializationgeneral

Created by

Large-scale open-source AI for social technologies.

Menlo Park, California, United States
Founded 2013
Website