LLM ReferenceLLM Reference

OctoML CodeLlama-70b-Instruct

octoml-codellama-70b-instruct

Open Source

About

CodeLlama 70B Instruct via OctoML

OctoML CodeLlama-70b-Instruct has a 100K-token context window.

OctoML CodeLlama-70b-Instruct input tokens at $0.4/1M, output at $0.6/1M.

Capabilities

VisionMultimodalReasoningFunction CallingTool UseStructured OutputsCode ExecutionPrompt CachingBatch APIAudioFine-tuning

Providers(1)

ProviderInput (per 1M)Output (per 1M)Type
OctoML (Deprecated)$0.4$0.6Serverless

Rankings

Specifications

Released2023-07-18
Parameters70B
Context100k
ArchitectureDecoder Only
Specializationgeneral

Created by

Large-scale open-source AI for social technologies.

Menlo Park, California, United States
Founded 2013
Website