LLM Reference
Databricks Foundation Model Serving

Models on Databricks Foundation Model Serving

13 models available · Databricks

ModelInput (per 1M)Output (per 1M)Context
Llama 2 70B Chat$0.5$1.54K
Mixtral 8x7B$0.5$132K
MPT 7B$0.5$0.5
DBRX Instruct$0.75$2.2532K
Llama 2 13B Chat$0.95$0.954K
Llama 3 70B Instruct$1$38K
MPT 30B$1$1
DBRX32K
DeepSeek R1128K
Llama 3 8B Instruct8K
Llama 3.1 405B Instruct128K
Llama 3.1 70B Instruct128K
Llama 3.1 8B Instruct128K

Pricing Overview

Cheapest$0.50/1M
Most expensive$1.00/1M

About Databricks Foundation Model Serving

Databricks offers a comprehensive AI platform that integrates a lakehouse model, combining the flexibility of data lakes with the management capabilities of data warehouses. The platform features a natural language interface for conversational data querying, automated infrastructure management for optimized performance, and robust governance tools ensuring data privacy and compliance. It supports a wide range of functionalities including data engineering, real-time streaming, and a marketplace for data sharing, while enabling seamless collaboration among data scientists, engineers, and DevOps teams . The platform's capabilities extend to advanced machine learning operations (MLOps), facilitating the entire lifecycle of AI model development. It includes built-in support for popular libraries like TensorFlow and PyTorch, tools for monitoring data quality and model performance, and automated workflows for building production-ready ETL pipelines. The platform also integrates with large language models (LLMs) for generative AI applications, emphasizing cost efficiency and ease of use. This comprehensive suite of tools empowers organizations to effectively leverage AI while maintaining control over their data and models .

Full provider profile →