llmreference
Scale AI GenAI Platform

Using MPT 7B on Scale AI GenAI Platform

Implementation guide · MPT · Databricks Mosaic

Serverless

Quick Start

  1. 1
    Create an account at Scale AI GenAI Platform and generate an API key.
  2. 2
    Use the Scale AI GenAI Platform SDK or REST API to call mpt-7b — see the documentation for request format.

Code Examples

See Scale AI GenAI Platform documentation for integration details.

About Scale AI GenAI Platform

The Scale GenAI Platform is a comprehensive solution for developing, testing, and deploying customized Generative AI applications across various industries. At its core, the platform features the Scale Data Engine, which allows organizations to connect and transform data from popular sources, creating high-quality training datasets tailored to specific use cases. The platform supports advanced retrieval-augmented generation (RAG) pipelines, optimizing the performance of large language models (LLMs) and generative models. It offers flexibility in model selection, supporting both closed-source models like OpenAI's GPT-4 and open-source alternatives such as Meta's Llama 2, enabling enterprises to choose the most suitable foundation models for their needs. Beyond data management, the Scale GenAI Platform provides a suite of applications to enhance operational efficiency and decision-making. Users can develop custom tools like knowledge base summarizers and customer support chatbots, improving employee productivity and customer engagement. The platform includes comprehensive testing and evaluation tools, ensuring model performance and safety through human-in-the-loop monitoring. With secure deployment options in private cloud environments and a focus on responsible AI practices, the Scale GenAI Platform empowers enterprises to effectively leverage generative AI technology while maintaining control over their data and models.

Scale AI's Generative AI Platform is designed to leverage enterprise data to customize powerful base generative models, enabling organizations to safely unlock the value of AI. The platform consists of two main components: 1. The Scale Data Engine: Provides comprehensive tools and features for collecting, curating, and annotating high-quality data. It also includes robust tools for evaluating and optimizing models. 2. Advanced LLM and Generative Model Support: Scale powers some of the most advanced large language models (LLMs) and generative models globally through world-class techniques such as: - Reinforcement Learning from Human Feedback (RLHF) - Data generation - Model evaluation - Safety measures - AI alignment The platform is trusted by leading technology companies (e.g., Microsoft, Meta), enterprises (e.g., Fox, Accenture), dedicated Generative AI companies (e.g., OpenAI, Cohere), U.S. Government Agencies (e.g., U.S. Army, U.S. Air Force), and innovative startups (e.g., Brex, OpenSea). Scale AI's mission is to accelerate the development of AI applications by providing the highest quality training data for various AI applications, including self-driving cars, mapping, AR/VR, robotics, and more.

Pricing on Scale AI GenAI Platform

Capabilities

No model capability flags are currently sourced.

About MPT 7B

MPT 7B is Databricks Mosaic's MPT model. Its knowledge cutoff is 2023.

Model Specs

Released2023-03-16
Parameters7B
Context2K
ArchitectureDecoder Only
Knowledge cutoff2023

Provider

Scale AI GenAI Platform
Scale AI GenAI Platform

Scale AI

San Francisco, California, United States