LLM ReferenceLLM Reference
IBM watsonx

Using Mixtral 8x7B Instruct v0.1 on IBM watsonx

Implementation guide · Mixtral · MistralAI

ServerlessOpen Source

Quick Start

  1. 1
    Create an account at IBM watsonx and generate an API key.
  2. 2
    Use the IBM watsonx SDK or REST API to call mixtral-8x7b-instruct-v0.1 — see the documentation for request format.
  3. 3
    You'll be billed $0.18/1M input, $0.18/1M output tokens. See full pricing.

Code Examples

See IBM watsonx documentation for integration details.

About IBM watsonx

The IBM watsonx AI platform is a comprehensive solution that integrates generative AI capabilities with traditional machine learning. It offers users access to a wide range of foundation models, including both IBM-developed and third-party options. The platform features a user-friendly studio for model building, a robust data management system based on an open lakehouse architecture, and governance tools to ensure compliance and ethical AI practices. Watsonx supports hybrid cloud deployments, enabling seamless integration of AI workloads into existing infrastructures, which enhances operational efficiency and scalability. This AI platform empowers organizations to leverage artificial intelligence for data-driven decision-making and innovation across multiple sectors, including healthcare, finance, and customer service. It offers advanced analytics, natural language processing, and automated workflows, aiding in tasks such as predictive analytics, content generation, and customer engagement. By streamlining processes and providing actionable insights, the platform helps businesses improve productivity and gain a competitive advantage, making it a crucial tool for those looking to harness the full potential of AI in their operations.

IBM offers a comprehensive AI platform that includes IBM watsonx, a next-generation enterprise AI and data platform. The platform integrates various AI technologies and services, including natural language processing, machine learning, and data analytics. IBM's AI solutions are designed to help businesses across industries leverage artificial intelligence for improved decision-making, automation, and innovation. The company's focus on AI extends to areas such as cloud computing, quantum computing, and industry-specific applications, making it a leader in enterprise AI solutions.

Pricing on IBM watsonx

TypePrice (per 1M)
Input tokens$0.18
Output tokens$0.18

Capabilities

VisionMultimodalReasoningFunction CallingTool UseStructured OutputsCode Execution

About Mixtral 8x7B Instruct v0.1

Mixtral 8x7B Instruct v0.1 via AWS Bedrock

Model Specs

Released2023-12-10
Parameters56B
Context33K
ArchitectureDecoder Only
Knowledge cutoff2023-12

Provider

IBM watsonx
IBM watsonx

IBM

Armonk, New York, United States