llmreference
RHEL AI

Using Granite 8B Code on RHEL AI

Implementation guide · Granite Code · IBM Research

Serverless

Quick Start

  1. 1
    Create an account at RHEL AI and generate an API key.
  2. 2
    Use the RHEL AI SDK or REST API to call granite-8b-code — see the documentation for request format.

Code Examples

See RHEL AI documentation for integration details.

About RHEL AI

Red Hat OpenShift AI is a comprehensive platform designed for developing, deploying, and managing AI and machine learning workloads across hybrid cloud environments. It integrates essential tools like TensorFlow, PyTorch, and Jupyter, enabling seamless collaboration between data scientists and developers. The platform facilitates rapid model development, operationalizes AI/ML models using Kubernetes, and supports both small-scale experiments and large-scale production models. With advanced security measures and a cloud-native architecture, it offers flexible deployment options as either a managed service or self-managed software. A standout feature of Red Hat OpenShift AI is its support for retrieval-augmented generation (RAG), allowing users to derive AI insights from their own reference documents. The platform enhances model serving with multi-model server capabilities and distributed workloads, utilizing technologies such as KServe and Ray for efficient data processing. It emphasizes community-driven innovation through open-source principles, enabling enterprises to modernize their applications and infrastructure, and ultimately drive productivity and competitive advantage in the AI landscape.

Red Hat, a subsidiary of IBM since 2019, is a pioneering technology company that has been at the forefront of open-source software development since its founding in 1993. Known for its commitment to innovation and collaboration, Red Hat has established itself as a leader in providing enterprise-level solutions that leverage the power of open-source communities. The company's portfolio extends beyond traditional software offerings, encompassing a range of products and services that enable organizations to navigate the complexities of modern IT environments, including cloud computing and artificial intelligence. At its core, Red Hat is dedicated to connecting enterprises with cutting-edge open-source technologies, fostering a culture of transparency and meritocracy. The company's influence spans various aspects of the software stack, from operating systems and middleware to advanced cloud solutions. Red Hat's emphasis on hybrid cloud infrastructure and container technologies has positioned it as a key player in the digital transformation landscape, offering businesses the tools they need to enhance agility, efficiency, and innovation in an increasingly complex technological ecosystem.

Pricing on RHEL AI

Capabilities

No model capability flags are currently sourced.

About Granite 8B Code

Granite 8B Code is IBM Research's Granite Code model. It is deprecated (originally released 2024-05-06); use it only for reproducing earlier results or evaluating drift over time.

Model Specs

Released2024-05-06
Parameters8B
Context8K
ArchitectureDecoder Only

Provider

RHEL AI
RHEL AI

Red Hat

Raleigh, North Carolina, United States