LLM ReferenceLLM Reference
NVIDIA NIM

SOLAR 10.7B on NVIDIA NIM

Solar Mini · Upstage

Provisioned

Last refreshed 2026-05-01. Next refresh: weekly.

Why use SOLAR 10.7B on NVIDIA NIM?

NVIDIA NIM offers SOLAR 10.7B with competitive pricing. NVIDIA NIM is NVIDIA's deployment platform for GPU-accelerated inference microservices.

Compare SOLAR 10.7B across 5 providers to find the best fit for your use case
Input / 1M
-
Output / 1M
-
Cache
Not sourced
Batch
Not sourced

Setup recipe

Docs fallback
Install
Use the provider REST API or SDK
Auth
Create a provider API key
Call
model: solar-10.7b
Model ID
solar-10.7b

Request example

Curated snippets for this provider are not sourced yet. Use NVIDIA NIM documentation with model ID solar-10.7b.

Gotchas

No curated gotchas have been sourced for this exact provider/model route yet.

Compare SOLAR 10.7B Across Providers

ProviderInput (per 1M)Output (per 1M)
NVIDIA NIM
Together AI$0.30$0.30
Upstage Console$0.30$0.30
Microsoft Foundry$0.52$0.67
Fireworks AI$0.20$0.20

Pricing

TypeRate
GPU Hour Rate$1.00/GPU·hr
GPU Config1xH100

Capabilities

Structured Outputs

About SOLAR 10.7B

SOLAR 10.7B is a robust large language model created by Upstage AI in South Korea, featuring 10.7 billion parameters. It is tailored for high efficiency and performance through its innovative "Depth Up-Scaling" (DUS) approach, which deepens the model's layers rather than widening them, allowing for enhanced capabilities without significantly increasing computational costs. This method distinguishes it from other models that utilize more complex techniques like Mixture of Experts. By integrating pre-trained weights from the Mistral 7B model with the Llama 2 framework, SOLAR 10.7B achieves notable performance, outpacing even some models with up to 30 billion parameters. Available under the Apache 2.0 license, it also includes a finely-tuned instruction-based variant under CC-BY-NC-4.0, optimized for single-turn conversations and diverse NLP tasks, albeit with limitations in handling multi-turn dialogue and complex context. The model is grounded in the transformer architecture, widely adopted in advanced language models.

FAQ

How does NVIDIA NIM compare to other SOLAR 10.7B providers?

SOLAR 10.7B is available from 5 providers. The cheapest input pricing is $0.2/1M tokens from Fireworks AI.

Who created SOLAR 10.7B?

SOLAR 10.7B was created by Upstage as part of the Solar Mini model family.

Is SOLAR 10.7B open source?

SOLAR 10.7B's open source status is unknown in the seed data.

Get Started

Model Specs

Released2024-06-24
Parameters10.7B
ArchitectureDecoder Only