LLM Reference

DeciLM 7B

Released
2024-01-16
Last refreshed
2026-05-19
Status
Researched 60d ago
Open sourceCommercial use: permitted

DeciLM 7B is worth evaluating for general LLM work when its provider route and context window match the workload.

Use it for

  • Teams evaluating general LLM work
  • Workloads that can use a 8k context window
  • Buyers comparing 1 tracked provider route

Do not use it for

  • Vision or document-understanding workloads
  • Strict JSON or tool-calling flows
Specifications
Family
DeciLM
Released
2024-01-16
Context
8k
Parameters
7B
Architecture
Decoder Only
Specialization
general
Openness
Open source
License
Apache 2.0OSI-approvedCommercial use: permitted
Weights
Unknown
Code
Unknown
Training
Fine-tuned
Created by

Automating neural architecture design

Tel Aviv, Israel
Founded 2019
Website
Pricing
Output / 1M
$0.670
Input / 1M
$0.520

Cheapest of 1 route · Microsoft Foundry

About

DeciLM-7B is a cutting-edge large language model developed by Deci AI, featuring 7.04 billion parameters. This model incorporates an advanced transformer decoder architecture, utilizing variable Grouped-Query Attention (GQA) to achieve high accuracy and efficiency. The architecture is fine-tuned using Deci's proprietary Neural Architecture Search technology, AutoNAC, for optimal performance. Capable of handling sequences of up to 8192 tokens, DeciLM-7B outperforms similar or larger models across various benchmarks. An instruction-tuned version, DeciLM-7B-instruct, further enhances its capabilities, especially for instruction-following tasks. It is released under the Apache 2.0 license, making it suitable for both commercial and research use.

DeciLM 7B is an open-source model in the DeciLM family. The structured metadata tracks a 8k-token context window. This page tracks provider routes through Microsoft Foundry, with the cheapest tracked route listed at $0.52 input and $0.67 output per 1M tokens. No headline benchmark score is tracked for DeciLM 7B yet.

Top use-case fit

No primary decision-task fit is mapped for this model yet.

Capabilities

No model capability flags are currently sourced.

Benchmark peer barsfor Coding

No task-mapped benchmark peers are available for this model yet.

Migration checks

No linked migration route is available for this model yet.

Frequently asked questions

What is the context window of DeciLM 7B?

DeciLM 7B has a context window of 8k tokens.

How much does DeciLM 7B cost?

DeciLM 7B is available at $0.52/1M input tokens through Microsoft Foundry.

When was DeciLM 7B released?

DeciLM 7B was released on 2024-01-16.

Which providers offer DeciLM 7B?

DeciLM 7B is available from 1 provider: Microsoft Foundry.