What is DeciLM used for?

DeciLM is used for coding. The family description and listed model capabilities point to those workloads as the best fit.

How does DeciLM compare to DeciCoder?

DeciLM by Deci AI is strongest where you need coding, while DeciCoder by Deci AI is the closest related family to check for coding. DeciLM has 2 listed variants and reaches up to 8k context, while DeciCoder reaches up to 4k context, so compare the specs and pricing tables before choosing a production model.

Which DeciLM model should I use?

DeciLM 7B is both the lowest listed input-price option at $0.52/1M input tokens through Microsoft Foundry and the strongest local starting point with 8k context. Use the provider table if latency, deployment type, or output-token pricing matters more than input price.

DeciLM Models by Deci AI

Deci AI

2 models2024Up to 8k ctxFrom $0.52/1M input

About

The DeciLM family of large language models, developed by Deci, specializes in AI-driven innovations for enhancing AI capabilities. These models are particularly renowned for their efficiency and accuracy, especially in the 6 and 7 billion parameter range 1512. The DeciLM-7B model is a prime example, excelling in speed and accuracy, even outperforming some models with greater parameters 25. Utilizing Deci’s AutoNAC technology and Grouped-Query Attention, these models are optimized for precision and computational efficiency 18. The availability of an "instruct" iteration, DeciLM-7B-instruct, further enhances instruction handling 3. Under the Apache 2.0 license, the DeciLM models are accessible for diverse applications, benefiting from the speed enhancements offered by the Infery-LLM inference engine 2.

Current Variants

Use-when guidance is derived from seed capabilities, context, release, and replacement fields.

2 in view

DeciLM 7BCurrent

Use when the workload needs 8k context and 7B parameters.

2024-018k context7B parameters

DeciLM 6BCurrent

Use when the workload needs 4k context and 6B parameters.

2024-014k context6B parameters

Current DeciLM variants with use-when guidance and lifecycle status
Model	Use when	Released	Signals	Status
DeciLM 7B	Use when the workload needs 8k context and 7B parameters.	2024-01	8k context7B parameters	Current
DeciLM 6B	Use when the workload needs 4k context and 6B parameters.	2024-01	4k context6B parameters	Current

Release Timeline

1 release group

2024-01

2 current

DeciLM 6B

4k context6B parameters

Current

DeciLM 7B

8k context7B parameters

Current

Specifications(2 models)

DeciLM model specifications comparison
Model	Released	Context	Parameters
DeciLM 7B	2024-01	8k	7B
DeciLM 6B	2024-01	4k	6B

Available From(1 provider)

Microsoft Foundry

Pricing

DeciLM model pricing by provider
Model	Provider	Input / 1M	Output / 1M	Type
DeciLM 7B	Microsoft Foundry	$0.52	$0.67	Provisioned

Frequently Asked Questions

What is DeciLM used for?: DeciLM is used for coding. The family description and listed model capabilities point to those workloads as the best fit.
How does DeciLM compare to DeciCoder?: DeciLM by Deci AI is strongest where you need coding, while DeciCoder by Deci AI is the closest related family to check for coding. DeciLM has 2 listed variants and reaches up to 8k context, while DeciCoder reaches up to 4k context, so compare the specs and pricing tables before choosing a production model.
Which DeciLM model should I use?: For the lowest listed input price, start with DeciLM 7B through Microsoft Foundry at $0.52/1M input tokens. For the most capable/latest local choice, evaluate DeciLM 7B with 8k context.