LLM Reference
Concepts & capability filters
Capability filtercapabilityintermediate

Fine-tuning

Fine-tuning is the process of further training a pretrained model on targeted datasets to specialize it for specific tasks or behaviors, adjusting weights minimally.

Category
capability
Difficulty
intermediate
Aliases
fine tune, custom training
Last reviewed
2026-05-15

14

matching active models

8

tracked providers

4

models with routes

model.fineTuning

Key facts

  • It leverages transfer learning for customization without full retraining, creating instruct/chat variants from base models and boosting capabilities.

Models With Fine-tuning

Sorted by decision relevance, with tracked capability and provider-route evidence.

14 matches
Cosmos 3 Nano Policy DROID

Cosmos 3 Nano Policy DROID is a 16B-parameter robotics policy model fine-tuned from Cosmos 3 Nano on the DROID dataset. Given natural language instructions and visual observations from a robot camera (image or video), it generates robot action trajectories (JSON 1D list) for manipulation and control tasks. Compatible with multiple robot embodiments including Franka Panda (single/dual), UR, Google robot, WidowX 250, UMI, and Agibot. Supports 16-400 frame action sequences in various DoF configurations (9D-57D). Intended as a reference implementation for post-training Cosmos 3 Nano on specific robot platforms. The action output modality is represented in prose because the current model schema only has text, vision, video, audio, and related capability flags.

2026-05-31

Researched 112d ago

4k

4,000 tokens

VisionMultimodalJSONFine-tune

No tracked provider route

Cosmos 3 Super Image2Video

Cosmos 3 Super Image2Video is a 64B-parameter fine-tuned variant of Cosmos 3 Super specialized for temporally coherent image-to-video generation. Takes a single image (jpg/png/webp at 256p-720p) plus an optional text prompt (up to 4096 tokens) and outputs MP4 video with 5-400 frames (default 189) at up to 720p, with optional muxed AAC stereo audio at 48kHz. Ranked #1 on Artificial Analysis image-to-video leaderboard (open models). Available via Hugging Face Diffusers and vLLM-Omni.

2026-05-31

Researched 112d ago

4k

4,000 tokens

VisionMultimodalAudioFine-tune

No tracked provider route

Cosmos 3 Super Text2Image

Cosmos 3 Super Text2Image is a 64B-parameter fine-tuned variant of Cosmos 3 Super specialized for high-fidelity text-to-image generation. Takes text prompts up to 4096 tokens and outputs JPEG images at 256p, 480p, or 720p in aspect ratios 16:9, 4:3, 1:1, 3:4, or 9:16. Ranked #1 on Artificial Analysis text-to-image leaderboard (open models). Available via Hugging Face Diffusers (DiffusionPipeline) and vLLM-Omni.

2026-05-31

Researched 112d ago

4k

4,000 tokens

MultimodalFine-tune

No tracked provider route

GPT-4o

OpenAI GPT-4o: Flagship multimodal model with vision, function calling, and broad capability. $2.50/M input, $10/M output.

2024-05-13

Researched 134d ago

128k

128,000 tokens

128k contextVisionMultimodalTool useFunctionsJSON
OpenAI API

$2.50 in / $10.00 out / 1M tokens

5 routes · 1 batch · 2 cache

Provider docs
GPT-4o-mini

OpenAI: GPT-4o-mini available via OpenRouter. Pricing: $0.15/1M input, $0.6/1M output.

2024-07-18

Researched 134d ago

128k

128,000 tokens

128k contextJSONPrompt cacheBatchFine-tune
OpenAI API

$0.150 in / $0.600 out / 1M tokens

4 routes · 2 cache

Provider docs
Inkling

Inkling is Thinking Machines Lab's Apache-2.0 open-weight general-purpose multimodal model. It accepts text, image, and audio inputs and generates text with a 1M-token context window. Compare it for Coding, RAG, Agents, Long context, Vision, and JSON / Tool use.

2026-07-15

Researched 68d ago

1m

1,000,000 tokens

1m contextReasoningVisionMultimodalAudioTool use
Baseten API

$1.00 in / $4.05 out / 1M tokens

3 routes · 3 cache

Provider docs
Hunyuan Hy4 Preview

Tencent Hunyuan Hy4 preview is a Mixture-of-Experts flagship language model released and open-sourced August 28, 2026. First-party Tencent release: 770B total parameters with 49B activated per token, context window exceeding 1M tokens, aimed at coding, office productivity, game development, and scientific research. Hugging Face model card (tencent/Hy4-preview) documents a 78-layer MoE backbone (256 routed experts, top-8 plus 1 shared expert), Gated DeepSeek Sparse Attention with IndexCache, iHC residual streams, native MTP speculative decoding, Apache License 2.0 weights (also Hy4-preview-FP8), and OpenAI-compatible serving via vLLM/SGLang with tool-call and reasoning parsers. Public access: Hugging Face/ModelScope/GitCode/CNB weights; API via Tencent Cloud TokenHub and OpenRouter (model id tencent/hy4-preview); also WorkBuddy, CodeBuddy, Yuanbao, and ima. Official API list pricing USD 0.834 / 2.501 per 1M input/output tokens and USD 0.042 per 1M cache hits. Sibling of seeded hy3-preview under family hunyuan. Compare it for Agents and Coding.

2026-08-28

Researched 21d ago

1.05m

1,048,576 tokens

1.05m contextReasoningTool useFunctionsPrompt cacheFine-tune
OpenRouter

$0.834 in / $2.50 out / 1M tokens

2 routes · 2 cache

Provider docs
Needle 3

Needle 3 is Cactus Compute's sliceable automation foundation model for tiny devices, announced 2026-09-17 (MCP-verified @cactuscompute tip 2100685924401295764 + first-party /needle). One set of weights; every depth from 2 to 20 layers is its own deployable model (intelligence ladder). Params ~25–121M at CQ2-bit (2L ~25M, 4L ~29M, 8L ~52M, 16L ~98M, 20L ~121M / config total_parameters 121021910); footprint 8–29MB (.cact; full 20L ~29MB). Positioning: does not chat — every turn is tool calling or schema extraction (structured JSON); also returns text embeddings. First-party claims it can match DeepSeek V4 Flash (esp. after fine-tune from 4L up on downstream tools) and beat much larger models on mobile tool calls / match 2–3× larger on extraction — comparative claim only; no modelBenchmark rows invented from that. Trained on 360B tokens of proprietary structured data. Context 8192 (HF config max_position_embeddings + .cact-format blog); NOT 4k — tip truncated 'up to 4k' is tokens/sec decode on Raspberry Pi 5 (400–4k tok/s decode, 1–10k prefill). Apache 2.0 (HF license:apache-2.0 + LICENSE file + in-thread @cactuscompute reply 2100733807934746810). Weights https://huggingface.co/Cactus-Compute/needle3 (needle3.cact + engines); pip cactus-needle; GitHub cactus-compute/needle. ONE primary seed row for the product — do not invent 19 depth-specific slugs. INSERT under new family needle. Compare it for Open Source / Agents / on-device / tool-use / structured-outputs.

2026-09-17

Researched 4d ago

8k

8,192 tokens

Tool useFunctionsJSONFine-tune

No tracked provider route

Spark X2.5 1.7B

Spark-X2.5-1.7B is the smaller SparkLLM / XHToken (iFlytek) post-trained on-device general language model in the Spark-X2.5 series. Hugging Face card XHToken/Spark-X2.5-1.7B (Apache License 2.0 LICENSE blob, Copyright 2026 XHToken) documents Spark2_5ForCausalLM with the same hybrid 3:1 sliding-window / full-attention pattern, native 1,048,576-token context, safetensors 1,707,657,216 parameters (card title 1.7B; HF size widget rounds to 2B), thinking mode, tool-call parser spark25, and Llama-Factory fine-tuning. Same first-party GitHub README as the 4B: ~20T pretrain, SFT plus RL / MOPD from base XHToken/Spark-X2.5-1.7B-Base; 200+ languages; agent/coding/reasoning on-device. Serving: SGLang, vLLM, MLX, llama.cpp, Ollama, LM Studio. Xingchen MaaS listed on SparkLLM DEV as limited-time free; first-party Token Plan docs on 2026-09-01 list Spark-X2 / X2-Agent / X2-Flash only, not X2.5 IDs or USD rates. Sibling Spark-X2.5-4B. Do not packet unreleased Spark X2.5 293B. Compare it for Agents, Coding, and Long context.

2026-08-31

Researched 20d ago

1.05m

1,048,576 tokens

1.05m contextReasoningTool useFunctionsFine-tune

No tracked provider route

Spark X2.5 4B

Spark-X2.5-4B is SparkLLM / XHToken (iFlytek) post-trained on-device general language model in the Spark-X2.5 series. Hugging Face card XHToken/Spark-X2.5-4B (Apache License 2.0 LICENSE blob, Copyright 2026 XHToken) documents a compact dense decoder (Spark2_5ForCausalLM) with hybrid attention: repeating 3 sliding-window layers plus 1 full-attention layer, native context up to 1,048,576 tokens (config max_position_embeddings), safetensors 4,112,079,360 parameters, thinking-mode chat template, tool-call parser spark25, and Llama-Factory fine-tuning. First-party GitHub README and HF card: pretrained ~20T tokens then SFT plus large-scale RL / MOPD from base XHToken/Spark-X2.5-4B-Base; 200+ languages; conversation, writing, translation, reasoning, coding, tool use, and agent harnesses (Codex, Claude Code, OpenClaw, Hermes). Serving recipes for SGLang, vLLM, MLX, llama.cpp, Ollama, LM Studio. Weights also listed on ModelScope, Modelers, SCNet. Xingchen MaaS API mentioned on SparkLLM DEV as limited-time free without published USD list prices or X2.5 providerModelId on first-party Token Plan as of 2026-09-01. Sibling Spark-X2.5-1.7B. Do not packet unreleased Spark X2.5 293B. Compare it for Agents, Coding, and Long context.

2026-08-31

Researched 20d ago

1.05m

1,048,576 tokens

1.05m contextReasoningTool useFunctionsFine-tune

No tracked provider route

Needle 2

Needle 2 is Cactus Compute's prior-generation open 45M-parameter automation model (first-party blog 2026-08-09 + HF Cactus-Compute/needle2). Single ~14MB CQ2-bit binary; ~28MB session RAM; tool calling, device use, and structured extraction. Apache 2.0 (HF license:apache-2.0). Tip Needle 3 is the follow-up under the same Needle family. Context left empty — blog emphasizes 256-token sliding KV window for RAM bounding rather than publishing a clear 8k-style context figure for seed. INSERT sibling under family needle (live /model/needle-2 404). Compare it for Open Source / Agents / on-device.

2026-08-09

Researched 4d ago

2k

2,048 tokens

Tool useFunctionsJSONFine-tune

No tracked provider route

Cohere Transcribe Arabic (07-2026)

Cohere Transcribe Arabic is Cohere's named 2B Arabic/English automatic speech-recognition model: an audio-in, text-out fine-tune of Cohere Transcribe for Arabic dialects and Arabic-English code-switching. It is not a general text-generation model.

2026-07-07

Researched 70d ago

No window data

MultimodalAudioFine-tune

No tracked provider route

Nemotron-Labs-Diffusion 14B

NVIDIA Nemotron-Labs-Diffusion 14B is the largest text model in NVIDIA Research's diffusion language model family, released May 23, 2026. Uses diffusion-based parallel decoding enabling up to 6× higher throughput versus autoregressive baselines, with three decoding modes: autoregressive, diffusion, and self-speculation. Training code released through NVIDIA Megatron Bridge framework alongside the weights, enabling fine-tuning. Released under NVIDIA Nemotron Open Model License (commercially usable open weights). Available on Hugging Face at nvidia/Nemotron-Labs-Diffusion-14B.

2026-05-23

Researched 93d ago

131k

131,072 tokens

131k contextFine-tune

No tracked provider route

Needle

Original Needle (catalog slug needle-1) is Cactus Compute's first open ~26M-parameter function-calling model (first-party blog 2026-05-12 + HF Cactus-Compute/needle). Distilled Gemini tool-calling into a Simple Attention Network for consumer devices. License note: May 2026 blog states Apache 2.0; HF cardData/tags currently license:mit and no LICENSE sibling file — EIC should confirm which governs weights; packet leaves licenseSlug empty on this row and documents conflict (do not invent resolution). Context not verified for seed. INSERT sibling under family needle. Compare it for Open Source / Agents / on-device. License: HF cardData/tags mit (no LICENSE blob in tree); May 2026 product blog also stated Apache 2.0 — seeded licenseSlug mit per EIC gate (HF card wins); blog-Apache conflict retained in notes.

2026-05-12

Researched 4d ago

No window data

Tool useFunctionsFine-tune

No tracked provider route