AQI AI / MODELS
Tools run and connect; models generate. Compare each separately.
A growing local model snapshot, separated by chat, coding, retrieval, reranking and speech tasks. It spans generations, not the entire market or every latest release. Quality and speed are not uniformly benchmarked here.
Embedding models produce retrieval vectors, rerankers score candidate passages, and speech models transcribe audio. These tasks are not comparable by chat quality. Batch, activation and audio memory are not modeled; specialist capacity stays unverified instead of using the chat-cache formula.
Compare under identical settings; size uses public tensor-element metadata and can differ from the named parameter count. Read licenses with base-model and usage terms.
Embedding models produce retrieval vectors, rerankers score candidate passages, and speech models transcribe audio. These tasks are not comparable by chat quality. Batch, activation and audio memory are not modeled; specialist capacity stays unverified instead of using the chat-cache formula.
Author sources and review date ↗Capacity estimate only; no automatic download or connection to your computer.
Author sources and review date ↗Capacity estimate only; no automatic download or connection to your computer.
Author sources and review date ↗Capacity estimate only; no automatic download or connection to your computer.
Author sources and review date ↗Capacity estimate only; no automatic download or connection to your computer.
Author sources and review date ↗Capacity estimate only; no automatic download or connection to your computer.
Author sources and review date ↗Capacity estimate only; no automatic download or connection to your computer.
Author sources and review date ↗Architecture/format needs review
Author sources and review date ↗Architecture/format needs review
Author sources and review date ↗Architecture/format needs review
Author sources and review date ↗Architecture/format needs review
Author sources and review date ↗Architecture/format needs review
Author sources and review date ↗Architecture/format needs review
Author sources and review date ↗Architecture/format needs review
Author sources and review date ↗Architecture/format needs review
Author sources and review date ↗Architecture/format needs review
Author sources and review date ↗Architecture/format needs review
Author sources and review date ↗Architecture/format needs review
Author sources and review date ↗Capacity estimate only; no automatic download or connection to your computer.
Author sources and review date ↗Capacity estimate only; no automatic download or connection to your computer.
Author sources and review date ↗Capacity estimate only; no automatic download or connection to your computer.
Author sources and review date ↗Capacity estimate only; no automatic download or connection to your computer.
Author sources and review date ↗Capacity estimate only; no automatic download or connection to your computer.
Author sources and review date ↗Capacity estimate only; no automatic download or connection to your computer.
Author sources and review date ↗Capacity estimate only; no automatic download or connection to your computer.
Author sources and review date ↗Capacity estimate only; no automatic download or connection to your computer.
Author sources and review date ↗Capacity estimate only; no automatic download or connection to your computer.
Author sources and review date ↗Author sources and review date ↗Capacity estimate only; no automatic download or connection to your computer.
Author sources and review date ↗Author sources and review date ↗Capacity estimate only; no automatic download or connection to your computer.
Author sources and review date ↗Capacity estimate only; no automatic download or connection to your computer.
Author sources and review date ↗Capacity estimate only; no automatic download or connection to your computer.
Author sources and review date ↗Capacity estimate only; no automatic download or connection to your computer.
Author sources and review date ↗Embedding models produce retrieval vectors, rerankers score candidate passages, and speech models transcribe audio. These tasks are not comparable by chat quality. Batch, activation and audio memory are not modeled; specialist capacity stays unverified instead of using the chat-cache formula.
Author sources and review date ↗Embedding models produce retrieval vectors, rerankers score candidate passages, and speech models transcribe audio. These tasks are not comparable by chat quality. Batch, activation and audio memory are not modeled; specialist capacity stays unverified instead of using the chat-cache formula.
Author sources and review date ↗Embedding models produce retrieval vectors, rerankers score candidate passages, and speech models transcribe audio. These tasks are not comparable by chat quality. Batch, activation and audio memory are not modeled; specialist capacity stays unverified instead of using the chat-cache formula.
Author sources and review date ↗Embedding models produce retrieval vectors, rerankers score candidate passages, and speech models transcribe audio. These tasks are not comparable by chat quality. Batch, activation and audio memory are not modeled; specialist capacity stays unverified instead of using the chat-cache formula.
Author sources and review date ↗Embedding models produce retrieval vectors, rerankers score candidate passages, and speech models transcribe audio. These tasks are not comparable by chat quality. Batch, activation and audio memory are not modeled; specialist capacity stays unverified instead of using the chat-cache formula.
Author sources and review date ↗Embedding models produce retrieval vectors, rerankers score candidate passages, and speech models transcribe audio. These tasks are not comparable by chat quality. Batch, activation and audio memory are not modeled; specialist capacity stays unverified instead of using the chat-cache formula.
Author sources and review date ↗Architecture/format needs review
Author sources and review date ↗Architecture/format needs review
Author sources and review date ↗Architecture/format needs review
Author sources and review date ↗Architecture/format needs review
Author sources and review date ↗Capacity estimate only; no automatic download or connection to your computer.
Author sources and review date ↗Capacity estimate only; no automatic download or connection to your computer.
Author sources and review date ↗Capacity estimate only; no automatic download or connection to your computer.
Author sources and review date ↗Embedding models produce retrieval vectors, rerankers score candidate passages, and speech models transcribe audio. These tasks are not comparable by chat quality. Batch, activation and audio memory are not modeled; specialist capacity stays unverified instead of using the chat-cache formula.
Author sources and review date ↗File sizes and hashes come from author repository listings; weights were not downloaded. File size is not total runtime memory. A verified matching-precision file takes precedence over the generic weight estimate, before cache and runtime margins.
Capacity scenario, not a benchmark: public weight tensor elements × bits ÷ 8 plus a 20% quantization/mixed-precision margin; F16 KV from layers, KV heads and context, plus 1.5 GiB runtime margin. Reserve at least 4 GiB or 25% RAM, and 2 GiB dedicated VRAM. One model, one text sequence; not a measured GGUF size or run guarantee.
Hybrid architectures, special packing or missing configs require manual review. Image/audio overhead is excluded. MoE uses total weights, not active parameters. 4/8-bit scenarios do not establish a published quant or backend compatibility.
46
BGE Reranker
Weight size basis: 0.57 B
License identifier (see source): apache-2.0
Use: Search reranking
Unknown
Weight estimate GiB: 0.3 · 4-bit / 4096
Architecture/format needs review
DeepSeek R1 Distill
Weight size basis: 1.78 B
License identifier (see source): mit + Apache-2.0 base
Use: Text chat · Reasoning
Documented/configured context limit: 131,072
Weight estimate GiB: 1.0 · 4-bit / 4096
DeepSeek R1 Distill
Weight size basis: 7.62 B
License identifier (see source): mit + Apache-2.0 base
Use: Text chat · Reasoning
Documented/configured context limit: 131,072
Weight estimate GiB: 4.3 · 4-bit / 4096
DeepSeek R1 Distill
Weight size basis: 8.03 B
License identifier (see source): mit + Llama 3.1 base
Use: Text chat · Reasoning
Documented/configured context limit: 131,072
Weight estimate GiB: 4.5 · 4-bit / 4096
DeepSeek R1 Distill
Weight size basis: 14.77 B
License identifier (see source): mit + Apache-2.0 base
Use: Text chat · Reasoning
Documented/configured context limit: 131,072
Weight estimate GiB: 8.3 · 4-bit / 4096
DeepSeek R1 Distill
Weight size basis: 32.76 B
License identifier (see source): mit + Apache-2.0 base
Use: Text chat · Reasoning
Documented/configured context limit: 131,072
Weight estimate GiB: 18.3 · 4-bit / 4096
DeepSeek R1 Distill
Weight size basis: 70.55 B
License identifier (see source): mit + Llama 3.3 base
Use: Text chat · Reasoning
Documented/configured context limit: 131,072
Weight estimate GiB: 39.4 · 4-bit / 4096
Gemma 3
Weight size basis: 1.00 B
License identifier (see source): gemma
Use: Text chat
Unknown
Weight estimate GiB: 0.6 · 4-bit / 4096
Architecture/format needs review
Gemma 3
Weight size basis: 4.30 B
License identifier (see source): gemma
Use: Text chat · Vision / multimodal
Unknown
Weight estimate GiB: 2.4 · 4-bit / 4096
Architecture/format needs review
Gemma 3
Weight size basis: 12.19 B
License identifier (see source): gemma
Use: Text chat · Vision / multimodal
Unknown
Weight estimate GiB: 6.8 · 4-bit / 4096
Architecture/format needs review
Gemma 3
Weight size basis: 27.43 B
License identifier (see source): gemma
Use: Text chat · Vision / multimodal
Unknown
Weight estimate GiB: 15.3 · 4-bit / 4096
Architecture/format needs review
Gemma 4
Weight size basis: 11.96 B
License identifier (see source): apache-2.0
Use: Text chat · Vision / multimodal
Documented/configured context limit: 262,144
Weight estimate GiB: 6.7 · 4-bit / 4096
Architecture/format needs review
gpt-oss
Weight size basis: 20.91 B
License identifier (see source): apache-2.0
Use: Text chat · Reasoning
Documented/configured context limit: 131,072
Weight estimate GiB: 11.7 · 4-bit / 4096
Architecture/format needs review
gpt-oss
Weight size basis: 116.83 B
License identifier (see source): apache-2.0
Use: Text chat · Reasoning
Documented/configured context limit: 131,072
Weight estimate GiB: 65.3 · 4-bit / 4096
Architecture/format needs review
Llama
Weight size basis: 1.24 B
License identifier (see source): llama3.2
Use: Text chat
Unknown
Weight estimate GiB: 0.7 · 4-bit / 4096
Architecture/format needs review
Llama
Weight size basis: 3.21 B
License identifier (see source): llama3.2
Use: Text chat
Unknown
Weight estimate GiB: 1.8 · 4-bit / 4096
Architecture/format needs review
Llama
Weight size basis: 8.03 B
License identifier (see source): llama3.1
Use: Text chat
Unknown
Weight estimate GiB: 4.5 · 4-bit / 4096
Architecture/format needs review
Llama
Weight size basis: 70.55 B
License identifier (see source): llama3.3
Use: Text chat
Unknown
Weight estimate GiB: 39.4 · 4-bit / 4096
Architecture/format needs review
Ministral 3
Weight size basis: 4.25 B
License identifier (see source): apache-2.0
Use: Text chat
Documented/configured context limit: 262,144
Weight estimate GiB: 2.4 · 4-bit / 4096
Ministral 3
Weight size basis: 8.92 B
License identifier (see source): apache-2.0
Use: Text chat
Documented/configured context limit: 262,144
Weight estimate GiB: 5.0 · 4-bit / 4096
Ministral 3
Weight size basis: 13.95 B
License identifier (see source): apache-2.0
Use: Text chat
Documented/configured context limit: 262,144
Weight estimate GiB: 7.8 · 4-bit / 4096
Mistral Small
Weight size basis: 24.01 B
License identifier (see source): apache-2.0
Use: Text chat
Documented/configured context limit: 131,072
Weight estimate GiB: 13.4 · 4-bit / 4096
Phi-4
Weight size basis: 3.84 B
License identifier (see source): mit
Use: Text chat
Documented/configured context limit: 131,072
Weight estimate GiB: 2.1 · 4-bit / 4096
Phi-4
Weight size basis: 14.66 B
License identifier (see source): mit
Use: Text chat
Documented/configured context limit: 16,384
Weight estimate GiB: 8.2 · 4-bit / 4096
Qwen3
Weight size basis: 0.75 B
License identifier (see source): apache-2.0
Use: Text chat
Documented/configured context limit: 32,768
Weight estimate GiB: 0.4 · 4-bit / 4096
Qwen3
Weight size basis: 2.03 B
License identifier (see source): apache-2.0
Use: Text chat
Documented/configured context limit: 32,768
Weight estimate GiB: 1.1 · 4-bit / 4096
Qwen3
Weight size basis: 4.02 B
License identifier (see source): apache-2.0
Use: Text chat
Documented/configured context limit: 32,768
Weight estimate GiB: 2.3 · 4-bit / 4096
Qwen3
Weight size basis: 8.19 B
License identifier (see source): apache-2.0
Use: Text chat
Documented/configured context limit: 32,768
Weight estimate GiB: 4.7 · 4-bit / 4096
Qwen3
Weight size basis: 14.77 B
License identifier (see source): apache-2.0
Use: Text chat
Documented/configured context limit: 32,768
Weight estimate GiB: 8.3 · 4-bit / 4096
Qwen3
Weight size basis: 30.53 B
License identifier (see source): apache-2.0
Use: Text chat
Documented/configured context limit: 32,768
Weight estimate GiB: 17.1 · 4-bit / 4096
Qwen3
Weight size basis: 32.76 B
License identifier (see source): apache-2.0
Use: Text chat
Documented/configured context limit: 32,768
Weight estimate GiB: 18.3 · 4-bit / 4096
Qwen3 Coder
Weight size basis: 30.53 B
License identifier (see source): apache-2.0
Use: Text chat · Code focused
Documented/configured context limit: 262,144
Weight estimate GiB: 17.1 · 4-bit / 4096
Qwen3 Embedding
Weight size basis: 0.60 B
License identifier (see source): apache-2.0
Use: Text embedding
Documented/configured context limit: 32,768
Weight estimate GiB: 0.3 · 4-bit / 4096
Architecture/format needs review
Qwen3 Embedding
Weight size basis: 4.02 B
License identifier (see source): apache-2.0
Use: Text embedding
Documented/configured context limit: 32,768
Weight estimate GiB: 2.2 · 4-bit / 4096
Architecture/format needs review
Qwen3 Embedding
Weight size basis: 7.57 B
License identifier (see source): apache-2.0
Use: Text embedding
Documented/configured context limit: 32,768
Weight estimate GiB: 4.2 · 4-bit / 4096
Architecture/format needs review
Qwen3 Reranker
Weight size basis: 0.60 B
License identifier (see source): apache-2.0
Use: Search reranking
Documented/configured context limit: 32,768
Weight estimate GiB: 0.3 · 4-bit / 4096
Architecture/format needs review
Qwen3 Reranker
Weight size basis: 4.02 B
License identifier (see source): apache-2.0
Use: Search reranking
Documented/configured context limit: 32,768
Weight estimate GiB: 2.2 · 4-bit / 4096
Architecture/format needs review
Qwen3 Reranker
Weight size basis: 8.19 B
License identifier (see source): apache-2.0
Use: Search reranking
Documented/configured context limit: 32,768
Weight estimate GiB: 4.6 · 4-bit / 4096
Architecture/format needs review
Qwen3.5
Weight size basis: 4.66 B
License identifier (see source): apache-2.0
Use: Text chat · Vision / multimodal
Documented/configured context limit: 262,144
Weight estimate GiB: 2.6 · 4-bit / 4096
Architecture/format needs review
Qwen3.5
Weight size basis: 9.65 B
License identifier (see source): apache-2.0
Use: Text chat · Vision / multimodal
Documented/configured context limit: 262,144
Weight estimate GiB: 5.4 · 4-bit / 4096
Architecture/format needs review
Qwen3.5
Weight size basis: 27.78 B
License identifier (see source): apache-2.0
Use: Text chat · Vision / multimodal
Documented/configured context limit: 262,144
Weight estimate GiB: 15.5 · 4-bit / 4096
Architecture/format needs review
Qwen3.8
Weight size basis: 27.78 B
License identifier (see source): apache-2.0
Use: Text chat · Vision / multimodal
Documented/configured context limit: 262,144
Weight estimate GiB: 15.5 · 4-bit / 4096
Architecture/format needs review
SmolLM2
Weight size basis: 0.13 B
License identifier (see source): apache-2.0
Use: Text chat
Documented/configured context limit: 8,192
Weight estimate GiB: 0.1 · 4-bit / 4096
SmolLM2
Weight size basis: 0.36 B
License identifier (see source): apache-2.0
Use: Text chat
Documented/configured context limit: 8,192
Weight estimate GiB: 0.2 · 4-bit / 4096
SmolLM2
Weight size basis: 1.71 B
License identifier (see source): apache-2.0
Use: Text chat
Documented/configured context limit: 8,192
Weight estimate GiB: 1.0 · 4-bit / 4096
Whisper
Weight size basis: 0.81 B
License identifier (see source): mit
Use: Speech to text
Unknown
Weight estimate GiB: 0.5 · 4-bit / 4096
Architecture/format needs review
No matching models.