# AI models

> Showing 1–32 of 32 AI models

Canonical: https://gpuninja.com/models
Data as of: 2026-10-11T15:48:18Z
Path: Home

## AI models

Model, Publisher, Parameters, Quantization, Min VRAM

- [DeepSeek-R1-Distill-Llama-70B (Q4_K_M)](https://gpuninja.com/models/deepseek-r1-distill-llama-70b-q4-k-m) — DeepSeek, 70.6B, q4_k_m, 42.5 GB
- [DeepSeek-R1-Distill-Llama-8B (Q4_K_M)](https://gpuninja.com/models/deepseek-r1-distill-llama-8b-q4-k-m) — DeepSeek, 8B, q4_k_m, 4.9 GB
- [DeepSeek-R1-Distill-Qwen-14B (Q4_K_M)](https://gpuninja.com/models/deepseek-r1-distill-qwen-14b-q4-k-m) — DeepSeek, 14.8B, q4_k_m, 9 GB
- [DeepSeek-R1-Distill-Qwen-32B (Q4_K_M)](https://gpuninja.com/models/deepseek-r1-distill-qwen-32b-q4-k-m) — DeepSeek, 32.8B, q4_k_m, 19.9 GB
- [DeepSeek-R1-Distill-Qwen-7B (Q4_K_M)](https://gpuninja.com/models/deepseek-r1-distill-qwen-7b-q4-k-m) — DeepSeek, 7.6B, q4_k_m, 4.7 GB
- [Gemma 3 12B IT (Q4_K_M)](https://gpuninja.com/models/gemma-3-12b-it-q4-k-m) — Google, 12.2B, q4_k_m, 7.3 GB
- [Gemma 3 27B IT (Q4_K_M)](https://gpuninja.com/models/gemma-3-27b-it-q4-k-m) — Google, 27.4B, q4_k_m, 16.6 GB
- [Gemma 3 4B IT (Q4_K_M)](https://gpuninja.com/models/gemma-3-4b-it-q4-k-m) — Google, 4.3B, q4_k_m, 2.5 GB
- [gpt-oss-120b (MXFP4)](https://gpuninja.com/models/gpt-oss-120b-mxfp4) — OpenAI, 116.8B, mxfp4, 63.4 GB
- [gpt-oss-20b (MXFP4)](https://gpuninja.com/models/gpt-oss-20b-mxfp4) — OpenAI, 20.9B, mxfp4, 12.1 GB
- [Llama 3.1 70B Instruct (Q4_K_M)](https://gpuninja.com/models/llama-3-1-70b-instruct-q4-k-m) — Meta, 70.6B, q4_k_m, 42.5 GB
- [Llama 3.1 8B Instruct (Q4_K_M)](https://gpuninja.com/models/llama-3-1-8b-instruct-q4-k-m) — Meta, 8B, q4_k_m, 4.9 GB
- [Llama 3.2 1B Instruct (Q4_K_M)](https://gpuninja.com/models/llama-3-2-1b-instruct-q4-k-m) — Meta, 1.2B, q4_k_m, 0.8 GB
- [Llama 3.2 3B Instruct (Q4_K_M)](https://gpuninja.com/models/llama-3-2-3b-instruct-q4-k-m) — Meta, 3.2B, q4_k_m, 2 GB
- [Llama 3.3 70B Instruct (Q4_K_M)](https://gpuninja.com/models/llama-3-3-70b-instruct-q4-k-m) — Meta, 70.6B, q4_k_m, 42.5 GB
- [Mistral 7B Instruct v0.3 (Q4_K_M)](https://gpuninja.com/models/mistral-7b-instruct-v0-3-q4-k-m) — Mistral AI, 7.3B, q4_k_m, 4.4 GB
- [Mistral Nemo Instruct 2407 (Q4_K_M)](https://gpuninja.com/models/mistral-nemo-instruct-2407-q4-k-m) — Mistral AI, 12.3B, q4_k_m, 7.5 GB
- [Mistral Small 3.1 24B Instruct 2503 (Q4_K_M)](https://gpuninja.com/models/mistral-small-3-1-24b-instruct-2503-q4-k-m) — Mistral AI, 24B, q4_k_m, 14.3 GB
- [Mixtral 8x7B Instruct v0.1 (Q4_K_M)](https://gpuninja.com/models/mixtral-8x7b-instruct-v0-1-q4-k-m) — Mistral AI, 46.7B, q4_k_m, 26.5 GB
- [Phi-4-mini-instruct (Q4_K_M)](https://gpuninja.com/models/phi-4-mini-instruct-q4-k-m) — Microsoft, 3.8B, q4_k_m, 2.5 GB
- [Phi-4 (Q4_K_M)](https://gpuninja.com/models/phi-4-q4-k-m) — Microsoft, 14.7B, q4_k_m, 9.1 GB
- [Qwen2.5 14B Instruct (Q4_K_M)](https://gpuninja.com/models/qwen2-5-14b-instruct-q4-k-m) — Alibaba, 14.8B, q4_k_m, 9 GB
- [Qwen2.5 32B Instruct (Q4_K_M)](https://gpuninja.com/models/qwen2-5-32b-instruct-q4-k-m) — Alibaba, 32.8B, q4_k_m, 19.9 GB
- [Qwen2.5 72B Instruct (Q4_K_M)](https://gpuninja.com/models/qwen2-5-72b-instruct-q4-k-m) — Alibaba, 72.7B, q4_k_m, 44 GB
- [Qwen2.5 7B Instruct (Q4_K_M)](https://gpuninja.com/models/qwen2-5-7b-instruct-q4-k-m) — Alibaba, 7.6B, q4_k_m, 4.7 GB
- [Qwen2.5-Coder 32B Instruct (Q4_K_M)](https://gpuninja.com/models/qwen2-5-coder-32b-instruct-q4-k-m) — Alibaba, 32.8B, q4_k_m, 19.9 GB
- [Qwen3 14B (Q4_K_M)](https://gpuninja.com/models/qwen3-14b-q4-k-m) — Alibaba, 14.8B, q4_k_m, 9 GB
- [Qwen3 235B-A22B (Q4_K_M)](https://gpuninja.com/models/qwen3-235b-a22b-q4-k-m) — Alibaba, 235.1B, q4_k_m, 142.2 GB
- [Qwen3 30B-A3B (Q4_K_M)](https://gpuninja.com/models/qwen3-30b-a3b-q4-k-m) — Alibaba, 30.5B, q4_k_m, 18.6 GB
- [Qwen3 32B (Q4_K_M)](https://gpuninja.com/models/qwen3-32b-q4-k-m) — Alibaba, 32.8B, q4_k_m, 19.8 GB
- [Qwen3 4B (Q4_K_M)](https://gpuninja.com/models/qwen3-4b-q4-k-m) — Alibaba, 4B, q4_k_m, 2.5 GB
- [Qwen3 8B (Q4_K_M)](https://gpuninja.com/models/qwen3-8b-q4-k-m) — Alibaba, 8.2B, q4_k_m, 5 GB

## Pages

Showing 1–32 of 32 AI models