Mixtral 8x7B Instruct v0.1 (Q4_K_M)
Mistral AI · 46.7B · q4_k_m
Specs verified:
Specifications
- Publisher
- Mistral AI
Source
- Retrieved
- Last verified
- Verification
- Verified
- Parameters
- 46.7B
Source
- Retrieved
- Last verified
- Verification
- Verified
- Quantization
- q4_k_m
Source
- Retrieved
- Last verified
- Verification
- Verified
- Minimum VRAM
- 26.5 GB
Source
- Retrieved
- Last verified
- Verification
- Unverified
- Context length
- 32K tokens
Source
- Retrieved
- Last verified
- Verification
- Verified
- Modality
- text
Source
- Retrieved
- Last verified
- Verification
- Unverified
- License
- Apache 2.0
Source
- Retrieved
- Last verified
- Verification
- Verified
Graphics cards that can run it
| Board | Chip | VRAM | TDP | Length | Slots | Price | Stock | VRAM headroom |
|---|---|---|---|---|---|---|---|---|
| ROG Astral GeForce RTX 5090 OC Edition | GeForce RTX 5090 | 32 GB | 600 W | 357.6 mm | 3.8-slot | Not recorded | No listings | 5.6 GB spare |
| GeForce RTX 5090 32G GAMING TRIO OC | GeForce RTX 5090 | 32 GB | 575 W | 359 mm | 3.4-slot | Not recorded | No listings | 5.6 GB spare |
| GeForce RTX 5090 Founders Edition | GeForce RTX 5090 | 32 GB | 575 W | 304 mm | 2-slot | Not recorded | No listings | 5.6 GB spare |
Benchmarks
No benchmark results recorded.
Sources
- huggingface.co (external site) · verified
- Publisher
- Parameters
- Modality
- License
- huggingface.co (external site) · verified
- Quantization
- Minimum VRAM
- huggingface.co (external site) · verified
- Context length