Mixtral 8x7B
Mistral·
LLMsopen-weightcloud + localWorkstation
Overview
Sparse Mixture-of-Experts model.
Capabilities and innovations
MoE ArchitectureGPT-3.5 levelOpen weightsSparse MoE ArchitectureRouter NetworkExpert Selection Mechanism
Benchmarks
No benchmark values are recorded for this model.
- GPQA Diamond: not reported by the vendor
- Humanity’s Last Exam (no tools): benchmark did not exist at release
- SWE-bench Verified: not reported by the vendor
- SWE-bench Pro: benchmark did not exist at release
- MMLU: not reported by the vendor
- MMLU-Pro: benchmark did not exist at release
- Terminal-Bench 2.x: benchmark did not exist at release
- MMMU-Pro: benchmark did not exist at release
Architecture and hardware
- Parameters
- 46.7B total, 12.9B active per token (MoE)
- Estimated VRAM at Q4
- ~27 GB, Workstation class
Links
More from Mistral
Data curated by AI Model Timeline. See the methodology for admission criteria, benchmark eras and source priority.