Codesota · Models · mistralai/Mixtral-8x7B-Instruct-v0.1mistralai17 results · 3 benchmarks
Model card

mistralai/Mixtral-8x7B-Instruct-v0.1.

mistralaiopen-weights46.7B params
§ 02 · Benchmarks

Every benchmark mistralai/Mixtral-8x7B-Instruct-v0.1 has a recorded score for.

#BenchmarkArea · TaskMetricValueRankDateSource
01Polish EQ-BenchNatural Language Processing · Polish Emotional Intelligenceeq-score57.6%#39/101—source ↗
02CPTU-BenchNatural Language Processing · Polish Text Understandingphraseology2.9%#65/93—source ↗
03CPTU-BenchNatural Language Processing · Polish Text Understandinglanguage-understanding3.2%#65/93—source ↗
04CPTU-BenchNatural Language Processing · Polish Text Understandingtricky-questions1.8%#70/93—source ↗
05CPTU-BenchNatural Language Processing · Polish Text Understandingaverage2.7%#73/93—source ↗
06Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generaleq-bench48.5%#76/299—source ↗
07CPTU-BenchNatural Language Processing · Polish Text Understandingsentiment3.1%#79/93—source ↗
08Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalbelebele84.2%#109/490—source ↗
09Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalcbd30.9%#129/490—source ↗
10Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalklej-ner-mc48.1%#134/490—source ↗
11Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalklej-ner-generative46.3%#144/489—source ↗
12Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalaverage42.5%#179/491—source ↗
13Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generaldyk51.7%#182/489—source ↗
14Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalppc63.9%#301/490—source ↗
15Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalpoquad-open-book40.9%#315/337—source ↗
16Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalpolemo2-in53.7%#437/490—source ↗
17Open PL LLM LeaderboardNatural Language Processing · Polish LLM Generalpolqa-open-book51.7%#471/489—source ↗
Rank column shows this model’s position vs all other models scored on the same benchmark + metric (competitors after the slash). #1 in red means current SOTA. Sorted by rank, then newest result.
§ 03 · Strengths by area

Where mistralai/Mixtral-8x7B-Instruct-v0.1 actually performs.

Natural Language Processing
3
benchmarks
avg rank #168.7
§ 05 · Related models

Other mistralai models scored on Codesota.

mistralai/Mistral-7B-Instruct-v0.3
7.25B params · 17 results
mistralai/Mistral-Large-Instruct-2407
123B params · 17 results
mistralai/Mistral-Large-Instruct-2411
123B params · 17 results
mistralai/Mistral-Nemo-Instruct-2407
12.2B params · 17 results
mistralai/Mistral-Small-24B-Instruct-2501
23.6B params · 17 results
mistralai/Mixtral-8x22B-Instruct-v0.1 (API)
141B params · 17 results
Mistral-7B-Instruct-v0.2
13 results
Mistral-7B-Instruct-v0.1
12 results
§ 06 · Sources & freshness

Where these numbers come from.

speakleash/open_pl_llm_leaderboard
11
results
SpeakLeash/CPTU-Bench
5
results
SpeakLeash/Polish-EQ-Bench
1
result
17 of 17 rows marked verified.