Mistral’s newest AI model has a cybersecurity standout, but not an overall lead over Chinese open models. Artificial Analysis gave Large 4 Preview a score of 38 on its Intelligence Index, below five Chinese rivals. Its strongest security-test result sits alongside a less flattering comparison: higher benchmark task costs than several competing models.
The evaluation gives substance to the competitive claims surrounding Mistral’s October 6 release. Artificial Analysis calls Large 4 the highest-scoring model from outside the United States and China on its index. That distinction describes a geographic lead within this evaluation—not leadership across all models or every kind of work.
The Intelligence Index combines 10 evaluations, including professional document reasoning, coding, knowledge and long-context reasoning. Large 4’s score matches GPT-6 Luna at its maximum setting. The Chinese open-weight models ahead of it span a range of scores, rather than one narrowly superior competitor:
Xiaomi MiMo-V2.6-Pro: 46.
Z.ai GLM-5.3 at maximum effort: 45.
Moonshot Kimi K3 at maximum effort: 44.
Z.ai GLM-5.3-Flash: 42.
DeepSeek V4.1 Flash at maximum effort: 39.
There is also an availability distinction. Those competitors have open weights; Large 4 does not yet. Mistral offers a public API preview and says it will release the weights by the end of October 2026. Artificial Analysis currently labels the preview proprietary.
Cybersecurity provides the clearest counterpoint to the overall ranking. Large 4 scored 50 on Artificial Analysis’s Cyber Index, tying GLM-5.3-Flash but trailing MiMo-V2.6-Pro’s 56. Its strongest component was CyberGym-E2E-AA, where it finished ahead of both MiMo-V2.6-Pro and GPT-6 Luna.
Mistral describes the CyberGym task as reproducing a real vulnerability in open-source software and then patching it. That makes the result relevant to a particular security workflow. But it is only one of three tests in the Cyber Index, and Large 4’s results on the other two are substantially lower.
Refusal behavior also complicates the comparison. Artificial Analysis’s chart marks Claude Opus 5.5 and GPT-6 Astra as declining some tasks on safety grounds. Mistral argues that such refusals can obstruct legitimate vulnerability research and incident response. Their near-zero CyberGym scores therefore reflect whether they would undertake the work, not simply whether they could solve it.
The company is testing the model with cybersecurity leaders, vetted partners and state authorities before releasing weights. Mistral says those participants receive reduced moderation and expanded cyber capabilities. That controlled testing is separate from the ordinary public preview.
Large 4’s standard API prices are $1.36 per million input tokens and $4.18 per million output tokens. Tokens are the units used to meter model input and output. Artificial Analysis lists those rates below its comparison medians, yet measures an average cost of $1.13 per Intelligence Index task.
The distinction is usage. Large 4 generated 200 million output tokens during the evaluation, against a comparison median of 81 million. Artificial Analysis calculates task cost from token charges, divides by task count and weights each evaluation’s contribution. Its figure is a benchmark-specific measure, not a promised bill for a customer’s workload.
A 50% discount for the first two weeks cuts Large 4’s benchmark task cost to $0.57. Even then, it remains above GLM-5.3-Flash at $0.25 and DeepSeek V4.1 Flash at $0.27. MiMo-V2.6-Pro costs $0.13 per task in the same comparison while posting the highest Intelligence Index score among these models.
Large 4 does offer faster-than-average generation: Artificial Analysis measured 116.1 output tokens per second, compared with 86 for its comparison average. It accepts text and images and returns text. The planned weights release would also allow private-cloud or on-premises deployment, giving organizations a different access model from today’s hosted preview.
Reader comments
Newest comments first. Replies stay oldest first.