Llama 4 Scout

46.97 % · Llama 4 Scout · GPQA Diamond · Accuracy · Vals AI · GPQA Diamond ↗

55.19 % · Llama 4 Scout · TaxEval · Accuracy · Vals AI · TaxEval ↗

7.7% · Llama 4 Scout · TextQuests · With clues · game progress · source 500-step protocol · TextQuests: How Good are LLMs at Text-Based Video Games? ↗

26% · Llama 4 Scout · CyberSecEval · CyberSOCEval · malware analysis · Easy accuracy · CyberSecEval 4 · CyberSOCEval defensive-analysis comparison · CyberSOCEval: Benchmarking LLMs Capabilities for Malware Analysis and Threat Intelligence Reasoning ↗

16% · Llama 4 Scout · CyberSecEval · CyberSOCEval · malware analysis · Medium accuracy · CyberSecEval 4 · CyberSOCEval defensive-analysis comparison · CyberSOCEval: Benchmarking LLMs Capabilities for Malware Analysis and Threat Intelligence Reasoning ↗

0% · Llama 4 Scout · CyberSecEval · CyberSOCEval · malware analysis · Hard accuracy · CyberSecEval 4 · CyberSOCEval defensive-analysis comparison · CyberSOCEval: Benchmarking LLMs Capabilities for Malware Analysis and Threat Intelligence Reasoning ↗

43.76% · Llama 4 Scout · CyberSecEval · CyberSOCEval · threat intelligence · image input · Overall accuracy · CyberSecEval 4 · CyberSOCEval image-input comparison · CyberSOCEval: Benchmarking LLMs Capabilities for Malware Analysis and Threat Intelligence Reasoning ↗

62% · Llama 4 Scout · CyberSecEval · CyberSOCEval · threat intelligence · image input · NSA reports · CyberSecEval 4 · CyberSOCEval image-input comparison · CyberSOCEval: Benchmarking LLMs Capabilities for Malware Analysis and Threat Intelligence Reasoning ↗

47% · Llama 4 Scout · CyberSecEval · CyberSOCEval · threat intelligence · image input · CrowdStrike reports · CyberSecEval 4 · CyberSOCEval image-input comparison · CyberSOCEval: Benchmarking LLMs Capabilities for Malware Analysis and Threat Intelligence Reasoning ↗

37% · Llama 4 Scout · CyberSecEval · CyberSOCEval · threat intelligence · image input · IC3 reports · CyberSecEval 4 · CyberSOCEval image-input comparison · CyberSOCEval: Benchmarking LLMs Capabilities for Malware Analysis and Threat Intelligence Reasoning ↗

38% · Llama 4 Scout · CyberSecEval · CyberSOCEval · threat intelligence · image input · CISA reports · CyberSecEval 4 · CyberSOCEval image-input comparison · CyberSOCEval: Benchmarking LLMs Capabilities for Malware Analysis and Threat Intelligence Reasoning ↗