DeepSeek / MODEL EVIDENCE

DeepSeek-Coder-V2-Lite-Instruct

2 benchmarks · 2 observations · 2 sources · released 2024-06-13

Scores at a glance

2 benchmarks · large dot: DeepSeek-Coder-V2-Lite-Instruct; small dots: closest models where reported

4.494.5

DeepSeek-Coder-V2-Lite-Instruct · GSM8K · EM · % ↗

14.2460.54

DeepSeek-Coder-V2-Lite-Instruct · Omni-MATH · Overall accuracy · official leaderboard ↗

Closest models by score

Similar positions on shared benchmark leaderboards. Smaller gaps are closer.

There are not enough shared scored settings to identify close comparisons reliably.

Sources

Every plotted observation links to its evaluation. Reported configurations, benchmark versions and task subsets can differ; similarity describes shared scores, not training lift.

  1. Qwen2.5-Coder Technical Report ↗

    Hui, Binyuan, Yang, Jian, Cui, Zeyu, Yang, Jiaxi, Liu, Dayiheng, Zhang, Lei et al. · 2024

    All 24 authors

    Hui, Binyuan, Yang, Jian, Cui, Zeyu, Yang, Jiaxi, Liu, Dayiheng, Zhang, Lei, Liu, Tianyu, Zhang, Jiajun, Yu, Bowen, Lu, Keming, Dang, Kai, Fan, Yang, Zhang, Yichang, Yang, An, Men, Rui, Huang, Fei, Zheng, Bo, Miao, Yibo, Quan, Shanghaoran, Feng, Yunlong, Ren, Xingzhang, Ren, Xuancheng, Zhou, Jingren, Lin, Junyang

  2. Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language Models — published result table ↗

    Gao, Bofei, Song, Feifan, Yang, Zhe, Cai, Zefan, Miao, Yibo, Dong, Qingxiu et al. · 2024

    All 20 authors

    Gao, Bofei, Song, Feifan, Yang, Zhe, Cai, Zefan, Miao, Yibo, Dong, Qingxiu, Li, Lei, Ma, Chenghao, Chen, Liang, Xu, Runxin, Tang, Zhengyang, Wang, Benyou, Zan, Daoguang, Quan, Shanghaoran, Zhang, Ge, Sha, Lei, Zhang, Yichang, Ren, Xuancheng, Liu, Tianyu, Chang, Baobao

Names used in source tables

DeepSeek-Coder-V2-Lite-Instruct