CS-Bench: A Comprehensive Benchmark for Large Language Models towards Computer Science Mastery
Paper
•
2406.08587
•
Published
•
16
Papers-Benchmarks
-
-
Test of Time: A Benchmark for Evaluating LLMs on Temporal Reasoning
Paper • 2406.09170 • Published • 27 -
AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents
Paper • 2407.18901 • Published • 35 -
Benchmarking Agentic Workflow Generation
Paper • 2410.07869 • Published • 29 -
OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotations
Paper • 2412.07626 • Published • 28 -
opendatalab/OmniDocBench
Viewer • Updated • 1.36k • 8.19k • 59 -
OmniEval
🥇4 -
RUC-NLPIR/OmniEval-AutoGen-Dataset
Updated • 456 • 5 -
m-ric/agents_medium_benchmark_2
Viewer • Updated • 142 • 207 • 11 -
gaia-benchmark/GAIA
Viewer • Updated • 932 • 16k • 579 -
GAIA: a benchmark for General AI Assistants
Paper • 2311.12983 • Published • 244 -
m-ric/agents_small_benchmark
Viewer • Updated • 100 • 144 • 11 -
EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agents
Paper • 2502.09560 • Published • 35 -
m-a-p/CodeCriticBench
Preview • Updated • 181 • 4 -
MultiAgentBench: Evaluating the Collaboration and Competition of LLM agents
Paper • 2503.01935 • Published • 29 -
SWE-Lancer: Can Frontier LLMs Earn $1 Million from Real-World Freelance Software Engineering?
Paper • 2502.12115 • Published • 46 -
MMTEB: Massive Multilingual Text Embedding Benchmark
Paper • 2502.13595 • Published • 43 -
kyutai/Babillage
Viewer • Updated • 465k • 86 • 12 -
YourBench: Easy Custom Evaluation Sets for Everyone
Paper • 2504.01833 • Published • 22 -
Agent Reward Bench Demo
💻4Explore agent trajectories and judgments in web benchmarks
-
AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectories
Paper • 2504.08942 • Published • 28 -
Benchmarking LLMs' Swarm intelligence
Paper • 2505.04364 • Published • 20 -
FullFront: Benchmarking MLLMs Across the Full Front-End Engineering Workflow
Paper • 2505.17399 • Published • 14 -
MultiFinBen: A Multilingual, Multimodal, and Difficulty-Aware Benchmark for Financial LLM Evaluation
Paper • 2506.14028 • Published • 93