cs-cl/llm-evaluation
IB-arxiv-2607.28146-weakest-below-baselines
measured
In ParliamentBench (Secret Hitler social deduction game; 16 LLMs evaluated across 1,600 simulated matches), the weakest models scored below both the random baseline (33%) and a simple algorithmic baseline (45%).
Observed quantities
num_llms 16 · num_matches 1600 · random_baseline_pct 33 · algorithmic_baseline_pct 45
01
Primary source
- Title
- Can Agents Deceive? Evaluating Reasoning and Deception in ParliamentBench using a Social Deduction Game
- Authors
- Niklas Bauer, Lars Benedikt Kaesberg, Akiko Aizawa, Jan Philip Wahle, Bela Gipp, Terry Ruas
- Version
- v1
- Check
- Support quote found word for word in the arXiv abstract v1, 2026-10-08
whereas the weakest models fall short of random (33%) and simple algorithmic (45%) baselines
02
Boundary of this block
No additional public limitation was recorded.
03
Connections
Outgoing
No outgoing public edges.
Incoming
No incoming public edges.