cs-cl/llm-evaluation IB-arxiv-2607.28146-weakest-below-baselines measured

In ParliamentBench (Secret Hitler social deduction game; 16 LLMs evaluated across 1,600 simulated matches), the weakest models scored below both the random baseline (33%) and a simple algorithmic baseline (45%).

Active Evidence state is recorded explicitly and may be revised by a later event.

Observed quantities

num_llms 16 · num_matches 1600 · random_baseline_pct 33 · algorithmic_baseline_pct 45

01

Primary source

  1. arxiv · 2607.28146 · v1 · abstract
Title
Can Agents Deceive? Evaluating Reasoning and Deception in ParliamentBench using a Social Deduction Game
Authors
Niklas Bauer, Lars Benedikt Kaesberg, Akiko Aizawa, Jan Philip Wahle, Bela Gipp, Terry Ruas
Version
v1
Check
Support quote found word for word in the arXiv abstract v1, 2026-10-08
Supporting quote from the source
whereas the weakest models fall short of random (33%) and simple algorithmic (45%) baselines

02

Boundary of this block

No additional public limitation was recorded.

03

Connections

Outgoing

No outgoing public edges.

Incoming

No incoming public edges.