cs-cv/vision-language
IB-arxiv-2607.28269-semantic-agreement
measured
Across 173,179 label pairs, captions generated by a Qwen3.5 4B dense model and a Qwen3.5 35B Mixture-of-Experts model showed a semantic agreement of 78.65 out of 100 as scored by an image-blind Qwen3.5-9B LLM-as-a-Judge.
Observed quantities
semantic_agreement_score 78.65 · score_max 100 · label_pairs 173179
01
Primary source
- Title
- Theia: Large-Scale Multimodal Captioning and Automated Validation of the Incidents1M Dataset for Data-Free Distillation
- Authors
- Simone Giano, Lorenzo Severini, Alessandro Galdelli, Adriano Mancini
- Version
- v1
- Check
- Support quote found word for word in the arXiv abstract v1, 2026-10-08
Our evaluation across 173,179 label pairs demonstrates a high semantic agreement (78.65/100) between the two architectures
02
Boundary of this block
No additional public limitation was recorded.
03
Connections
Outgoing
No outgoing public edges.
Incoming
No incoming public edges.