No PUN Intended: Plausible Unknown Names for Person-Centred LLM Evaluation
Person names are widely used as prompt variables in LLM evaluations of factuality, privacy leakage, bias and abstention, but when a name's evidential status is uncontrolled, measurements may conflate memorisation, retrieval, name priors and wrong-person attribution. We operationalise an unknown name as one with plausible First-Last form, no indexed full-name evidence, and no ambiguity signals under a documented validation run, and introduce PUN (Plausible Unknown Names), a protocol for constructing and validating such names, combining Wikidata-derived components, web-enabled LLM screening, and
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- PossiblePossibly related (embedding) · 47%An interviewer–evaluator–judger LLM framework for text-based personality inference - Nature →
- LinkedLinked via arxiv author · 85%Dimitri Staufer →
“No PUN Intended: Plausible Unknown Names for Person-Centred LLM Evaluation”
- LinkedLinked via arxiv author · 85%David Hartmann →
“No PUN Intended: Plausible Unknown Names for Person-Centred LLM Evaluation”
- LinkedLinked via arxiv author · 85%Ibrahim Baroud →
“No PUN Intended: Plausible Unknown Names for Person-Centred LLM Evaluation”