A Comparative Evaluation of Embeddings and LLMs in a Greek Book Publisher Setting - The CUP Dataset
We present CUP, a Greek book retrieval benchmark consisting of 868 catalog records and 104 expert-annotated queries with graded relevance judgments. We evaluate sparse (BM25), dense (sentence-transformers), hybrid, and LLM-assisted retrieval methods in this book-search setting. Multilingual embeddings outperform Greek-specific models, while hybrid retrieval performs best overall. A query-level analysis shows that BM25 excels at named-entity queries, while dense and hybrid methods improve natural-language, noisy, cross-lingual, and concept queries. Field-aware prompting has model-specific effec
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- PossiblePossibly related (embedding) · 49%Set up a retrieval pipeline →
- PossiblePossibly related (embedding) · 48%RAGless: Q-Q retrieval with score aggregation for closed-domain FAQ [P] →
- LinkedLinked via arxiv author · 85%Katerina Papantoniou →
“A Comparative Evaluation of Embeddings and LLMs in a Greek Book Publisher Setting - The CUP Dataset”
- LinkedLinked via arxiv author · 85%Panagiotis Papadakos →
“A Comparative Evaluation of Embeddings and LLMs in a Greek Book Publisher Setting - The CUP Dataset”
- LinkedLinked via arxiv author · 85%Theodore Patkos →
“A Comparative Evaluation of Embeddings and LLMs in a Greek Book Publisher Setting - The CUP Dataset”
- LinkedLinked via arxiv author · 85%Dimitris Garefalakis →
“A Comparative Evaluation of Embeddings and LLMs in a Greek Book Publisher Setting - The CUP Dataset”
- LinkedLinked via arxiv author · 85%Nikos Vardakis →
“A Comparative Evaluation of Embeddings and LLMs in a Greek Book Publisher Setting - The CUP Dataset”
- LinkedLinked via arxiv author · 85%Dimitris Plexousakis →
“A Comparative Evaluation of Embeddings and LLMs in a Greek Book Publisher Setting - The CUP Dataset”