Human Grounded Evaluation of Large Language Models for Optical Network Automation
Large language models (LLMs) are increasingly adopted for network automation, yet their output quality and inference cost can vary substantially across LLM families. We present HuGLEN, a stepwise evaluation pipeline that uses an LLM-as-a-judge together with a small set of expert ratings to enable scalable and reproducible comparison of candidate LLMs, and to rank them using a quality efficiency score (QES). We demonstrate HuGLEN for translating outputs from an explainable artificial intelligence (XAI) model for the optical network quality of transmission (QoT) estimation task into operator-fri
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- PossiblePossibly related (embedding) · 52%NVIDIA Brings Trusted, 24/7 AI Agents to Telecom Operations →
- LinkedLinked via arxiv author · 85%Kiarash Rezaei →
“Human Grounded Evaluation of Large Language Models for Optical Network Automation”
- LinkedLinked via arxiv author · 85%Omran Ayoub →
“Human Grounded Evaluation of Large Language Models for Optical Network Automation”
- LinkedLinked via arxiv author · 85%Paolo Monti →
“Human Grounded Evaluation of Large Language Models for Optical Network Automation”
- LinkedLinked via arxiv author · 85%Carlos Natalino →
“Human Grounded Evaluation of Large Language Models for Optical Network Automation”