newsReddit r/artificialTrust 52 · CommunityPublished 3d agoLive · 2d ago
Structured output reliability with LLMs — 3-month production learnings
Been shipping structured JSON output from LLMs in production for a health app. Here's what I've learned about reliability. The problem: get a 70B model to return valid JSON matching a strict schema, every time. What I tried: Attempt 1: "Return JSON." No schema. 40% valid output. Attempt 2: Detailed schema in prompt. 75% valid. Attempt 3: JSON mode enabled (Groq/OpenAI/Anthropic all support). 92%. Attempt 4: JSO
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- PossiblePossibly related (embedding) · 49%tgel0/crssnt →
- PossiblePossibly related (embedding) · 47%Object Aligner: A Configurable JSON Schema Similarity Score for Graphs, Applied to LLM Prompt Optimization →
- PossiblePossibly related (embedding) · 46%mangiucugna/json_repair →
- PossiblePossibly related (embedding) · 51%ndcorder/outputguard →