repoGitHubTrust 82 · PrimaryPublished 20d agoLive · yesterday
fkiene/llmtrim
Local proxy that compresses your LLM API requests so you pay less, with no change to the answers. Trims wasted tokens from prompts, history, tool output, and code before they're sent: -31% input / -74% output, measured live. Any provider, no extra model calls. Also an MCP server and embeddable library (Rust, Python, Ruby, Kotlin, Swift, JS/TS).
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- PossiblePossibly related (embedding) · 54%Show HN: Bash4LLM+ – A lightweight, dependency-free Bash wrapper for LLM APIs →
- PossiblePossibly related (embedding) · 51%How're you deploying LLMs in production now-a-days? What's the best and most affordable way? [D] →
- PossiblePossibly related (embedding) · 50%MCP Server Architecture Patterns for LLM-Integrated Applications →
- PossiblePossibly related (embedding) · 50%My reasons to run local models →
- PossiblePossibly related (embedding) · 45%12 Ways to Reduce LLM Latency and Inference Costs in Production - KDnuggets →
- PossiblePossibly related (embedding) · 46%How Much Does It Actually Cost to Run a Local LLM? (Euros per Million Tokens, Measured) - Towards Data Science →
- PossiblePossibly related (embedding) · 48%Right-Sizing the Frontier: A Guide to LLM Routing, Workload-to-Model Matching, and Token-per-Dollar… - Medium →
- PossiblePossibly related (embedding) · 50%Why goodput matters more than throughput for LLM serving →
Covers
Implements
Covers (incoming)
news12 Ways to Reduce LLM Latency and Inference Costs in Production - KDnuggetsnewsHow Much Does It Actually Cost to Run a Local LLM? (Euros per Million Tokens, Measured) - Towards Data SciencenewsRight-Sizing the Frontier: A Guide to LLM Routing, Workload-to-Model Matching, and Token-per-Dollar… - MediumnewsWhy goodput matters more than throughput for LLM servingnewsTorrents arrived
Related across the graph
paperMCP Server Architecture Patterns for LLM-Integrated ApplicationsnewsRight-Sizing the Frontier: A Guide to LLM Routing, Workload-to-Model Matching, and Token-per-Dollar… - MediumnewsMy reasons to run local modelsnewsHow're you deploying LLMs in production now-a-days? What's the best and most affordable way? [D]newsTorrents arrivednewsHow Much Does It Actually Cost to Run a Local LLM? (Euros per Million Tokens, Measured) - Towards Data Sciencenews12 Ways to Reduce LLM Latency and Inference Costs in Production - KDnuggetsnewsShow HN: Bash4LLM+ – A lightweight, dependency-free Bash wrapper for LLM APIsnewsWhy goodput matters more than throughput for LLM serving