repoGitLabTrust 82 · PrimaryPublished 7d agoLive · 6d ago
Ryan-Adams57/model-fit
Terminal tool that ranks which LLMs can realistically run on your machine based on RAM, CPU, and GPU.
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Covers
newsHow're you deploying LLMs in production now-a-days? What's the best and most affordable way? [D]newsI mapped which local LLMs actually fit each RAM tier, 8 to 128GB (open dataset)newsAsk HN: MacBook vs. Dedicated GPU for LLMnewsOpenAI and Broadcom announce chip designed for LLM inference at scale
Related to
Related across the graph
newsOpenAI and Broadcom announce chip designed for LLM inference at scalenewsI mapped which local LLMs actually fit each RAM tier, 8 to 128GB (open dataset)newsHow're you deploying LLMs in production now-a-days? What's the best and most affordable way? [D]newsAsk HN: MacBook vs. Dedicated GPU for LLMtutorialEvaluate a model properly