repoGitHubTrust 82 · PrimaryPublished 1mo agoLive · 23d ago
av/awesome-llm-services
A list of self-hostable LLM services
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- PossiblePossibly related (embedding) · 55%How're you deploying LLMs in production now-a-days? What's the best and most affordable way? [D] →
- PossiblePossibly related (embedding) · 51%Any good uses for a 192 GB DDR3 Server in the LLM world? →
- PossiblePossibly related (embedding) · 48%MCP Server Architecture Patterns for LLM-Integrated Applications →
- PossiblePossibly related (embedding) · 47%Self-hosted GitHub Actions runners on Lambda MicroVMs →
- PossiblePossibly related (embedding) · 46%Jamesob's guide to running SOTA LLMs locally →
- PossiblePossibly related (embedding) · 53%Has anyone created a "Local LLM Survival Kit"? →
- PossiblePossibly related (embedding) · 49%DSLs Enable Reliable Use of LLMs →
Covers
newsHow're you deploying LLMs in production now-a-days? What's the best and most affordable way? [D]newsAny good uses for a 192 GB DDR3 Server in the LLM world?newsEnd of an Agony. Real production service that uses LLM to earn money my team had made and now we are so happy that it will die. Here are some of my final "experiences".
Implements
Covers (incoming)
newsSelf-hosted GitHub Actions runners on Lambda MicroVMsnewsJamesob's guide to running SOTA LLMs locallynewsHas anyone created a "Local LLM Survival Kit"?newsDSLs Enable Reliable Use of LLMsnewsVeea Inc. Announces Commercial Availability of Full-Stack Edge-to-Cloud Solution for Third-Party Devices and Servers - Quiver QuantitativenewsRunning a self-hosted LLM in Kubernetes with vLLM
Related across the graph
paperMCP Server Architecture Patterns for LLM-Integrated ApplicationsnewsRunning a self-hosted LLM in Kubernetes with vLLMnewsDSLs Enable Reliable Use of LLMsnewsJamesob's guide to running SOTA LLMs locallynewsSelf-hosted GitHub Actions runners on Lambda MicroVMsnewsAny good uses for a 192 GB DDR3 Server in the LLM world?newsHow're you deploying LLMs in production now-a-days? What's the best and most affordable way? [D]newsVeea Inc. Announces Commercial Availability of Full-Stack Edge-to-Cloud Solution for Third-Party Devices and Servers - Quiver QuantitativenewsEnd of an Agony. Real production service that uses LLM to earn money my team had made and now we are so happy that it will die. Here are some of my final "experiences".newsHas anyone created a "Local LLM Survival Kit"?