newsReddit r/MachineLearningTrust 72 · CommunityPublished 1mo agoLive · 1mo ago
How're you deploying LLMs in production now-a-days? What's the best and most affordable way? [D]
I've been developing an AI product using LLM APIs (from OpenRouter) but want to deploy an open-source LLM in my own Prod env. which I can control. Few reasons behind this are: - I wanna own the complete stack around my product. - Second I wanna fine-tune the model around my usecase. So, what's the most affordable but a good platform for this? I'm not an AI engineer so don't wanna stuck in CUDA or Transformers hell, anything which ca
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- LinkedLinked via unknowneval-harness-plus →
- LinkedLinked via unknownagent-tools →
- LinkedLinked via unknownEvaluate a model properly →
- PossiblePossibly related (embedding) · 65%kaito-project/aikit →
- PossiblePossibly related (embedding) · 52%defilantech/LLMKube →
- PossiblePossibly related (embedding) · 49%rasros/lx →
- PossiblePossibly related (embedding) · 45%rivet-dev/agentos →
- PossiblePossibly related (embedding) · 53%BerriAI/litellm →
Covers
Covers (incoming)
repokaito-project/aikitrepodefilantech/LLMKubereporasros/lxreporivet-dev/agentosrepoBerriAI/litellmreporocketride-org/rocketride-serverrepo0xPlaygrounds/rigrepoMakazhanAlpamys/Souprepomicrosoft/semantic-kernelrepotheopenco/llmgatewayrepobotpress/botpressrepobeyefendi/awesome-llm-securityrepoFastFlowLM/FastFlowLMrepoposit-dev/btwrepowaveix/pkg-ffagentrepomozilla-ai/otarirepolightseekorg/smgrepoOaklight/ToolRegistryrepoqualcomm/GenieXrepozycaskevin/Vault-for-LLMrepoAXERA-TECH/ax-llmrepojohn-rocky/apple-silicon-llm-benchrepoCYBIRD-D/FREE-LLM-API-Providerrepothejollydev/bezaforge-infrastructurerepoInternLM/lmdeployrepoPaddlePaddle/FastDeployreposgl-project/rbgrepoareal-project/AReaLrepoav/awesome-llm-servicesrepomohitsoni48/TurboLLMrepoLazyAGI/LazyLLMrepovertesia/llumiverserepodevoxx/DevoxxGenieIDEAPluginrepollm-exe/llm-exerepoLyubomirT/intense-rp-nextrepoaimclub/OSArepotal7aouy/LLM-Engineeringrepoperemartra/Rearchitecting-LLMsrepointentee/paddlerreporafska/awesome-local-llmrepoBodhiSearch/BodhiApprepoohdearquant/latticerepoAlpha-Legents/Prismrepoludwig-ai/ludwigreposcaleapi/llm-enginerepofkiene/llmtrimrepoNirDiamant/Prompt_Engineeringrepomarkusbegerow/local-llm-chat-vsrepoetalab-ia/OpenGateLLMrepokit-lang/packages/kit-llmrepoRyan-Adams57/model-fitrepodevelopment-and-operations/model-fitrepomobitouchOS/MaIN.NETrepopleasedodisturb/awesome-llm-token-optimizationrepoluojieLLMaaS/haxivrepoNadirRouter/NadirClawrepojust-llms/justllmsrepoVasco0x4/AIDArepoUnmortan-Ellary/Vascura-FRONTrepoafshar-oss/pipewrightrepoWangRongsheng/awesome-LLM-resourcesrepobetagouv/ComparIArepoLightning-AI/litgptrepoavedorcloud/projects/matrix/maubot-llm-shimrepodadsontcg/CyberDeckrepollm-ring/lmringrepotjqscott/doryrepoeullm/eullmrepomattermost/mattermost-plugin-agentsreporaiyanyahya/llmakerrepodanielroe/carpenterrepoericmjl/llamabotrepoleviatan.centinel.levi/tunix_CentOSrepollamastash/llamastashrepobrave/pull-mergerepocmsa/manifest-driven-llmsrepohuangxd24/gitlab-opencodereporajputsaurabh19990/bolt-diyrepoRekklesNA/ProxmoxMCP-PlusrepoGoekdeniz-Guelmez/MLX-LoRA-Studiorepokmontag/macherrepoSciSharp/LLamaSharprepoInftyAI/Awesome-LLMOpsrepolix19937/llm-deployrepoossature/ossaturerepopeerlesshospitals6/llm-buildrepoNorthwood-Systems/millwrightrepoPedroscrobotics/gitlab-opencoderepoheripo-lab/llm-newsletter-kit-corerepoWide-Moat/open-computer-use
Related across the graph
repodevoxx/DevoxxGenieIDEAPluginrepoRyan-Adams57/model-fitrepolightseekorg/smgrepoLazyAGI/LazyLLMrepobrave/pull-mergerepoLightning-AI/litgptrepotheopenco/llmgatewayrepofkiene/llmtrimreporaiyanyahya/llmakerrepopleasedodisturb/awesome-llm-token-optimizationrepodanielroe/carpenterrepollm-ring/lmringrepoheripo-lab/llm-newsletter-kit-corerepoGoekdeniz-Guelmez/MLX-LoRA-Studiorepoohdearquant/latticerepodefilantech/LLMKuberepovertesia/llumiverserepocmsa/manifest-driven-llmsrepowaveix/pkg-ffagentrepoWangRongsheng/awesome-LLM-resourcesrepoPaddlePaddle/FastDeployreporasros/lxreposgl-project/rbgrepomobitouchOS/MaIN.NETrepoWide-Moat/open-computer-userepoNadirRouter/NadirClawrepoericmjl/llamabotrepomozilla-ai/otarirepoRekklesNA/ProxmoxMCP-Plusrepoossature/ossaturereporafska/awesome-local-llmrepoNorthwood-Systems/millwrightreporajputsaurabh19990/bolt-diyrepoludwig-ai/ludwigrepokaito-project/aikitrepothejollydev/bezaforge-infrastructurerepotal7aouy/LLM-Engineeringrepobeyefendi/awesome-llm-securityrepoMakazhanAlpamys/Souprepomicrosoft/semantic-kernelreporocketride-org/rocketride-serverrepobotpress/botpressrepokit-lang/packages/kit-llmrepoeullm/eullmrepodevelopment-and-operations/model-fitrepointentee/paddlerrepolix19937/llm-deployrepoareal-project/AReaLrepokmontag/macherrepoposit-dev/btwrepoCYBIRD-D/FREE-LLM-API-Providerrepoeval-harness-plusrepoUnmortan-Ellary/Vascura-FRONTrepopeerlesshospitals6/llm-buildrepoPedroscrobotics/gitlab-opencoderepoetalab-ia/OpenGateLLMrepoavedorcloud/projects/matrix/maubot-llm-shimrepoluojieLLMaaS/haxivrepoSciSharp/LLamaSharprepoVasco0x4/AIDArepo0xPlaygrounds/rigrepoInftyAI/Awesome-LLMOpsrepodadsontcg/CyberDeckrepobetagouv/ComparIAreposcaleapi/llm-enginerepomarkusbegerow/local-llm-chat-vsrepoAXERA-TECH/ax-llmrepollm-exe/llm-exerepotjqscott/doryrepoperemartra/Rearchitecting-LLMsrepoav/awesome-llm-servicesrepoNirDiamant/Prompt_Engineeringrepojust-llms/justllmsreporivet-dev/agentostutorialEvaluate a model properlyrepoOaklight/ToolRegistryrepoafshar-oss/pipewrightrepoleviatan.centinel.levi/tunix_CentOSrepojohn-rocky/apple-silicon-llm-benchrepoBodhiSearch/BodhiApprepohuangxd24/gitlab-opencoderepomattermost/mattermost-plugin-agentsrepomohitsoni48/TurboLLMrepoFastFlowLM/FastFlowLMrepoBerriAI/litellmrepoInternLM/lmdeployrepoLyubomirT/intense-rp-nextrepoAlpha-Legents/Prismrepoagent-toolsrepozycaskevin/Vault-for-LLMrepollamastash/llamastashrepoqualcomm/GenieXrepoaimclub/OSA