Llamacpp
10 items across the graph — tagged with Llamacpp.
From the graph · 10
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.
Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!
State of the Art Natural Language Processing
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, e…
Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer.
Build apps powered by on-device AI
Auto-tuned launcher for GGUF models on llama.cpp / ik_llama.cpp — OpenAI-compatible server with multi-GPU tensor-split, MoE expert placement, measured flag tuni…
lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)
Inference Hub for AI at Scale
Advanced code editor using local AI