mudler — researcher or builder tracked in the Angestrom contributor network.
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features