Llava

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

Fully Open Framework for Democratized Multimodal Training

llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2

A light llama-like llm inference framework based on the triton kernel.