Cpp

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

FinceptTerminal is a modern finance application offering advanced market analytics, investment research, and economic data tools, designed for interactive explo…

⚡ Automatically decrypt encryptions without knowing the key or cipher, decode encodings, and crack hashes ⚡

Open3D: A Modern Library for 3D Data Processing

Flower: A Friendly Federated AI Framework

A flexible, high-performance serving system for machine learning models

High-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale LLM workflows with 13+ model providers, 8+ vector d…

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!

State of the Art Natural Language Processing

C++ DataFrame for statistical, financial, and ML analysis in modern C++

A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows

High-performance automatic differentiation of LLVM and MLIR.

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, e…

Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer.

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

Tree-Boosting, Gaussian Processes, and Mixed-Effects Models

A library to train, evaluate, interpret, and productionize decision forest models such as Random Forest and Gradient Boosted Decision Trees.

oneAPI Data Analytics Library (oneDAL)

Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking

Local First Ai Agent. Optimized for Local Ai models. Long context window. Proper tools callings. Runs privately on your device.

Neural Network TensorFlow C API

Build apps powered by on-device AI

Auto-tuned launcher for GGUF models on llama.cpp / ik_llama.cpp — OpenAI-compatible server with multi-GPU tensor-split, MoE expert placement, measured flag tuni…

C++ Large Scale Genetic Programming

Run any local LLM engine, auto-tuned to your GPU — polished web UI + OpenAI/Anthropic-compatible API. Point Claude Code at your own machine in one command. No E…

lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)

DocWire SDK: Award-winning modern data processing in C++20. SourceForge Community Choice & Microsoft support. AI-driven processing. Supports nearly 100 data for…

Inference Hub for AI at Scale

Run large language models locally on Intel Macs with AMD GPUs — native macOS app with Metal acceleration

Neutral, reproducible benchmark for local LLMs on Apple Silicon (Mac · iPhone · iPad) — MLX, llama.cpp, CoreML, Apple Foundation Models

Self-hosted AI workspace where chat becomes visual workflows, multi-agent operations, and reviewable automations. Local memory; local or cloud models

Neve AI é uma plataforma de IA local privacy-first, desenvolvida para oferecer uma experiência de alta performance na execução de LLMs, reduzindo a dependência…

Advanced code editor using local AI

From-scratch C++/CUDA inference engine for the NVIDIA RTX 5090 (sm_120a) — the best single-GPU backend for agentic AI: tool calling, long-context loops, reasoni…

Off Grid AI — private, on-device AI. Run open models (text, vision, image, voice) locally through one OpenAI-compatible gateway. No cloud, no accounts, no API k…

Unified KV cache compression for LLM inference — TurboQuant, IsoQuant, PlanarQuant, TriAttention. 10 methods, GPU-validated, multi-GPU planner. Compress KV cach…

Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI + systemd.

Dual-engine (llama.cpp + vLLM) LLM benchmarking pipeline for GGUF & safetensors on NVIDIA GPUs — speed, quality, live dashboard, publishable cards.