Topic

Call

50 items across the graph · 16 news stories — tagged with Call.

Latest news

NewsReddit r/LocalLLaMALive · 20h ago

Kimi K3 Release Video [Made with Kimi K3]

Everyone's probably seen the remo

Read full story →

More news · 15

NewsReddit r/LocalLLaMALive · yesterday

Hy3 1Bit 89-93 GB

AngelSlim/Hy3-GGUF at hugging face (I am not affiliated just testing) I dont really make posts but I wanted to make sure everyone is aware that there is now a 1bit qua

Read full story →
NewsReddit r/LocalLLaMALive · 2d ago

Bonsai 27B: The First 27B-Class Model to Run on a Phone

submitted by /u/yogthos [link] [comments]

Read full story →
NewsReddit r/LocalLLaMALive · 2d ago

Prism-ML Bonsai Qwen 3.6 27B

submitted by /u/thoquz

Read full story →
NewsReddit r/LocalLLaMALive · 2d ago

Prism-ML's Bonsai-27B Benchmarks

We got benchmaxed quants before Qwen3.7 27B All results were taken from original models cards on HF:

Read full story →
NewsReddit r/LocalLLaMALive · 6d ago

Hy3 (295B MoE) and NVIDIA Nemotron-Labs-Audex-30B-A3B (audio-capable 30B MoE) GGUF quants

Sharing two GGUF quant sets, both with the same treatment: imatrix quantization, KLD/PPL measured against BF16 reference logits, llama-bench throughput numbers, and all raw benchmark data included in the repos. No vibes-based "quality tested" claims — every number is reproducible…

Read full story →
NewsReddit r/LocalLLaMALive · 10d ago

Qwen's J-Space - Anthropic's discovery of an internal model Global Workspace

Anthropic published research today into what a model is thinking behind the scenes while it is deciding what to actually write. More importantly, they released the J-Space lens code and their partner put together a demonstration of Qwen 3.6 27B J-Space . submit

Read full story →
NewsReddit r/LocalLLaMALive · 10d ago

Mimo & deepseek are really amazing at optimizing ai. Read the the official blog page i linked, it will give amazing insight on how they pulled off this kind of low pricing with 2x - 3x profit margins.

Read full story →
NewsReddit r/LocalLLaMALive · 10d ago

Qwen & Gemma on deadlock situation (For Benchmarks Numbers)?

I have this feeling for sometime.

Read full story →
NewsReddit r/LocalLLaMALive · 11d ago

If trends hold, SK-Hynix capability may be building dyson spheres within ~2 years

submitted by

Read full story →
NewsReddit r/LocalLLaMALive · 12d ago

Uh.. Honey, how do you feel about takeout?

- 2x RTX Pro 6000 Max-Q (96GB) - 8x RTX 3090 (24GB) - 2x RTX 5090 (32GB)

Read full story →
NewsReddit r/LocalLLaMALive · 15d ago

I benchmarked PrismML's 1-bit Bonsai-8B against IBM's Granite on CPU tool calling. The 1-bit model won, but only with grammar-constrained decoding

Everyone keeps asking if the 1-bit models are actually usable for agents, so I ran the numbers myself. Couldn't find a single independent tool-calling eval of Bonsai-8B anywhere. Not on the BFCL leaderboard, nothing on BenchLM. So as far as I can tell this is the first one. Setup…

Read full story →
NewsReddit r/LocalLLaMALive · 15d ago

How to improve RAM offload?

I have only 12GB VRAM (RTX3060) but have enough RAM to run Qwen3.6 27B Q4 with offload. Something tells me that it won't achieve m

Read full story →
NewsReddit r/LocalLLaMALive · 17d ago

Benchmarked Graph-RAG vs. Graph-Free Multi-Hop RAG: The graph mostly bought us a massive rebuild bill, not accuracy.

We kept hitting the same wall building multi-hop RAG: the systems with the best accuracy (GraphRAG, HippoRAG 2, RAPTOR) all lean on a knowledge graph built offline - and that’s great numbers, until the moment your data changes! Every update means re-running an LLM indexing pass t…

Read full story →
NewsReddit r/LocalLLaMALive · 18d ago

Any good uses for a 192 GB DDR3 Server in the LLM world?

I've been gifted this old IBM System X V4 with a

Read full story →
NewsReddit r/LocalLLaMALive · 20d ago

[Research] JetSpec: Speculative Decoding with Parallel Tree Drafting Enables up to 9.64x Lossless LLM Inference Speedup with more than 1000TPS

Read full story →

From the graph · 34

repo
ComposioHQ/composio

Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into act…

repo
cheshire-cat-ai/core

AI agent microservice

repo
TanStack/ai

🤖 Type-safe, provider-agnostic TypeScript AI SDK for streaming chat, tool calling, agents, and multimodal apps across OpenAI, Anthropic, Gemini, React, Vue, Sv…

repo
lioensky/VCPToolBox

VCP 部署在 AI 模型 API 与前端应用之间,是面向AGI OS开发和探索的工业级基建示范项目。通过统一指令协议、多层级持久化记忆、分布式插件引擎及多 Agent 协作框架,将原本“无状态、无记忆、无工具调用能力”的大语言模型,彻底改造成拥有永久自我意识、物理世界操作权及群体协作智能的完整智能体系统。

repo
antoinezambelli/forge

A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows

repo
awaescher/OllamaSharp

The easiest way to use Ollama in .NET

repo
fim-ai/fim-one

Open-source agent platform for Global × China enterprises — wire every system through one agent core. Self-hosted, any LLM.

repo
vamplabAI/sgr-agent-core

Schema-Guided Reasoning (SGR) has agentic system design created by neuraldeep community

repo
truffle-ai/dexto

A coding agent and general agent harness for building and orchestrating agentic applications.

repo
opensolon/solon-ai

Java AI application development framework (supports LLM-tool,skill; RAG; MCP; Agent-ReAct,Team-Agent). Compatible with java8 ~ java25. It can also be embedded i…

repo
IBM/mcp

A collection of Model Context Protocol (MCP) servers, clients and developer tools by IBM.

repo
raketenkater/ggrun

Auto-tuned launcher for GGUF models on llama.cpp / ik_llama.cpp — OpenAI-compatible server with multi-GPU tensor-split, MoE expert placement, measured flag tuni…

repo
AOrbitron/Eridanus

基于 OneBot 协议的多功能bot兼开发框架。以llm function calling为核心构建了更智能的功能调用机制。支持不接入QQ纯Live2d桌宠模式

repo
gustavoeenriquez/MakerAi

The AI Operating System for Delphi. 100% native framework with RAG 2.0, autonomous agents, MCP protocol, and universal LLM connector. Supports OpenAI, Claude, G…

repo
fw-ai/cookbook

Recipes and resources for building, deploying, and fine-tuning generative AI with Fireworks.

repo
liushuangls/go-anthropic

Anthropic Claude API wrapper for Go

repo
Ganador1/FenixAI_tradingBot

Fenix Ai Trading Bot with LangGraph and ollama and multipe providers

repo
BodhiSearch/BodhiApp

Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs

repo
garycli/garycli

The Spear Carrier. AI-native CLI agent for STM32 embedded development and automated debugging. (Gary:专为 STM32 打造的 AI 原生命令行开发与调试智能体。)

repo
vinhnx/VT.ai

VT.ai - multimodal AI chat app with dynamic conversation routing

repo
lihaiya/freeipcc

Call Center,Contact Center,AI,呼叫中心,客服系统,工单系统,智能外呼,大模型呼叫中心,智能呼叫中心,FreeSWITCH

repo
adrianliechti/wingman

Inference Hub for AI at Scale

repo
Oaklight/ToolRegistry

ToolRegistry: A Protocol-Agnostic Tool Management Library for Function-Calling LLMs (OpenAI, Anthropic, Gemini, LangChain, MCP)

repo
xinhuangcs/agentmaker

A general-purpose Python framework for building LLM agents and multi-agent systems. "Four lines of code, an agent with memory."

repo
WiseriaAI/pie-ai-agent

Browser-automation agent for Chrome — natural-language tasks executed through native tool calling, scoped Skills, CDP keyboard control, and a confirm-before-act…

repo
KochC/opencode-llm-proxy

Local AI gateway for OpenCode with tool/function calling — use any model via OpenAI, Anthropic, or Gemini API

repo
thomas9120/LLama-GUI

User friendly GUI for Llama.cpp for easy configuration and launching.

repo
myriade-ai/agentlys

Lightweight AI agent library. Turn Python functions/classes into AI tools instantly. No verbose configs or complex abstractions.

repo
clifton/rstructor

Pydantic + Instructor for Rust: extract structured, validated data from LLMs (OpenAI GPT, Anthropic Claude, Gemini, Grok/xAI) into native Rust structs & enums.…

repo
iovdin/tune

llm chat in text file

repo
Tom-Ryder/AgentRunKit

Swift 6 agent SDK: type-safe tools, streaming, cloud + on-device inference via MLX on Apple Silicon

repo
dfinity/icskills

Agent-readable skill files for Internet Computer (ICP) development. Prevents AI hallucinations.

repo
slb350/open-agent-sdk-rust

Rust SDK for building AI agents with local OpenAI-compatible servers (LMStudio, Ollama, llama.cpp, vLLM). Features streaming, tools, hooks, retry logic, and com…

repo
MiiFlow/miiflow-agent

Lightweight Python SDK for LLMs with unified API across 9 providers. Built-in ReAct & Plan-Execute agents, streaming, native tool calling, context injection, st…

Related topics