50 items across the graph · 49 news stories — tagged with Reddit.
Latest news
GPUHedge: Hedging serverless GPU providers improves cold start p95 latency from 117s to 30s [P]
Disclosure: I built it, it is open source, Apache-2.0 licensed, and currently alpha. Repository: https://github.com/mireklzicar/gpuhedge I started working on it after benchmarking a 17 GB AI model across several serverless GPU providers. On the primary provider, requests usually either completed in roughly 6–8 seconds…
Read full story →More news · 48
New LLM Coordination Benchmark - Benchmarking Open-Ended Multi-Agent Coordination in Language Agents [R]
Can LLM agents coordinate in long-horizon, open-ended worlds? We evaluate 13 modern LLMs in a new benchmark where agents must work together to explore, communicate, trade resources, craft tools, build structures, and fight mobs. TL;DR : Most agents struggle, averaging only ~6% no…
Read full story →👀A new GLM model incoming
Spoiler from one of the founders of
Read full story →Query regarding billing
Hey guys, I have the 300 usd free credits from google. I needed an api key and im using it for that. Since ai studio can NOT use those free credits, i am right now using them via vertex ai I am still hitting the rate limits sometimes Please correct me if im wrong here but: I shou…
Read full story →FOSS NotebookLM connected to Reddit,YT,Google,IG,Tiktok etc
NotebookLM is one of the
Read full story →GLM 5.2 running on MacBook Pro M5 48 GB Ram at between 2 - 2.8t/s
I started readin
Read full story →The U.S. tech industry is increasingly anxious about the rising power and competitive price of open-source AI models from China — and whether the Trump administration will respond with yet another executive order | Politico
Read full story →How should I approach training this specific ML model for my startup project [D]
So, I am working on this startup project with pretty low budget and one of the features is sentiment analysis based on political news, x posts and Instagram hashtag trends in which will be in Indian languages. I've been suggested muRIL, an Indian language-based model fine-tuned o…
Read full story →Where would you put the safety line for an agent running commands in a repo?
I have a practical question for people who care about local/CI safety. When a coding assistant works inside a repo, it is not only editing code. It may run tests, install packages, start services, touch config files, or suggest a CI change. Some of that is normal. Some of it feel…
Read full story →Some testing on RTX Pro 4500 (With Oculink) on PrismaQuant, INT4 Autoround and NVFP4 W4A4 quantized model
Read full story →ML Papers with hundreds of authors should just collapse down to the organization response instead of listing every author [D]
I've had this feeling for a while when reading the citation pages of ML papers and had to continuously scroll down for like 2+ pages because a citation with hundreds of authors, such as the Llama herd of model paper: https://arxiv.org/abs/2407.21783 (no endorsement of this paper…
Read full story →Beijing is looking at curbing overseas access to China's top AI models (Reuters)
R
Read full story →This is what Hy3 is capable of. Mother of god.
https://codepen.io/Captain-Blackbeard/pen/EaZQKWX prompt: "Task: create a beautiful, relaxing flight simulator in a single html page" harness: opencode environment: empty model: hy3 (free) via openrouter submitted by /u/BlackBeardAI
Read full story →What if a model could only learn what trusted LoRA adapters can express? [R]
Hello
Read full story →AI can’t simulate human preferences - new study tests LLMs against thousands of real users
https://arxiv.org/abs/2605.18311 There’s a massive trend right now where companies are trying to replace real human feedback with LLM-driven "synthetic users." The idea sounds great on paper - why would you spend money and time recruiting real people to test products, pick design…
Read full story →Looking at tooling and curious how your team actually using AI in ITops?
Curious how teams are actually using AI in day-to-day ITops, not the vendor pitch version, but what's genuinely saving time , improves results vs. what's been overhyped. submitted by /u/bsmike [link]
Read full story →Leaving Your Cloud Provider Is About to Get Cheaper - by Law
From 12 Janu
Read full story →Masked depth modeling with sensor-validity masking: reports best RMSE on 7 of 8 masked/sparse depth benchmarks, plus a controlled encoder-init study[R]
Read full story →Anyone else seeing Karpenter / EC2 API rate limits (503 RequestLimitExceeded) in us-east-1?
For the past 2 hours, our Karpenter setup hasn't been able to create new nodes in us-east-1 . We are consistently hitting AWS API rate limits and getting 503 errors. Other regions are working perfectly as intended. Is anyone else hitting this right now, or did AWS change somethin…
Read full story →Competence Gate: gating tool-use on a small model's internal confidence signal instead of its verbalised one — Qwen3.5-4B, open weights [P]
I made a 10MB LoRA adapter for Qwen3.5-4B plus a small orchestration layer. It decides, per query, whether to answer directly, search the web, or retrieve from your own local documents and it refuses to make things up when it can't verify an answer. It runs locally (Apple Silicon…
Read full story →AddApplicationInsightsTelemetry needed?
I'm creating an application to try out some Azure features and the setup is Web API plus a Blazor application hosted in two separate App Services in a single App Service plan. I was setting up Application Insights and I wasn't sure AddApplicationInsightsTelemetry is actually need…
Read full story →Who Has The “Jankiest” Local LLM Setup? | Non-Official | Fun Contest | No Prizes
Had an idea for a fun no prize/non official competition to see who has the “Jankiest” local LLM setup. NOTE: This is NOT an official competition. There are NO prizes. This is just for fun . Rules: 1. One Submission via comment per person 2. Has to be your current setup or your pr…
Read full story →Meta Paid Hundreds of Contractors to Pretend to Be Teenagers While Barraging Its Competitors’ AI With Disturbing Content
Read full story →I benchmarked 13 models at 65K-128K context to find out what actually matters for agentic workloads
I benchmarked 13 models at 65K-128K context to find out what actually matters for agentic workloads — prefill dominates everything, and KV head count beats parameter count I've been running local LLMs for agentic workflows (tool use, coding agents, RAG) and kept seeing people obs…
Read full story →What performs the operations coordinated within each layer or head of a Transformer?
Hi, I want to train a Transformer layer to perform specific tasks, but I’m not sure how to coordinate them or determine when to use one versus the other. Does anyone have experience with this? How have you handled it? submitted by /u/New-Competition-3106
Read full story →300$ credits 3.5flash and 3.1pro?
Any success applying credits for these models? They are available in agent studio but can't get em to run via json key submitted by /u/Stimulatedmotion [link]
Read full story →A novel approach to automating GCP quota monitoring across projects.
https://tech.coop.no/blog/platform-engineering/2026/06/25/automating-gcp-quota-monitoring-across-multiple-projects/ GCP has two separate quota systems and neither has a button for "alert on everything" across projects. So I built one using PromQL and Terraform, which auto-discove…
Read full story →GLM5.2 on 5x Pro 6000s and a 5090, an expensive journey
This started as something I thought was reasonable. I a
Read full story →Portugal just released their own LLM Amalia (9B)!
I didnt see any mention here. Source:
Read full story →Training transformers where every layer W = V·Uᵀ from initialization reveals a corpus-determined optimal rank - looking for arXiv endorser (cs.LG) [D]
Read full story →ECS Agent v1.103.x on the AL2023 arm64 AMI doesnt load pause image
The failure is an ECS-agent defect (v1.103.x on the AL2023 arm64 AMI): it skips loading its bundled pause-container tarball at boot. happens in eu-west-1, didnt checked any other region Solution: ``` docker cp ecs-agent:/images/amazon-ecs-pause.tar /tmp/pause.tar docker load -i /…
Read full story →Jodie Foster Says Brad Pitt’s ‘F1’ Seemed Like It Was Made by AI and Written by a Computer: "Wasn’t It?"
Read full story →How can I delete a Google Cloud Identity (free version) user and then add another one?
I've hit my free limit for 50 users but want to delete accounts so I can add more. I've deleted ones that I don't need but, it keeps saying I've hit my limit when I try to add more. submitted by /u/Accurate_Bed6878 [link]
Read full story →First Time Submitter to ArXiv and Need an Endorser [D]
Hi a I'm submitting my first arXiv paper in cs.AI. arXiv requires first-time submitter(s) to have an endorser. Is anyone here active in cs.ai or similar such as emerging tech, agents, etc. and willing to take a 30-second look at the abstract and click endorse if it's a fit? I can…
Read full story →SentryCode: Real-time Auditor + Honeytokens for AI Coding Agents [P]
In light of recent privacy concerns arising from local AI coding agents performing telemetry, environmental scanning, and hidden cue fingerprinting, I've open-sourced SentryCode—a kernel-level behavior auditing tool. It logs file/network/cue activity, uses honeypot tokens for zer…
Read full story →I benchmarked PrismML's 1-bit Bonsai-8B against IBM's Granite on CPU tool calling. The 1-bit model won, but only with grammar-constrained decoding
Everyone keeps asking if the 1-bit models are actually usable for agents, so I ran the numbers myself. Couldn't find a single independent tool-calling eval of Bonsai-8B anywhere. Not on the BFCL leaderboard, nothing on BenchLM. So as far as I can tell this is the first one. Setup…
Read full story →Couldn't hold back
Had been waiting for months and the cards finally got delivered today. No one at my workplace was excited, maybe because no one cares for AI stuff that i wo
Read full story →Has anyone tried using llama-server as a backend for multiplayer games or co-op working?
Curious if it’s a viable small scale distributed system. submitted by /u/TheSmashingChamp [link] [comments]
Read full story →Meta fights soaring hardware costs by reusing old DDR4 server memory in new DDR5-only servers — custom CXL 2.0 chip marries legacy DDR4-2400 with cutting-edge DDR5-6400
https://www.tomshardware.com/pc-components/dram/meta-fights-soaring-hardware-costs-by-reusing-old-ddr4-server-memory-in-new-ddr5-only-servers-custom-cxl-2-0-chip-marries-legacy-ddr4-2400-with-cutting-edge-ddr5-6400
Read full story →nvidia/Qwen3.6-27B-NVFP4 just dropped
https://huggingface.co/nvidia/Qwen3.6-27B-NVFP4 submitted by /u/vanbukin [link] [c
Read full story →Mellum2 local deployments
Hey local community, I work at JetBrains with the team that trained Mellum2 models — 12B-2.5A LLMs. Those models are trained com
Read full story →DeepSeek V4 by am17an · Pull Request #24162 · ggml-org/llama.cpp
now
Read full story →Script to monitor llama cpp and analyze memory usage
My goal has always been to be productive with commodity hard
Read full story →I had 55 LLMs blind-grade each other (22k judgments, all open). Every model family with enough data is biased toward its own siblings. Qwen judges favor Qwen by ~0.9 points. Mistral penalizes its own by ~1.0.
I have been running an open evaluation setup where N models answer the same prompt, then blind-grade each other in an N x N matrix with self-judgments excluded. No single privileged judge. So far: 286 evaluations, 198 hand-written questions, 22,254 valid judgments across 55 model…
Read full story →I silently break training codes or configs so I made pybench [P]
It is like pytest but for statistical tests: it ensures no regression of your metrics at a statistical level. It manages tedious things such that seeds, past benchmark results, ... Simple CLI working like pytest but with benchmarks/ directory instead of tests/: pybench # 1st time…
Read full story →KLD is flawed in abliteration.
I've noticed while creating my abliteration engine that KL is a flawed metric because it can be represented so many different ways, it depends completely on eval prompts, and lots of people use first token KL to make their models appear better than others. So I'm curious what do…
Read full story →Ornith-1.0 released on Hugging Face
Including 9B Dense, 31B Dense, 35B MoE, and 397B MoE and reporting sota on different benchmark (let's see if this holds). https://huggingface.co/collections/deepreinforce-ai/ornith-10 submitted by /u/paf1138
Read full story →US Govt to individually approve who gets GPT 5.6.
submitted by /u/AtlanticHM
Read full story →Kuma: compiling PyTorch models into self-contained WebGPU executables [P]
I've been experimenting with a compiler/runtime project that I'm not entirely sure is a good idea, so I'd love some feedback from people who've worked on deployment systems. The idea is to compile an exported PyTorch model into a self-contained package that contains: graph binary…
Read full story →