newsReddit r/MachineLearningTrust 52 · CommunityPublished 1mo agoLive · 1mo ago
Open-sourcing a two-stage prompt-injection detector (regex gate + quantised DeBERTa-v3 ONNX), trained partly on real attacks from a game I ran [P]
I built a prompt-injection detector for LLM inputs and I've open-sourced the whole thing - code, weights, and the dataset. The design is two stages. A regex layer (around 430 patterns, plus a decode-then-scan step for base64/ROT13/leetspeak) settles the easy majority of traffic in under a millisecond. Anything ambiguous falls through to a fine-tuned DeBERTa-v3-large, exported to ONNX and quantised to INT8, with a 4-class head (benign / direct / jailbreak
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- PossiblePossibly related (embedding) · 48%When Local Monitors Miss Compositional Harm: Diagnosing Distributed Backdoors in Multi-Agent Systems →
- PossiblePossibly related (embedding) · 47%AarambhDevHub/aarambh-ai →
- PossiblePossibly related (embedding) · 47%ARMOR++: Agentic Orchestration of a Multi-Domain Primitive Set for Transferable Attacks on Deepfake Detectors →
- PossiblePossibly related (embedding) · 46%Traffic-Aware Randomized Smoothing for LLM-Based Network Intrusion Detection →
- PossiblePossibly related (embedding) · 45%jyjeanne/crustly →
- PossiblePossibly related (embedding) · 46%DaoyuanLi2816/mini-verl →
- PossiblePossibly related (embedding) · 47%Detecting Backdoors in Object Detection via Pre-NMS Prediction Distribution Shift →
- PossiblePossibly related (embedding) · 46%DEFUSE: Generalizable Backdoor Defense for Self-Supervised Encoders with Generative Priors →
Covers
paperWhen Local Monitors Miss Compositional Harm: Diagnosing Distributed Backdoors in Multi-Agent SystemsrepoAarambhDevHub/aarambh-aipaperARMOR++: Agentic Orchestration of a Multi-Domain Primitive Set for Transferable Attacks on Deepfake DetectorspaperTraffic-Aware Randomized Smoothing for LLM-Based Network Intrusion Detectionrepojyjeanne/crustly
Covers (incoming)
repoDaoyuanLi2816/mini-verlpaperDetecting Backdoors in Object Detection via Pre-NMS Prediction Distribution ShiftpaperDEFUSE: Generalizable Backdoor Defense for Self-Supervised Encoders with Generative PriorspaperHiveTraceGuard-Pro: A Compact Generative Guardrail for Prompt Injection, Jailbreaks, and Adversarial Obfuscation
Related across the graph
paperWhen Local Monitors Miss Compositional Harm: Diagnosing Distributed Backdoors in Multi-Agent SystemspaperDEFUSE: Generalizable Backdoor Defense for Self-Supervised Encoders with Generative PriorspaperARMOR++: Agentic Orchestration of a Multi-Domain Primitive Set for Transferable Attacks on Deepfake DetectorsrepoAarambhDevHub/aarambh-aipaperHiveTraceGuard-Pro: A Compact Generative Guardrail for Prompt Injection, Jailbreaks, and Adversarial ObfuscationpaperDetecting Backdoors in Object Detection via Pre-NMS Prediction Distribution Shiftrepojyjeanne/crustlyrepoDaoyuanLi2816/mini-verlpaperTraffic-Aware Randomized Smoothing for LLM-Based Network Intrusion Detection