paperarXivTrust 82 · PrimaryPublished 1mo agoLive · 1mo ago
A Sovereign, Open-Source Foundation Model for German and English
We present Soofi S 30B-A3B, a sovereign, open-source Mixture-of-Experts (MoE) hybrid Mamba Transformer foundation model for German and English. Its hybrid design activates only 3B of 30B parameters per token and keeps the inference cache near-constant as context grows, giving it a decisive throughput advantage over dense models for long-context, high-concurrency deployment. Pretrained on roughly 27 trillion tokens with deliberately up-weighted German, Soofi S matches dense 14 to 27B models on aggregate English and German benchmarks while achieving the best code aggregates in both languages amo
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- PossiblePossibly related (embedding) · 58%thu-pacman/chitu →
- PossiblePossibly related (embedding) · 58%lone-cloud/gerbil →
- PossiblePossibly related (embedding) · 57%chrisliu298/awesome-llm-unlearning →
- PossiblePossibly related (embedding) · 56%EuroEval/EuroEval →
- PossiblePossibly related (embedding) · 56%Atomic-man007/Awesome_Multimodel_LLM →
- PossiblePossibly related (embedding) · 50%Xiaohao-Liu/Awesome-Multi-Token-Prediction →
- PossiblePossibly related (embedding) · 45%Large language models could democratize data use—but only if the foundations are in place - World Bank Blogs →
- PossiblePossibly related (embedding) · 57%German AI consortium releases Soofi S, an open 30B model that tops benchmarks in both English and German - the-decoder.com →
Implements
Implements (incoming)
Covers (incoming)
newsLarge language models could democratize data use—but only if the foundations are in place - World Bank BlogsnewsGerman AI consortium releases Soofi S, an open 30B model that tops benchmarks in both English and German - the-decoder.comnewsHow Large Language Models Decide Which Tools to Recommend — and What Developers Can Do About It - Programming InsidernewsGigaToken: ~1000x faster Language model tokenizationnewsGerman AI consortium releases Soofi S, an open 30B model that tops benchmarksnewsGerman SooFi team launches Soofi S 30B-A3B , an open-source Mixture-of-Experts (MoE) hybrid Mamba–Transformer foundation model for German and English.
authored (incoming)
personThe Soofi-TeampersonBenedikt DrostepersonDavid FitzekpersonRuben HärlepersonLukas HelffpersonMaximilian IdahlpersonAlex JudepersonAbbas Goher KhanpersonMaurice KrauspersonTimm RulandpersonRichard RutmannpersonSebastian SztwiertniapersonMarkus FreypersonDaniil GurgurovpersonJan PfisterpersonTom RöhrpersonSebastian von RohrscheidtpersonJörg BienertpersonNicolas Flores-HerrpersonSimon GottschalkpersonAndreas HothopersonKristian KerstingpersonJoachim KöhlerpersonAlexander LöserpersonWolfgang NejdlpersonSimon OstermannpersonJan PlogstiespersonPatrick PutzkypersonMehdi AlipersonMichael FrommpersonMax Lübbering
Related across the graph
repochrisliu298/awesome-llm-unlearningrepolone-cloud/gerbilrepomarimo-team/marimopersonRuben Härlerepothu-pacman/chitupersonMarkus FreypersonNicolas Flores-HerrpersonTom RöhrpersonSebastian SztwiertniapersonJan PfisterpersonKristian KerstingpersonBenedikt DrostepersonJan PlogstiespersonDaniil GurgurovpersonDavid FitzeknewsGerman AI consortium releases Soofi S, an open 30B model that tops benchmarks in both English and German - the-decoder.compersonSimon OstermannpersonJörg BienertpersonAlex JudepersonTimm RulandnewsHow Large Language Models Decide Which Tools to Recommend — and What Developers Can Do About It - Programming Insiderrepodean0x/skimpersonJoachim KöhlernewsLarge language models could democratize data use—but only if the foundations are in place - World Bank BlogspersonSebastian von RohrscheidtpersonWolfgang NejdlpersonPatrick PutzkypersonAbbas Goher KhanpersonThe Soofi-TeampersonLukas HelffpersonSimon GottschalkpersonMax Lübberingrepoerogol/BlaGPTrepoAtomic-man007/Awesome_Multimodel_LLMpersonRichard RutmannpersonAndreas HothonewsGigaToken: ~1000x faster Language model tokenizationpersonMehdi Alirepoultralytics/yolov5personMaximilian IdahlnewsGerman SooFi team launches Soofi S 30B-A3B , an open-source Mixture-of-Experts (MoE) hybrid Mamba–Transformer foundation model for German and English.newsGerman AI consortium releases Soofi S, an open 30B model that tops benchmarksreporecommenders-team/recommendersrepoEuroEval/EuroEvalpersonAlexander LöserrepoXiaohao-Liu/Awesome-Multi-Token-PredictionpersonMichael FrommpersonMaurice Kraus